About the Role
We are seeking a talented Senior Data Engineer to join our Data team at Stability AI. This role is pivotal in building and maintaining the data infrastructure that supports the training of our AI models. You will work remotely from Germany, collaborating with a multidisciplinary team of research scientists and machine learning engineers to enhance and scale our model efficiency.
Responsibilities
- Data Preparation: Clean, normalize, and preprocess data in a scalable, parallelizable manner to prepare it for ingestion into our machine learning model training pipelines, ensuring data quality.
- Infrastructure Development: Design, implement, and maintain scalable data infrastructure for generative AI.
- Tool Development: Develop tools to search and serve data at scale.
- Collaboration: Work with cross-functional teams to understand and meet their data requirements.
- Pipeline Management: Develop and manage data processing pipelines to support machine learning teams.
- Data Quality: Maintain and improve data quality and integrity across various databases and data stores.
- Data Management: Manage and organize large-scale unstructured data, including image, text, audio, video, and 3D.
Qualifications
- Proven experience with large-scale distributed workloads.
- Experience with large-scale data loading for machine learning training runs.
- Proficiency in cloud storage and file systems, with a preference for AWS (S3).
- Strong experience with Python.
- Expertise in large-scale data processing and software development for unstructured data.
- Knowledge of database, data lake, and data warehouse technologies such as Redshift, BigQuery, and Snowflake.
- Experience with machine learning projects, ideally with some deep learning or computer vision knowledge.
- Excellent teamwork and communication skills, especially in a distributed international team setting.
- Attention to detail and ability to document processes and solutions effectively.
Equal Employment Opportunity
Stability AI is an equal opportunity employer. We do not discriminate based on race, religion, national origin, gender, sexual orientation, age, veteran status, disability, or other legally protected statuses.
Join us in building open AI tools that empower humanity to reach its full potential.
Benefits Extracted with AI
- Remote work
- Equal opportunity employer
Similar jobs
Last update: 23 minutes ago
Staff Software Engineer
Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.
Cloud Data Engineer
Seeking a Cloud Data Engineer with expertise in AWS, Python, and CI/CD for a hybrid role in Hannover. Join our dynamic team!
Senior Backend Engineer C++
Join DeepL as a Senior Backend Engineer C++ to design and maintain scalable backend services using C++ and AI technologies.
Senior Software Engineer - AWS, Python, Ruby on Rails
Join HeyJobs as a Senior Software Engineer to design scalable systems using AWS, Python, and Ruby on Rails in a dynamic team.
Staff Software Engineer, Data Platform
Join Personio as a Staff Software Engineer in Berlin to build scalable data platforms using Kafka, Kubernetes, and AWS. Drive innovation and excellence.
Senior Software Engineer - Python, Apache Kafka
Join Aiven as a Senior Software Engineer in Berlin, focusing on Python and Apache Kafka in a hybrid work environment.
Senior Software Engineer (Node.js & TypeScript)
Join n8n as a Senior Software Engineer to build AI applications using Node.js and TypeScript. Remote role within Europe.
Senior Backend Engineer - Java, Rust, Go
Join Together AI as a Senior Backend Engineer in Amsterdam. Work with Java, Rust, and Go to build scalable backend systems.
Senior Cloud DevOps Engineer
Join netgo as a Senior Cloud DevOps Engineer in Berlin. Work with Kubernetes, GitOps, and more in a dynamic team environment.
Senior Systems Engineer, Managed Operations
Join AWS as a Senior Systems Engineer in Berlin to lead operations for the European Sovereign Cloud, ensuring high-availability AWS services.
Senior Backend Developer
Join Motius as a Senior Backend Developer to work on cutting-edge R&D projects using AWS, Docker, GraphQL, and more in a hybrid work environment.
Expert Machine Learning Engineer
Join Dataroots as an Expert Machine Learning Engineer to design and deliver AI-powered solutions, focusing on machine learning models.
Senior Software Engineer - Data Platform
Join Nubank as a Senior Software Engineer to build and maintain core data infrastructure, ensuring reliable and scalable data flow.
Senior Backend Engineer (Go)
Join Nebius as a Senior Backend Engineer (Go) to develop fault-tolerant cloud services in a hybrid work environment.
Senior C++ Software Engineer
Join Bitmovin as a Senior C++ Software Engineer to develop scalable video streaming solutions using modern C++ and cloud-native architectures.
Software Engineer - Autonomous Driving
Join Applied Intuition as a Software Engineer in Munich to tackle autonomous driving challenges with top ADAS/AV programs.
Senior Backend Engineer (Node.js, Remote)
Join Factor Eleven as a Senior Backend Engineer to develop scalable microservices using Node.js, TypeScript, and AWS in a remote role.
Staff DevOps Engineer
Join Oviva as a Staff DevOps Engineer to enhance automation and standardization in a hybrid role in Berlin, Germany.
Senior Python Developer with AWS Experience
Join Basetime BV as a Senior Python Developer to develop and maintain AWS cloud solutions. Hybrid work, competitive salary, and growth opportunities.
Senior Software Engineer - Backend Development
Join Sysdig as a Senior Software Engineer to develop scalable backend services using Go, RESTful APIs, and microservices in a hybrid work environment.
Senior Software Engineer - Java, Microservices
Join Sofico as a Senior Software Engineer focusing on Java and Microservices in Bavaria, Germany. Work on ERP solutions for automotive finance.
Cloud Engineer
Join our team as a Cloud Engineer in Cologne, Germany. Work with GCP, Azure, and serverless computing in a dynamic, hybrid environment.
Senior Fullstack & Unity Developer (Gen AI, AR)
Join ZAUBAR as a Senior Fullstack & Unity Developer in Berlin to create immersive AR experiences with GenAI. Work on cutting-edge technology in a dynamic team.
AI Engineer
Join BCG X as an AI Engineer in Milan, Italy. Develop AI solutions, partner with clients, and drive innovation in a dynamic environment.
