About the Role
We are seeking a talented Data Engineer to join our Data team at Stability AI. This role is pivotal in enhancing and scaling the efficiency of our models. You will work closely with a multidisciplinary team of research scientists and machine learning engineers to build and maintain the data infrastructure that supports the training of all Stability AI models. This position is remote and based in Germany.
Responsibilities
- Data Preparation: Clean, normalize, and preprocess data in a scalable, parallelizable manner to prepare it for ingestion into our machine learning model training pipelines, ensuring data quality.
- Infrastructure Development: Design, implement, and maintain scalable data infrastructure for generative AI.
- Tool Development: Develop tools to search and serve data at scale.
- Collaboration: Work with multiple research teams to understand and meet their data requirements.
- Pipeline Management: Develop and manage data processing pipelines to support machine learning teams.
- Data Quality: Maintain and improve data quality and integrity across various databases and data stores.
- Data Management: Manage and organize large-scale unstructured data, including image, text, audio, video, and 3D.
Qualifications
- Proven experience with large-scale distributed workloads.
- Experience with large-scale data loading for machine learning training runs.
- Proficiency in cloud storage and file systems, with a preference for AWS (S3).
- Strong experience with Python.
- Expertise in database, data lake, and data warehouse technologies such as Redshift, BigQuery, and Snowflake.
- Experience working on machine learning projects, with some knowledge of deep learning and computer vision.
- Excellent teamwork and communication skills, especially in a distributed international team setting.
- Attention to detail and the ability to document processes and solutions effectively.
Equal Employment Opportunity
Stability AI is an equal opportunity employer. We do not discriminate based on race, religion, national origin, gender, sexual orientation, age, veteran status, disability, or other legally protected statuses.
Join us in building the foundation to activate humanity’s potential through open AI tools and solutions.
Benefits Extracted with AI
- Remote work
- Equal Employment Opportunity
Similar jobs
Last update: 23 minutes ago
Cloud Data Engineer
Seeking a Cloud Data Engineer with expertise in AWS, Python, and CI/CD for a hybrid role in Hannover. Join our dynamic team!
Staff Software Engineer
Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.
Staff Software Engineer, Data Platform
Join Personio as a Staff Software Engineer in Berlin to build scalable data platforms using Kafka, Kubernetes, and AWS. Drive innovation and excellence.
Senior Backend Engineer C++
Join DeepL as a Senior Backend Engineer C++ to design and maintain scalable backend services using C++ and AI technologies.
Expert Machine Learning Engineer
Join Dataroots as an Expert Machine Learning Engineer to design and deliver AI-powered solutions, focusing on machine learning models.
Senior Backend Engineer - Java, Rust, Go
Join Together AI as a Senior Backend Engineer in Amsterdam. Work with Java, Rust, and Go to build scalable backend systems.
Senior Software Engineer - AWS, Python, Ruby on Rails
Join HeyJobs as a Senior Software Engineer to design scalable systems using AWS, Python, and Ruby on Rails in a dynamic team.
Senior Software Engineer (Node.js & TypeScript)
Join n8n as a Senior Software Engineer to build AI applications using Node.js and TypeScript. Remote role within Europe.
Senior Software Engineer - Python, Apache Kafka
Join Aiven as a Senior Software Engineer in Berlin, focusing on Python and Apache Kafka in a hybrid work environment.
Senior Backend Developer
Join Motius as a Senior Backend Developer to work on cutting-edge R&D projects using AWS, Docker, GraphQL, and more in a hybrid work environment.
Senior Cloud DevOps Engineer
Join netgo as a Senior Cloud DevOps Engineer in Berlin. Work with Kubernetes, GitOps, and more in a dynamic team environment.
Senior Full Stack Engineer - Climate Tech - Rust & TypeScript
Join Climatiq as a Senior Full Stack Engineer to develop climate tech solutions using Rust and TypeScript. Remote work available.
Senior Backend Engineer (Go)
Join Nebius as a Senior Backend Engineer (Go) to develop fault-tolerant cloud services in a hybrid work environment.
AI Engineer
Join BCG X as an AI Engineer in Milan, Italy. Develop AI solutions, partner with clients, and drive innovation in a dynamic environment.
Full-Stack Developer with Cloud and Frontend Expertise
Join ChemInnovation as a Full-Stack Developer to build innovative AI solutions for analytical chemistry. Work remotely with flexible hours.
Senior Software Engineer - Data Platform
Join Nubank as a Senior Software Engineer to build and maintain core data infrastructure, ensuring reliable and scalable data flow.
Senior Python Developer with AWS Experience
Join Basetime BV as a Senior Python Developer to develop and maintain AWS cloud solutions. Hybrid work, competitive salary, and growth opportunities.
Data Engineer with Azure and PySpark
Join BeFrank as a Data Engineer to build and enhance our data platform using Azure and PySpark. Hybrid work in Amsterdam.
Cloud Engineer
Join our team as a Cloud Engineer in Cologne, Germany. Work with GCP, Azure, and serverless computing in a dynamic, hybrid environment.
Full-Stack Engineer with Angular and React.js
Join Labelbox as a Full-Stack Engineer to develop scalable systems using Angular, React.js, and GraphQL. Work remotely in a dynamic AI-driven environment.
Software Engineer - Cloud Applications and Python
Join Topicus as a Software Engineer in Arnhem to develop cloud applications using Python, REST APIs, and ETL processes for healthcare data services.
Remote FullStack Developer (m/w/d)
Join our dynamic IT company as a Remote FullStack Developer, working with JavaScript, Node.js, and Python. Flexible hours and remote work.
Digital Expert - Software Developer / Full Stack Developer / Data Analyst
Join Ramboll as a Digital Expert in Berlin to drive digital transformation with skills in software development, data analysis, and process automation.
Senior Systems Engineer, Managed Operations
Join AWS as a Senior Systems Engineer in Berlin to lead operations for the European Sovereign Cloud, ensuring high-availability AWS services.