About the Role
Stability AI is seeking a Senior Data Platform Engineer to enhance and expand our data platform using AWS and GCP services. This role involves understanding our needs, selecting the appropriate tech stack and tools, gaining buy-in from stakeholders, and choosing the best long-term solutions. As a technical thought leader, you will help hire and mentor other members of the team.
Responsibilities
- Architect, implement, and monitor data pipelines.
- Conduct knowledge-sharing sessions with peers to ensure effective data use.
- Work with team members and leaders to further develop our data strategy.
- Develop and maintain a data catalog for a comprehensive understanding of the data and events within our platform.
- Maintain infrastructure-as-code (AWS CDK) provisioning, spin up new and/or revised data platform resources and environments to enhance data collection and processing from our applications and data sources.
- Act as the primary technical decision-maker for the data platform and help hire and support analytical data personnel (e.g., Data Scientist, Data Analyst, BI Developer).
Technical Experience
- Containerized compute: Kubernetes (EKS, GKS), ECS, Docker
- Data ingestion: Airbyte, Mage AI, AWS Glue
- Pipeline orchestration: Airflow, Mage AI
- Data manipulation: Pandas, Numpy, Polars
- Data lake: S3, Iceberg, Delta Lake
- Data warehouse: BigQuery, Redshift
- Database: PostgreSQL
- Data visualization: Looker, Superset/Preset
- Data quality (optional): Great Expectations, Monte Carlo
- Data catalog (optional): Amundsen, AWS Glue Catalog
- Event streaming (optional): Kafka, Flink, Redis, Pub/Sub
- Infrastructure-as-code: AWS CDK, Terraform
- CI/CD: GitHub Actions
Qualifications
- Must have 7+ years of hands-on experience working with data platforms.
- Experience being involved in the design and implementation of at least one data platform.
- Experience in streaming and/or batch analytics.
- Experience with scalable distributed data processing, management, and visualization tools.
- Experience using business intelligence tools and data frameworks.
- Strong working knowledge of Python for both provisioning cloud infrastructure and working with data.
Compensation
The salary range for this role is between $130,000 and $190,000. Individual pay within the range is based on factors like job-related skills and experience. Total compensation also includes stock options and benefits.
Equal Employment Opportunity
We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or other legally protected statuses.
Benefits Extracted with AI
- Remote work flexibility
- Stock options
Similar jobs
Last update: 23 minutes ago
Senior Data Engineer
Join Stability AI as a Senior Data Engineer to build scalable data infrastructure for AI models. Remote work from Germany.
Remote Data Engineer - Research
Join Stability AI as a Remote Data Engineer to build scalable data infrastructure for AI models.
Staff Software Engineer
Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.
Cloud Data Engineer
Seeking a Cloud Data Engineer with expertise in AWS, Python, and CI/CD for a hybrid role in Hannover. Join our dynamic team!
Senior Backend/Data Engineer
Join Zalando as a Senior Backend/Data Engineer in Berlin to enhance our audience-building platform using AWS, Java, Scala, and SQL.
Staff Software Engineer, Data Platform
Join Personio as a Staff Software Engineer in Berlin to build scalable data platforms using Kafka, Kubernetes, and AWS. Drive innovation and excellence.
Senior Fullstack Developer for AI-Driven Mission Technologies
Seeking a Senior Fullstack Developer for AI-driven mission technologies, focusing on Java, JavaScript, Python, and C++. Remote work available.
Senior Backend Engineer (AI)
Join Stability AI as a Senior Backend Engineer to develop REST APIs and AI/ML services for Generative AI models.
Software Engineer - Data Platform
Join Bot Auto as a Software Engineer to design and evolve our hybrid-Cloud data platform. Work remotely with cutting-edge technology in autonomous trucking.
Senior Data Engineer
Join i4talent as a Senior Data Engineer to lead cloud transitions and data projects. Enjoy a fun work environment with great benefits.
Senior DevOps Engineer with Linux, Kubernetes, and GCP
Join Redcare Pharmacy as a Senior DevOps Engineer to enhance infrastructure efficiency using Linux, Kubernetes, and GCP.
Senior Full-Stack Engineer ReactJS/NodeJS
Join Gorgias as a Senior Full-Stack Engineer specializing in ReactJS and NodeJS, enhancing AI-powered ecommerce solutions.
Senior GCP Data Engineer (Databricks)
Join Xebia Poland as a Senior GCP Data Engineer, focusing on Databricks, Python, and SQL for cloud-based solutions.
Senior Python Developer with AWS Experience
Join Basetime BV as a Senior Python Developer to develop and maintain AWS cloud solutions. Hybrid work, competitive salary, and growth opportunities.
Senior Platform Engineer
Join Orbem as a Senior Platform Engineer to build robust platforms, enhance software delivery, and drive innovation in AI-powered imaging.
Lead Architect - Gen AI API Platform
Lead Architect for Gen AI API platform, focusing on AWS, REST APIs, and AI/ML infrastructure. Remote role with competitive salary.
Senior Software Engineer - AWS, Python, Ruby on Rails
Join HeyJobs as a Senior Software Engineer to design scalable systems using AWS, Python, and Ruby on Rails in a dynamic team.
Senior Backend Engineer (Go)
Join Nebius as a Senior Backend Engineer (Go) to develop fault-tolerant cloud services in a hybrid work environment.
Cloud Engineer
Join Tibo Energy as a Cloud Engineer to drive energy transition with cloud architecture skills in a dynamic team.
Backend Software Engineer - Privacy Technology
Join Zalando as a Backend Software Engineer in Privacy Technology, focusing on data protection and privacy automation services.
Senior Backend Engineer - Java, Rust, Go
Join Together AI as a Senior Backend Engineer in Amsterdam. Work with Java, Rust, and Go to build scalable backend systems.
Senior Data Platform Engineer
Senior Data Platform Engineer needed for Blip, focusing on Big Data management and cloud solutions. Expertise in SQL, Python, Spark, and cloud platforms required.
Senior Full Stack Engineer - Climate Tech - Rust & TypeScript
Join Climatiq as a Senior Full Stack Engineer to develop climate tech solutions using Rust and TypeScript. Remote work available.
Senior IoT Engineer
Join Skytree as a Senior IoT Engineer to lead IoT projects, focusing on Azure IoT solutions, edge computing, and data pipelines.
