About the Role
Stability AI is seeking a Senior Data Platform Engineer to enhance and expand our data platform using AWS and GCP services. This role involves understanding our needs, selecting the appropriate tech stack and tools, gaining buy-in from stakeholders, and choosing the best long-term solutions. As a technical thought leader, you will help hire and mentor other members of the team.
Responsibilities
- Architect, implement, and monitor data pipelines.
- Conduct knowledge-sharing sessions with peers to ensure effective data use.
- Work with team members and leaders to further develop our data strategy.
- Develop and maintain a data catalog for a comprehensive understanding of the data and events within our platform.
- Maintain infrastructure-as-code (AWS CDK) provisioning, spin up new and/or revised data platform resources and environments to enhance data collection and processing from our applications and data sources.
- Act as the primary technical decision-maker for the data platform and help hire and support analytical data personnel (e.g., Data Scientist, Data Analyst, BI Developer).
Technical Experience
- Containerized compute: Kubernetes (EKS, GKS), ECS, Docker
- Data ingestion: Airbyte, Mage AI, AWS Glue
- Pipeline orchestration: Airflow, Mage AI
- Data manipulation: Pandas, Numpy, Polars
- Data lake: S3, Iceberg, Delta Lake
- Data warehouse: BigQuery, Redshift
- Database: PostgreSQL
- Data visualization: Looker, Superset/Preset
- Data quality (optional): Great Expectations, Monte Carlo
- Data catalog (optional): Amundsen, AWS Glue Catalog
- Event streaming (optional): Kafka, Flink, Redis, Pub/Sub
- Infrastructure-as-code: AWS CDK, Terraform
- CI/CD: GitHub Actions
Qualifications
- Must have 7+ years of hands-on experience working with data platforms.
- Experience being involved in the design and implementation of at least one data platform.
- Experience in streaming and/or batch analytics.
- Experience with scalable distributed data processing, management, and visualization tools.
- Experience using business intelligence tools and data frameworks.
- Strong working knowledge of Python for both provisioning cloud infrastructure and working with data.
Compensation
The salary range for this role is between $130,000 and $190,000. Individual pay within the range is based on factors like job-related skills and experience. Total compensation also includes stock options and benefits.
Equal Employment Opportunity
We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or other legally protected statuses.
Benefits Extracted with AI
- Remote work flexibility
- Stock options
Similar jobs
Last update: 23 minutes ago
Staff Software Engineer
Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.
Cloud Data Engineer
Seeking a Cloud Data Engineer with expertise in AWS, Python, and CI/CD for a hybrid role in Hannover. Join our dynamic team!
Senior Fullstack Developer for AI-Driven Mission Technologies
Seeking a Senior Fullstack Developer for AI-driven mission technologies, focusing on Java, JavaScript, Python, and C++. Remote work available.
Senior Backend/Data Engineer
Join Zalando as a Senior Backend/Data Engineer in Berlin to enhance our audience-building platform using AWS, Java, Scala, and SQL.
Staff Software Engineer, Data Platform
Join Personio as a Staff Software Engineer in Berlin to build scalable data platforms using Kafka, Kubernetes, and AWS. Drive innovation and excellence.
Senior Full-Stack Engineer ReactJS/NodeJS
Join Gorgias as a Senior Full-Stack Engineer specializing in ReactJS and NodeJS, enhancing AI-powered ecommerce solutions.
Senior Data Engineer
Join i4talent as a Senior Data Engineer to lead cloud transitions and data projects. Enjoy a fun work environment with great benefits.
Cloud Engineer
Join Tibo Energy as a Cloud Engineer to drive energy transition with cloud architecture skills in a dynamic team.
Senior DevOps Engineer with Linux, Kubernetes, and GCP
Join Redcare Pharmacy as a Senior DevOps Engineer to enhance infrastructure efficiency using Linux, Kubernetes, and GCP.
Senior Python Developer with AWS Experience
Join Basetime BV as a Senior Python Developer to develop and maintain AWS cloud solutions. Hybrid work, competitive salary, and growth opportunities.
Data Engineer with ETL and SQL Expertise
Join Holland Casino as a Data Engineer to build and maintain data infrastructure for the Online Casino, focusing on ETL, SQL, and cloud solutions.
Backend Software Engineer - Privacy Technology
Join Zalando as a Backend Software Engineer in Privacy Technology, focusing on data protection and privacy automation services.
Senior Solutions Engineer
Join Reddit as a Senior Solutions Engineer in Amsterdam to support our growing advertising business with technical expertise and problem-solving skills.
Full Stack Engineer with Node.js and React
Join RightCrowd as a Full Stack Engineer to develop cloud-native applications using Node.js and React. Work remotely with cutting-edge technology.
Cofounder - Full Stack Developer/Data Scientist for Climatech Startup
Join Carbon13 as a cofounder in climate tech, leveraging AI, data science, and software development to combat climate change.
Staff Software Engineer, Fullstack, Capacity & Efficiency Engineering
Join Uber as a Staff Software Engineer in Amsterdam, focusing on fullstack development and capacity efficiency engineering.
Senior Full Stack Engineer - Climate Tech - Rust & TypeScript
Join Climatiq as a Senior Full Stack Engineer to develop climate tech solutions using Rust and TypeScript. Remote work available.
Senior IoT Engineer
Join Skytree as a Senior IoT Engineer to lead IoT projects, focusing on Azure IoT solutions, edge computing, and data pipelines.
Senior Systems Engineer, Managed Operations
Join AWS as a Senior Systems Engineer in Berlin to lead operations for the European Sovereign Cloud, ensuring high-availability AWS services.
Senior API Platform Engineer
Join Brenntag as a Senior API Platform Engineer in Amsterdam to drive API platform development using Kubernetes, Istio, and AWS EKS.
Senior Software Engineer - Python, Apache Kafka
Join Aiven as a Senior Software Engineer in Berlin, focusing on Python and Apache Kafka in a hybrid work environment.
Senior Software Engineer - AWS, Python, Ruby on Rails
Join HeyJobs as a Senior Software Engineer to design scalable systems using AWS, Python, and Ruby on Rails in a dynamic team.
Senior Backend Developer (Node.js) / SRE
Join Binance as a Senior Backend Developer (Node.js) / SRE to develop monitoring systems for high-load production environments.
Intermediate Backend Engineer - Ruby on Rails, PostgreSQL
Join GitLab as an Intermediate Backend Engineer to enhance CI platform performance using Ruby on Rails and PostgreSQL in a remote role.
