Staff Software Engineer, Data Processing Infrastructure

About the Role

Pinterest is seeking a Staff Software Engineer to join our Data Processing Infrastructure team. This role is pivotal in building and leading the next generation of data processing infrastructure that powers mission-critical big data and ML/AI applications. You will work with cutting-edge open-source technologies such as Kubernetes, Spark, Ray, and Flink, managing data at the scale of hundreds of petabytes.

Key Responsibilities

Lead Strategy and Technical Direction: Define and drive the strategy and technical direction for Pinterest’s data processing infrastructure, focusing on big data and ML/AI applications.
Build and Scale Frameworks: Develop and scale data processing frameworks and infrastructure to handle petabyte-scale datasets, including job management, resource management, scheduling, and remote shuffling.
Collaborate with Internal Customers: Work closely with internal teams to address critical business use cases that depend on data processing.
Provide Thought Leadership: Offer guidance on data processing and storage to enhance reliability, speed, and efficiency at scale.
Contribute to Technical Vision: Play a key role in shaping the team’s technical vision and long-term roadmap.

What We’re Looking For

Experience: 8+ years of industry experience with a proven track record of technical excellence, including 5+ years in building and supporting large-scale big data platforms.
Technical Skills: Deep knowledge of big data and ML technologies such as Spark, YuniKorn, Celeborn, Flink, Ray, PyTorch/TensorFlow.
Programming Proficiency: Expertise in one or more programming languages, including Java, Go, Scala, and Python.
Cloud and Container Technologies: Experience with Kubernetes and AWS technologies.
Leadership: Experience in leading cross-team engineering efforts.

Additional Information

Relocation: This position does not offer relocation assistance.
Workplace Type: Remote work is supported under our PinFlex model.
Salary Range: €148,049—€260,000 annually, with eligibility for equity.

Our Commitment to Diversity

Pinterest is an equal opportunity employer. We are committed to creating an inclusive environment for all employees and applicants, regardless of race, color, ancestry, national origin, religion, sex, sexual orientation, gender identity, age, marital status, veteran status, disability, or any other legally protected status.

Join us in our mission to inspire people worldwide and help them create a life they love. Apply today to be part of a team that values diverse perspectives and experiences.

Benefits
Extracted with AI

Equity
Flexible work model (PinFlex)
Diversity and inclusion initiatives

Similar jobs

Last update: 23 minutes ago

Staff Product Manager, Empathetic AI

Lead AI safety capabilities at Pinterest as a Staff Product Manager. Drive innovation and strategy in a remote role.

17 days ago

Senior Software Engineer, Data Processing Infrastructure

Join Stripe as a Senior Software Engineer in Data Processing Infrastructure, focusing on high-scale distributed systems.

21 days ago

Senior ML Infrastructure Engineer

Join CHAI: AI Platform as a Senior ML Infrastructure Engineer to build and scale ML systems in Palo Alto.

6 days ago

Senior Data Engineer

Join us as a Senior Data Engineer in Lisbon to design and maintain data infrastructure. Hybrid role with flexible benefits.

4 days ago

Staff Engineer - Python, Cloud, Distributed Systems

Join Keelvar as a Staff Engineer to lead design and architecture in a remote role, focusing on Python, cloud, and distributed systems.

8 days ago

Senior Staff Software Engineer, Fullstack Backend

Join Intuit as a Senior Staff Software Engineer to lead MarTech initiatives, focusing on backend development and integration.

2 hours ago

Data Engineer with AWS, Java, and Python

Join Poppi Technologies as a Data Engineer in Valenzano, Italy. Work with AWS, Java, and Python to drive AI in finance.

8 days ago

Senior Staff Software Engineer - Infrastructure

Join Rippling as a Senior Staff Software Engineer in Infrastructure, leading projects and building scalable systems.

16 days ago

Senior Backend Engineer, Media Foundation

Join Airbnb as a Senior Backend Engineer to build and operate next-gen Media infrastructure. Remote eligible within the US.

6 days ago

Data Engineer II

Join Accolade as a Data Engineer II in Prague. Design and maintain cloud-native data infrastructure using AWS and modern technologies.

9 days ago

Staff Software Engineer - Python, Machine Learning

Join Parafin as a Staff Software Engineer to build scalable platforms for underwriting and decisioning using Python and ML.

21 days ago

Remote Data Engineer - Research

Join Stability AI as a Remote Data Engineer to build scalable data infrastructure for AI models.

16 days ago

Senior Machine Learning Engineer

Join as a Senior Machine Learning Engineer to design and deploy advanced ML solutions using Python, Spark, and cloud platforms. Remote work opportunity.

16 days ago