Pinterest logo

Staff Software Engineer, Data Processing Infrastructure

Pinterest

About the Role

Pinterest is seeking a Staff Software Engineer to join our Data Processing Infrastructure team. This role is pivotal in building and leading the next generation of data processing infrastructure that powers mission-critical big data and ML/AI applications. You will work with cutting-edge open-source technologies such as Kubernetes, Spark, Ray, and Flink, managing data at the scale of hundreds of petabytes.

Key Responsibilities

  • Lead Strategy and Technical Direction: Define and drive the strategy and technical direction for Pinterest’s data processing infrastructure, focusing on big data and ML/AI applications.
  • Build and Scale Frameworks: Develop and scale data processing frameworks and infrastructure to handle petabyte-scale datasets, including job management, resource management, scheduling, and remote shuffling.
  • Collaborate with Internal Customers: Work closely with internal teams to address critical business use cases that depend on data processing.
  • Provide Thought Leadership: Offer guidance on data processing and storage to enhance reliability, speed, and efficiency at scale.
  • Contribute to Technical Vision: Play a key role in shaping the team’s technical vision and long-term roadmap.

What We’re Looking For

  • Experience: 8+ years of industry experience with a proven track record of technical excellence, including 5+ years in building and supporting large-scale big data platforms.
  • Technical Skills: Deep knowledge of big data and ML technologies such as Spark, YuniKorn, Celeborn, Flink, Ray, PyTorch/TensorFlow.
  • Programming Proficiency: Expertise in one or more programming languages, including Java, Go, Scala, and Python.
  • Cloud and Container Technologies: Experience with Kubernetes and AWS technologies.
  • Leadership: Experience in leading cross-team engineering efforts.

Additional Information

  • Relocation: This position does not offer relocation assistance.
  • Workplace Type: Remote work is supported under our PinFlex model.
  • Salary Range: €148,049—€260,000 annually, with eligibility for equity.

Our Commitment to Diversity

Pinterest is an equal opportunity employer. We are committed to creating an inclusive environment for all employees and applicants, regardless of race, color, ancestry, national origin, religion, sex, sexual orientation, gender identity, age, marital status, veteran status, disability, or any other legally protected status.

Join us in our mission to inspire people worldwide and help them create a life they love. Apply today to be part of a team that values diverse perspectives and experiences.

Benefits
Extracted with AI

  • Equity
  • Flexible work model (PinFlex)
  • Diversity and inclusion initiatives

Similar jobs

Last update: 23 minutes ago

Pinterest logo
Pinterest

Senior Staff Software Engineer, Big Data Platform

Lead Big Data and ML/AI initiatives at Pinterest, using technologies like Kubernetes, Spark, and AWS. Based in San Francisco, hybrid role.

Pinterest logo
Pinterest

Staff Software Engineer, Content Quality

Join Pinterest as a Staff Software Engineer in Content Quality, focusing on large-scale content processing systems.

Pinterest logo
Pinterest

Staff Software Engineer, Big Data Query Platform

Staff Software Engineer for Big Data Query Platform at Pinterest, specializing in technologies like Spark and Presto.

Pinterest logo
Pinterest

Senior Software Engineer, Analytics Platform

Senior Software Engineer for Analytics Platform at Pinterest, focusing on ML and data processing enhancements.

Pinterest logo
Pinterest

Backend Software Engineer

Join Pinterest as a Backend Software Engineer to build robust frameworks and features for Pinner-facing applications.

Pinterest logo
Pinterest

Senior Backend Software Engineer

Join Pinterest as a Senior Backend Software Engineer to build robust frameworks and features, enabling new technologies.

Pinterest logo
Pinterest

Senior Software Engineer, Solutions Engineering

Join Pinterest as a Senior Software Engineer in Solutions Engineering, focusing on API, JavaScript, and Python development.

Pinterest logo
Pinterest

Senior Data Scientist

Join Pinterest as a Senior Data Scientist to shape future products using data science, machine learning, and statistical modeling.

Pinterest logo
Pinterest

Full Stack Software Engineer, Core and Monetization

Join Pinterest as a Full Stack Software Engineer in San Francisco, focusing on core and monetization features.

Pinterest logo
Pinterest

Backend Software Engineer at Pinterest

Join Pinterest as a Backend Software Engineer in Seattle, focusing on RESTful API and robust technical design.

Airbnb logo
Airbnb

Staff Software Engineer, Data Infrastructure

Senior Data Infrastructure Engineer at Airbnb, focusing on data engineering tools and frameworks, remote eligible.

Pinterest logo
Pinterest

Engineering Manager II at Pinterest

Lead a dynamic engineering team at Pinterest, managing Web, Backend, iOS, and Android development. Remote flexibility offered.

Pinterest logo
Pinterest

Staff Product Manager, Empathetic AI

Lead AI safety capabilities at Pinterest as a Staff Product Manager. Drive innovation and strategy in a remote role.

Stripe logo
Stripe

Senior Software Engineer, Data Processing Infrastructure

Join Stripe as a Senior Software Engineer in Data Processing Infrastructure, focusing on high-scale distributed systems.

Pinterest logo
Pinterest

Machine Learning Internship for Master's Students

Join Pinterest as a Machine Learning Intern, work on AI challenges, and apply your skills in Python, Java, and TensorFlow.

GitHub logo
GitHub

Software Engineer II, Data Engineering

Join GitHub as a Software Engineer II in Data Engineering, focusing on data pipelines with Python, SQL, Airflow, and Spark.

Sift logo
Sift

Senior/Staff Data Engineer

Join Sift as a Senior/Staff Data Engineer to design scalable data platforms and work with cutting-edge technologies in a hybrid environment.

Pinterest logo
Pinterest

Fullstack Engineer - Growth Platform Team

Join Pinterest's Growth Engineering team in Dublin as a Fullstack Engineer, pivotal in global growth initiatives.

Walmart logo
Walmart

Staff Software Engineer - Data

Join Walmart as a Staff Software Engineer - Data to design scalable data pipelines and infrastructure.

Airbnb logo
Airbnb

Staff Data Engineer, Guest & Host Products

Staff Data Engineer role at Airbnb focusing on data integrity for marketplaces, including data modeling and pipeline construction.

LinkedIn logo
LinkedIn

Senior Staff Software Engineer - Sales Productivity Engineering

Join LinkedIn as a Senior Staff Software Engineer to drive innovation in Sales Productivity Engineering with a focus on technical leadership and backend development.

Discord logo
Discord

Staff Software Engineer, ML Platform

Join Discord as a Staff Software Engineer in ML Platform, focusing on ML lifecycle, data processing, and model serving.

Reddit, Inc. logo
Reddit, Inc.

Senior Software Engineer, Data Infrastructure

Senior Software Engineer for Data Infrastructure at Reddit, focusing on big data tools and cloud services.

Inclusively logo
Inclusively

Senior Software Engineer, Machine Learning Platform

Join as a Senior Software Engineer in Machine Learning Platform, working remotely with cutting-edge ML tools and frameworks.