Netflix logo

Senior Software Engineer, LLM Compute & Serving Systems

Netflix

The Opportunity

Netflix is seeking a Senior Software Engineer to join our Consumer ML Serving team, which provides the computational platform for our consumer-facing ML/AI applications. This role involves building and operating high-traffic, real-time distributed systems and ML serving infrastructure, particularly for large language models (LLMs) and other large foundation models.

Responsibilities

  • Develop and maintain the ML/AI serving infrastructure.
  • Collaborate with engineers, product managers, machine learning engineers, and data/research scientists to enhance our ML/AI capabilities.
  • Translate requirements from research scientists into robust platform offerings.
  • Ensure high availability, throughput, and performance of the systems.

You May Enjoy Working With Us If You Are:

  • Self-driven and highly motivated to deliver top-tier ML infrastructure.
  • Eager to learn about new domains and ship high-quality, well-tested code.
  • Able to produce generic and optimal solutions while balancing near-term needs.
  • Excited to work in a multidisciplinary environment.

Preferred Experience

  • Experience with building and operating real-time distributed systems.
  • Familiarity with public cloud services like AWS, Azure, or GCP.
  • Proficiency in Java or willingness to learn on the job.

Benefits

Netflix offers comprehensive benefits including health plans, mental health support, a 401(k) retirement plan with employer match, stock option program, disability programs, and more. Full-time employees enjoy flexible time off.

About Netflix

Netflix is a global leader in streaming entertainment, offering a diverse range of TV series, films, and games in over 190 countries. At Netflix, we are committed to diversity and inclusion, recognizing that a diverse workforce enhances our work environment and contributes to our success.

Benefits
Extracted with AI

  • 401(k) Retirement Plan with employer match
  • Health Plans
  • Mental Health support
  • Stock Option Program
  • Disability Programs
  • Health Savings and Flexible Spending Accounts
  • Family-forming benefits
  • Life and Serious Injury Benefits
  • Paid leave of absence programs

Similar jobs

Last update: 23 minutes ago

Netflix logo
Netflix

Senior Software Engineer - Consumer Engineering

Senior Software Engineer for Consumer Engineering at Netflix, focusing on backend systems and complex problem-solving.

Netflix logo
Netflix

Senior Software Engineer, CI/CD Observability Platform

Senior Software Engineer for CI/CD Observability at Netflix, focusing on full-stack development, data visualization, and CI/CD platforms.

Netflix logo
Netflix

Senior Software Engineer - Ads Platform

Senior Software Engineer for Ads Platform at Netflix, skilled in Java, C#, microservices, and API design.

Netflix logo
Netflix

Distributed Systems Engineer (L4), Content Engineering

Join Netflix as a Distributed Systems Engineer in Content Engineering, focusing on scalable, reliable systems. Remote work available.

Netflix logo
Netflix

Senior Software Engineer, Machine Learning Platform (Metaflow)

Senior Software Engineer for Machine Learning Platform at Netflix, skilled in Python, AWS, CI/CD, TensorFlow, and PyTorch.

Netflix logo
Netflix

Senior Full Stack Software Engineer - Netflix CKG

Join Netflix as a Senior Full Stack Software Engineer in Los Angeles, developing innovative data systems and applications.

Netflix logo
Netflix

Senior Software Engineer - Web Foundations

Senior Software Engineer for Web Foundations at Netflix, focusing on Node.js, JavaScript, and UI design.

Netflix logo
Netflix

Senior Software Engineer - Live Infrastructure Testing

Senior Software Engineer for Live Infrastructure Testing at Netflix, focusing on enhancing testing tools and practices.

Persona logo
Persona

LLM Backend Developer

Join Persona as a LLM Backend Developer, work remotely, and develop AI-driven backend systems for top startups.

Bitmovin logo
Bitmovin

Senior C++ Software Engineer

Join Bitmovin as a Senior C++ Software Engineer to develop scalable video streaming solutions using modern C++ and cloud-native architectures.

Aiven logo
Aiven

Staff Software Engineer

Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.

TrueLayer logo
TrueLayer

Senior Software Engineer - C#/.NET

Join TrueLayer as a Senior Software Engineer in Milan, working with C#, .NET, AWS, and Kubernetes to build scalable systems.

Uber logo
Uber

Staff Software Engineer - Backend

Join Uber as a Staff Software Engineer - Backend, focusing on membership systems. Work with Java, Python, C++, and more in Amsterdam.

Snowflake logo
Snowflake

Senior Software Engineer - LLM

Join Snowflake as a Senior Software Engineer to build scalable machine learning platforms with LLMs, leveraging Python and TensorFlow.

Uber logo
Uber

Staff Software Engineer, Fullstack, Capacity & Efficiency Engineering

Join Uber as a Staff Software Engineer in Amsterdam, focusing on fullstack development and capacity efficiency engineering.

yourfirm GmbH logo
yourfirm GmbH

Senior Fullstack Developer for AI-Driven Mission Technologies

Seeking a Senior Fullstack Developer for AI-driven mission technologies, focusing on Java, JavaScript, Python, and C++. Remote work available.

Uber logo
Uber

Senior Software Engineer (Elasticsearch)

Join Uber as a Senior Software Engineer specializing in Elasticsearch, working on sophisticated infrastructure across data centers and cloud.

Sofico logo
Sofico

Senior Software Engineer - Java, Microservices

Join Sofico as a Senior Software Engineer focusing on Java and Microservices in Bavaria, Germany. Work on ERP solutions for automotive finance.

netgo logo
netgo

Senior Cloud DevOps Engineer

Join netgo as a Senior Cloud DevOps Engineer in Berlin. Work with Kubernetes, GitOps, and more in a dynamic team environment.

Snowflake logo
Snowflake

Senior Software Engineer - LLM

Join Snowflake as a Senior Software Engineer to build scalable machine learning platforms with LLMs, leveraging Python and TensorFlow.

Netflix logo
Netflix

Senior UI Engineer, Growth Product Experiences

Senior UI Engineer for Netflix's Growth Product Experiences team, focusing on JavaScript, React, and GraphQL.

Zalando logo
Zalando

Senior Backend/Data Engineer

Join Zalando as a Senior Backend/Data Engineer in Berlin to enhance our audience-building platform using AWS, Java, Scala, and SQL.

Uber logo
Uber

Staff Software Engineer - Backend

Join Uber as a Staff Software Engineer - Backend to develop and enhance solutions for millions of members globally.

DeepL logo
DeepL

Senior Backend Engineer C++

Join DeepL as a Senior Backend Engineer C++ to design and maintain scalable backend services using C++ and AI technologies.