Netflix logo

Senior Software Engineer, LLM Compute & Serving Systems

Netflix

The Opportunity

Netflix is seeking a Senior Software Engineer to join our Consumer ML Serving team, which provides the computational platform for our consumer-facing ML/AI applications. This role involves building and operating high-traffic, real-time distributed systems and ML serving infrastructure, particularly for large language models (LLMs) and other large foundation models.

Responsibilities

  • Develop and maintain the ML/AI serving infrastructure.
  • Collaborate with engineers, product managers, machine learning engineers, and data/research scientists to enhance our ML/AI capabilities.
  • Translate requirements from research scientists into robust platform offerings.
  • Ensure high availability, throughput, and performance of the systems.

You May Enjoy Working With Us If You Are:

  • Self-driven and highly motivated to deliver top-tier ML infrastructure.
  • Eager to learn about new domains and ship high-quality, well-tested code.
  • Able to produce generic and optimal solutions while balancing near-term needs.
  • Excited to work in a multidisciplinary environment.

Preferred Experience

  • Experience with building and operating real-time distributed systems.
  • Familiarity with public cloud services like AWS, Azure, or GCP.
  • Proficiency in Java or willingness to learn on the job.

Benefits

Netflix offers comprehensive benefits including health plans, mental health support, a 401(k) retirement plan with employer match, stock option program, disability programs, and more. Full-time employees enjoy flexible time off.

About Netflix

Netflix is a global leader in streaming entertainment, offering a diverse range of TV series, films, and games in over 190 countries. At Netflix, we are committed to diversity and inclusion, recognizing that a diverse workforce enhances our work environment and contributes to our success.

Benefits
Extracted with AI

  • 401(k) Retirement Plan with employer match
  • Health Plans
  • Mental Health support
  • Stock Option Program
  • Disability Programs
  • Health Savings and Flexible Spending Accounts
  • Family-forming benefits
  • Life and Serious Injury Benefits
  • Paid leave of absence programs

Similar jobs

Last update: 23 minutes ago

Netflix logo
Netflix

Senior Software Engineer - Consumer Engineering

Senior Software Engineer for Consumer Engineering at Netflix, focusing on backend systems and complex problem-solving.

Netflix logo
Netflix

Senior Software Engineer, CI/CD Observability Platform

Senior Software Engineer for CI/CD Observability at Netflix, focusing on full-stack development, data visualization, and CI/CD platforms.

Netflix logo
Netflix

Senior Software Engineer - Ads Platform

Senior Software Engineer for Ads Platform at Netflix, skilled in Java, C#, microservices, and API design.

Netflix logo
Netflix

Distributed Systems Engineer (L4), Content Engineering

Join Netflix as a Distributed Systems Engineer in Content Engineering, focusing on scalable, reliable systems. Remote work available.

Netflix logo
Netflix

Senior Software Engineer, Machine Learning Platform (Metaflow)

Senior Software Engineer for Machine Learning Platform at Netflix, skilled in Python, AWS, CI/CD, TensorFlow, and PyTorch.

Netflix logo
Netflix

Senior Full Stack Software Engineer - Netflix CKG

Join Netflix as a Senior Full Stack Software Engineer in Los Angeles, developing innovative data systems and applications.

Netflix logo
Netflix

Senior Software Engineer - Web Foundations

Senior Software Engineer for Web Foundations at Netflix, focusing on Node.js, JavaScript, and UI design.

Netflix logo
Netflix

Senior Software Engineer - Live Infrastructure Testing

Senior Software Engineer for Live Infrastructure Testing at Netflix, focusing on enhancing testing tools and practices.

Netflix logo
Netflix

Senior UI Engineer, Growth Product Experiences

Senior UI Engineer for Netflix's Growth Product Experiences team, focusing on JavaScript, React, and GraphQL.

Netflix logo
Netflix

Senior Product Manager, AI Platform

Senior Product Manager for AI Platform at Netflix, focusing on ML/AI, strategic product management, and innovation.

Snowflake logo
Snowflake

Senior Software Engineer - LLM

Join Snowflake as a Senior Software Engineer to build scalable machine learning platforms with LLMs, leveraging Python and TensorFlow.

Microsoft logo
Microsoft

Senior Software Engineer - Azure Compute

Senior Software Engineer for Azure Compute at Microsoft, focusing on scalable cloud infrastructure. Remote work available.

Snowflake logo
Snowflake

Senior Software Engineer - LLM

Join Snowflake as a Senior Software Engineer to build scalable machine learning platforms with LLMs, leveraging Python and TensorFlow.

micro1 logo
micro1

Senior LLM Engineer

Join our team as a Senior LLM Engineer, leveraging AWS, Python, and JavaScript to develop scalable AI solutions.

CentML logo
CentML

Senior Software Engineer - LLM Inference

Join CentML as a Senior Software Engineer focusing on LLM Inference, leveraging AI, ML, and GPU technologies.

Amazon logo
Amazon

Senior Software Engineer, Machine Learning Infrastructure

Join Amazon's Search team as a Senior Software Engineer in ML Infrastructure, focusing on large-scale distributed systems and deep learning.

DigitalOcean logo
DigitalOcean

Senior Software Engineer (AI/ML)

Join DigitalOcean as a Senior Software Engineer (AI/ML) to build AI/ML features using TypeScript, React, and GraphQL. Remote role with competitive benefits.

Netflix logo
Netflix

Engineering Manager - Developer Enablement Engineering

Lead a team of software engineers in Developer Enablement Engineering at Netflix, Warsaw. Focus on high-impact results and team development.

DigitalOcean logo
DigitalOcean

Senior Software Engineer (AI/ML)

Join DigitalOcean as a Senior Software Engineer (AI/ML) to build AI/ML features using TypeScript, React, and GraphQL. Remote role with competitive benefits.

Lattice logo
Lattice

Senior Software Engineer, AI/ML

Join Lattice as a Senior Software Engineer focusing on AI/ML technologies. Work remotely with a modern tech stack.

Captions logo
Captions

Senior Software Engineer, Backend

Join Captions as a Senior Backend Engineer to build scalable video software in NYC. Requires 3+ years experience with GCP, AWS, and Kubernetes.

Lambda logo
Lambda

Senior Software Engineer - Cloud

Join Lambda as a Senior Software Engineer to build the world's best deep learning cloud using AWS, Python, and distributed systems.

Orkes logo
Orkes

Senior Software Engineer - Cloud Infrastructure

Join Orkes as a Senior Software Engineer focusing on cloud infrastructure, leveraging AWS, GCP, and Azure. Remote position with competitive salary.

Reddit, Inc. logo
Reddit, Inc.

Senior Software Engineer, ML Platform

Senior Software Engineer for ML Platform at Reddit, focusing on system architecture and team leadership.