Netflix logo

Senior Software Engineer, LLM Compute & Serving Systems

Netflix

The Opportunity

Netflix is seeking a Senior Software Engineer to join our Consumer ML Serving team, which provides the computational platform for our consumer-facing ML/AI applications. This role involves building and operating high-traffic, real-time distributed systems and ML serving infrastructure, particularly for large language models (LLMs) and other large foundation models.

Responsibilities

  • Develop and maintain the ML/AI serving infrastructure.
  • Collaborate with engineers, product managers, machine learning engineers, and data/research scientists to enhance our ML/AI capabilities.
  • Translate requirements from research scientists into robust platform offerings.
  • Ensure high availability, throughput, and performance of the systems.

You May Enjoy Working With Us If You Are:

  • Self-driven and highly motivated to deliver top-tier ML infrastructure.
  • Eager to learn about new domains and ship high-quality, well-tested code.
  • Able to produce generic and optimal solutions while balancing near-term needs.
  • Excited to work in a multidisciplinary environment.

Preferred Experience

  • Experience with building and operating real-time distributed systems.
  • Familiarity with public cloud services like AWS, Azure, or GCP.
  • Proficiency in Java or willingness to learn on the job.

Benefits

Netflix offers comprehensive benefits including health plans, mental health support, a 401(k) retirement plan with employer match, stock option program, disability programs, and more. Full-time employees enjoy flexible time off.

About Netflix

Netflix is a global leader in streaming entertainment, offering a diverse range of TV series, films, and games in over 190 countries. At Netflix, we are committed to diversity and inclusion, recognizing that a diverse workforce enhances our work environment and contributes to our success.

Benefits
Extracted with AI

  • 401(k) Retirement Plan with employer match
  • Health Plans
  • Mental Health support
  • Stock Option Program
  • Disability Programs
  • Health Savings and Flexible Spending Accounts
  • Family-forming benefits
  • Life and Serious Injury Benefits
  • Paid leave of absence programs

Similar jobs

Last update: 23 minutes ago

Inclusively logo
Inclusively

Senior Cloud Engineer

Join as a Senior Cloud Engineer to architect and deploy cloud solutions using Azure, AWS, and GCP. Lead innovation in cloud technology.

Airbnb logo
Airbnb

Senior Backend Engineer, Media Foundation

Join Airbnb as a Senior Backend Engineer to build and operate next-gen Media infrastructure. Remote eligible within the US.

Standard AI logo
Standard AI

Senior Software Engineer, Backend

Join Standard AI as a Senior Backend Engineer to design scalable microservices and APIs. Remote role with competitive salary and benefits.

Walmart logo
Walmart

Senior Software Engineer - Java Backend

Join Walmart as a Senior Software Engineer focusing on Java backend development, microservices, and cloud technologies.

micro1 logo
micro1

Machine Learning Engineer with AI/ML Experience

Join us as a Machine Learning Engineer to develop AI/ML models and applications. Work remotely with top-tier companies.

Orkes logo
Orkes

Senior Software Engineer - Cloud Infrastructure

Join Orkes as a Senior Software Engineer focusing on cloud infrastructure, leveraging AWS, GCP, and Azure. Remote position with competitive salary.

Inclusively logo
Inclusively

Senior Software Engineer, Machine Learning

Join as a Senior Software Engineer in Machine Learning, working remotely to build ML-driven products for user engagement.

LlamaIndex logo
LlamaIndex

Founding AI Engineer, Backend

Join LlamaIndex as a Founding AI Engineer, Backend to build scalable cloud services for LLM applications.

Sanity logo
Sanity

Senior Software Engineer (Backend) - Content Lake DX

Join Sanity as a Senior Backend Engineer to build scalable distributed systems for content management.

OPENLANE logo
OPENLANE

Remote Software Engineer

Join our team as a Remote Software Engineer, developing high-quality code in an agile environment. Skills in microservices, API development, and cloud computing required.

FactSet logo
FactSet

Senior Full-Stack Engineer - LLM and Go

Join FactSet as a Senior Full-Stack Engineer specializing in LLM and Go, focusing on innovative software solutions.

Subject logo
Subject

Senior Software Engineer with Front-End Experience (Next.js/Vercel)

Join Subject as a Senior Software Engineer with expertise in Next.js and Vercel, leading innovative projects in a dynamic ed-tech startup.

Scale AI logo
Scale AI

Senior Fullstack Software Engineer, GenAI Horizontal Task Tooling

Join Scale AI as a Senior Fullstack Software Engineer to build web-based applications for AI data annotation.

Reveleer logo
Reveleer

Senior Software Engineer (.NET Core, AWS)

Join Reveleer as a Senior Software Engineer to develop and maintain cloud-native applications using .NET Core and AWS.

Lattice logo
Lattice

Senior Software Engineer, AI

Join Lattice as a Senior Software Engineer, AI, focusing on AI/ML technologies and large language models.

Major League Baseball (MLB) logo
Major League Baseball (MLB)

Software Engineer, Media Services

Join MLB's Media Services team as a Software Engineer to enhance fan experiences with streaming media products.

Seqera logo
Seqera

Senior Software Engineer - Cloud and Distributed Systems

Join Seqera as a Senior Software Engineer to develop cloud-based solutions in a remote-friendly environment.

Olo logo
Olo

Senior Machine Learning Engineer

Join Olo as a Senior Machine Learning Engineer to build and scale ML models for the restaurant industry. Remote work available.

webAI logo
webAI

Senior Distributed Systems Engineer

Join webAI as a Senior Distributed Systems Engineer to design and maintain scalable systems using Python, Kubernetes, and more.

FactSet logo
FactSet

Senior Full-Stack Engineer - LLM and Go

Join FactSet as a Senior Full-Stack Engineer specializing in LLM and Go, enhancing financial data solutions.

Niantic, Inc. logo
Niantic, Inc.

Senior Software Engineer, Machine Learning

Join Niantic as a Senior Software Engineer in Machine Learning to enhance products using generative AI technologies.

Microsoft logo
Microsoft

Senior Software Development Engineer

Join Microsoft as a Senior Software Development Engineer to drive AI and ML innovations in Windows.

Oracle logo
Oracle

Senior Backend Developer - Java, Microservices

Join Oracle as a Senior Backend Developer focusing on Java and Microservices to revolutionize healthcare technology.

Square logo
Square

Senior Software Engineer, Reporting Platform

Join Square as a Senior Software Engineer to lead development on the Reporting Platform, focusing on Java, Kotlin, and AWS.