Scale AI logo

Senior Software Engineer, GenAI Safety & Evaluation

Scale AI

Job Overview

Scale AI is seeking a Senior Software Engineer to join our GenAI Safety & Evaluation team. This role is pivotal in building a world-class customer-facing model evaluation platform. You will have the opportunity to shape the way models across the industry are evaluated, impacting billions of people globally.

Key Responsibilities

  • Own large new areas within our product: Work across backend, frontend, and interact with LLMs and other ML models.
  • Deliver experiments: Engage our customers with high-velocity and quality experiments.
  • Product lifecycle management: Involve in the entire product lifecycle from conceptualization through production.
  • Multi-tasking and learning: Be able and willing to learn new technologies quickly.
  • Collaboration: Work with cross-functional teams to define, design, and ship new product features and experiences.

Requirements

  • Experience: 5+ years of full-time engineering experience post-graduation.
  • Technical Skills: Proficiencies in Python, Node, React, Next.js, and MongoDB.
  • Background: Solid understanding of algorithms, data structures, and object-oriented programming.
  • Experience with AI technologies: Excitement to work with AI technologies and scaling products at hyper-growth startups.
  • Communication: Strong written and verbal communication skills.
  • Problem-solving: Ability to work independently or as part of a team.

Nice to Haves

  • Software engineering best practices: Strong knowledge and experience.
  • AI platforms and technologies: Experience with generative models and LLMs.
  • ML infrastructure: Experience building ML infrastructure and AI-powered solutions.

Location

  • Workplace: Hybrid, with the ability to commute to the San Francisco office 1-2 times weekly.

Compensation

  • Salary Range: $160,000—$192,000 USD annually.
  • Equity: Eligible roles include equity-based compensation.

Benefits

  • Comprehensive health, dental, and vision coverage.
  • Retirement benefits.
  • Learning and development stipend.
  • Generous PTO.
  • Commuter stipend.

About Scale AI

At Scale, our mission is to accelerate the development of AI applications. We believe that to make the best models, you need the best data. Our Generative AI Platform leverages enterprise data to customize powerful base generative models, unlocking the value of AI safely. We are trusted by leading technology companies, government agencies, and enterprises worldwide.

Join us in transforming how organizations build and deploy AI, and be part of a team that is at the forefront of the AI race.

Benefits
Extracted with AI

  • Comprehensive health, dental and vision coverage
  • Retirement benefits
  • Learning and development stipend
  • Generous PTO
  • Commuter stipend

Similar jobs

Last update: 23 minutes ago

Scale AI logo
Scale AI

Senior Fullstack Software Engineer, GenAI Horizontal Task Tooling

Join Scale AI as a Senior Fullstack Software Engineer to build web-based applications for AI data annotation.

Scale AI logo
Scale AI

Software Engineer - New Grad

Join Scale AI as a Software Engineer - New Grad in San Francisco. Work on AI applications with TypeScript, MongoDB, and more.

Scale AI logo
Scale AI

Software Engineering Intern (Summer 2025)

Join Scale AI as a Software Engineering Intern for Summer 2025, working on AI applications with Python, TypeScript, and MongoDB.

Scale AI logo
Scale AI

Staff AI Product Manager, Generative AI

Join Scale AI as a Staff AI Product Manager to lead the development of ML-powered products in a hybrid role in San Francisco.

CHAI: AI Platform logo
CHAI: AI Platform

Senior ML Infrastructure Engineer

Join CHAI: AI Platform as a Senior ML Infrastructure Engineer to build and scale ML systems in Palo Alto.

Cascading AI (YC S23) logo
Cascading AI (YC S23)

Senior Full-stack Engineer

Join Cascading AI as a Senior Full-stack Engineer to develop AI-driven lending solutions in San Francisco.

Standard AI logo
Standard AI

Senior Software Engineer, Backend

Join Standard AI as a Senior Backend Engineer to design scalable microservices and APIs. Remote role with competitive salary and benefits.

Scale AI logo
Scale AI

AI Product Manager, Generative AI

Join Scale AI as an AI Product Manager to lead ML-assisted tooling and data quality platforms in a hybrid role.

Meta logo
Meta

Research Engineer, Language - Generative AI

Join Meta as a Research Engineer in Generative AI, focusing on large language models and NLP.

webAI logo
webAI

Senior Distributed Systems Engineer

Join webAI as a Senior Distributed Systems Engineer to design and maintain scalable systems using Python, Kubernetes, and more.

webAI logo
webAI

AI Framework Engineer

Join webAI as an AI Framework Engineer to develop innovative AI frameworks for distributed computing environments.

Scout AI logo
Scout AI

Founding Full-stack Engineer

Join a stealth startup as a Founding Full-stack Engineer to enhance cybersecurity using LLMs. Work with AWS, React, and Python.

Niantic, Inc. logo
Niantic, Inc.

Senior Software Engineer, Machine Learning

Join Niantic as a Senior Software Engineer in Machine Learning to enhance products using generative AI technologies.

OpenAI logo
OpenAI

Software Engineer, ChatGPT Enterprise

Join OpenAI as a Software Engineer for ChatGPT Enterprise, focusing on secure, scalable AI solutions.

Lattice logo
Lattice

Senior Software Engineer, AI

Join Lattice as a Senior Software Engineer, AI, focusing on AI/ML technologies and large language models.

micro1 logo
micro1

Machine Learning Engineer with AI/ML Experience

Join us as a Machine Learning Engineer to develop AI/ML models and applications. Work remotely with top-tier companies.

Argon AI (YC W24) logo
Argon AI (YC W24)

Senior Full Stack Software Engineer

Join Argon AI as a Senior Full Stack Software Engineer to build AI solutions for biopharma in NYC. Work with Python, PostgreSQL, and more.

Alter Solutions Portugal logo
Alter Solutions Portugal

Senior AI Developer with GenAI

Join Alter Solutions Portugal as a Senior AI Developer specializing in GenAI, focusing on innovative AI solutions.

Augment AI logo
Augment AI

Senior Software Engineer, Platform

Join Augment AI as a Senior Software Engineer to build AI-driven platforms using AWS, Ruby, and Python. Enjoy great benefits and stock options.

CHAI: AI Platform logo
CHAI: AI Platform

Senior Applied AI Researcher

Join CHAI: AI Platform as a Senior Applied AI Researcher to optimize and innovate AI solutions in a high-growth environment.

DwellFi  logo
DwellFi

AI Solutions Software Engineer

Join DwellFi as an AI Solutions Software Engineer to develop innovative AI solutions using LangChain or Llama.

SPREAD AI logo
SPREAD AI

FullStack Software Developer

Join SPREAD AI as a FullStack Software Developer to innovate in data management and engineering intelligence.

Stability AI logo
Stability AI

Senior Backend Engineer (AI)

Join Stability AI as a Senior Backend Engineer to develop REST APIs and AI/ML services for Generative AI models.

Zep AI (YC W24) logo
Zep AI (YC W24)

Senior AI Engineer

Join Zep AI as a Senior AI Engineer to lead LLM-based AI solutions development in a hybrid work environment.