Scale AI logo

Senior Software Engineer, GenAI Safety & Evaluation

Scale AI

Job Overview

Scale AI is seeking a Senior Software Engineer to join our GenAI Safety & Evaluation team. This role is pivotal in building a world-class customer-facing model evaluation platform. You will have the opportunity to shape the way models across the industry are evaluated, impacting billions of people globally.

Key Responsibilities

  • Own large new areas within our product: Work across backend, frontend, and interact with LLMs and other ML models.
  • Deliver experiments: Engage our customers with high-velocity and quality experiments.
  • Product lifecycle management: Involve in the entire product lifecycle from conceptualization through production.
  • Multi-tasking and learning: Be able and willing to learn new technologies quickly.
  • Collaboration: Work with cross-functional teams to define, design, and ship new product features and experiences.

Requirements

  • Experience: 5+ years of full-time engineering experience post-graduation.
  • Technical Skills: Proficiencies in Python, Node, React, Next.js, and MongoDB.
  • Background: Solid understanding of algorithms, data structures, and object-oriented programming.
  • Experience with AI technologies: Excitement to work with AI technologies and scaling products at hyper-growth startups.
  • Communication: Strong written and verbal communication skills.
  • Problem-solving: Ability to work independently or as part of a team.

Nice to Haves

  • Software engineering best practices: Strong knowledge and experience.
  • AI platforms and technologies: Experience with generative models and LLMs.
  • ML infrastructure: Experience building ML infrastructure and AI-powered solutions.

Location

  • Workplace: Hybrid, with the ability to commute to the San Francisco office 1-2 times weekly.

Compensation

  • Salary Range: $160,000—$192,000 USD annually.
  • Equity: Eligible roles include equity-based compensation.

Benefits

  • Comprehensive health, dental, and vision coverage.
  • Retirement benefits.
  • Learning and development stipend.
  • Generous PTO.
  • Commuter stipend.

About Scale AI

At Scale, our mission is to accelerate the development of AI applications. We believe that to make the best models, you need the best data. Our Generative AI Platform leverages enterprise data to customize powerful base generative models, unlocking the value of AI safely. We are trusted by leading technology companies, government agencies, and enterprises worldwide.

Join us in transforming how organizations build and deploy AI, and be part of a team that is at the forefront of the AI race.

Benefits
Extracted with AI

  • Comprehensive health, dental and vision coverage
  • Retirement benefits
  • Learning and development stipend
  • Generous PTO
  • Commuter stipend

Similar jobs

Last update: 23 minutes ago

Scale AI logo
Scale AI

Senior Software Engineer, GenAI Safety & Evaluation

Senior Software Engineer role in AI safety and evaluation, requiring skills in AI, backend development, and system performance.

Scale AI logo
Scale AI

Senior Software Engineer, GenAI Model Evaluation

Join Scale AI as a Senior Software Engineer in GenAI Model Evaluation, focusing on AI model safety and performance.

Scale AI logo
Scale AI

Senior Software Engineer, Generative AI

Senior Software Engineer for Generative AI at Scale AI, focusing on backend development and AI technologies.

Scale AI logo
Scale AI

Senior Software Engineer, Generative AI

Senior Software Engineer role at Scale AI, focusing on Generative AI technologies, requiring skills in Python, Node.js, React, and more.

Scale AI logo
Scale AI

Software Engineer, GenAI Growth

Join Scale AI as a Software Engineer in GenAI Growth, focusing on AI applications and platform growth.

Scale AI logo
Scale AI

Software Engineer, GenAI Growth

Join Scale AI as a Software Engineer in GenAI Growth, developing AI applications with a dynamic team in NYC.

Scale AI logo
Scale AI

Fullstack Software Engineer, GenAI Growth

Join Scale AI as a Fullstack Software Engineer to build and optimize GenAI growth products.

Scale AI logo
Scale AI

Lead Software Engineer, Generative AI

Lead Software Engineer role at Scale AI, focusing on generative AI, requiring skills in Python, Next.js, and AI technologies.

Scale AI logo
Scale AI

Senior Software Engineer - Generative AI Operator

Senior Software Engineer for Generative AI, focusing on building advanced LLMs and generative models with technologies like MongoDB, React, and Node.js.

Scale AI logo
Scale AI

Senior Software Engineer - Frontend, Generative AI

Senior Software Engineer for Frontend in Generative AI at Scale AI, focusing on React.js, Node.js, and performance optimization.

Scale AI logo
Scale AI

Senior Fullstack Software Engineer, GenAI Horizontal Task Tooling

Join Scale AI as a Senior Fullstack Software Engineer to build web-based applications for AI data annotation.

Scale AI logo
Scale AI

Senior Fullstack Software Engineer, GenAI Allocation

Senior Fullstack Engineer role focusing on AI applications, requiring AWS, OOP, and problem-solving skills.

Scale AI logo
Scale AI

Senior Software Engineer, Machine Learning Infrastructure

Join Scale AI as a Senior Software Engineer in Machine Learning Infrastructure, focusing on backend system design and ML Infrastructure.

Scale AI logo
Scale AI

Fullstack Software Engineer, GenAI Quality

Fullstack Software Engineer role focusing on GenAI Quality, involving end-to-end feature development and system design.

Scale AI logo
Scale AI logo
Scale AI

Tech Lead, Software Engineer, GenAI Fraud

Join Scale AI as a Tech Lead, Software Engineer in GenAI Fraud, focusing on cutting-edge fraud prevention solutions.

Scale AI logo
Scale AI

Software Engineer - New Grad

Join Scale AI as a Software Engineer - New Grad in San Francisco. Work on AI applications with TypeScript, MongoDB, and more.

Scale AI logo
Scale AI

Fullstack Software Engineer, GenAI Growth

Fullstack Software Engineer role focusing on AI growth, requiring skills in back-end and front-end development, and system design.

Scale AI logo
Scale AI

Engineering Manager, Generative AI

Lead a team in Generative AI at Scale AI, focusing on engineering management and technical leadership.

Scale AI logo
Scale AI

Senior Prompt Engineer

Senior Prompt Engineer at Scale AI, specializing in LLM applications, data analysis, and AI model development.

Scale AI logo
Scale AI

Senior Fullstack Software Engineer, Pay & Incentives

Senior Fullstack Engineer role focusing on payment systems, requiring skills in both front-end and back-end development.

Scale AI logo
Scale AI

Machine Learning Engineer, Violations

Join Scale AI as a Machine Learning Engineer in San Francisco, focusing on violations and fraud detection using advanced AI.

Scale AI logo
Scale AI

Director of Contributor Growth

Lead contributor growth at Scale AI, driving Generative AI business with strategic leadership and operational excellence.

Scale AI logo
Scale AI

Machine Learning Research Engineer - New Grad

Join Scale AI as a Machine Learning Research Engineer - New Grad, focusing on AI, ML, and data science.