Scale AI logo

Senior Software Engineer, GenAI Model Evaluation

Scale AI

Job Overview

Join Scale AI as a Senior Software Engineer in the GenAI Model Evaluation team. This role is pivotal in building a world-class customer-facing model evaluation platform. You will work closely with researchers and the expert red team to ensure AI models are safe, aligned, and highly useful. This position offers a unique opportunity to shape the evaluation of AI models across the industry, impacting billions of people worldwide.

Key Responsibilities

  • Own Product Areas: Deliver customer-ready features with engineering excellence.
  • Full-Stack Development: Work across backend, frontend, and interact with LLMs and other ML models.
  • Product Lifecycle: Engage from conceptualization through production.
  • Cross-Functional Collaboration: Define, design, and ship new product features and experiences.
  • Fast-Paced Environment: Be ready to jump in on fast-turnaround product requests for high-value customers.

Ideal Candidate

  • Experience: 5+ years of full-time engineering experience.
  • Technical Skills: Proficiencies in Python, Node, React, Next.js, and MongoDB.
  • Problem Solving: Strong skills in algorithms, data structures, and object-oriented programming.
  • AI Enthusiasm: Excitement to work with AI technologies.
  • Communication: Strong written and verbal skills.

Nice to Have

  • AI Platforms: Experience with AI platforms and technologies, including generative models and LLMs.
  • ML Infrastructure: Experience building ML infrastructure and AI-powered solutions.
  • Product Development: Experience growing new products from 0 to 1.

Compensation and Benefits

  • Salary Range: $160,000—$225,000 USD
  • Equity: Eligible roles include equity-based compensation.
  • Benefits: Comprehensive health, dental, and vision coverage, retirement benefits, learning and development stipend, generous PTO, and a commuter stipend.

About Scale AI

Scale AI is at the forefront of AI development, providing the data and tools necessary to build the most advanced AI models. Trusted by leading tech companies, government agencies, and enterprises, Scale AI is committed to accelerating the development of AI applications.

Location

This position is based in the San Francisco Bay Area and offers a hybrid work environment, allowing for both on-site and off-site work.

Benefits
Extracted with AI

  • Comprehensive health, dental and vision coverage
  • Retirement benefits
  • Learning and development stipend
  • Generous PTO
  • Commuter stipend

Similar jobs

Last update: 23 minutes ago

Scale AI logo
Scale AI

Senior Software Engineer, GenAI Safety & Evaluation

Join Scale AI as a Senior Software Engineer in GenAI Safety & Evaluation, shaping AI model evaluation.

Scale AI logo
Scale AI

Senior Software Engineer, GenAI Safety & Evaluation

Senior Software Engineer role in AI safety and evaluation, requiring skills in AI, backend development, and system performance.

Scale AI logo
Scale AI

Software Engineer, GenAI Growth

Join Scale AI as a Software Engineer in GenAI Growth, focusing on AI applications and platform growth.

Scale AI logo
Scale AI

Senior Software Engineer, Generative AI

Senior Software Engineer for Generative AI at Scale AI, focusing on backend development and AI technologies.

Scale AI logo
Scale AI

Software Engineer, GenAI Growth

Join Scale AI as a Software Engineer in GenAI Growth, developing AI applications with a dynamic team in NYC.

Scale AI logo
Scale AI

Senior Software Engineer, Generative AI

Senior Software Engineer role at Scale AI, focusing on Generative AI technologies, requiring skills in Python, Node.js, React, and more.

Scale AI logo
Scale AI

Fullstack Software Engineer, GenAI Growth

Join Scale AI as a Fullstack Software Engineer to build and optimize GenAI growth products.

Scale AI logo
Scale AI

Senior Fullstack Software Engineer, GenAI Horizontal Task Tooling

Join Scale AI as a Senior Fullstack Software Engineer to build web-based applications for AI data annotation.

Scale AI logo
Scale AI

Senior Fullstack Software Engineer, GenAI Allocation

Senior Fullstack Engineer role focusing on AI applications, requiring AWS, OOP, and problem-solving skills.

Scale AI logo
Scale AI

Lead Software Engineer, Generative AI

Lead Software Engineer role at Scale AI, focusing on generative AI, requiring skills in Python, Next.js, and AI technologies.

Scale AI logo
Scale AI

Senior Software Engineer, Machine Learning Infrastructure

Join Scale AI as a Senior Software Engineer in Machine Learning Infrastructure, focusing on backend system design and ML Infrastructure.

Scale AI logo
Scale AI

Senior Software Engineer - Generative AI Operator

Senior Software Engineer for Generative AI, focusing on building advanced LLMs and generative models with technologies like MongoDB, React, and Node.js.

Scale AI logo
Scale AI logo
Scale AI

Fullstack Software Engineer, GenAI Quality

Fullstack Software Engineer role focusing on GenAI Quality, involving end-to-end feature development and system design.

Scale AI logo
Scale AI

Senior Software Engineer - Frontend, Generative AI

Senior Software Engineer for Frontend in Generative AI at Scale AI, focusing on React.js, Node.js, and performance optimization.

Scale AI logo
Scale AI

Software Engineer - New Grad

Join Scale AI as a Software Engineer - New Grad in San Francisco. Work on AI applications with TypeScript, MongoDB, and more.

Scale AI logo
Scale AI

Tech Lead, Software Engineer, GenAI Fraud

Join Scale AI as a Tech Lead, Software Engineer in GenAI Fraud, focusing on cutting-edge fraud prevention solutions.

Scale AI logo
Scale AI

Machine Learning Engineer, Violations

Join Scale AI as a Machine Learning Engineer in San Francisco, focusing on violations and fraud detection using advanced AI.

Scale AI logo
Scale AI

Fullstack Software Engineer, GenAI Growth

Fullstack Software Engineer role focusing on AI growth, requiring skills in back-end and front-end development, and system design.

Scale AI logo
Scale AI

Engineering Manager, Generative AI

Lead a team in Generative AI at Scale AI, focusing on engineering management and technical leadership.

Scale AI logo
Scale AI

Senior Prompt Engineer

Senior Prompt Engineer at Scale AI, specializing in LLM applications, data analysis, and AI model development.

Scale AI logo
Scale AI

Senior Fullstack Software Engineer, Pay & Incentives

Senior Fullstack Engineer role focusing on payment systems, requiring skills in both front-end and back-end development.

Scale AI logo
Scale AI

Machine Learning Research Engineer - New Grad

Join Scale AI as a Machine Learning Research Engineer - New Grad, focusing on AI, ML, and data science.

Scale AI logo
Scale AI

Director of Contributor Growth

Lead contributor growth at Scale AI, driving Generative AI business with strategic leadership and operational excellence.