Scale AI logo

Senior Software Engineer, GenAI Model Evaluation

Scale AI

Job Overview

Join Scale AI as a Senior Software Engineer in the GenAI Model Evaluation team. This role is pivotal in building a world-class customer-facing model evaluation platform. You will work closely with researchers and the expert red team to ensure AI models are safe, aligned, and highly useful. This position offers a unique opportunity to shape the evaluation of AI models across the industry, impacting billions of people worldwide.

Key Responsibilities

  • Own Product Areas: Deliver customer-ready features with engineering excellence.
  • Full-Stack Development: Work across backend, frontend, and interact with LLMs and other ML models.
  • Product Lifecycle: Engage from conceptualization through production.
  • Cross-Functional Collaboration: Define, design, and ship new product features and experiences.
  • Fast-Paced Environment: Be ready to jump in on fast-turnaround product requests for high-value customers.

Ideal Candidate

  • Experience: 5+ years of full-time engineering experience.
  • Technical Skills: Proficiencies in Python, Node, React, Next.js, and MongoDB.
  • Problem Solving: Strong skills in algorithms, data structures, and object-oriented programming.
  • AI Enthusiasm: Excitement to work with AI technologies.
  • Communication: Strong written and verbal skills.

Nice to Have

  • AI Platforms: Experience with AI platforms and technologies, including generative models and LLMs.
  • ML Infrastructure: Experience building ML infrastructure and AI-powered solutions.
  • Product Development: Experience growing new products from 0 to 1.

Compensation and Benefits

  • Salary Range: $160,000—$225,000 USD
  • Equity: Eligible roles include equity-based compensation.
  • Benefits: Comprehensive health, dental, and vision coverage, retirement benefits, learning and development stipend, generous PTO, and a commuter stipend.

About Scale AI

Scale AI is at the forefront of AI development, providing the data and tools necessary to build the most advanced AI models. Trusted by leading tech companies, government agencies, and enterprises, Scale AI is committed to accelerating the development of AI applications.

Location

This position is based in the San Francisco Bay Area and offers a hybrid work environment, allowing for both on-site and off-site work.

Benefits
Extracted with AI

  • Comprehensive health, dental and vision coverage
  • Retirement benefits
  • Learning and development stipend
  • Generous PTO
  • Commuter stipend

Similar jobs

Last update: 23 minutes ago

Meta logo
Meta

Software Engineer, Generative AI

Join Meta as a Software Engineer in Generative AI, focusing on NLP and large language models. Work with a global team to innovate AI products.

Meta logo
Meta

Software Engineer, Generative AI

Join Meta as a Software Engineer in Generative AI, focusing on NLP and large language models.

Scale AI logo
Scale AI

Senior Fullstack Software Engineer, GenAI Horizontal Task Tooling

Join Scale AI as a Senior Fullstack Software Engineer to build web-based applications for AI data annotation.

Amazon logo
Amazon

Senior Software Engineer - Generative AI

Join Amazon as a Senior Software Engineer in Generative AI, focusing on high-performance inference capabilities.

Meta logo
Meta

Software Engineer, Language - Generative AI

Join Meta as a Software Engineer in Generative AI, focusing on Large Language Models and NLP.

Meta logo
Meta

Software Engineer, Language - Generative AI

Join Meta as a Software Engineer in Generative AI, focusing on NLP and large language models. Competitive salary and benefits.

OpenAI logo
OpenAI

Software Engineer, Applied Engineering

Join OpenAI as a Software Engineer in Applied Engineering to develop innovative AI products using JavaScript, React, and Python.

Meta logo
Meta

Software Engineer, Language - Generative AI

Join Meta as a Software Engineer in Generative AI, focusing on NLP and large language models.

Google logo
Google

Software Engineer, Mobile (Android), GenAI

Join Google as a Software Engineer for Android development in GenAI, focusing on innovative AI tools for YouTube.

Amazon logo
Amazon

Senior Software Engineer - Generative AI, AGI Inference Engine

Join Amazon as a Senior Software Engineer to advance Generative AI capabilities, focusing on high-performance inference.

Adobe logo
Adobe

Senior Generative AI/Machine Learning Engineer and Data Scientist

Join Adobe as a Senior Generative AI/Machine Learning Engineer and Data Scientist to innovate with AI models.

Alibaba Group logo
Alibaba Group

Generative AI Engineer

Join Alibaba Group as a Generative AI Engineer to develop cutting-edge AI search products using LLM technology.

Clay logo
Clay

Senior Software Engineer, AI

Join Clay as a Senior Software Engineer, AI, to develop cutting-edge LLM applications in a hybrid work environment.

Labelbox logo
Labelbox

Software Engineer, Early Professional

Join Labelbox as a Software Engineer to develop AI systems, collaborate in a hybrid model, and grow in a fast-paced environment.

Keysight Technologies logo
Keysight Technologies

Machine Learning/AI Engineer

Join Keysight Technologies as a Machine Learning/AI Engineer to develop and optimize AI/ML models for EDA applications.

OpenAI logo
OpenAI

Software Engineer, Developer Productivity

Join OpenAI as a Software Engineer focused on Developer Productivity, enhancing development cycles with Python, Rust, and Kubernetes.

Scale AI logo
Scale AI

Machine Learning Research Engineer - New Grad

Join Scale AI as a Machine Learning Research Engineer - New Grad, focusing on AI, ML, and data science.

Alibaba Group logo
Alibaba Group

AI Engineer

Join Alibaba Group as an AI Engineer to develop groundbreaking AI search products using LLM technology.

Resolve AI logo
Resolve AI

AI Engineer with LLM Expertise

Join Resolve AI as an AI Engineer in San Francisco to build AI-powered workflows with LLM expertise.

Relyance AI logo
Relyance AI

Senior Software Engineer, Static Code Analysis

Join Relyance AI as a Senior Software Engineer in Static Code Analysis, focusing on microservices and machine learning.

OpenAI logo
OpenAI

Senior Android Engineer, ChatGPT Core Experiences

Join OpenAI as a Senior Android Engineer to innovate and evolve ChatGPT's Android client, focusing on performance and AI-driven features.

Coactive AI logo
Coactive AI

Senior Full Stack Engineer - AI Applications

Join Coactive AI as a Senior Full Stack Engineer to develop AI-driven solutions using React, TypeScript, and FastAPI.

Amazon logo
Amazon

Senior Software Development Engineer, Applied AI

Join Amazon's Applied AI team as a Senior Software Development Engineer to innovate with AI technologies.

Voltai logo
Voltai

Software Engineer - AI Training Data

Join Voltai as a Software Engineer to build and optimize AI training data systems, focusing on semiconductor datasets.