Job Description
Scale AI is seeking a Prompt Engineer to join our team in San Francisco, California. As a Prompt Engineer, you will be at the forefront of developing and optimizing AI models, particularly focusing on large language models (LLMs) and generative AI. You will work closely with our machine learning engineers and software developers to create innovative solutions that leverage AI to solve complex problems.
Responsibilities
- Develop LLM applications to evaluate data quality and solve synthetic data challenges.
- Identify and exploit vulnerabilities in LLMs and other generative AI models.
- Create training materials for red teaming and adversarial analysis; conduct training sessions with operational staff.
- Develop scripts in Python and TypeScript for data creation and vulnerability testing.
- Collaborate with ML Engineers and software engineers for robust implementation and deployment.
- Analyze and visualize experimental prompt results.
- Innovate and teach new prompt engineering methods to ML engineers and software engineering staff.
Requirements
- B.S. or higher in a quantitative field or one related to language models (e.g., linguistics, philosophy).
- Proficiency in Python or TypeScript for API-enabled scripts.
- Ability to analyze model performance using statistics and data visualization.
- Experience with frontier-scale LLMs (e.g., GPT, Claude, PaLM) for specific applications.
- Demonstrated experience in building LLM-based applications or hacking LLMs for novel purposes.
- Familiarity with LLM evaluation metrics (e.g., BLUE, ROUGE, MAUVE) and statistics.
- Strong written and verbal communication skills.
- A creative mindset to drive experimentation and internal R&D.
Nice to Haves
- Previous experience with AI/LLM development or red teaming.
- Academic work in language models, particularly on adversarial robustness.
- Experience with cloud technology stacks (e.g., AWS or GCP) and developing machine learning models in a cloud environment.
Compensation and Benefits
- Base salary range: $140,000—$210,000 USD.
- Equity-based compensation, subject to Board of Director approval.
- Comprehensive health, dental, and vision coverage.
- Retirement benefits.
- Learning and development stipend.
- Generous PTO.
- Commuter stipend.
Join us at Scale AI and be part of a team that is transforming how organizations build and deploy AI. We are committed to equal employment opportunity and providing reasonable accommodations to applicants with disabilities. If you need assistance, please contact us.
Scale AI is an affirmative action employer and an inclusive and equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability status, gender identity, or Veteran status.
Benefits Extracted with AI
- Comprehensive health, dental and vision coverage
- Retirement benefits
- Learning and development stipend
- Generous PTO
- Commuter stipend
Similar jobs
Last update: 23 minutes ago
Full Stack Developer with AI and API Expertise
Join Catalyze Group as a Full Stack Developer to build AI-powered grant-writing tools. Work with React, Django, and more in Amsterdam.
LLM Backend Developer
Join Persona as a LLM Backend Developer, work remotely, and develop AI-driven backend systems for top startups.
Senior Fullstack Developer for AI-Driven Mission Technologies
Seeking a Senior Fullstack Developer for AI-driven mission technologies, focusing on Java, JavaScript, Python, and C++. Remote work available.
Senior Full-Stack Engineer ReactJS/NodeJS
Join Gorgias as a Senior Full-Stack Engineer specializing in ReactJS and NodeJS, enhancing AI-powered ecommerce solutions.
Senior C++ Computer Vision Engineer
Join a cutting-edge AI-DeepTech startup in Berlin as a Senior C++ Computer Vision Engineer. Work on world-class on-device AI technology.
Senior Backend Engineer C++
Join DeepL as a Senior Backend Engineer C++ to design and maintain scalable backend services using C++ and AI technologies.
Back End Engineer with Node.js and TypeScript
Join LegalFly as a Back End Engineer to revolutionize legal AI with Node.js and TypeScript in a hybrid role in Ghent.
Expert Machine Learning Engineer
Join Dataroots as an Expert Machine Learning Engineer to design and deliver AI-powered solutions, focusing on machine learning models.
Lead Developer with DevOps and Functional Programming
Join Reaktor as a Lead Developer in Amsterdam, focusing on DevOps, Functional Programming, and JavaScript in a hybrid work environment.
AI Engineer
Join BCG X as an AI Engineer in Milan, Italy. Develop AI solutions, partner with clients, and drive innovation in a dynamic environment.
Staff Software Engineer
Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.
Cloud Engineer
Join Tibo Energy as a Cloud Engineer to drive energy transition with cloud architecture skills in a dynamic team.
Senior Quality Assurance Engineer with TypeScript and Automation
Join Simplicate as a Senior QA Engineer, focusing on TypeScript, automation, and quality assurance in a hybrid work environment.
Software Engineer - Cloud Applications and Python
Join Topicus as a Software Engineer in Arnhem to develop cloud applications using Python, REST APIs, and ETL processes for healthcare data services.
Cloud Data Engineer
Seeking a Cloud Data Engineer with expertise in AWS, Python, and CI/CD for a hybrid role in Hannover. Join our dynamic team!
Senior Backend Engineer - Payments
Join Instapro Group as a Senior Backend Engineer in Berlin, focusing on PHP and payment systems in a hybrid work environment.
Solutions Engineer
Join Darktrace as a Solutions Engineer in Amsterdam, providing technical pre-sales and post-sales support in a hybrid work environment.
Senior Backend Engineer - PHP, Symfony, Laravel
Join Instapro Group as a Senior Backend Engineer, working with PHP, Symfony, and Laravel in a hybrid environment.
Senior Full Stack Engineer - Climate Tech - Rust & TypeScript
Join Climatiq as a Senior Full Stack Engineer to develop climate tech solutions using Rust and TypeScript. Remote work available.
Entry Level Back-End Software Engineer (Java)
Join Grammarly as an Entry Level Back-End Software Engineer in Berlin. Work with Java, AWS, and more in a hybrid environment.
Senior Full-Stack Engineer - TypeScript, React, Node.js
Join us as a Senior Full-Stack Engineer to develop a super app for medical professionals using TypeScript, React, and Node.js.
Senior Backend/Data Engineer
Join Zalando as a Senior Backend/Data Engineer in Berlin to enhance our audience-building platform using AWS, Java, Scala, and SQL.
Full Stack Engineer with Node.js and React
Join RightCrowd as a Full Stack Engineer to develop cloud-native applications using Node.js and React. Work remotely with cutting-edge technology.
Senior Mobile Platform Engineer
Join Pleo as a Senior Mobile Platform Engineer to empower product teams in building and maintaining mobile app features with React Native and TypeScript.
