Job Description
Scale AI is seeking a Prompt Engineer to join our team in San Francisco, California. As a Prompt Engineer, you will be at the forefront of developing and optimizing AI models, particularly focusing on large language models (LLMs) and generative AI. You will work closely with our machine learning engineers and software developers to create innovative solutions that leverage AI to solve complex problems.
Responsibilities
- Develop LLM applications to evaluate data quality and solve synthetic data challenges.
- Identify and exploit vulnerabilities in LLMs and other generative AI models.
- Create training materials for red teaming and adversarial analysis; conduct training sessions with operational staff.
- Develop scripts in Python and TypeScript for data creation and vulnerability testing.
- Collaborate with ML Engineers and software engineers for robust implementation and deployment.
- Analyze and visualize experimental prompt results.
- Innovate and teach new prompt engineering methods to ML engineers and software engineering staff.
Requirements
- B.S. or higher in a quantitative field or one related to language models (e.g., linguistics, philosophy).
- Proficiency in Python or TypeScript for API-enabled scripts.
- Ability to analyze model performance using statistics and data visualization.
- Experience with frontier-scale LLMs (e.g., GPT, Claude, PaLM) for specific applications.
- Demonstrated experience in building LLM-based applications or hacking LLMs for novel purposes.
- Familiarity with LLM evaluation metrics (e.g., BLUE, ROUGE, MAUVE) and statistics.
- Strong written and verbal communication skills.
- A creative mindset to drive experimentation and internal R&D.
Nice to Haves
- Previous experience with AI/LLM development or red teaming.
- Academic work in language models, particularly on adversarial robustness.
- Experience with cloud technology stacks (e.g., AWS or GCP) and developing machine learning models in a cloud environment.
Compensation and Benefits
- Base salary range: $140,000—$210,000 USD.
- Equity-based compensation, subject to Board of Director approval.
- Comprehensive health, dental, and vision coverage.
- Retirement benefits.
- Learning and development stipend.
- Generous PTO.
- Commuter stipend.
Join us at Scale AI and be part of a team that is transforming how organizations build and deploy AI. We are committed to equal employment opportunity and providing reasonable accommodations to applicants with disabilities. If you need assistance, please contact us.
Scale AI is an affirmative action employer and an inclusive and equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability status, gender identity, or Veteran status.
Benefits Extracted with AI
- Comprehensive health, dental and vision coverage
- Retirement benefits
- Learning and development stipend
- Generous PTO
- Commuter stipend
Similar jobs
Last update: 23 minutes ago
Senior Prompt Engineer
Senior Prompt Engineer at Scale AI, specializing in LLM applications, data analysis, and AI model development.
Senior Prompt Engineer
Join Accrete AI as a Senior Prompt Engineer to design and optimize prompts for AI agents, enhancing NLP applications.
Prompt Engineering Lead
Lead prompt engineering at Glean, working with AI and LLMs to enhance customer solutions.
Manager, Machine Learning Research Engineer, Generative AI
Lead a team in developing generative AI models at Scale AI, focusing on LLMs and MLOps.
Contributor Engagement Lead, Generative AI
Lead initiatives in Generative AI, manage communications, and drive strategy at Scale AI in San Francisco. Experience with AI and LLMs preferred.
Python Backend Developer / MLOps Engineer
Join Prompt Therapy Solutions as a Python Backend Developer / MLOps Engineer to enhance AI infrastructure and backend systems remotely.
Lead Software Engineer, Generative AI
Lead Software Engineer role at Scale AI, focusing on generative AI, requiring skills in Python, Next.js, and AI technologies.
LLM Backend Developer
Join Persona as a LLM Backend Developer, work remotely, and develop AI-driven backend systems for top startups.
Staff AI Product Manager, Generative AI
Join Scale AI as a Staff AI Product Manager to lead the development of ML-powered products in a hybrid role in San Francisco.
Senior Software Engineer, Generative AI
Senior Software Engineer role at Scale AI, focusing on Generative AI technologies, requiring skills in Python, Node.js, React, and more.
Associate Product Manager, Generative AI
Join Scale AI as an Associate Product Manager in San Francisco, focusing on Generative AI. Lead initiatives, define requirements, and drive product launches.
Full Stack Developer with AI and API Expertise
Join Catalyze Group as a Full Stack Developer to build AI-powered grant-writing tools. Work with React, Django, and more in Amsterdam.
Senior Software Engineer, Generative AI
Senior Software Engineer for Generative AI at Scale AI, focusing on backend development and AI technologies.
Senior Full Stack Engineer, LLM APIs
Join Abridge as a Senior Full Stack Engineer to build innovative ML-powered solutions in healthcare AI, focusing on LLM APIs and cloud services.
Senior Software Engineer, Machine Learning Infrastructure
Join Scale AI as a Senior Software Engineer in Machine Learning Infrastructure, focusing on backend system design and ML Infrastructure.
Senior Software Engineer, GenAI Safety & Evaluation
Join Scale AI as a Senior Software Engineer in GenAI Safety & Evaluation, shaping AI model evaluation.
Software Engineer, GenAI Growth
Join Scale AI as a Software Engineer in GenAI Growth, focusing on AI applications and platform growth.
Customer Engineer, Enterprise - Scale AI
Join Scale AI as a Customer Engineer in Seattle, enhancing AI applications with leading tech companies. Skills in CSS, GCP, Azure, TypeScript.
Fullstack Software Engineer, GenAI Growth
Join Scale AI as a Fullstack Software Engineer to build and optimize GenAI growth products.
Senior Generative AI/Machine Learning Engineer and Data Scientist
Join Adobe as a Senior Generative AI/Machine Learning Engineer and Data Scientist to innovate with AI models.
Engineering Manager, Generative AI
Lead a team in Generative AI at Scale AI, focusing on engineering management and technical leadership.
Senior Software Engineer - Generative AI Operator
Senior Software Engineer for Generative AI, focusing on building advanced LLMs and generative models with technologies like MongoDB, React, and Node.js.
Senior Backend Engineer C++
Join DeepL as a Senior Backend Engineer C++ to design and maintain scalable backend services using C++ and AI technologies.
Senior AI Prompt Engineer
Join Spotter as a Senior AI Prompt Engineer to enhance next-gen creator tools using AI. Work on cutting-edge projects in a hybrid setting.
