Job Description
Scale AI is seeking a Prompt Engineer to join our team in San Francisco, California. As a Prompt Engineer, you will be at the forefront of developing and optimizing AI models, particularly focusing on large language models (LLMs) and generative AI. You will work closely with our machine learning engineers and software developers to create innovative solutions that leverage AI to solve complex problems.
Responsibilities
- Develop LLM applications to evaluate data quality and solve synthetic data challenges.
- Identify and exploit vulnerabilities in LLMs and other generative AI models.
- Create training materials for red teaming and adversarial analysis; conduct training sessions with operational staff.
- Develop scripts in Python and TypeScript for data creation and vulnerability testing.
- Collaborate with ML Engineers and software engineers for robust implementation and deployment.
- Analyze and visualize experimental prompt results.
- Innovate and teach new prompt engineering methods to ML engineers and software engineering staff.
Requirements
- B.S. or higher in a quantitative field or one related to language models (e.g., linguistics, philosophy).
- Proficiency in Python or TypeScript for API-enabled scripts.
- Ability to analyze model performance using statistics and data visualization.
- Experience with frontier-scale LLMs (e.g., GPT, Claude, PaLM) for specific applications.
- Demonstrated experience in building LLM-based applications or hacking LLMs for novel purposes.
- Familiarity with LLM evaluation metrics (e.g., BLUE, ROUGE, MAUVE) and statistics.
- Strong written and verbal communication skills.
- A creative mindset to drive experimentation and internal R&D.
Nice to Haves
- Previous experience with AI/LLM development or red teaming.
- Academic work in language models, particularly on adversarial robustness.
- Experience with cloud technology stacks (e.g., AWS or GCP) and developing machine learning models in a cloud environment.
Compensation and Benefits
- Base salary range: $140,000—$210,000 USD.
- Equity-based compensation, subject to Board of Director approval.
- Comprehensive health, dental, and vision coverage.
- Retirement benefits.
- Learning and development stipend.
- Generous PTO.
- Commuter stipend.
Join us at Scale AI and be part of a team that is transforming how organizations build and deploy AI. We are committed to equal employment opportunity and providing reasonable accommodations to applicants with disabilities. If you need assistance, please contact us.
Scale AI is an affirmative action employer and an inclusive and equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability status, gender identity, or Veteran status.
Benefits Extracted with AI
- Comprehensive health, dental and vision coverage
- Retirement benefits
- Learning and development stipend
- Generous PTO
- Commuter stipend
Similar jobs
Last update: 23 minutes ago
Senior Prompt Engineer
Senior Prompt Engineer at Scale AI, specializing in LLM applications, data analysis, and AI model development.
Senior Prompt Engineer
Join Accrete AI as a Senior Prompt Engineer to design and optimize prompts for AI agents, enhancing NLP applications.
Manager, Machine Learning Research Engineer, Generative AI
Lead a team in developing generative AI models at Scale AI, focusing on LLMs and MLOps.
Contributor Engagement Lead, Generative AI
Lead initiatives in Generative AI, manage communications, and drive strategy at Scale AI in San Francisco. Experience with AI and LLMs preferred.
Prompt Engineering Lead
Lead prompt engineering at Glean, working with AI and LLMs to enhance customer solutions.
Lead Software Engineer, Generative AI
Lead Software Engineer role at Scale AI, focusing on generative AI, requiring skills in Python, Next.js, and AI technologies.
Senior Software Engineer, Generative AI
Senior Software Engineer role at Scale AI, focusing on Generative AI technologies, requiring skills in Python, Node.js, React, and more.
Associate Product Manager, Generative AI
Join Scale AI as an Associate Product Manager in San Francisco, focusing on Generative AI. Lead initiatives, define requirements, and drive product launches.
Staff AI Product Manager, Generative AI
Join Scale AI as a Staff AI Product Manager to lead the development of ML-powered products in a hybrid role in San Francisco.
Senior Software Engineer, Generative AI
Senior Software Engineer for Generative AI at Scale AI, focusing on backend development and AI technologies.
Senior Software Engineer, Machine Learning Infrastructure
Join Scale AI as a Senior Software Engineer in Machine Learning Infrastructure, focusing on backend system design and ML Infrastructure.
Senior Software Engineer, GenAI Safety & Evaluation
Join Scale AI as a Senior Software Engineer in GenAI Safety & Evaluation, shaping AI model evaluation.
Software Engineer, GenAI Growth
Join Scale AI as a Software Engineer in GenAI Growth, focusing on AI applications and platform growth.
Customer Engineer, Enterprise - Scale AI
Join Scale AI as a Customer Engineer in Seattle, enhancing AI applications with leading tech companies. Skills in CSS, GCP, Azure, TypeScript.
Fullstack Software Engineer, GenAI Growth
Join Scale AI as a Fullstack Software Engineer to build and optimize GenAI growth products.
Engineering Manager, Generative AI
Lead a team in Generative AI at Scale AI, focusing on engineering management and technical leadership.
Senior Software Engineer - Generative AI Operator
Senior Software Engineer for Generative AI, focusing on building advanced LLMs and generative models with technologies like MongoDB, React, and Node.js.
Senior AI Prompt Engineer
Join Spotter as a Senior AI Prompt Engineer to enhance next-gen creator tools using AI. Work on cutting-edge projects in a hybrid setting.
Software Engineer, GenAI Growth
Join Scale AI as a Software Engineer in GenAI Growth, developing AI applications with a dynamic team in NYC.
Director of Contributor Growth
Lead contributor growth at Scale AI, driving Generative AI business with strategic leadership and operational excellence.
Senior Software Engineer, GenAI Safety & Evaluation
Senior Software Engineer role in AI safety and evaluation, requiring skills in AI, backend development, and system performance.
AI Product Manager, Generative AI
Join Scale AI as an AI Product Manager to lead ML-assisted tooling and data quality platforms in a hybrid role.
Software Engineer - New Grad
Join Scale AI as a Software Engineer - New Grad in San Francisco. Work on AI applications with TypeScript, MongoDB, and more.
Director of Contributor Growth - Generative AI
Lead the growth of contributor workforce in Generative AI, driving strategies and operational excellence at Scale AI.
