Senior Prompt Engineer
Scale AIAbout the Role
As a Senior Prompt Engineer at Scale AI, you will be at the forefront of developing and implementing advanced LLM applications. Your main responsibilities will include evaluating data quality, solving complex problems related to synthetic data capabilities, and executing robust business solutions. You will also be involved in 'jailbreaking' and finding vulnerabilities in LLMs and other generative AI models, developing training materials for red teaming and adversarial analysis, and conducting training with operational staff.
Responsibilities
- Develop LLM applications to evaluate data quality and solve complex problems.
- 'Jailbreak' and find vulnerabilities in LLMs and other generative AI models.
- Develop training materials for red teaming and adversarial analysis.
- Conduct training with operational staff.
- Develop data creation and vulnerability testing scripts in Python/TypeScript.
- Work with ML Engineers and software engineers for robust implementation and in-platform deployment.
- Analyze and visualize experimental prompt results.
- Develop and teach new prompt engineering methods to ML engineers and software engineering staff.
Qualifications
- B.S. or higher in a quantitative major or one related to language models (linguistics, philosophy, etc.).
- Proficiency writing Python or TypeScript for API-enabled scripts.
- Ability to conduct analysis of model performance via statistics and data visualization.
- Experience using frontier-scale LLMs (GPT, Claude, PaLM) programmatically towards specific applications or implementations.
- Demonstrated ability to have built an LLM-based application or hacking an LLM to serve some novel purpose.
- Familiarity with LLM evaluation metrics (BLUE, ROUGE, MAUVE, etc.) and statistics.
Nice to Haves
- Previous experience with AI/LLM developmental work or red teaming a strong plus.
- Academic work in language models, particularly on adversarial robustness.
- Previous disclosures of vulnerabilities or security issues in LLMs or other AI models.
- Experience working with cloud technology stack (e.g., AWS or GCP) and developing machine learning models in a cloud environment.
Compensation and Benefits
Compensation packages at Scale for eligible roles include base salary, equity, and benefits. The salary range for this full-time position in locations like San Francisco, New York, Seattle is $140,000 — $210,000 USD. Scale employees in eligible roles are also granted equity-based compensation, subject to Board of Director approval. Additionally, this role may be eligible for additional benefits such as a commuter stipend.
Benefits Extracted with AI
- Comprehensive health, dental, and vision coverage
- Retirement benefits
- Learning and development stipend
- Generous PTO
- Commuter stipend
Similar jobs
Last update: 23 minutes ago
Senior Fullstack Software Engineer, GenAI Horizontal Task Tooling
Join Scale AI as a Senior Fullstack Software Engineer to build web-based applications for AI data annotation.
Senior Prompt Engineer
Join Accrete AI as a Senior Prompt Engineer to design and optimize prompts for AI agents, enhancing NLP applications.
Staff AI Product Manager, Generative AI
Join Scale AI as a Staff AI Product Manager to lead the development of ML-powered products in a hybrid role in San Francisco.
Software Engineer - New Grad
Join Scale AI as a Software Engineer - New Grad in San Francisco. Work on AI applications with TypeScript, MongoDB, and more.
Associate Product Manager - New Grad
Join Scale AI as an Associate Product Manager - New Grad to lead product initiatives and drive AI innovation.
Software Engineering Intern (Summer 2025)
Join Scale AI as a Software Engineering Intern for Summer 2025, working on AI applications with Python, TypeScript, and MongoDB.
Senior ML Infrastructure Engineer
Join CHAI: AI Platform as a Senior ML Infrastructure Engineer to build and scale ML systems in Palo Alto.
AI Product Manager, Generative AI
Join Scale AI as an AI Product Manager to lead ML-assisted tooling and data quality platforms in a hybrid role.
Generative AI Intern
Join Presto Automation as a Generative AI Intern to work on cutting-edge AI technologies and enhance restaurant drive-thru experiences.
Senior Full-stack Engineer
Join Cascading AI as a Senior Full-stack Engineer to develop AI-driven lending solutions in San Francisco.
Senior Applied AI Researcher
Join CHAI: AI Platform as a Senior Applied AI Researcher to optimize and innovate AI solutions in a high-growth environment.
Founding Applied AI Engineer
Join Argon AI as a Founding Applied AI Engineer to lead AI initiatives in pharma, focusing on domain-specific AI and RAG systems.
Senior Applied Scientist, AWS Marketing AI/ML
Join AWS as a Senior Applied Scientist in Marketing AI/ML, leading personalization and targeting initiatives.
Senior Software Engineer, Backend
Join Standard AI as a Senior Backend Engineer to design scalable microservices and APIs. Remote role with competitive salary and benefits.
Senior Software Engineer, AI
Join Lattice as a Senior Software Engineer, AI, focusing on AI/ML technologies and large language models.
Senior AI Engineer - Backend
Join Keboola as a Senior AI Engineer to enhance AI features, develop models, and collaborate on innovative projects in Prague.
Prompt Engineer with Python and TypeScript
Join Scale AI as a Prompt Engineer in San Francisco, focusing on LLMs and generative AI with Python and TypeScript.
AI Solutions Software Engineer
Join DwellFi as an AI Solutions Software Engineer to develop innovative AI solutions using LangChain or Llama.
AI Framework Engineer
Join webAI as an AI Framework Engineer to develop innovative AI frameworks for distributed computing environments.
Senior Machine Learning Engineer
Join Intuit as a Senior Machine Learning Engineer to innovate and scale AI algorithms in San Diego.
Research Engineer, Language - Generative AI
Join Meta as a Research Engineer in Generative AI, focusing on large language models and NLP.
Senior AI Engineer
Join Zep AI as a Senior AI Engineer to lead LLM-based AI solutions development in a hybrid work environment.
Founding AI Engineer
Join LlamaIndex as a Founding AI Engineer to shape the future of LLM applications with cutting-edge AI projects.
Founding Applied AI Engineer
Join LlamaIndex as a Founding Applied AI Engineer to build and deploy LLM applications. Competitive salary and equity offered.