Prompt Engineer with Python and TypeScript
Scale AIJob Description
Scale AI is seeking a Prompt Engineer to join our team in San Francisco, California. As a Prompt Engineer, you will be at the forefront of developing and optimizing AI models, particularly focusing on large language models (LLMs) and generative AI. You will work closely with our machine learning engineers and software developers to create innovative solutions that leverage AI to solve complex problems.
Responsibilities
- Develop LLM applications to evaluate data quality and solve synthetic data challenges.
- Identify and exploit vulnerabilities in LLMs and other generative AI models.
- Create training materials for red teaming and adversarial analysis; conduct training sessions with operational staff.
- Develop scripts in Python and TypeScript for data creation and vulnerability testing.
- Collaborate with ML Engineers and software engineers for robust implementation and deployment.
- Analyze and visualize experimental prompt results.
- Innovate and teach new prompt engineering methods to ML engineers and software engineering staff.
Requirements
- B.S. or higher in a quantitative field or one related to language models (e.g., linguistics, philosophy).
- Proficiency in Python or TypeScript for API-enabled scripts.
- Ability to analyze model performance using statistics and data visualization.
- Experience with frontier-scale LLMs (e.g., GPT, Claude, PaLM) for specific applications.
- Demonstrated experience in building LLM-based applications or hacking LLMs for novel purposes.
- Familiarity with LLM evaluation metrics (e.g., BLUE, ROUGE, MAUVE) and statistics.
- Strong written and verbal communication skills.
- A creative mindset to drive experimentation and internal R&D.
Nice to Haves
- Previous experience with AI/LLM development or red teaming.
- Academic work in language models, particularly on adversarial robustness.
- Experience with cloud technology stacks (e.g., AWS or GCP) and developing machine learning models in a cloud environment.
Compensation and Benefits
- Base salary range: $140,000—$210,000 USD.
- Equity-based compensation, subject to Board of Director approval.
- Comprehensive health, dental, and vision coverage.
- Retirement benefits.
- Learning and development stipend.
- Generous PTO.
- Commuter stipend.
Join us at Scale AI and be part of a team that is transforming how organizations build and deploy AI. We are committed to equal employment opportunity and providing reasonable accommodations to applicants with disabilities. If you need assistance, please contact us.
Scale AI is an affirmative action employer and an inclusive and equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability status, gender identity, or Veteran status.
Benefits Extracted with AI
- Comprehensive health, dental and vision coverage
- Retirement benefits
- Learning and development stipend
- Generous PTO
- Commuter stipend
Similar jobs
Last update: 23 minutes ago
Senior Prompt Engineer
Join Accrete AI as a Senior Prompt Engineer to design and optimize prompts for AI agents, enhancing NLP applications.
Generative AI Intern
Join Presto Automation as a Generative AI Intern to work on cutting-edge AI technologies and enhance restaurant drive-thru experiences.
Senior Fullstack Software Engineer, GenAI Horizontal Task Tooling
Join Scale AI as a Senior Fullstack Software Engineer to build web-based applications for AI data annotation.
Staff AI Product Manager, Generative AI
Join Scale AI as a Staff AI Product Manager to lead the development of ML-powered products in a hybrid role in San Francisco.
Senior ML Infrastructure Engineer
Join CHAI: AI Platform as a Senior ML Infrastructure Engineer to build and scale ML systems in Palo Alto.
Software Engineer - New Grad
Join Scale AI as a Software Engineer - New Grad in San Francisco. Work on AI applications with TypeScript, MongoDB, and more.
Software Engineering Intern (Summer 2025)
Join Scale AI as a Software Engineering Intern for Summer 2025, working on AI applications with Python, TypeScript, and MongoDB.
Research Engineer, Language - Generative AI
Join Meta as a Research Engineer in Generative AI, focusing on large language models and NLP.
AI Solutions Software Engineer
Join DwellFi as an AI Solutions Software Engineer to develop innovative AI solutions using LangChain or Llama.
Machine Learning Engineer with AI/ML Experience
Join us as a Machine Learning Engineer to develop AI/ML models and applications. Work remotely with top-tier companies.
AI Product Manager, Generative AI
Join Scale AI as an AI Product Manager to lead ML-assisted tooling and data quality platforms in a hybrid role.
Machine Learning Engineer
Join Ema Unlimited as a Machine Learning Engineer in SF Bay Area, working on cutting-edge AI solutions with a focus on NLP and ML technologies.
Senior Machine Learning Engineer
Join Intuit as a Senior Machine Learning Engineer to innovate and scale AI algorithms in San Diego.
Software Engineer, ChatGPT Enterprise
Join OpenAI as a Software Engineer for ChatGPT Enterprise, focusing on secure, scalable AI solutions.
AI/ML/LLM Proof of Concept Engineer
Join Cisco as an AI/ML/LLM Proof of Concept Engineer to develop and demonstrate innovative AI solutions.
Senior Applied AI Researcher
Join CHAI: AI Platform as a Senior Applied AI Researcher to optimize and innovate AI solutions in a high-growth environment.
Senior Full-stack Engineer
Join Cascading AI as a Senior Full-stack Engineer to develop AI-driven lending solutions in San Francisco.
Associate Product Manager - New Grad
Join Scale AI as an Associate Product Manager - New Grad to lead product initiatives and drive AI innovation.
Senior AI Engineer - Backend
Join Keboola as a Senior AI Engineer to enhance AI features, develop models, and collaborate on innovative projects in Prague.
Founding AI Engineer
Join LlamaIndex as a Founding AI Engineer to shape the future of LLM applications with cutting-edge AI projects.
Founding Full-stack Engineer
Join a stealth startup as a Founding Full-stack Engineer to enhance cybersecurity using LLMs. Work with AWS, React, and Python.
Senior Distributed Systems Engineer
Join webAI as a Senior Distributed Systems Engineer to design and maintain scalable systems using Python, Kubernetes, and more.
AI Specialist with Azure Expertise
Join Summ.link as an AI Specialist to develop and integrate AI solutions using Azure tools. Boost your career in a dynamic environment.
Software Engineer - Full Stack
Join Uplimit as a Full Stack Software Engineer to build AI-powered learning platforms. Work on cutting-edge AI projects in a hybrid environment.