Senior Prompt Engineer

Job Overview

As a Prompt Engineer on the AI Platform Team at Accrete AI, you will be responsible for designing, testing, and refining natural language prompts that enhance the performance of AI agents. You will work closely with AI researchers, data scientists, and engineers to develop effective prompts that improve the accuracy, relevance, and usability of our AI-driven applications. This role requires a deep understanding of language models, creativity in prompt design, and a strong analytical mindset.

Key Responsibilities

• Prompt Design and Development: Craft, test, and optimize prompts that improve the performance of large language models (LLMs) across various use cases and applications. Experiment with different prompt strategies, tool designs, and chaining techniques to maximize agent accuracy and relevance. Collaborate with AI researchers and engineers to integrate prompts into AI workflows and systems.

• Performance Analysis: Analyze the effectiveness of different prompts by analyzing agent outputs, identifying patterns, and understanding failure cases. Use A/B testing, user feedback, and data-driven approaches to refine prompts and enhance model performance. Document performance metrics and best practices to inform future development.

• Collaboration and Communication: Work closely with cross-functional teams, including product managers and UX designers, to align prompt design with business goals and user needs. Communicate findings, challenges, and opportunities to stakeholders in a clear and actionable manner. Contribute to team knowledge sharing by documenting prompt strategies, successes, and lessons learned.

• Innovation and Research: Stay updated on the latest advancements in AI, NLP, and prompt engineering techniques. Experiment with innovative approaches to prompt design. Contribute to the development of internal tools and frameworks that streamline prompt creation and testing.

• Quality Assurance: Ensure that prompts are robust, reliable, and generalizable across different contexts and datasets. Implement testing protocols to detect biases, inaccuracies, or unintended consequences in prompt outcomes. Collaborate with AI ethics teams to ensure prompts align with ethical guidelines and avoid harmful outputs.

Qualifications

• Education: Bachelor’s or Master’s degree in Computer Science, Linguistics, Cognitive Science, or a related field. Advanced degrees or relevant certifications are a plus.

• Experience: 3+ years of experience in natural language processing (NLP), machine learning, or a related field. Proven experience in designing and optimizing prompts for large language models. Experience working with AI/ML frameworks like TensorFlow, PyTorch, or OpenAI GPT is highly desirable. Experience working with smaller language models is a plus.

• Technical Skills: Strong understanding of NLP techniques, language models, and prompt engineering concepts. Proficiency in Python. Familiarity with machine learning model evaluation, fine-tuning, and deployment.

• Soft Skills: Strong analytical and problem-solving skills. Excellent written and verbal communication skills, with the ability to explain complex concepts to non-technical stakeholders. Creativity and a keen interest in language and linguistics. Ability to work collaboratively in a fast-paced, dynamic environment.

Benefits

• Fortune 500 level core benefits package: health, dental, vision, Rx, long-term disability, short-term disability, life insurance, & 401(k) Traditional & Roth
• Unlimited PTO & all U.S. federal holidays off
• Company events include happy hours, team bonding with bowling, tennis, and more
• Our office is stocked with lunch & snacks – healthy, delicious, beverages, vitamins & more

We offer a competitive salary, benefits package, and opportunities for growth and advancement within the company. If you are an innovative and results-driven leader, we encourage you to apply for this exciting opportunity.

Accrete is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.