micro1 logo

Senior LLM Engineer

micro1

Job Description

Job Title: Senior LLM Engineer

Job Type: Full-time
Location: Hybrid (Chicago, IL; Princeton, NJ; or New York, NY)

Job Summary

We are seeking a highly skilled Senior LLM Engineer to join our innovative team. The ideal candidate will thrive in a hybrid work environment, coming into the office three days a week at one of our specified locations to collaborate closely with a talented team.

The ideal candidate needs to have a minimum of 5 years of experience in software development and 1-2 years in LLM solution development. The ideal candidate will have strong experience working with Python, LLM solution patterns and tools (RAG, Vector DB, Agentic workflows, LoRA, etc.), cloud platforms (AWS, Azure, GCP), and DevOps tools. They will be responsible for designing and developing scalable software solutions, leading architecture design, and ensuring the performance and reliability of our systems.

Responsibilities

  • Take ownership of architecture design and development of scalable and distributed software systems.
  • Translate business to technical requirements.
  • Own technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocation.
  • Data-driven decision-making skills with a focus on achieving product goals.
  • Design, develop, and deploy LLM-based pipelines involving patterns like RAG, Agentic workflows, PEFT (e.g., LORA, QLORA, etc.).
  • Responsible for the complete software development lifecycle, including requirements analysis, design, coding, testing, and deployment.
  • Utilize AWS services/Azure services like IAM, Monitoring, Load Balancing, Autoscaling, Database, Networking, storage, ECR, AKS, ACR, etc.
  • Implement DevOps practices using tools like Docker, Kubernetes to ensure continuous integration and delivery. Develop DevOps scripts for automation and monitoring.
  • Collaborate with cross-functional teams, conduct code reviews, and provide guidance on software design and best practices.

Qualifications

  • Bachelor’s degree in computer science, Information Technology, or a related field (or equivalent work experience).
  • At least 5 years of experience in software development, with relevant work experience in LLM app development.
  • Strong coding skills with proficiency in Python and JavaScript.
  • Experience with API frameworks both stateless and stateful such as FastAPI, Django.
  • Well-versed in the implementation of web sockets, gRPC, access management using JWT (Azure AD, IDM preferred).
  • Proficient in cloud platforms, specifically AWS, Azure, or GCP.
  • Knowledge and hands-on experience with front-end development (React JS, Next JS, Tailwind CSS) preferred.
  • Strong experience in LLM patterns like RAG, Vector DB, Hybrid Search, Agent development, Agentic workflows, prompt engineering, etc.
  • Strong experience with LLM APIs (Open AI, Anthropic, AWS Bedrock), SDKs (Langchain, DSPy).
  • Hands-on experience with DevOps tools including Docker, Kubernetes, and AWS services (Redshift, RDS, S3).
  • Experience in production deployments involving thousands of users.
  • Strong understanding of scalable application design principles and experience with security best practices and compliance with privacy regulations.
  • Good knowledge of software engineering practices like version control (GIT), DevOps (Azure DevOps preferred), and Agile or Scrum.
  • Strong communication skills, with the ability to effectively convey complex technical concepts to a diverse audience.
  • Experience with SDLC and best practices while development.
  • Experience with Agile methodology for continuous product development and delivery.

Join us in building the AI engine that will match 1 billion people with their dream role. Our mission is to make every recruiter on the planet 100x more powerful to help global talent find their perfect role faster.

Benefits
Extracted with AI

  • Hybrid work environment
  • Collaborative team
  • Opportunities for professional growth

Similar jobs

Last update: 23 minutes ago

micro1 logo
micro1

LLM Engineer with Python and JavaScript

Join us as an LLM Engineer to design and develop scalable software solutions using Python, JavaScript, and AWS in a remote setting.

Abridge logo
Abridge

Senior Full Stack Engineer, LLM APIs

Join Abridge as a Senior Full Stack Engineer to build innovative ML-powered solutions in healthcare AI, focusing on LLM APIs and cloud services.

Unicon, Inc. logo
Unicon, Inc.

Senior Software Developer - AI/LLM

Join Unicon as a Senior Software Developer specializing in AI/LLM, working on cutting-edge AI technologies in a hybrid role in Gilbert, AZ.

Stripe logo
Stripe

ML Engineering Manager, LLM Foundation

Lead ML engineering team at Stripe, focusing on LLMs and AI/ML systems. Drive innovation and manage high-impact projects.

EQT Ventures logo
EQT Ventures

Fullstack LLM Engineer

Join EQT Ventures as a Fullstack LLM Engineer to drive AI innovation in venture capital. Work with cutting-edge AI tools and data-driven insights.

NVIDIA logo
NVIDIA

Machine Learning Engineer - LLM Fine-tuning and Performance

Join NVIDIA as a Machine Learning Engineer specializing in LLM fine-tuning and performance optimization. Work with cutting-edge ML technologies.

Snowflake logo
Snowflake

Senior Software Engineer - LLM

Join Snowflake as a Senior Software Engineer to build scalable machine learning platforms with LLMs, leveraging Python and TensorFlow.

AirOps logo
AirOps

LLM Solution Engineer

Join AirOps as an LLM Solution Engineer to design AI workflows, integrate systems, and enhance customer success in a dynamic environment.

Snowflake logo
Snowflake

Senior Software Engineer - LLM

Join Snowflake as a Senior Software Engineer to build scalable machine learning platforms with LLMs, leveraging Python and TensorFlow.

CentML logo
CentML

Senior Software Engineer - LLM Inference

Join CentML as a Senior Software Engineer focusing on LLM Inference, leveraging AI, ML, and GPU technologies.

LILT logo
LILT

Senior Full Stack Engineer (Java, React, MySQL)

Join LILT as a Senior Full Stack Engineer, working with Java, React, and MySQL to drive AI translation solutions. Remote with future hybrid work.

Lumenalta (formerly Clevertech) logo
Lumenalta (formerly Clevertech)

Senior Node.js Engineer

Join Lumenalta as a Senior Node.js Engineer. Work remotely on innovative projects using JavaScript, Node.js, AWS Lambda, and more.

DwellFi  logo
DwellFi

AI Solutions Software Engineer

Join DwellFi as an AI Solutions Software Engineer to develop innovative AI solutions using LangChain or Llama. Remote position in Palo Alto, CA.

YLD logo
YLD

Senior Software Engineer (React/Node)

Join YLD as a Senior Software Engineer specializing in React and Node.js, working remotely in EST timezone. Build innovative products in a fast-paced environment.

Anon logo
Anon

Senior Full Stack Software Engineer

Join Anon as a Senior Full Stack Software Engineer to build AI integration platforms using Typescript, Next.js, Rust, and AWS.

Rogo logo
Rogo

Senior Full-Stack Software Engineer (React, TypeScript)

Join Rogo as a Senior Full-Stack Software Engineer to develop cutting-edge AI tools in NYC.

Poggio logo
Poggio

Senior AI Engineer

Join Poggio as a Senior AI Engineer to innovate AI systems for enterprise sales, focusing on AI capabilities and system performance.

Aleph logo
Aleph

Frontend Engineer, AI

Join Aleph as a Frontend Engineer focusing on AI to develop innovative features using React.js and AI technologies in a remote role.

Monterey AI logo
Monterey AI

Senior Full-Stack Software Engineer

Join Monterey AI as a Senior Full-Stack Software Engineer to build AI-driven Voice of Customer platforms using Typescript, Node.js, SQL, and AWS.

Blueprint logo
Blueprint

AI Engineer - Machine Learning and Robotics

Join Blueprint as an AI Engineer in Machine Learning and Robotics, focusing on scalable AI model training systems. Hybrid role in Redmond, WA.

MoonPay logo
MoonPay

Machine Learning Engineer

Join MoonPay as a Machine Learning Engineer to build and maintain ML infrastructure, collaborating with data scientists and cross-functional teams.

Boston Consulting Group (BCG) logo
Boston Consulting Group (BCG)

Global IT LLM Engineer Director & Chapter Lead

Lead AI and ML innovation as Global IT LLM Engineer Director at BCG, focusing on GenAI product development and optimization.

Multiverse Computing logo
Multiverse Computing

Senior Machine Learning Engineer

Join Multiverse Computing as a Senior Machine Learning Engineer to lead LLM projects using quantum AI technologies.

Pass App logo
Pass App

Machine Learning Engineer with Web3 and NLP Experience

Join Pass App as a Machine Learning Engineer to build AI solutions for web3, focusing on NLP and data pipelines.