micro1 logo

Senior LLM Engineer

micro1

Job Description

Job Title: Senior LLM Engineer

Job Type: Full-time
Location: Hybrid (Chicago, IL; Princeton, NJ; or New York, NY)

Job Summary

We are seeking a highly skilled Senior LLM Engineer to join our innovative team. The ideal candidate will thrive in a hybrid work environment, coming into the office three days a week at one of our specified locations to collaborate closely with a talented team.

The ideal candidate needs to have a minimum of 5 years of experience in software development and 1-2 years in LLM solution development. The ideal candidate will have strong experience working with Python, LLM solution patterns and tools (RAG, Vector DB, Agentic workflows, LoRA, etc.), cloud platforms (AWS, Azure, GCP), and DevOps tools. They will be responsible for designing and developing scalable software solutions, leading architecture design, and ensuring the performance and reliability of our systems.

Responsibilities

  • Take ownership of architecture design and development of scalable and distributed software systems.
  • Translate business to technical requirements.
  • Own technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocation.
  • Data-driven decision-making skills with a focus on achieving product goals.
  • Design, develop, and deploy LLM-based pipelines involving patterns like RAG, Agentic workflows, PEFT (e.g., LORA, QLORA, etc.).
  • Responsible for the complete software development lifecycle, including requirements analysis, design, coding, testing, and deployment.
  • Utilize AWS services/Azure services like IAM, Monitoring, Load Balancing, Autoscaling, Database, Networking, storage, ECR, AKS, ACR, etc.
  • Implement DevOps practices using tools like Docker, Kubernetes to ensure continuous integration and delivery. Develop DevOps scripts for automation and monitoring.
  • Collaborate with cross-functional teams, conduct code reviews, and provide guidance on software design and best practices.

Qualifications

  • Bachelor’s degree in computer science, Information Technology, or a related field (or equivalent work experience).
  • At least 5 years of experience in software development, with relevant work experience in LLM app development.
  • Strong coding skills with proficiency in Python and JavaScript.
  • Experience with API frameworks both stateless and stateful such as FastAPI, Django.
  • Well-versed in the implementation of web sockets, gRPC, access management using JWT (Azure AD, IDM preferred).
  • Proficient in cloud platforms, specifically AWS, Azure, or GCP.
  • Knowledge and hands-on experience with front-end development (React JS, Next JS, Tailwind CSS) preferred.
  • Strong experience in LLM patterns like RAG, Vector DB, Hybrid Search, Agent development, Agentic workflows, prompt engineering, etc.
  • Strong experience with LLM APIs (Open AI, Anthropic, AWS Bedrock), SDKs (Langchain, DSPy).
  • Hands-on experience with DevOps tools including Docker, Kubernetes, and AWS services (Redshift, RDS, S3).
  • Experience in production deployments involving thousands of users.
  • Strong understanding of scalable application design principles and experience with security best practices and compliance with privacy regulations.
  • Good knowledge of software engineering practices like version control (GIT), DevOps (Azure DevOps preferred), and Agile or Scrum.
  • Strong communication skills, with the ability to effectively convey complex technical concepts to a diverse audience.
  • Experience with SDLC and best practices while development.
  • Experience with Agile methodology for continuous product development and delivery.

Join us in building the AI engine that will match 1 billion people with their dream role. Our mission is to make every recruiter on the planet 100x more powerful to help global talent find their perfect role faster.

Benefits
Extracted with AI

  • Hybrid work environment
  • Collaborative team
  • Opportunities for professional growth

Similar jobs

Last update: 23 minutes ago

micro1 logo
micro1

LLM Engineer with Python and JavaScript

Join us as an LLM Engineer to design and develop scalable software solutions using Python, JavaScript, and AWS in a remote setting.

micro1 logo
micro1

Machine Learning Engineer with AI/ML Experience

Join us as a Machine Learning Engineer to develop AI/ML models and applications. Work remotely with top-tier companies.

Writer logo
Writer

Senior AI Engineer - Python, LLMs

Senior AI Engineer needed for a leading AI platform. Expertise in Python, LLMs, and software engineering required.

Unify logo
Unify

LLM Engineer (Contributor)

Join Unify as an LLM Engineer to innovate in Generative AI and contribute to AI Open Source Projects.

AirOps logo
AirOps

LLM Solution Engineer

Join AirOps as an LLM Solution Engineer to design AI workflows, integrate systems, and enhance customer success in a dynamic environment.

Bloomberg logo
Bloomberg

Senior LLM Engineer - Artificial Intelligence

Senior LLM Engineer role focusing on AI-driven products using Python, HPC, and ML technologies in New York.

Abridge logo
Abridge

Senior Full Stack Engineer, LLM APIs

Join Abridge as a Senior Full Stack Engineer to build innovative ML-powered solutions in healthcare AI, focusing on LLM APIs and cloud services.

CentML logo
CentML

Senior Software Engineer - LLM Inference

Join CentML as a Senior Software Engineer focusing on LLM Inference, leveraging AI, ML, and GPU technologies.

Bloomberg logo
Bloomberg

Senior LLM Engineer - Artificial Intelligence

Senior LLM Engineer role focusing on AI-driven products using technologies like transformers and large language models.

Lattice logo
Lattice

Senior Software Engineer, AI/ML

Join Lattice as a Senior Software Engineer focusing on AI/ML technologies. Work remotely with a modern tech stack.

Persona logo
Persona

LLM Backend Developer

Join Persona as a LLM Backend Developer, work remotely, and develop AI-driven backend systems for top startups.

Scale AI logo
Scale AI

Senior Software Engineer - Generative AI Operator

Senior Software Engineer for Generative AI, focusing on building advanced LLMs and generative models with technologies like MongoDB, React, and Node.js.

Unisys logo
Unisys

LLM Engineer

Join Unisys as an LLM Engineer to revolutionize ITSM with large language models. Work remotely in Vilnius, Lithuania.

LlamaIndex logo
LlamaIndex

Founding AI Engineer

Join LlamaIndex as a Founding AI Engineer to shape the future of LLM applications with cutting-edge AI projects.

LlamaIndex logo
LlamaIndex

Founding AI Engineer, Backend

Join LlamaIndex as a Founding AI Engineer, Backend to build scalable cloud services for LLM applications.

Robin AI logo
Robin AI

LLM Research Engineer

Join Robin AI as a LLM Research Engineer in New York, pioneering AI in legal tech with cutting-edge ML projects.

Amazon logo
Amazon

Senior Applied Scientist - LLM & Video Synthesis

Join Amazon's Creative X team as a Senior Applied Scientist focusing on LLM & Video Synthesis. Drive ML projects and innovate in advertising.

Writer logo
Writer

Senior AI Engineer

Senior AI Engineer at Writer, NY. Expertise in Python, LLMs, AI/ML development. Full-time, hybrid work with competitive benefits.

Bloomberg logo
Bloomberg

Senior LLM Engineer - Artificial Intelligence

Join Bloomberg as a Senior LLM Engineer to develop AI-driven solutions using Python and transformers.

Refuel logo
Refuel

Software Engineer - Platform

Join Refuel as a Software Engineer - Platform to design and develop critical features using Python, AWS, and LLMs in a hybrid work environment.

QA Ltd logo
QA Ltd

Senior ML/AI Engineer

Join QA Ltd as a Senior ML/AI Engineer to develop data-driven applications using AI, NLP, and LLMs in a hybrid work environment.

Amazon logo
Amazon

Senior Machine Learning Engineer

Join Amazon as a Senior Machine Learning Engineer to build scalable AI/ML infrastructure and MLOps platforms.

Vendr logo
Vendr

Senior AI Engineer with Focus on Large Language Models

Join Vendr as a Senior AI Engineer focusing on LLMs, leveraging tools like OpenAI, Anthropic, and Hugging Face.

Lambda logo
Lambda

Senior Software Engineer - Cloud

Join Lambda as a Senior Software Engineer to build the world's best deep learning cloud using AWS, Python, and distributed systems.