NVIDIA logo

Machine Learning Engineer - LLM Fine-tuning and Performance

NVIDIA

Job Overview

As a Machine Learning Engineer (LLM Fine-tuning & Performance Specialist), you will play a crucial role in enhancing the accuracy and performance of fine-tuned Large Language Models (LLMs) for real-world applications. This groundbreaking opportunity allows you to work with cutting-edge ML technologies, collaborating closely with partners to drive innovation and ensure smooth integration and deployment of ML solutions. Your expertise will be essential in automating ML workflows and optimizing performance, making a lasting impact in the field of AI.

Key Responsibilities

  • Develop, implement, and manage processes for optimizing LLMs using domain-specific data, improving the model's capability to complete structured tasks.
  • Develop and implement techniques to measure LLM performance, defining and monitoring metrics such as recall, F1, perplexity, BLEU, ROUGE, etc.
  • Utilize tools like ONNX and TensorRT for optimizing model inference on specialized hardware.
  • Collaborate with ISVs and IHVs to understand their performance requirements and ensure successful model integration.
  • Use C++ to improve ML model performance, specifically in performance-critical systems, and provide technical mentorship to junior engineers.

Qualifications

  • 8+ years of validated experience in system software or related field.
  • M.S. or higher degree in Computer Science/Data Science/Engineering or equivalent experience.
  • Deep understanding of transformer architectures and large language models like GPT, BERT, T5, or similar.
  • Validated hands-on experience with fine-tuning LLMs for specific tasks and improving model performance using libraries like PyTorch.
  • Strong ability to assess and optimize model performance using relevant metrics and evaluation techniques.
  • Proficiency in crafting and automating ML workflows using tools such as Kubeflow, MLflow, or Airflow.
  • Excellent problem-solving skills, especially in debugging and improving LLM accuracy for real-world applications.
  • Proficiency in Python and knowledge of C++ for optimizing performance and developing system-level integrations.
  • Strong interpersonal skills for effective collaboration with internal teams and external partners.

Preferred Qualifications

  • Experience with LLM-based function and tool calling systems.
  • Understanding of distributed training for LLM fine-tuning and cloud platforms like Nvidia's NVCF.
  • Familiarity with hardware acceleration for ML workloads, including GPU and specialized hardware optimizations.

Compensation

The base salary range is $180,000 - $339,250 USD annually. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. You will also be eligible for equity and benefits.

Diversity and Inclusion

NVIDIA is committed to fostering a diverse work environment and is proud to be an equal opportunity employer. We highly value diversity in our current and future employees and do not discriminate on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.

Application Process

NVIDIA accepts applications on an ongoing basis. Join us in shaping the future of AI and computing.

Job ID: JR1990034

Benefits
Extracted with AI

  • Equity
  • Diverse work environment

Similar jobs

Last update: 23 minutes ago

Persona logo
Persona

LLM Backend Developer

Join Persona as a LLM Backend Developer, work remotely, and develop AI-driven backend systems for top startups.

NVIDIA logo
NVIDIA

Senior Deep Learning Performance Software Engineer

Senior role optimizing deep learning performance at NVIDIA, involving Python, HPC, and AI technologies.

NVIDIA logo
NVIDIA

Senior Deep Learning Engineer

Join NVIDIA as a Senior Deep Learning Engineer to optimize AI performance using PyTorch, TensorFlow, and more in Berlin.

FoodLabs logo
FoodLabs

Senior C++ Computer Vision Engineer

Join a cutting-edge AI-DeepTech startup in Berlin as a Senior C++ Computer Vision Engineer. Work on world-class on-device AI technology.

CentML logo
CentML

Senior Software Engineer - LLM Inference

Join CentML as a Senior Software Engineer focusing on LLM Inference, leveraging AI, ML, and GPU technologies.

NVIDIA logo
NVIDIA

Senior Artificial Intelligence Algorithms Engineer

Senior AI Algorithms Engineer role focusing on AI/DL, data analytics, and machine learning in Santa Clara, CA.

Snowflake logo
Snowflake

Senior Software Engineer - LLM

Join Snowflake as a Senior Software Engineer to build scalable machine learning platforms with LLMs, leveraging Python and TensorFlow.

Snowflake logo
Snowflake

Senior Software Engineer - LLM

Join Snowflake as a Senior Software Engineer to build scalable machine learning platforms with LLMs, leveraging Python and TensorFlow.

Wayve logo
Wayve

Senior Machine Learning Performance Engineer

Join Wayve as a Senior Machine Learning Performance Engineer to optimize large-scale training jobs and improve GPU efficiency.

Bonfy.AI logo
Bonfy.AI

Senior Software Engineer - LLM

Join Bonfy.AI as a Senior Software Engineer to develop and optimize scalable machine learning models using Python, TensorFlow, and cloud platforms.

dataroots logo
dataroots

Expert Machine Learning Engineer

Join Dataroots as an Expert Machine Learning Engineer to design and deliver AI-powered solutions, focusing on machine learning models.

NVIDIA logo
NVIDIA

Trustworthy AI Software Engineer

Join NVIDIA as a Trustworthy AI Software Engineer in Santa Clara, CA. Develop cutting-edge AI tools and models in a multidisciplinary team.

DeepL logo
DeepL

Senior Backend Engineer C++

Join DeepL as a Senior Backend Engineer C++ to design and maintain scalable backend services using C++ and AI technologies.

NVIDIA logo
NVIDIA

Senior Full Stack Engineer, Deep Learning Algorithms

Join NVIDIA as a Senior Full Stack Engineer to build software for AI, focusing on deep learning algorithms and high-performance computing.

Huawei Nederland logo
Huawei Nederland

Information Retrieval Algorithm Engineer

Join Huawei as an Information Retrieval Algorithm Engineer to develop cutting-edge AI technologies in Amsterdam.

Perplexity logo
Perplexity

AI Research Engineer - LLM Training

Join Perplexity as an AI Research Engineer to enhance LLMs using AI, ML, and NLP in San Francisco.

Stripe logo
Stripe

ML Engineering Manager, LLM Foundation

Lead ML engineering team at Stripe, focusing on LLMs and AI/ML systems. Drive innovation and manage high-impact projects.

NVIDIA logo
NVIDIA

Senior Engineering Manager, Robotics and ML Applications

Senior Engineering Manager for Robotics & ML at NVIDIA, leading innovative projects in AI and robotics applications.

NVIDIA logo
NVIDIA

Artificial Intelligence and Deep Learning Intern

Join NVIDIA's 2025 AI and Deep Learning Internship to work on cutting-edge projects in AI, robotics, and more.

Snap Inc. logo
Snap Inc.

Machine Learning Engineer

Join Snap Inc. as a Machine Learning Engineer in New York, NY. Develop AI models, collaborate with teams, and drive innovation.

Adobe logo
Adobe

Senior Machine Learning Engineer

Join Adobe as a Senior Machine Learning Engineer to lead Gen AI projects, focusing on document cloud technologies.

NVIDIA logo
NVIDIA

Senior Full-Stack Software Engineer

Join NVIDIA as a Senior Full-Stack Software Engineer, working on cutting-edge web applications and infrastructure.

micro1 logo
micro1

Senior LLM Engineer

Join our team as a Senior LLM Engineer, leveraging AWS, Python, and JavaScript to develop scalable AI solutions.

NVIDIA logo