NVIDIA logo

Senior Research Scientist, Multimodal Foundation Models and Robotics

NVIDIA

Overview

NVIDIA is seeking a highly skilled Senior Research Scientist to join our Generalist Embodied Agent Research (GEAR) group in Santa Clara, CA. This role focuses on developing foundation models for humanoid robots, contributing to projects that blend the virtual and physical worlds.

What You Will Be Doing

  • Design and implement novel AI algorithms and models for general-purpose humanoid robots.
  • Develop large-scale AI training and inference methods for foundation models.
  • Optimize and deploy AI models in physical simulation and on robot hardware.
  • Collaborate with research and engineering teams across NVIDIA to transfer research to products and services.

What We Need To See

  • A Ph.D. in Computer Science/Engineering, Electrical Engineering, or a related field.
  • 5+ years of relevant work/research experience in Multimodal Foundation Models.
  • Hands-on training experience and publications in topics such as LLMs, large vision-language models, video generative models, diffusion algorithms, or action-based transformers.
  • Outstanding engineering skills in rapid prototyping and model training frameworks (e.g., PyTorch, Jax, TensorFlow).
  • Proficiency in Python; C++ and CUDA are a big plus.

Robotics Skills

  • Hands-on training experience and publications in robot learning, such as reinforcement learning, imitation learning, and classical control methods.
  • Strong programming skills in Python, C++, ROS, and machine learning frameworks like PyTorch.
  • Deep understanding of robot kinematics, dynamics, and sensors.
  • Knowledge of control methods, including PID, model predictive control, and whole-body control.
  • Familiarity with physics simulation frameworks such as MuJoCo and Isaac Sim.
  • Robot hardware design and hands-on building experience.

Why NVIDIA?

Join one of the technology world's most desirable employers. We have some of the most forward-thinking and productive people in the world working with us. This is your chance to be at the forefront of developing general-purpose robots and embodied agents.

Salary and Benefits

The base salary range is $180,000 - $345,000 USD, determined by location, experience, and comparable pay. You will also be eligible for equity and comprehensive benefits.

Benefits
Extracted with AI

  • Equity
  • Health insurance
  • Paid vacation

Similar jobs

Last update: 23 minutes ago

Huawei Nederland logo
Huawei Nederland

Senior ASR / TTS Researcher

Join Huawei's research center in Amsterdam as a Senior ASR/TTS Researcher, focusing on speech synthesis and AI.

NVIDIA logo
NVIDIA

Machine Learning Engineer - LLM Fine-tuning and Performance

Join NVIDIA as a Machine Learning Engineer specializing in LLM fine-tuning and performance optimization. Work with cutting-edge ML technologies.

Huawei Nederland logo
Huawei Nederland

Information Retrieval Algorithm Engineer

Join Huawei as an Information Retrieval Algorithm Engineer to develop cutting-edge AI technologies in Amsterdam.

Nebius AI logo
Nebius AI

Senior Software Engineer (C++)

Join Nebius as a Senior Software Engineer (C++) to develop reliable cloud services in a hybrid work environment.

BCG X logo
BCG X

AI Engineer

Join BCG X as an AI Engineer in Milan, Italy. Develop AI solutions, partner with clients, and drive innovation in a dynamic environment.

Blueprint logo
Blueprint

AI Engineer - Machine Learning and Robotics

Join Blueprint as an AI Engineer in Machine Learning and Robotics, focusing on scalable AI model training systems. Hybrid role in Redmond, WA.

dataroots logo
dataroots

Expert Machine Learning Engineer

Join Dataroots as an Expert Machine Learning Engineer to design and deliver AI-powered solutions, focusing on machine learning models.

Applied Intuition logo
Applied Intuition

Software Engineer - Autonomous Driving

Join Applied Intuition as a Software Engineer in Munich to tackle autonomous driving challenges with top ADAS/AV programs.

Cere Network logo
Cere Network

Principal AI Engineer

Join Cere Network as a Principal AI Engineer to drive AI innovation in Web3. Requires 10+ years in AI/ML, NLP, and software development.

Motius logo
Motius

Senior Backend Developer

Join Motius as a Senior Backend Developer to work on cutting-edge R&D projects using AWS, Docker, GraphQL, and more in a hybrid work environment.

Together AI logo
Together AI

Senior Backend Engineer - Java, Rust, Go

Join Together AI as a Senior Backend Engineer in Amsterdam. Work with Java, Rust, and Go to build scalable backend systems.

Nebius AI logo
Nebius AI

Senior Backend Engineer (Go)

Join Nebius as a Senior Backend Engineer (Go) to develop fault-tolerant cloud services in a hybrid work environment.

DeepL logo
DeepL

Senior Backend Engineer C++

Join DeepL as a Senior Backend Engineer C++ to design and maintain scalable backend services using C++ and AI technologies.

ZAUBAR logo
ZAUBAR

Senior Fullstack & Unity Developer (Gen AI, AR)

Join ZAUBAR as a Senior Fullstack & Unity Developer in Berlin to create immersive AR experiences with GenAI. Work on cutting-edge technology in a dynamic team.

NN Group logo
NN Group

Senior Full-stack Engineer (Angular, Node.js, TypeScript)

Join NN Group as a Senior Full-stack Engineer, leading software architecture and development with Angular, Node.js, and TypeScript.

Arena logo
Arena

Machine Learning Scientist

Join Arena as a Machine Learning Scientist to develop AI systems using PyTorch and TensorFlow, focusing on real-world problem-solving.

Bonfy.AI logo
Bonfy.AI

Senior Software Engineer - LLM

Join Bonfy.AI as a Senior Software Engineer to develop and optimize scalable machine learning models using Python, TensorFlow, and cloud platforms.

Poggio logo
Poggio

Senior AI Engineer

Join Poggio as a Senior AI Engineer to innovate AI systems for enterprise sales, focusing on AI capabilities and system performance.

Bitmovin logo
Bitmovin

Senior C++ Software Engineer

Join Bitmovin as a Senior C++ Software Engineer to develop scalable video streaming solutions using modern C++ and cloud-native architectures.

Aiven logo
Aiven

Staff Software Engineer

Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.

Grab logo
Grab

Lead Data Scientist - Computer Vision and Machine Learning

Lead Data Scientist role focusing on computer vision and machine learning for map automation at Grab in Cluj-Napoca.

n8n logo
n8n

Senior Software Engineer (Node.js & TypeScript)

Join n8n as a Senior Software Engineer to build AI applications using Node.js and TypeScript. Remote role within Europe.

Nederlandse Spoorwegen logo
Nederlandse Spoorwegen

Senior Lead Fullstack Developer with Frontend Focus

Join NS as a Senior Lead Fullstack Developer focusing on frontend, working with Angular, AWS, and TypeScript in a dynamic e-commerce environment.

DwellFi  logo
DwellFi

AI Solutions Software Engineer

Join DwellFi as an AI Solutions Software Engineer to develop innovative AI solutions using LangChain or Llama. Remote position in Palo Alto, CA.