NVIDIA logo

Senior Research Scientist, Multimodal Foundation Models and Robotics

NVIDIA

Overview

NVIDIA is seeking a highly skilled Senior Research Scientist to join our Generalist Embodied Agent Research (GEAR) group in Santa Clara, CA. This role focuses on developing foundation models for humanoid robots, contributing to projects that blend the virtual and physical worlds.

What You Will Be Doing

  • Design and implement novel AI algorithms and models for general-purpose humanoid robots.
  • Develop large-scale AI training and inference methods for foundation models.
  • Optimize and deploy AI models in physical simulation and on robot hardware.
  • Collaborate with research and engineering teams across NVIDIA to transfer research to products and services.

What We Need To See

  • A Ph.D. in Computer Science/Engineering, Electrical Engineering, or a related field.
  • 5+ years of relevant work/research experience in Multimodal Foundation Models.
  • Hands-on training experience and publications in topics such as LLMs, large vision-language models, video generative models, diffusion algorithms, or action-based transformers.
  • Outstanding engineering skills in rapid prototyping and model training frameworks (e.g., PyTorch, Jax, TensorFlow).
  • Proficiency in Python; C++ and CUDA are a big plus.

Robotics Skills

  • Hands-on training experience and publications in robot learning, such as reinforcement learning, imitation learning, and classical control methods.
  • Strong programming skills in Python, C++, ROS, and machine learning frameworks like PyTorch.
  • Deep understanding of robot kinematics, dynamics, and sensors.
  • Knowledge of control methods, including PID, model predictive control, and whole-body control.
  • Familiarity with physics simulation frameworks such as MuJoCo and Isaac Sim.
  • Robot hardware design and hands-on building experience.

Why NVIDIA?

Join one of the technology world's most desirable employers. We have some of the most forward-thinking and productive people in the world working with us. This is your chance to be at the forefront of developing general-purpose robots and embodied agents.

Salary and Benefits

The base salary range is $180,000 - $345,000 USD, determined by location, experience, and comparable pay. You will also be eligible for equity and comprehensive benefits.

Benefits
Extracted with AI

  • Equity
  • Health insurance
  • Paid vacation

Similar jobs

Last update: 23 minutes ago

NVIDIA logo
NVIDIA

Senior Artificial Intelligence Algorithms Engineer

Senior AI Algorithms Engineer role focusing on AI/DL, data analytics, and machine learning in Santa Clara, CA.

NVIDIA logo
NVIDIA

Senior Software Engineer, Robotics Manipulation

Senior Software Engineer specializing in Robotics Manipulation, AI, C++, and ROS in Santa Clara, CA.

NVIDIA logo
NVIDIA

Senior Engineering Manager, Robotics and ML Applications

Senior Engineering Manager for Robotics & ML at NVIDIA, leading innovative projects in AI and robotics applications.

NVIDIA logo
NVIDIA

Senior Software Engineer, AI Platform - Robotics

Senior Software Engineer needed for AI Robotics platform at NVIDIA, Santa Clara. Involves cloud platforms, Kubernetes, Python.

NVIDIA logo
NVIDIA

Machine Learning Engineer - LLM Fine-tuning and Performance

Join NVIDIA as a Machine Learning Engineer specializing in LLM fine-tuning and performance optimization. Work with cutting-edge ML technologies.

NVIDIA logo
NVIDIA

Trustworthy AI Software Engineer

Join NVIDIA as a Trustworthy AI Software Engineer in Santa Clara, CA. Develop cutting-edge AI tools and models in a multidisciplinary team.

Huawei Nederland logo
Huawei Nederland

Senior ASR / TTS Researcher

Join Huawei's research center in Amsterdam as a Senior ASR/TTS Researcher, focusing on speech synthesis and AI.

NVIDIA logo
NVIDIA

Senior Backend Engineer, AI Platform - Robotics

Join NVIDIA as a Senior Backend Engineer to develop AI platforms for robotics. Work remotely with cutting-edge technology.

NVIDIA logo
NVIDIA

Senior Deep Learning Engineer

Join NVIDIA as a Senior Deep Learning Engineer to optimize AI performance using PyTorch, TensorFlow, and more in Berlin.

NVIDIA logo
NVIDIA

Artificial Intelligence and Deep Learning Intern

Join NVIDIA's 2025 AI and Deep Learning Internship to work on cutting-edge projects in AI, robotics, and more.

NVIDIA logo
NVIDIA

Senior Visual Artist

Senior Visual Artist at NVIDIA, skilled in 3D & 2D graphics, storytelling, and tech visualization in Santa Clara, CA.

FoodLabs logo
FoodLabs

Senior C++ Computer Vision Engineer

Join a cutting-edge AI-DeepTech startup in Berlin as a Senior C++ Computer Vision Engineer. Work on world-class on-device AI technology.

NVIDIA logo
NVIDIA

Senior Software Architect – Data Center Platform Simulation and Virtualization

Join NVIDIA as a Senior Software Architect focusing on data center platform simulation and virtualization.

NVIDIA logo
NVIDIA

Senior Deep Learning Performance Software Engineer

Senior role optimizing deep learning performance at NVIDIA, involving Python, HPC, and AI technologies.

NVIDIA logo
NVIDIA

Senior Frontend Engineer, AI Platform - Robotics

Join NVIDIA as a Senior Frontend Engineer to develop AI platform UIs using React, Angular, and Vue.js.

OpenAI logo
OpenAI

Research Engineer/Scientist, Perception - OpenAI

Join OpenAI as a Research Engineer/Scientist in Perception, enhancing AI capabilities in San Francisco. Hybrid work, relocation offered.

NVIDIA logo
NVIDIA

Senior Full-Stack Software Engineer

Join NVIDIA as a Senior Full-Stack Software Engineer, working on cutting-edge web applications and infrastructure.

NVIDIA logo
NVIDIA

Senior Software Architect, Advanced Development

Join NVIDIA as a Senior Software Architect in Advanced Development, focusing on innovative solutions in network programmability and data centers.

Amazon logo
Amazon

Senior Applied Scientist - Large Language Models

Join Amazon as a Senior Applied Scientist to develop cutting-edge AI agents using Large Language Models in Sunnyvale, CA.

Blueprint logo
Blueprint

AI Engineer - Machine Learning and Robotics

Join Blueprint as an AI Engineer in Machine Learning and Robotics, focusing on scalable AI model training systems. Hybrid role in Redmond, WA.

NVIDIA logo
NVIDIA

Senior DevOps Engineer

Join NVIDIA as a Senior DevOps Engineer to enhance our Kubernetes platform and multi-cloud infrastructure.

yourfirm GmbH logo
yourfirm GmbH

Senior Fullstack Developer for AI-Driven Mission Technologies

Seeking a Senior Fullstack Developer for AI-driven mission technologies, focusing on Java, JavaScript, Python, and C++. Remote work available.

Huawei Nederland logo
Huawei Nederland

Information Retrieval Algorithm Engineer

Join Huawei as an Information Retrieval Algorithm Engineer to develop cutting-edge AI technologies in Amsterdam.

Ampere logo
Ampere

Senior Applied AI Model Researcher

Join Ampere as a Senior Applied AI Model Researcher to lead AI model development and optimization in a remote role.