Senior Research Scientist, Multimodal Foundation Models and Robotics
NVIDIAOverview
NVIDIA is seeking a highly skilled Senior Research Scientist to join our Generalist Embodied Agent Research (GEAR) group in Santa Clara, CA. This role focuses on developing foundation models for humanoid robots, contributing to projects that blend the virtual and physical worlds.
What You Will Be Doing
- Design and implement novel AI algorithms and models for general-purpose humanoid robots.
- Develop large-scale AI training and inference methods for foundation models.
- Optimize and deploy AI models in physical simulation and on robot hardware.
- Collaborate with research and engineering teams across NVIDIA to transfer research to products and services.
What We Need To See
- A Ph.D. in Computer Science/Engineering, Electrical Engineering, or a related field.
- 5+ years of relevant work/research experience in Multimodal Foundation Models.
- Hands-on training experience and publications in topics such as LLMs, large vision-language models, video generative models, diffusion algorithms, or action-based transformers.
- Outstanding engineering skills in rapid prototyping and model training frameworks (e.g., PyTorch, Jax, TensorFlow).
- Proficiency in Python; C++ and CUDA are a big plus.
Robotics Skills
- Hands-on training experience and publications in robot learning, such as reinforcement learning, imitation learning, and classical control methods.
- Strong programming skills in Python, C++, ROS, and machine learning frameworks like PyTorch.
- Deep understanding of robot kinematics, dynamics, and sensors.
- Knowledge of control methods, including PID, model predictive control, and whole-body control.
- Familiarity with physics simulation frameworks such as MuJoCo and Isaac Sim.
- Robot hardware design and hands-on building experience.
Why NVIDIA?
Join one of the technology world's most desirable employers. We have some of the most forward-thinking and productive people in the world working with us. This is your chance to be at the forefront of developing general-purpose robots and embodied agents.
Salary and Benefits
The base salary range is $180,000 - $345,000 USD, determined by location, experience, and comparable pay. You will also be eligible for equity and comprehensive benefits.
Benefits Extracted with AI
- Equity
- Health insurance
- Paid vacation
Similar jobs
Last update: 23 minutes ago
Artificial Intelligence and Deep Learning Intern
Join NVIDIA's 2025 AI and Deep Learning Internship to work on cutting-edge projects in AI, robotics, and more.
Senior Applied AI Researcher
Join CHAI: AI Platform as a Senior Applied AI Researcher to optimize and innovate AI solutions in a high-growth environment.
Deep Learning Researcher
Join DataRobot as a Deep Learning Researcher to advance generative AI capabilities and integrate them into product offerings.
Research Engineer, Language - Generative AI
Join Meta as a Research Engineer in Generative AI, focusing on large language models and NLP.
Senior Full Stack Web Software Engineer
Join NVIDIA as a Senior Full Stack Web Software Engineer to build AI-assisted developer tools using React.js and TypeScript.
AI Research Scientist - Generative AI Red Teaming
Join Meta as an AI Research Scientist focusing on Generative AI Red Teaming, advancing AI responsibly.
Machine Learning Scientist
Join PhysicsX as a Machine Learning Scientist to develop innovative models using deep learning for physics simulations.
Research Scientist, Human-AI Interaction
Join OpenAI as a Research Scientist in Human-AI Interaction, focusing on data collection and cognitive science.
Senior Applied Scientist - Large Language Models
Join Amazon as a Senior Applied Scientist to develop cutting-edge AI agents using Large Language Models in Sunnyvale, CA.
Applied Scientist, Artificial General Intelligence
Join AWS as an Applied Scientist in Artificial General Intelligence, driving AI innovation in cloud computing.
Internship, Reinforcement Learning Engineer
Join Tesla as a Reinforcement Learning Engineer Intern to develop robotic learning systems for humanoid robots.
Applied Scientist, Artificial General Intelligence
Join Amazon's AGI team as an Applied Scientist to develop cutting-edge AI technology in Computer Vision and NLP.
AI Engineer Intern, Self-Driving
Join Tesla as an AI Engineer Intern to develop large-scale models for self-driving technology. Work on cutting-edge AI techniques.
Senior Software Engineer, Machine Learning
Join Niantic as a Senior Software Engineer in Machine Learning to enhance products using generative AI technologies.
Senior Researcher - Responsible AI
Join eBay as a Senior Researcher in Responsible AI, leading AI evaluation and development with a focus on fairness and safety.
AI Engineer Intern - Export & Inference
Join Tesla as an AI Engineer Intern focusing on Export & Inference. Work on cutting-edge AI projects in Palo Alto.
Mid-Level AI Researcher
Join Leonardo.Ai as a Mid-Level AI Researcher to develop and refine AI models, focusing on model training and optimization.
Software Engineering Intern
Join NVIDIA as a Software Engineering Intern in 2025. Work remotely on AI, cloud, and data science projects. Enhance your skills in a diverse environment.
Deep Learning Computer Architecture Intern
Join NVIDIA as a Deep Learning Computer Architecture Intern. Work on cutting-edge AI projects with a leading company in accelerated computing.
Senior Machine Learning Engineer
Join NIQ as a Senior ML Engineer to develop and implement AI models using Python, PyTorch, and Azure in a hybrid work environment.
Research Engineer, Product
Join Google DeepMind as a Research Engineer to apply cutting-edge AI models to real-world problems. Hybrid work in New York.
Applied AI Scientist
Join ClimateAi as an Applied AI Scientist to develop AI solutions for climate resilience. Work with diverse teams in a hybrid environment.
Mid-Level AI Researcher
Join Leonardo.Ai as a Mid-Level AI Researcher to develop AI models and enhance generative AI platforms.
Internship Software Engineer - Machine Learning Infrastructure
Join Tesla as an Internship Software Engineer in Machine Learning Infrastructure. Work on AI infrastructure and neural network scaling.