Job Overview
Amazon Web Services (AWS) is seeking a Senior Machine Learning Engineer to join the AWS Neuron Apps team, focusing on ML Inference Applications. This role involves the development, enablement, and performance tuning of a wide variety of ML model families, including large language models like Llama2, GPT2, GPT3, stable diffusion, and Vision Transformers.
Responsibilities
- Lead the efforts in building distributed inference support into Pytorch and TensorFlow using XLA and the Neuron compiler and runtime stacks.
- Tune models to ensure highest performance on AWS Trainium and Inferentia silicon and TRn1, Inf1 servers.
- Engage in software development using C++/Python and apply ML knowledge to optimize inference performance for both latency and throughput.
Day-to-Day Activities
- Design and code solutions to drive efficiencies in software architecture.
- Create metrics, implement automation, and resolve software defects.
- Participate in design discussions, code reviews, and communicate with internal and external stakeholders.
- Work cross-functionally to help drive business decisions with your technical input.
About the Team
The ML Apps team works closely with compiler engineers and runtime engineers to create, build, and tune distributed inference solutions. The team environment supports new members through mentorship and knowledge-sharing, fostering an inclusive and collaborative work culture.
Career Growth and Development
AWS values diverse experiences and is committed to building a team that represents a variety of backgrounds, perspectives, and skills. The role offers significant opportunities for career growth, aiming to help team members develop into well-rounded professionals capable of taking on complex tasks in the future.
Work/Life Balance
AWS promotes work-life harmony by offering flexible work arrangements, ensuring that success at work does not come at the expense of your personal life.
Inclusive Team Culture
Our team embraces diversity and inclusion, actively fostering a workplace where everyone feels valued and inspired. We support various employee-led affinity groups and host ongoing learning experiences to promote an inclusive environment.
Benefits Extracted with AI
- Health insurance
- Paid vacation
- Flexible work hours
- Remote work options
Similar jobs
Last update: 23 minutes ago
Senior Software Engineer - AI/ML, AWS Neuron Distributed Training
Senior Software Engineer for AI/ML at AWS Neuron, focusing on distributed training systems.
Senior Software Development Manager, ML Acceleration
Lead the development of ML Inference features in a senior managerial role at AWS, focusing on distributed systems and ML frameworks.
Applied Scientist, Artificial General Intelligence
Join AWS as an Applied Scientist in Artificial General Intelligence, driving AI innovation in cloud computing.
Senior Machine Learning Engineer
Join Amazon as a Senior Machine Learning Engineer to build scalable AI/ML infrastructure and MLOps platforms.
Senior ML Engineer - Generative AI Innovation Center
Senior ML Engineer needed in Milan for AWS, focusing on generative AI innovations, requiring expertise in AI, ML, Python, and cloud technologies.
Senior Applied Scientist, AWS Marketing AI/ML
Join AWS as a Senior Applied Scientist in Marketing AI/ML, leading personalization and targeting initiatives.
Senior Software Engineer, Machine Learning Infrastructure
Join Amazon's Search team as a Senior Software Engineer in ML Infrastructure, focusing on large-scale distributed systems and deep learning.
Senior Worldwide Specialist, GenAI Model Training & Inference
Join AWS as a Senior Specialist in GenAI Model Training & Inference, driving customer adoption and scaling workloads.
Senior Software Engineer - Cloud
Join Lambda as a Senior Software Engineer to build the world's best deep learning cloud using AWS, Python, and distributed systems.
Applied Scientist, AWS HealthScribe
Join AWS as an Applied Scientist in Health AI, focusing on NLP and machine learning.
Deep Learning Architect, AWS Generative AI Innovation Center
Join AWS as a Deep Learning Architect to innovate with Generative AI, solving real-world problems in a fast-paced environment.
Senior Data Scientist, Generative AI Innovation Center
Join AWS as a Senior Data Scientist in Milan to innovate with Generative AI and solve real-world challenges.
Senior Software Development Engineer, Applied AI
Join Amazon's Applied AI team as a Senior Software Development Engineer to innovate with AI technologies.
Senior Data Scientist - AWS Security
Senior Data Scientist role at AWS, focusing on cloud security, using ML, DL, and statistical modeling in Dublin.
Senior Software Engineer - Generative AI, AGI Inference Engine
Join Amazon as a Senior Software Engineer to advance Generative AI capabilities, focusing on high-performance inference.
Senior Generative AI Data Scientist
Join AWS as a Senior Generative AI Data Scientist to lead AI innovations using Amazon SageMaker.
Deep Learning Architect, Generative AI Innovation Center
Join AWS as a Deep Learning Architect in Milan to innovate with Generative AI and transform business opportunities.
Senior Deep Learning Architect, Generative AI
Join AWS as a Senior Deep Learning Architect to innovate with Generative AI and transform business opportunities.
Senior Applied Scientist, Support Products & Services
Join Amazon as a Senior Applied Scientist to develop NLP and AI solutions for customer service challenges.
Senior Applied Scientist, Artificial General Intelligence
Join Amazon's AGI team as a Senior Applied Scientist to develop cutting-edge AI algorithms and models. Requires deep learning expertise.
Software Development Engineer Intern - Machine Learning Chip Architect
Join AWS as a Software Development Engineer Intern focusing on Machine Learning Chip Architecture. Enhance your skills in a dynamic environment.
Senior Specialist, GenAI Frameworks at AWS
Senior Specialist in GenAI Frameworks at AWS, focusing on market development and customer engagement through innovative AI solutions.
Senior Machine Learning Architect
Join Amazon Devices as a Senior ML Architect to develop next-gen SoCs for ML-enabled products.
Senior Data Scientist, Machine Learning - Amazon
Senior Data Scientist role at Amazon, focusing on machine learning and LLM technologies in Seattle.
