Job Overview
Amazon Web Services (AWS) is seeking a Senior Machine Learning Engineer to join the AWS Neuron Apps team, focusing on ML Inference Applications. This role involves the development, enablement, and performance tuning of a wide variety of ML model families, including large language models like Llama2, GPT2, GPT3, stable diffusion, and Vision Transformers.
Responsibilities
- Lead the efforts in building distributed inference support into Pytorch and TensorFlow using XLA and the Neuron compiler and runtime stacks.
- Tune models to ensure highest performance on AWS Trainium and Inferentia silicon and TRn1, Inf1 servers.
- Engage in software development using C++/Python and apply ML knowledge to optimize inference performance for both latency and throughput.
Day-to-Day Activities
- Design and code solutions to drive efficiencies in software architecture.
- Create metrics, implement automation, and resolve software defects.
- Participate in design discussions, code reviews, and communicate with internal and external stakeholders.
- Work cross-functionally to help drive business decisions with your technical input.
About the Team
The ML Apps team works closely with compiler engineers and runtime engineers to create, build, and tune distributed inference solutions. The team environment supports new members through mentorship and knowledge-sharing, fostering an inclusive and collaborative work culture.
Career Growth and Development
AWS values diverse experiences and is committed to building a team that represents a variety of backgrounds, perspectives, and skills. The role offers significant opportunities for career growth, aiming to help team members develop into well-rounded professionals capable of taking on complex tasks in the future.
Work/Life Balance
AWS promotes work-life harmony by offering flexible work arrangements, ensuring that success at work does not come at the expense of your personal life.
Inclusive Team Culture
Our team embraces diversity and inclusion, actively fostering a workplace where everyone feels valued and inspired. We support various employee-led affinity groups and host ongoing learning experiences to promote an inclusive environment.
Benefits Extracted with AI
- Health insurance
- Paid vacation
- Flexible work hours
- Remote work options
Similar jobs
Last update: 23 minutes ago
Senior Software Engineer - AI/ML, AWS Neuron Distributed Training
Senior Software Engineer for AI/ML at AWS Neuron, focusing on distributed training systems.
Senior Systems Engineer, Managed Operations
Join AWS as a Senior Systems Engineer in Berlin to lead operations for the European Sovereign Cloud, ensuring high-availability AWS services.
Senior Software Development Manager, ML Acceleration
Lead the development of ML Inference features in a senior managerial role at AWS, focusing on distributed systems and ML frameworks.
Applied Scientist, Artificial General Intelligence
Join AWS as an Applied Scientist in Artificial General Intelligence, driving AI innovation in cloud computing.
Senior Applied Scientist, AWS Marketing AI/ML
Join AWS as a Senior Applied Scientist in Marketing AI/ML, leading personalization and targeting initiatives.
Senior Machine Learning Engineer
Join Amazon as a Senior Machine Learning Engineer to build scalable AI/ML infrastructure and MLOps platforms.
Senior ML Engineer - Generative AI Innovation Center
Senior ML Engineer needed in Milan for AWS, focusing on generative AI innovations, requiring expertise in AI, ML, Python, and cloud technologies.
Senior Software Engineer, Machine Learning Infrastructure
Join Amazon's Search team as a Senior Software Engineer in ML Infrastructure, focusing on large-scale distributed systems and deep learning.
Senior Software Engineer - AWS, Python, Ruby on Rails
Join HeyJobs as a Senior Software Engineer to design scalable systems using AWS, Python, and Ruby on Rails in a dynamic team.
Cloud Data Engineer
Seeking a Cloud Data Engineer with expertise in AWS, Python, and CI/CD for a hybrid role in Hannover. Join our dynamic team!
Senior Worldwide Specialist, GenAI Model Training & Inference
Join AWS as a Senior Specialist in GenAI Model Training & Inference, driving customer adoption and scaling workloads.
Senior Software Engineer - Cloud
Join Lambda as a Senior Software Engineer to build the world's best deep learning cloud using AWS, Python, and distributed systems.
Deep Learning Architect, AWS Generative AI Innovation Center
Join AWS as a Deep Learning Architect to innovate with Generative AI, solving real-world problems in a fast-paced environment.
Applied Scientist, AWS HealthScribe
Join AWS as an Applied Scientist in Health AI, focusing on NLP and machine learning.
Senior Python Developer with AWS Experience
Join Basetime BV as a Senior Python Developer to develop and maintain AWS cloud solutions. Hybrid work, competitive salary, and growth opportunities.
Staff Software Engineer
Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.
Senior Software Development Engineer, Applied AI
Join Amazon's Applied AI team as a Senior Software Development Engineer to innovate with AI technologies.
Senior Data Scientist, Generative AI Innovation Center
Join AWS as a Senior Data Scientist in Milan to innovate with Generative AI and solve real-world challenges.
Senior Software Engineer - Generative AI, AGI Inference Engine
Join Amazon as a Senior Software Engineer to advance Generative AI capabilities, focusing on high-performance inference.
Senior Fullstack Developer for AI-Driven Mission Technologies
Seeking a Senior Fullstack Developer for AI-driven mission technologies, focusing on Java, JavaScript, Python, and C++. Remote work available.
Senior Software Engineer - LLM
Join Snowflake as a Senior Software Engineer to build scalable machine learning platforms with LLMs, leveraging Python and TensorFlow.
Senior Backend/Data Engineer
Join Zalando as a Senior Backend/Data Engineer in Berlin to enhance our audience-building platform using AWS, Java, Scala, and SQL.
Senior Data Scientist - AWS Security
Senior Data Scientist role at AWS, focusing on cloud security, using ML, DL, and statistical modeling in Dublin.
Senior Backend Engineer C++
Join DeepL as a Senior Backend Engineer C++ to design and maintain scalable backend services using C++ and AI technologies.
