Amazon Web Services (AWS) logo

Senior Software Development Manager, ML Acceleration

Amazon Web Services (AWS)

Job Overview

As the Senior Software Development Manager for the Neuron Inference Technology Team at Amazon Web Services (AWS), you will lead a dynamic team of managers and engineers in the development of distributed ML Inference features and use cases. Your primary responsibilities will include overseeing the full development lifecycle of features and extensions for inference support in our Neuronx_Distributed and Transformers_Neuronx Inference Libraries. You will also develop reliability, scalability features, and performance updates in these libraries, and contribute to other popular open Inference Libraries to enable them to make Trainium and Inferentia devices as the first-class citizens for ML Acceleration.

Responsibilities

  • Leadership and Management: Lead a team of managers and engineers to achieve project goals. Ensure the right products are built and delivered to customers.
  • Technical Development: Oversee the development of distributed ML Inference libraries and frameworks using Pytorch, JAX, and Tensorflow on XLA devices. Integrate and develop using C++ for framework integrations.
  • Strategic Planning: Work with executive leadership and other senior management to define product directions and ensure they align with business objectives.
  • Customer Interaction: Engage directly with customers to gather feedback and ensure their needs are met.

About the Team

The Neuron Inference Technology Team is part of AWS, a leader in cloud computing and infrastructure services. We focus on building massive-scale distributed training and inference solutions, integrating software, servers, and chips to accelerate at the highest scale.

Inclusive Team Culture

AWS values diversity and inclusion. We have various employee-led affinity groups and host annual learning experiences to promote an inclusive culture. Our leadership principles encourage seeking diverse perspectives and earning trust.

Work/Life Balance

We prioritize work-life balance, offering flexibility in working hours and encouraging a healthy balance between personal and professional life.

Mentorship and Career Growth

We are committed to supporting new team members and providing opportunities for career advancement through mentorship and varied projects.

Qualifications

  • Experience: 10+ years in engineering, with at least 5 years in engineering team management. Experience in planning, designing, developing, and delivering consumer software.
  • Skills: Proficiency in Machine Learning, Pytorch, JAX, Tensorflow, C++, and XLA. Experience with distributed systems is essential.

Preferred Qualifications

  • Experience in large scale, high-traffic applications and partnering with product and program management teams.

Benefits
Extracted with AI

  • Flexible working hours
  • Inclusive team culture
  • Mentorship and career growth opportunities

Similar jobs

Last update: 23 minutes ago

Amazon Web Services (AWS) logo
Amazon Web Services (AWS)

Senior Systems Engineer, Managed Operations

Join AWS as a Senior Systems Engineer in Berlin to lead operations for the European Sovereign Cloud, ensuring high-availability AWS services.

HeyJobs logo
HeyJobs

Senior Software Engineer - AWS, Python, Ruby on Rails

Join HeyJobs as a Senior Software Engineer to design scalable systems using AWS, Python, and Ruby on Rails in a dynamic team.

Aiven logo
Aiven

Staff Software Engineer

Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.

Haufe Akademie logo
Haufe Akademie

Software Engineer AWS & TypeScript

Join Haufe Akademie as a Software Engineer specializing in AWS & TypeScript to develop innovative cloud solutions in Freiburg.

Basetime BV logo
Basetime BV

Senior Python Developer with AWS Experience

Join Basetime BV as a Senior Python Developer to develop and maintain AWS cloud solutions. Hybrid work, competitive salary, and growth opportunities.

CARFAX Europe logo
CARFAX Europe

Senior DevOps Engineer

Join CARFAX Europe as a Senior DevOps Engineer to manage AWS infrastructure, develop CI/CD pipelines, and enhance system observability.

9am logo
9am

Senior Solution Architect AWS (Freelance)

Seeking a Senior Solution Architect AWS for a freelance role in Frankfurt, Germany. Remote work available. Extensive AWS experience required.

Motius logo
Motius

Senior Backend Developer

Join Motius as a Senior Backend Developer to work on cutting-edge R&D projects using AWS, Docker, GraphQL, and more in a hybrid work environment.

Computer Futures logo
Computer Futures

Cloud Data Engineer

Seeking a Cloud Data Engineer with expertise in AWS, Python, and CI/CD for a hybrid role in Hannover. Join our dynamic team!

DeepL logo
DeepL

Senior Backend Engineer C++

Join DeepL as a Senior Backend Engineer C++ to design and maintain scalable backend services using C++ and AI technologies.

Applied Intuition logo
Applied Intuition

Software Engineer - Autonomous Driving

Join Applied Intuition as a Software Engineer in Munich to tackle autonomous driving challenges with top ADAS/AV programs.

Amazon Web Services (AWS) logo
Amazon Web Services (AWS)

Front End Development Engineer - AWS Commerce Platform

Join AWS as a Front End Development Engineer to build high-quality user interfaces using Angular, React, and TypeScript in Berlin.

CHEEX logo
CHEEX

Backend Developer with AWS and Spring Boot Experience

Join CHEEX as a Backend Developer in Berlin. Work with AWS, Spring Boot, and Angular in a progressive, inclusive environment.

Covestro logo
Covestro

Senior DevOps Engineer - Price & Deal Management

Join Covestro as a Senior DevOps Engineer to drive digital transformation in pricing and deal management with AWS, Docker, and Java expertise.

Omnia Retail logo
Omnia Retail

Senior Software Developer - AWS, Java, Python, Scala

Join Omnia Retail as a Senior Software Developer, working with AWS, Java, Python, and Scala in a hybrid role in Frankfurt.

Amazon Web Services (AWS) logo
Amazon Web Services (AWS)

Senior Software Development Engineer - Aurora Limitless Database

Join AWS as a Senior Software Development Engineer to innovate in cloud database services with Aurora Limitless Database.

Together AI logo
Together AI

Senior Backend Engineer - Java, Rust, Go

Join Together AI as a Senior Backend Engineer in Amsterdam. Work with Java, Rust, and Go to build scalable backend systems.

dataroots logo
dataroots

Expert Machine Learning Engineer

Join Dataroots as an Expert Machine Learning Engineer to design and deliver AI-powered solutions, focusing on machine learning models.

Personio logo
Personio

Staff Software Engineer, Data Platform

Join Personio as a Staff Software Engineer in Berlin to build scalable data platforms using Kafka, Kubernetes, and AWS. Drive innovation and excellence.

BCG X logo
BCG X

AI Engineer

Join BCG X as an AI Engineer in Milan, Italy. Develop AI solutions, partner with clients, and drive innovation in a dynamic environment.

Aiven logo
Aiven

Senior Software Engineer - Python, Apache Kafka

Join Aiven as a Senior Software Engineer in Berlin, focusing on Python and Apache Kafka in a hybrid work environment.

Nederlandse Spoorwegen logo
Nederlandse Spoorwegen

Senior Lead Fullstack Developer with Frontend Focus

Join NS as a Senior Lead Fullstack Developer focusing on frontend, working with Angular, AWS, and TypeScript in a dynamic e-commerce environment.

Computer Futures logo
Computer Futures

Mid-Level Full Stack Software Engineer - Cloud & Web

Join as a Full Stack Software Engineer focusing on C#, Azure, and Microservices in a dynamic team with flexible work options.

VIAVI Solutions logo
VIAVI Solutions

Senior Software Engineer (C++, Python & Cloud)

Join VIAVI Solutions as a Senior Software Engineer specializing in C++, Python, and cloud technologies. Work in a hybrid environment in Berlin.