Amazon Web Services (AWS) logo

Senior Software Development Manager, ML Acceleration

Amazon Web Services (AWS)

Job Overview

As the Senior Software Development Manager for the Neuron Inference Technology Team at Amazon Web Services (AWS), you will lead a dynamic team of managers and engineers in the development of distributed ML Inference features and use cases. Your primary responsibilities will include overseeing the full development lifecycle of features and extensions for inference support in our Neuronx_Distributed and Transformers_Neuronx Inference Libraries. You will also develop reliability, scalability features, and performance updates in these libraries, and contribute to other popular open Inference Libraries to enable them to make Trainium and Inferentia devices as the first-class citizens for ML Acceleration.

Responsibilities

  • Leadership and Management: Lead a team of managers and engineers to achieve project goals. Ensure the right products are built and delivered to customers.
  • Technical Development: Oversee the development of distributed ML Inference libraries and frameworks using Pytorch, JAX, and Tensorflow on XLA devices. Integrate and develop using C++ for framework integrations.
  • Strategic Planning: Work with executive leadership and other senior management to define product directions and ensure they align with business objectives.
  • Customer Interaction: Engage directly with customers to gather feedback and ensure their needs are met.

About the Team

The Neuron Inference Technology Team is part of AWS, a leader in cloud computing and infrastructure services. We focus on building massive-scale distributed training and inference solutions, integrating software, servers, and chips to accelerate at the highest scale.

Inclusive Team Culture

AWS values diversity and inclusion. We have various employee-led affinity groups and host annual learning experiences to promote an inclusive culture. Our leadership principles encourage seeking diverse perspectives and earning trust.

Work/Life Balance

We prioritize work-life balance, offering flexibility in working hours and encouraging a healthy balance between personal and professional life.

Mentorship and Career Growth

We are committed to supporting new team members and providing opportunities for career advancement through mentorship and varied projects.

Qualifications

  • Experience: 10+ years in engineering, with at least 5 years in engineering team management. Experience in planning, designing, developing, and delivering consumer software.
  • Skills: Proficiency in Machine Learning, Pytorch, JAX, Tensorflow, C++, and XLA. Experience with distributed systems is essential.

Preferred Qualifications

  • Experience in large scale, high-traffic applications and partnering with product and program management teams.

Benefits
Extracted with AI

  • Flexible working hours
  • Inclusive team culture
  • Mentorship and career growth opportunities

Similar jobs

Last update: 23 minutes ago

Amazon Web Services (AWS) logo
Amazon Web Services (AWS)

Senior Systems Engineer, Managed Operations

Join AWS as a Senior Systems Engineer in Berlin to lead operations for the European Sovereign Cloud, ensuring high-availability AWS services.

yourfirm GmbH logo
yourfirm GmbH

Senior Fullstack Developer for AI-Driven Mission Technologies

Seeking a Senior Fullstack Developer for AI-driven mission technologies, focusing on Java, JavaScript, Python, and C++. Remote work available.

Aiven logo
Aiven

Staff Software Engineer

Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.

Haufe Akademie logo
Haufe Akademie

Software Engineer AWS & TypeScript

Join Haufe Akademie as a Software Engineer specializing in AWS & TypeScript to develop innovative cloud solutions in Freiburg.

FoodLabs logo
FoodLabs

Senior C++ Computer Vision Engineer

Join a cutting-edge AI-DeepTech startup in Berlin as a Senior C++ Computer Vision Engineer. Work on world-class on-device AI technology.

Uber logo
Uber

Senior Software Engineer: Configuration Management/Deployment

Join Uber's Amsterdam team as a Senior Software Engineer focusing on configuration management and deployment. Solve infrastructure challenges at scale.

HeyJobs logo
HeyJobs

Senior Software Engineer - AWS, Python, Ruby on Rails

Join HeyJobs as a Senior Software Engineer to design scalable systems using AWS, Python, and Ruby on Rails in a dynamic team.

Basetime BV logo
Basetime BV

Senior Python Developer with AWS Experience

Join Basetime BV as a Senior Python Developer to develop and maintain AWS cloud solutions. Hybrid work, competitive salary, and growth opportunities.

CARFAX Europe logo
CARFAX Europe

Senior DevOps Engineer

Join CARFAX Europe as a Senior DevOps Engineer to manage AWS infrastructure, develop CI/CD pipelines, and enhance system observability.

ANWB logo
ANWB

Full-stack JavaScript Developer

Join ANWB as a Full-stack JavaScript Developer to enhance our online platform using JavaScript, TypeScript, and AWS technologies.

9am logo
9am

Senior Solution Architect AWS (Freelance)

Seeking a Senior Solution Architect AWS for a freelance role in Frankfurt, Germany. Remote work available. Extensive AWS experience required.

Zalando logo
Zalando

Senior Backend/Data Engineer

Join Zalando as a Senior Backend/Data Engineer in Berlin to enhance our audience-building platform using AWS, Java, Scala, and SQL.

Moss logo
Moss

Senior Backend Engineer (Java, Spring)

Join Moss as a Senior Backend Engineer in Berlin, focusing on Java, Spring, and microservices.

Motius logo
Motius

Senior Backend Developer

Join Motius as a Senior Backend Developer to work on cutting-edge R&D projects using AWS, Docker, GraphQL, and more in a hybrid work environment.

PwC Deutschland logo
PwC Deutschland

Senior Developer Cloud Technologies

Join PwC Deutschland as a Senior Developer in Cloud Technologies, focusing on Azure, DevOps, and backend development.

Computer Futures logo
Computer Futures

Cloud Data Engineer

Seeking a Cloud Data Engineer with expertise in AWS, Python, and CI/CD for a hybrid role in Hannover. Join our dynamic team!

DeepL logo
DeepL

Senior Backend Engineer C++

Join DeepL as a Senior Backend Engineer C++ to design and maintain scalable backend services using C++ and AI technologies.

WECHEER logo
WECHEER

Full Stack Team Leader .Net

Lead a remote full-stack team with .NET and Angular expertise, focusing on technical leadership and hands-on development.

Carbon13 logo
Carbon13

Cofounder - Full Stack Developer/Data Scientist for Climatech Startup

Join Carbon13 as a cofounder in climate tech, leveraging AI, data science, and software development to combat climate change.

Oracle logo
Oracle

Cloud Solution Engineer (IC4)

Join Oracle as a Cloud Solution Engineer to design and deploy cloud architectures, driving customer success in Amsterdam.

Reaktor logo
Reaktor

Lead Developer with DevOps and Functional Programming

Join Reaktor as a Lead Developer in Amsterdam, focusing on DevOps, Functional Programming, and JavaScript in a hybrid work environment.

Uber logo
Uber

Staff Software Engineer: Data & Infrastructure Platforms - Metrics & Alerting

Join Uber's Amsterdam team as a Staff Software Engineer focusing on Data & Infrastructure Platforms, specializing in Metrics & Alerting.

Zalando logo
Zalando

Backend Software Engineer - Privacy Technology

Join Zalando as a Backend Software Engineer in Privacy Technology, focusing on data protection and privacy automation services.

Covestro logo
Covestro

Senior DevOps Engineer - Price & Deal Management

Join Covestro as a Senior DevOps Engineer to drive digital transformation in pricing and deal management with AWS, Docker, and Java expertise.