Job Overview
As the Senior Software Development Manager for the Neuron Inference Technology Team at Amazon Web Services (AWS), you will lead a dynamic team of managers and engineers in the development of distributed ML Inference features and use cases. Your primary responsibilities will include overseeing the full development lifecycle of features and extensions for inference support in our Neuronx_Distributed and Transformers_Neuronx Inference Libraries. You will also develop reliability, scalability features, and performance updates in these libraries, and contribute to other popular open Inference Libraries to enable them to make Trainium and Inferentia devices as the first-class citizens for ML Acceleration.
Responsibilities
- Leadership and Management: Lead a team of managers and engineers to achieve project goals. Ensure the right products are built and delivered to customers.
- Technical Development: Oversee the development of distributed ML Inference libraries and frameworks using Pytorch, JAX, and Tensorflow on XLA devices. Integrate and develop using C++ for framework integrations.
- Strategic Planning: Work with executive leadership and other senior management to define product directions and ensure they align with business objectives.
- Customer Interaction: Engage directly with customers to gather feedback and ensure their needs are met.
About the Team
The Neuron Inference Technology Team is part of AWS, a leader in cloud computing and infrastructure services. We focus on building massive-scale distributed training and inference solutions, integrating software, servers, and chips to accelerate at the highest scale.
Inclusive Team Culture
AWS values diversity and inclusion. We have various employee-led affinity groups and host annual learning experiences to promote an inclusive culture. Our leadership principles encourage seeking diverse perspectives and earning trust.
Work/Life Balance
We prioritize work-life balance, offering flexibility in working hours and encouraging a healthy balance between personal and professional life.
Mentorship and Career Growth
We are committed to supporting new team members and providing opportunities for career advancement through mentorship and varied projects.
Qualifications
- Experience: 10+ years in engineering, with at least 5 years in engineering team management. Experience in planning, designing, developing, and delivering consumer software.
- Skills: Proficiency in Machine Learning, Pytorch, JAX, Tensorflow, C++, and XLA. Experience with distributed systems is essential.
Preferred Qualifications
- Experience in large scale, high-traffic applications and partnering with product and program management teams.
Benefits Extracted with AI
- Flexible working hours
- Inclusive team culture
- Mentorship and career growth opportunities
Similar jobs
Last update: 23 minutes ago
Senior Machine Learning Engineer, AWS Neuron Apps
Senior ML Engineer needed for AWS Neuron Apps, focusing on ML Inference with expertise in Python, TensorFlow, and distributed computing.
Senior Machine Learning Engineer
Join Amazon as a Senior Machine Learning Engineer to build scalable AI/ML infrastructure and MLOps platforms.
Senior Software Engineer - AI/ML, AWS Neuron Distributed Training
Senior Software Engineer for AI/ML at AWS Neuron, focusing on distributed training systems.
Senior Software Engineer, Machine Learning Infrastructure
Join Amazon's Search team as a Senior Software Engineer in ML Infrastructure, focusing on large-scale distributed systems and deep learning.
Senior Worldwide Specialist, GenAI Model Training & Inference
Join AWS as a Senior Specialist in GenAI Model Training & Inference, driving customer adoption and scaling workloads.
Senior ML Engineer - Generative AI Innovation Center
Senior ML Engineer needed in Milan for AWS, focusing on generative AI innovations, requiring expertise in AI, ML, Python, and cloud technologies.
Senior Applied Scientist, AWS Marketing AI/ML
Join AWS as a Senior Applied Scientist in Marketing AI/ML, leading personalization and targeting initiatives.
Software Development Engineer in EC2 Accelerated Platforms
Join AWS in Berlin as a Software Development Engineer in EC2 Accelerated Platforms, working on cutting-edge cloud technologies.
Senior Software Development Engineer, Applied AI
Join Amazon's Applied AI team as a Senior Software Development Engineer to innovate with AI technologies.
Senior Software Development Engineer III, AWS IDEs
Join AWS as a Senior Software Development Engineer to build AI/ML tools for developers, enhancing cloud experiences.
Account Manager, AI/ML Startups
Join AWS as an Account Manager for AI/ML startups, driving success and innovation in cloud computing.
Senior Software Engineer - Cloud
Join Lambda as a Senior Software Engineer to build the world's best deep learning cloud using AWS, Python, and distributed systems.
Software Development Engineer, AWS Compute Services
Join AWS as a Software Development Engineer to innovate in serverless computing. Work on large-scale systems in Austin, Texas.
Applied Scientist, Artificial General Intelligence
Join AWS as an Applied Scientist in Artificial General Intelligence, driving AI innovation in cloud computing.
Software Development Engineer Intern - Machine Learning Chip Architect
Join AWS as a Software Development Engineer Intern focusing on Machine Learning Chip Architecture. Enhance your skills in a dynamic environment.
Senior Systems Development Engineer, Managed Operations
Join AWS as a Senior Systems Development Engineer to improve and operate large-scale software systems in Berlin.
Deep Learning Architect, Generative AI Innovation Center
Join AWS as a Deep Learning Architect in Milan to innovate with Generative AI and transform business opportunities.
Software Development Engineer II, AWS Field Experience
Join AWS as a Software Development Engineer II to build innovative global products. Embrace a culture of inclusion and career growth.
Principal Systems Development Engineer, Managed Operations
Join AWS as a Principal Systems Development Engineer to drive operational efficiency and reliability in cloud services.
Senior Specialist, GenAI Frameworks at AWS
Senior Specialist in GenAI Frameworks at AWS, focusing on market development and customer engagement through innovative AI solutions.
Software Development Engineer, AWS Systems Manager
Join AWS in Berlin as a Software Development Engineer to innovate and build on AWS Systems Manager.
Deep Learning Architect, AWS Generative AI Innovation Center
Join AWS as a Deep Learning Architect to innovate with Generative AI, solving real-world problems in a fast-paced environment.
Senior Software Engineer - Generative AI, AGI Inference Engine
Join Amazon as a Senior Software Engineer to advance Generative AI capabilities, focusing on high-performance inference.
Senior Software Development Engineer - AWS Commerce Platform
Senior Software Development Engineer for AWS Commerce Platform in Tempe, AZ. Involves large-scale data processing and distributed computing challenges.
