Senior Software Development Manager, ML Acceleration
Amazon Web Services (AWS)Job Overview
As the Senior Software Development Manager for the Neuron Inference Technology Team at Amazon Web Services (AWS), you will lead a dynamic team of managers and engineers in the development of distributed ML Inference features and use cases. Your primary responsibilities will include overseeing the full development lifecycle of features and extensions for inference support in our Neuronx_Distributed and Transformers_Neuronx Inference Libraries. You will also develop reliability, scalability features, and performance updates in these libraries, and contribute to other popular open Inference Libraries to enable them to make Trainium and Inferentia devices as the first-class citizens for ML Acceleration.
Responsibilities
- Leadership and Management: Lead a team of managers and engineers to achieve project goals. Ensure the right products are built and delivered to customers.
- Technical Development: Oversee the development of distributed ML Inference libraries and frameworks using Pytorch, JAX, and Tensorflow on XLA devices. Integrate and develop using C++ for framework integrations.
- Strategic Planning: Work with executive leadership and other senior management to define product directions and ensure they align with business objectives.
- Customer Interaction: Engage directly with customers to gather feedback and ensure their needs are met.
About the Team
The Neuron Inference Technology Team is part of AWS, a leader in cloud computing and infrastructure services. We focus on building massive-scale distributed training and inference solutions, integrating software, servers, and chips to accelerate at the highest scale.
Inclusive Team Culture
AWS values diversity and inclusion. We have various employee-led affinity groups and host annual learning experiences to promote an inclusive culture. Our leadership principles encourage seeking diverse perspectives and earning trust.
Work/Life Balance
We prioritize work-life balance, offering flexibility in working hours and encouraging a healthy balance between personal and professional life.
Mentorship and Career Growth
We are committed to supporting new team members and providing opportunities for career advancement through mentorship and varied projects.
Qualifications
- Experience: 10+ years in engineering, with at least 5 years in engineering team management. Experience in planning, designing, developing, and delivering consumer software.
- Skills: Proficiency in Machine Learning, Pytorch, JAX, Tensorflow, C++, and XLA. Experience with distributed systems is essential.
Preferred Qualifications
- Experience in large scale, high-traffic applications and partnering with product and program management teams.
Benefits Extracted with AI
- Flexible working hours
- Inclusive team culture
- Mentorship and career growth opportunities
Similar jobs
Last update: 23 minutes ago
Senior Applied Scientist, AWS Marketing AI/ML
Join AWS as a Senior Applied Scientist in Marketing AI/ML, leading personalization and targeting initiatives.
Applied Scientist, Artificial General Intelligence
Join AWS as an Applied Scientist in Artificial General Intelligence, driving AI innovation in cloud computing.
Senior Software Development Engineer, Customer Trust - Core Services
Join Amazon as a Senior Software Development Engineer to build scalable AI systems for customer trust.
Senior Distributed Systems Engineer
Join webAI as a Senior Distributed Systems Engineer to design and maintain scalable systems using Python, Kubernetes, and more.
Senior Machine Learning Engineer
Join Amazon as a Senior Machine Learning Engineer to build scalable AI/ML infrastructure and MLOps platforms.
Senior Applied Scientist
Join Amazon as a Senior Applied Scientist to lead machine learning projects, optimize ad performance, and drive innovation.
Senior Software Development Engineer
Join Amazon as a Senior Software Development Engineer to innovate in delivery and fulfillment technology.
Senior Worldwide Specialist, GenAI Model Training & Inference
Join AWS as a Senior Specialist in GenAI Model Training & Inference, driving customer adoption and scaling workloads.
Machine Learning Engineer with AI/ML Experience
Join us as a Machine Learning Engineer to develop AI/ML models and applications. Work remotely with top-tier companies.
Senior Cloud Engineer
Join as a Senior Cloud Engineer to architect and deploy cloud solutions using Azure, AWS, and GCP. Lead innovation in cloud technology.
AI Framework Engineer
Join webAI as an AI Framework Engineer to develop innovative AI frameworks for distributed computing environments.
Senior Applied Scientist
Join Amazon as a Senior Applied Scientist to lead machine learning projects, optimize models, and drive innovation in advertising.
Machine Learning Engineer for Predictive Metrics, Alexa Conversational Assistant Services
Join Amazon as a Machine Learning Engineer to develop predictive metrics for Alexa using Generative AI and AWS Inferentia2.
Senior Technical Program Manager, AI/ML
Join Meta as a Senior Technical Program Manager in AI/ML, driving impactful AI initiatives in Seattle.
Frontend Engineer II
Join AWS as a Frontend Engineer II to build web applications using Angular, CSS, and JavaScript frameworks.
Senior Fullstack Software Engineer, GenAI Horizontal Task Tooling
Join Scale AI as a Senior Fullstack Software Engineer to build web-based applications for AI data annotation.
Senior Software Engineer, Machine Learning
Join as a Senior Software Engineer in Machine Learning, working remotely to build ML-driven products for user engagement.
Senior Software Development Engineer
Join Microsoft as a Senior Software Development Engineer to drive AI and ML innovations in Windows.
Software Engineer - Platform
Join Refuel as a Software Engineer - Platform to design and develop critical features using Python, AWS, and LLMs in a hybrid work environment.
Senior ML Infrastructure Engineer
Join CHAI: AI Platform as a Senior ML Infrastructure Engineer to build and scale ML systems in Palo Alto.
Senior Applied Scientist, Sponsored Products
Join Amazon as a Senior Applied Scientist in New York, focusing on AI, ML, and data science for Sponsored Products.
Senior Software Engineer, Platform
Join Augment AI as a Senior Software Engineer to build AI-driven platforms using AWS, Ruby, and Python. Enjoy great benefits and stock options.
Lead Software Engineer with AWS and REST Expertise
Join Wellhub as a Lead Software Engineer to design scalable web applications using AWS and REST in a remote role.
Applied Scientist, Artificial General Intelligence
Join Amazon's AGI team as an Applied Scientist to develop cutting-edge AI technology in Computer Vision and NLP.