Machine Learning Engineer for Predictive Metrics, Alexa Conversational Assistant Services

Job Description

We are seeking an experienced and curious machine learning engineer to join our predictive CX metrics organization at Amazon. As our SDE/MLE superstar, you'll have the power to lead the charge in developing cutting-edge inference and architectures to ensure our scientists can push the boundaries of large model training, especially with experience in AWS Inferentia2. Your groundbreaking work will directly impact our customers' lives through life-changing and delightful products and services.

Key Responsibilities

• Quickly learn cutting-edge technologies and algorithms in the field of Generative AI to participate in our journey to build the best LLMs.
• Develop and maintain key platforms needed for developing, evaluating, and deploying LLMs for real-world applications.
• Collaborate with team members, including applied/research/data scientists, linguists, other engineers, and product leads, to investigate design approaches, prototype new technology, and evaluate technical feasibility.
• Work closely with applied scientists to process massive data (e.g., 20B parameters) and scale machine learning models while optimizing.
• Maintain high standards for operational readiness, operational excellence, and runbook documentation.
• Demonstrate curiosity and adaptability in your work.
• Work hard, have fun, and make history!

A Day in the Life

• Design, document, and build novel inference infrastructure and/or modeling techniques using hardware like AWS Inferentia2.
• Inform and guide the predictive metrics roadmap based on learnings, opportunities, and efficiencies in hardware and infrastructure.
• Attend scrum activities to ensure technical delivery is on-time, under-budget, and meeting customer requirements.
• Maintain high standards for technical implementation, from code revision submissions/reviews to operational readiness and excellence.
• Be attentive to customer needs and continuously seek improvements in predictive metrics and infrastructure.

About The Team

We are a cross-functional organization comprised of product managers, data engineers, business intelligence engineers, software development engineers, and science-focused teams with applied scientists, research scientists, and machine learning engineers. We are passionate about building and improving our analytics platform, "Gale", which enables Alexa developers and leaders to make informed business and CX decisions reliably and quickly. We are deeply rooted in big data, responsible (privacy, secure) data, performant services, and user-friendly analytics applications.

Basic Qualifications

• 3+ years of non-internship professional software development experience.
• 2+ years of non-internship design or architecture experience (design patterns, reliability, and scaling) of new and existing systems.
• Experience programming with at least one software programming language.

Preferred Qualifications

• 3+ years of full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.
• Bachelor's degree in computer science or equivalent.
• Expertise in model deployment on inf2.

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.