Senior Software Engineer, Machine Learning Infrastructure

Job Description

The Amazon Search team is seeking a Senior Software Engineer to join our Machine Learning Infrastructure team. This team is responsible for the large-scale distributed software systems that power Amazon's search results, a critical feature used by millions of customers daily. We design, build, and operate high-performance, fault-tolerant software services that leverage the latest technologies to solve customer problems.

Key Responsibilities

• Evolve a sophisticated deep-learning ranking system and feature store deployed across thousands of machines in AWS, serving billions of queries at tens of millisecond latencies.
• Provide cutting-edge solutions to large-scale information retrieval and machine learning (ML/DL) problems.
• Focus on scalability, latency, performance robustness, and cost trade-offs in highly virtualized, elastic, cloud-based environments.
• Conduct and automate performance testing of the model serving system to evaluate different hardware options, model architectures, and serving configurations.
• Lead the implementation and enhancement of a rapid experimentation framework to test ranking hypotheses.
• Create mechanisms to ensure models work as expected in production.
• Collaborate closely with applied scientists to determine the requirements for deploying ranking models in production environments.
• Work with Principal Engineers in Amazon Search to set the technical vision for the team.

Basic Qualifications

• 5+ years of non-internship professional software development experience.
• 5+ years of experience leading design or architecture of new and existing systems.
• Proficiency in programming with at least one software programming language such as C++, Java, or Scala, as well as Python, Perl, or related scripting languages.
• Experience in large-scale AI and ML infrastructure and technologies including PyTorch, TensorRT, AWS Inferentia, Triton Inference Server, etc.
• Experience writing production code for services utilizing Machine Learning or Information Retrieval algorithms.

Preferred Qualifications

• 5+ years of full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.
• Experience implementing large-scale low-latency distributed systems and working with scalable algorithms utilizing large amounts of data.
• Masters Degree or PhD in Computer Science or related discipline.

About Amazon

Amazon is committed to a diverse and inclusive workplace. We are an equal opportunity employer and do not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.

Compensation

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $151,300/year in our lowest geographic market up to $261,500/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits.