Amazon logo

Senior Software Engineer - Generative AI

Amazon

Job Description

Are you interested in advancing Amazon's Generative AI capabilities? Join a talented team of engineers and scientists in a highly collaborative and friendly environment. We are building state-of-the-art Generative AI technology that will benefit all Amazon businesses and customers.

Key Responsibilities

As a Software Development Engineer, you will be responsible for designing, developing, testing, and deploying high-performance inference capabilities. This includes multi-modality, state-of-the-art model architectures, latency, throughput, and cost optimization. You will collaborate closely with a team of engineers and scientists to influence our overall strategy and define the team’s roadmap. You will drive system architecture, spearhead best practices, and mentor junior engineers.

A Day in the Life

  • Read papers and consult with scientists to get inspiration from emerging techniques and integrate them into our roadmap.
  • Design and experiment with new algorithms, benchmark the latency and accuracy of your implementations.
  • Implement production-grade solutions and oversee their deployment.
  • Collaborate with other science and engineering teams to ensure proper execution.
  • Maintain high standards in operational excellence and support production systems, constantly creating solutions to minimize operational load.

About The Team

Our mission is to build best-in-class, fast, accurate, and cost-efficient large language model inference solutions and infrastructure that will enable Amazon businesses to deliver more value to their customers.

Basic Qualifications

  • 3+ years of non-internship professional software development experience.
  • 2+ years of non-internship design or architecture experience of new and existing systems.
  • Experience programming with at least one software programming language.
  • Prior experience with software performance optimization or knowledge of Machine Learning and Deep Learning.

Preferred Qualifications

  • 3+ years of full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.
  • Bachelor's degree in computer science or equivalent.
  • Experience with Large Language Model inference.
  • Experience with Trainium and Inferentia Development.
  • Experience with GPU programming (TensorRT-LLM).
  • Experience with Python, PyTorch, and C++ programming and performance optimization.

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit Amazon's disability accommodations page.

Compensation

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $129,300/year in our lowest geographic market up to $223,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits.

Benefits
Extracted with AI

  • Medical benefits
  • Financial benefits
  • Equity
  • Sign-on payments

Similar jobs

Last update: 23 minutes ago

Amazon logo
Amazon

Senior Software Engineer - Generative AI, AGI Inference Engine

Join Amazon as a Senior Software Engineer to advance Generative AI capabilities, focusing on high-performance inference.

Amazon logo
Amazon

Senior Software Development Engineer, Applied AI

Join Amazon's Applied AI team as a Senior Software Development Engineer to innovate with AI technologies.

Amazon logo
Amazon

Principal Technical Program Manager - Generative AI

Join Amazon as a Principal Technical Program Manager in Generative AI, leading complex projects and building state-of-the-art technology.

Amazon logo
Amazon

Senior Applied Scientist, Artificial General Intelligence

Join Amazon's AGI team as a Senior Applied Scientist to develop cutting-edge AI algorithms and models. Requires deep learning expertise.

Amazon logo
Amazon

Software Development Engineer (AI/ML)

Join Amazon as a Software Development Engineer in AI/ML, working on cutting-edge technology and solving complex problems.

Amazon logo
Amazon

Software Development Engineer Intern, Artificial General Intelligence

Join Amazon as a Software Development Engineer Intern in Artificial General Intelligence. Work on innovative AI technologies.

Amazon Web Services (AWS) logo
Amazon Web Services (AWS)

Senior Generative AI Data Scientist

Join AWS as a Senior Generative AI Data Scientist to lead AI innovations using Amazon SageMaker.

Amazon logo
Amazon

Senior Software Development Engineer

Join Amazon as a Senior Software Development Engineer to lead design efforts and develop innovative systems.

FoodLabs logo
FoodLabs

Senior C++ Computer Vision Engineer

Join a cutting-edge AI-DeepTech startup in Berlin as a Senior C++ Computer Vision Engineer. Work on world-class on-device AI technology.

Amazon logo
Amazon

Machine Learning Engineer for Predictive Metrics, Alexa Conversational Assistant Services

Join Amazon as a Machine Learning Engineer to develop predictive metrics for Alexa using Generative AI and AWS Inferentia2.

Amazon logo
Amazon

Senior Software Engineer, Machine Learning Infrastructure

Join Amazon's Search team as a Senior Software Engineer in ML Infrastructure, focusing on large-scale distributed systems and deep learning.

Amazon logo
Amazon

SDE 2 - Generative AI and Machine Learning

Join Amazon as an SDE 2, focusing on Generative AI and Machine Learning in Seattle. Develop cutting-edge AI technologies for enhanced user interactions.

Aiven logo
Aiven

Staff Software Engineer

Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.

Amazon logo
Amazon

Senior Applied Scientist

Join Amazon as a Senior Applied Scientist to lead machine learning projects, optimize ad performance, and drive innovation.

Amazon Web Services (AWS) logo
Amazon Web Services (AWS)

Senior Deep Learning Architect, Generative AI

Join AWS as a Senior Deep Learning Architect to innovate with Generative AI and transform business opportunities.

Amazon logo
Amazon

Senior Machine Learning Engineer

Join Amazon as a Senior Machine Learning Engineer to build scalable AI/ML infrastructure and MLOps platforms.

yourfirm GmbH logo
yourfirm GmbH

Senior Fullstack Developer for AI-Driven Mission Technologies

Seeking a Senior Fullstack Developer for AI-driven mission technologies, focusing on Java, JavaScript, Python, and C++. Remote work available.

Amazon Web Services (AWS) logo
Amazon Web Services (AWS)

Senior Systems Engineer, Managed Operations

Join AWS as a Senior Systems Engineer in Berlin to lead operations for the European Sovereign Cloud, ensuring high-availability AWS services.

Together AI logo
Together AI

Senior Backend Engineer - Java, Rust, Go

Join Together AI as a Senior Backend Engineer in Amsterdam. Work with Java, Rust, and Go to build scalable backend systems.

Datadog logo
Datadog

Staff Software Engineer - Generative AI

Lead Generative AI projects, enhance user experience, and mentor engineers at Datadog, a top cloud application monitoring platform.

Amazon logo
Amazon

Applied Scientist, Artificial General Intelligence

Join Amazon's AGI team as an Applied Scientist to develop cutting-edge AI technology in Computer Vision and NLP.

Amazon logo
Amazon

Senior Applied Scientist

Join Amazon as a Senior Applied Scientist to lead machine learning projects, optimize models, and drive innovation in advertising.

Meta logo
Meta

Software Engineer, Generative AI

Join Meta as a Software Engineer in Generative AI, focusing on NLP and large language models.

Amazon Web Services (AWS) logo
Amazon Web Services (AWS)

Senior ML Engineer - Generative AI Innovation Center

Senior ML Engineer needed in Milan for AWS, focusing on generative AI innovations, requiring expertise in AI, ML, Python, and cloud technologies.