Job Description
Are you interested in advancing Amazon's Generative AI capabilities? Join a talented team of engineers and scientists in a highly collaborative and friendly environment. We are building state-of-the-art Generative AI technology that will benefit all Amazon businesses and customers.
Key Responsibilities
As a Software Development Engineer, you will be responsible for designing, developing, testing, and deploying high-performance inference capabilities. This includes multi-modality, state-of-the-art model architectures, latency, throughput, and cost optimization. You will collaborate closely with a team of engineers and scientists to influence our overall strategy and define the team’s roadmap. You will drive system architecture, spearhead best practices, and mentor junior engineers.
A Day in the Life
- Read papers and consult with scientists to get inspiration from emerging techniques and integrate them into our roadmap.
- Design and experiment with new algorithms, benchmark the latency and accuracy of your implementations.
- Implement production-grade solutions and oversee their deployment.
- Collaborate with other science and engineering teams to ensure proper execution.
- Maintain high standards in operational excellence and support production systems, constantly creating solutions to minimize operational load.
About The Team
Our mission is to build best-in-class, fast, accurate, and cost-efficient large language model inference solutions and infrastructure that will enable Amazon businesses to deliver more value to their customers.
Basic Qualifications
- 3+ years of non-internship professional software development experience.
- 2+ years of non-internship design or architecture experience of new and existing systems.
- Experience programming with at least one software programming language.
- Prior experience with software performance optimization or knowledge of Machine Learning and Deep Learning.
Preferred Qualifications
- 3+ years of full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.
- Bachelor's degree in computer science or equivalent.
- Experience with Large Language Model inference.
- Experience with Trainium and Inferentia Development.
- Experience with GPU programming (TensorRT-LLM).
- Experience with Python, PyTorch, and C++ programming and performance optimization.
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit Amazon's disability accommodations page.
Compensation
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $129,300/year in our lowest geographic market up to $223,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits.
Benefits Extracted with AI
- Medical benefits
- Financial benefits
- Equity
- Sign-on payments
Similar jobs
Last update: 23 minutes ago
Senior Software Engineer - Generative AI, AGI Inference Engine
Join Amazon as a Senior Software Engineer to advance Generative AI capabilities, focusing on high-performance inference.
Senior Software Development Engineer, Applied AI
Join Amazon's Applied AI team as a Senior Software Development Engineer to innovate with AI technologies.
Principal Technical Program Manager - Generative AI
Join Amazon as a Principal Technical Program Manager in Generative AI, leading complex projects and building state-of-the-art technology.
Senior Applied Scientist, Artificial General Intelligence
Join Amazon's AGI team as a Senior Applied Scientist to develop cutting-edge AI algorithms and models. Requires deep learning expertise.
Software Development Engineer (AI/ML)
Join Amazon as a Software Development Engineer in AI/ML, working on cutting-edge technology and solving complex problems.
Software Development Engineer Intern, Artificial General Intelligence
Join Amazon as a Software Development Engineer Intern in Artificial General Intelligence. Work on innovative AI technologies.
Senior Generative AI Data Scientist
Join AWS as a Senior Generative AI Data Scientist to lead AI innovations using Amazon SageMaker.
Senior Software Development Engineer
Join Amazon as a Senior Software Development Engineer to lead design efforts and develop innovative systems.
Senior C++ Computer Vision Engineer
Join a cutting-edge AI-DeepTech startup in Berlin as a Senior C++ Computer Vision Engineer. Work on world-class on-device AI technology.
Machine Learning Engineer for Predictive Metrics, Alexa Conversational Assistant Services
Join Amazon as a Machine Learning Engineer to develop predictive metrics for Alexa using Generative AI and AWS Inferentia2.
Senior Software Engineer, Machine Learning Infrastructure
Join Amazon's Search team as a Senior Software Engineer in ML Infrastructure, focusing on large-scale distributed systems and deep learning.
SDE 2 - Generative AI and Machine Learning
Join Amazon as an SDE 2, focusing on Generative AI and Machine Learning in Seattle. Develop cutting-edge AI technologies for enhanced user interactions.
Staff Software Engineer
Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.
Senior Applied Scientist
Join Amazon as a Senior Applied Scientist to lead machine learning projects, optimize ad performance, and drive innovation.
Senior Deep Learning Architect, Generative AI
Join AWS as a Senior Deep Learning Architect to innovate with Generative AI and transform business opportunities.
Senior Machine Learning Engineer
Join Amazon as a Senior Machine Learning Engineer to build scalable AI/ML infrastructure and MLOps platforms.
Senior Fullstack Developer for AI-Driven Mission Technologies
Seeking a Senior Fullstack Developer for AI-driven mission technologies, focusing on Java, JavaScript, Python, and C++. Remote work available.
Senior Systems Engineer, Managed Operations
Join AWS as a Senior Systems Engineer in Berlin to lead operations for the European Sovereign Cloud, ensuring high-availability AWS services.
Senior Backend Engineer - Java, Rust, Go
Join Together AI as a Senior Backend Engineer in Amsterdam. Work with Java, Rust, and Go to build scalable backend systems.
Staff Software Engineer - Generative AI
Lead Generative AI projects, enhance user experience, and mentor engineers at Datadog, a top cloud application monitoring platform.
Applied Scientist, Artificial General Intelligence
Join Amazon's AGI team as an Applied Scientist to develop cutting-edge AI technology in Computer Vision and NLP.
Senior Applied Scientist
Join Amazon as a Senior Applied Scientist to lead machine learning projects, optimize models, and drive innovation in advertising.
Software Engineer, Generative AI
Join Meta as a Software Engineer in Generative AI, focusing on NLP and large language models.
Senior ML Engineer - Generative AI Innovation Center
Senior ML Engineer needed in Milan for AWS, focusing on generative AI innovations, requiring expertise in AI, ML, Python, and cloud technologies.