About Us
We believe AI will fundamentally transform how people live and work. CentML's mission is to massively reduce the cost of developing and deploying ML models so we can enable anyone to harness the power of AI and everyone to benefit from its potential.
Our founding team is made up of experts in AI, compilers, and ML hardware and has led efforts at companies like Amazon, Google, Microsoft Research, Nvidia, Intel, Qualcomm, and IBM. Our co-founder and CEO, Gennady Pekhimenko, is a world-renowned expert in ML systems who holds multiple academic and industry research awards from Google, Amazon, Facebook, and VMware.
About the Position
As a member of the LLM inference team, you will help build state-of-the-art software with the goal of enabling LLM inference to become more efficient, scalable, and accessible. Are you interested in architecting and implementing the best inference stacks in the LLM world? Work and collaborate with a diverse set of teams involving resource orchestration, distributed systems, inference engine optimization, and writing high-performance GPU kernels.
Come join our team and contribute towards democratizing Machine Learning for the world!
Responsibilities
- Write safe, scalable, modular, and high-quality (C++/Python) code for our core backend software.
- Perform benchmarking, profiling, and system-level programming for GPU applications.
- Provide code reviews, design docs, and tutorials to facilitate collaboration among the team.
- Conduct unit tests and performance tests for different stages of the inference pipeline.
Who You Are
- Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
- Strong coding skills in Python and C++.
- 5+ years of industry experience in software engineering.
- Knowledgeable and passionate about machine learning and performance engineering.
Nice to Haves
- Solid fundamentals in machine learning and deep learning.
- Solid fundamentals in operating systems, computer architecture, and parallel programming.
- Research experience in systems or machine learning.
- Industry experience in building enterprise-scale large distributed systems.
- Experience with training, deploying, or optimizing the inference of LLMs in production is a plus.
- Experience with performance modeling, profiling, debugging, and code optimization or architectural knowledge of CPU and GPU is a plus.
We strongly encourage you to include sample projects (e.g. Github) that demonstrate the qualifications above. For recent graduates, you can optionally submit your unofficial transcripts.
Benefits & Perks
- An open and inclusive work environment
- Employee stock options
- Best-in-class medical and dental benefits
- Parental Leave top-up for 6 months
- Professional development budget
- Flexible vacation time to promote a healthy work-life blend
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability, and any other protected ground of discrimination under applicable human rights legislation.
CentML strives to respect the dignity and independence of people with disabilities and is committed to giving them the same opportunity to succeed as all other employees.
Inclusiveness is core to our culture at CentML, and we strive to ensure you get the most from your interview experience. CentML makes reasonable accommodations for applicants with disabilities. If a reasonable accommodation is needed to participate in the job application or interview process, please reach out to the Talent team.
Benefits Extracted with AI
- Employee stock options
- Best-in-class medical and dental benefits
- Parental Leave top-up for 6 months
- Professional development budget
- Flexible vacation time
Similar jobs
Last update: 23 minutes ago
Machine Learning Engineer - LLM Fine-tuning and Performance
Join NVIDIA as a Machine Learning Engineer specializing in LLM fine-tuning and performance optimization. Work with cutting-edge ML technologies.
Senior Software Engineer - LLM
Join Snowflake as a Senior Software Engineer to build scalable machine learning platforms with LLMs, leveraging Python and TensorFlow.
Senior Software Engineer - LLM
Join Snowflake as a Senior Software Engineer to build scalable machine learning platforms with LLMs, leveraging Python and TensorFlow.
ML Engineering Manager, LLM Foundation
Lead ML engineering team at Stripe, focusing on LLMs and AI/ML systems. Drive innovation and manage high-impact projects.
Senior LLM Engineer
Join our team as a Senior LLM Engineer, leveraging AWS, Python, and JavaScript to develop scalable AI solutions.
LLM Engineer with Python and JavaScript
Join us as an LLM Engineer to design and develop scalable software solutions using Python, JavaScript, and AWS in a remote setting.
AI Research Engineer - LLM Training
Join Perplexity as an AI Research Engineer to enhance LLMs using AI, ML, and NLP in San Francisco.
Senior Software Developer - AI/LLM
Join Unicon as a Senior Software Developer specializing in AI/LLM, working on cutting-edge AI technologies in a hybrid role in Gilbert, AZ.
Senior Full Stack Engineer, LLM APIs
Join Abridge as a Senior Full Stack Engineer to build innovative ML-powered solutions in healthcare AI, focusing on LLM APIs and cloud services.
Senior AI Engineer
Join Poggio as a Senior AI Engineer to innovate AI systems for enterprise sales, focusing on AI capabilities and system performance.
Fullstack LLM Engineer
Join EQT Ventures as a Fullstack LLM Engineer to drive AI innovation in venture capital. Work with cutting-edge AI tools and data-driven insights.
Senior Machine Learning Engineer
Join Multiverse Computing as a Senior Machine Learning Engineer to lead LLM projects using quantum AI technologies.
AI Solutions Software Engineer
Join DwellFi as an AI Solutions Software Engineer to develop innovative AI solutions using LangChain or Llama. Remote position in Palo Alto, CA.
Machine Learning Scientist
Join Arena as a Machine Learning Scientist to develop AI systems using PyTorch and TensorFlow, focusing on real-world problem-solving.
Machine Learning Engineer
Join MoonPay as a Machine Learning Engineer to build and maintain ML infrastructure, collaborating with data scientists and cross-functional teams.
Senior Full-Stack Software Engineer
Join Monterey AI as a Senior Full-Stack Software Engineer to build AI-driven Voice of Customer platforms using Typescript, Node.js, SQL, and AWS.
AI Research Engineer
Join Perplexity as an AI Research Engineer to innovate AI-powered search solutions using LLMs in San Francisco.
Senior Software Engineer - AI and Search
Join Microsoft as a Senior Software Engineer in AI and Search, working on cutting-edge AI technologies in a hybrid role in Barcelona.
Machine Learning Engineer with Web3 and NLP Experience
Join Pass App as a Machine Learning Engineer to build AI solutions for web3, focusing on NLP and data pipelines.
Machine Learning Platform Engineer
Join Shopify as a Machine Learning Platform Engineer to build cutting-edge AI infrastructure and tools. Work remotely in a dynamic environment.
AI Engineer - Machine Learning and Robotics
Join Blueprint as an AI Engineer in Machine Learning and Robotics, focusing on scalable AI model training systems. Hybrid role in Redmond, WA.
Global IT LLM Engineer Director & Chapter Lead
Lead AI and ML innovation as Global IT LLM Engineer Director at BCG, focusing on GenAI product development and optimization.
AI Engineer with Machine Learning and Deep Learning Expertise
Join Pulley as an AI Engineer to develop AI-driven solutions, enhance internal tools, and collaborate with cross-functional teams.
Senior Full Stack Engineer (Java, React, MySQL)
Join LILT as a Senior Full Stack Engineer, working with Java, React, and MySQL to drive AI translation solutions. Remote with future hybrid work.