Senior Software Engineer, LLM/VLM
Enchanted ToolsJob Overview
As a Senior Software Engineer at Enchanted Tools, you will be at the forefront of integrating Large Language Models (LLM) and Vision Language Models (VLM) into our advanced robotic systems. Your role will involve designing and implementing efficient pipelines for LLM/VLM integration, focusing on real-time, multimodal data processing including vision, audio, text, and sensor fusion. You will leverage your expertise in quantization techniques and model size reduction methods to optimize models for deployment on edge devices with limited computational resources.
Responsibilities
- Design and implement efficient pipelines for LLM/VLM integration into robot control systems.
- Leverage expertise in quantization techniques and model size reduction methods.
- Collaborate with R&D teams to ensure seamless integration of AI models with robot hardware, software, and sensor systems.
- Stay up-to-date on the latest advancements in deep learning on the edge and multimodal processing.
- Design and implement benchmarks and continuous monitoring systems to evaluate model performance and its downstream effects on the data pipeline.
- Evaluate potential third-party partners and collaborate with other engineers to develop innovative solutions.
Qualifications
- Master's or Ph.D. degree in Computer Science, Machine Learning, Robotics, or a related field.
- 3+ years of experience in developing and deploying deep learning models, focusing on multimodal data processing.
- Proven experience with LLM and/or VLM architectures, applying best MLOps practices.
- Real hands-on practices with LLM implementation tools and frameworks (LangChain, RLHF, Vector DBs).
- Expertise in Python programming and deep learning frameworks (e.g., PyTorch, ONNX).
- Hands-on experience with containerization technologies like Docker and deployment frameworks like TensorRT for on-device inference.
Plus Points
- Experience with robot simulation platforms (e.g., Isaac, Gazebo, Rviz).
- Experience with robotics and embedded systems programming.
- Experience in multimodal data processing or affective computing.
- Experience with cloud computing (AWS Sagemaker, GCP).
Hiring Process
- Video interview with a recruiter.
- Video Interview with the Hiring Manager.
- Video interview with the HR Director.
- Offer.
You are welcome to visit our offices and meet Miroki and Miroka during the process.
Benefits Extracted with AI
- Freedom to test and own your work
- Opportunity to work on cutting-edge technology
- Chance to make a real impact on the future of robotics
- Collaborative and supportive work environment
- Chance to learn and grow with a team of talented engineers
Similar jobs
Last update: 23 minutes ago
Senior Software Engineer, Machine Learning
Join as a Senior Software Engineer in Machine Learning, working remotely to build ML-driven products for user engagement.
Senior Software Engineer - Language Tools
Join Datadog as a Senior Software Engineer in Lyon to develop and support language tools for backend engineers.
Senior Software Engineer, Machine Learning
Join Niantic as a Senior Software Engineer in Machine Learning to enhance products using generative AI technologies.
Machine Learning Engineer with AI/ML Experience
Join us as a Machine Learning Engineer to develop AI/ML models and applications. Work remotely with top-tier companies.
Senior Machine Learning Engineer
Join Echo Analytics as a Senior Machine Learning Engineer in Paris. Leverage ML to drive data modeling and design intelligent data flows.
AI Research Engineer - Automation and Control
Join Helsing as an AI Research Engineer in Paris, focusing on automation and control systems in AI. Work with cutting-edge technology.
Senior Fullstack JavaScript Engineer / Product Developer
Join lempire as a Senior Fullstack JavaScript Engineer to design and develop features for innovative SaaS products.
Software Architect with DevOps and CI/CD Expertise
Join Robovision as a Software Architect to lead software design and architecture with a focus on DevOps and CI/CD.
Machine Learning Engineer
Join Ema Unlimited as a Machine Learning Engineer in SF Bay Area, working on cutting-edge AI solutions with a focus on NLP and ML technologies.
Senior Software Engineer - Language Tools
Join Datadog as a Senior Software Engineer in Lisbon to develop language tools for backend engineers.
Senior Software Engineer
Join Umbra as a Senior Software Engineer to develop software for autonomous satellite operations. Remote or hybrid in Santa Barbara, CA.
Remote Software Engineer
Join Waabi as a Remote Software Engineer to develop cutting-edge self-driving technology. Work with AI, Python, C++, and more.
Senior Machine Learning Engineer - NLP
Join Parrot as a Senior Machine Learning Engineer focusing on NLP to develop cutting-edge AI solutions for legal tech.
FullStack Software Developer
Join SPREAD AI as a FullStack Software Developer in Berlin. Work with JavaScript, Python, Go, and more in a hybrid setup.
Senior Software Engineer, Platform
Join Augment AI as a Senior Software Engineer to build AI-driven platforms using AWS, Ruby, and Python. Enjoy great benefits and stock options.
Senior Distributed Systems Engineer
Join webAI as a Senior Distributed Systems Engineer to design and maintain scalable systems using Python, Kubernetes, and more.
Principal Software Engineer
Join Farmless as a Principal Software Engineer to revolutionize food production with cutting-edge software solutions.
Senior DevOps Engineer
Join InstaDeep as a Senior DevOps Engineer in Paris, working at the intersection of machine learning and engineering.
Mid-Level AI Researcher
Join Leonardo.Ai as a Mid-Level AI Researcher to develop and refine AI models, focusing on model training and optimization.
FullStack Software Developer
Join SPREAD AI as a FullStack Software Developer to innovate in data management and engineering intelligence.
Senior Software Engineer (Full-Stack)
Join Parrot as a Senior Software Engineer (Full-Stack) to build AI-driven web applications and backend services.
Staff Engineer - Python, Cloud, Distributed Systems
Join Keelvar as a Staff Engineer to lead design and architecture in a remote role, focusing on Python, cloud, and distributed systems.
Founding AI Engineer
Join LlamaIndex as a Founding AI Engineer to shape the future of LLM applications with cutting-edge AI projects.
Software Engineer - Platform
Join Refuel as a Software Engineer - Platform to design and develop critical features using Python, AWS, and LLMs in a hybrid work environment.