Otter.ai logo

Senior Software Engineer, LLM

Otter.ai

Job Opportunity: Senior Software Engineer, LLM

The Opportunity

Our growing company is actively seeking a highly-skilled Large Language Model (LLM) Engineer to join our team. This role will have you directly involved in the design and development of state-of-the-art LLM-based algorithms and systems that power our conversational AI applications. If you possess a passion for pushing the boundaries of LLM technologies and have relevant LLM experience, we would love to connect.

Your Impact

  • Spearhead the design, development, and optimization of robust, scalable systems and infrastructure for deploying pioneering algorithms and systems based on large language models.
  • Conduct research and rapidly prototype neural network architectures, training pipelines, inference servers, etc., ensuring we continually stay a step ahead in serving production workloads.
  • Benchmark and profile diverse software/hardware configurations, striving for optimal model performance.
  • Drive implementation of model optimizations for a more scalable and cost-effective LLM system.
  • Collaborate closely with our team of research engineers to streamline the transition of machine learning models and algorithms into production.
  • Monitor and incessantly enhance system efficiency, latency, throughput, and more.

We're Looking For Someone Who

  • Holds a Master's Degree in Computer Science or a related technical discipline; a PhD is a plus.
  • Has 5+ years of demonstrated experience in the construction and optimization of AI/NLP infrastructure and pipelines.
  • Is proficient in Python and experienced with frameworks like PyTorch/TensorFlow.
  • Has experience working with existing large language models, which is highly desirable.
  • Possesses superior system design and analytical abilities, with an eye for problem-solving.
  • Demonstrates the capacity to deliver in a high-velocity, dynamic environment.

About Otter.ai

We are in the business of shaping the future of work. Our mission is to make conversations more valuable. With over 1B meetings transcribed, Otter.ai is the world’s leading tool for meeting transcription, summarization, and collaboration. Using artificial intelligence, Otter generates real-time automated meeting notes, summaries, and other insights from in-person and virtual meetings - turning meetings into accessible, collaborative, and actionable data that can be shared across teams and organizations. The company is backed by early investors in Google, DeepMind, Zoom, and Tesla.

Otter.ai is an equal opportunity employer. We proudly celebrate diversity and are dedicated to inclusivity.

Salary Range

Salary Range: $155,000 to $210,000 USD per year. This salary range represents the low and high end of the estimated salary range for this position. The actual base salary offered for the role is dependent on several factors. Our base salary is just one component of our comprehensive total rewards package.

Benefits
Extracted with AI

  • Comprehensive total rewards package

Similar jobs

Last update: 23 minutes ago

Otter.ai logo
Otter.ai

Senior Software Engineer, iOS

Join Otter.ai as a Senior iOS Engineer to lead mobile app development with Swift and Objective-C in a dynamic environment.

Persona logo
Persona

LLM Backend Developer

Join Persona as a LLM Backend Developer, work remotely, and develop AI-driven backend systems for top startups.

DeepL logo
DeepL

Senior Backend Engineer C++

Join DeepL as a Senior Backend Engineer C++ to design and maintain scalable backend services using C++ and AI technologies.

FoodLabs logo
FoodLabs

Senior C++ Computer Vision Engineer

Join a cutting-edge AI-DeepTech startup in Berlin as a Senior C++ Computer Vision Engineer. Work on world-class on-device AI technology.

Huawei Nederland logo
Huawei Nederland

Senior ASR / TTS Researcher

Join Huawei's research center in Amsterdam as a Senior ASR/TTS Researcher, focusing on speech synthesis and AI.

n8n logo
n8n

Senior Software Engineer (Node.js & TypeScript)

Join n8n as a Senior Software Engineer to build AI applications using Node.js and TypeScript. Remote role within Europe.

LEGALFLY logo
LEGALFLY

Back End Engineer with Node.js and TypeScript

Join LegalFly as a Back End Engineer to revolutionize legal AI with Node.js and TypeScript in a hybrid role in Ghent.

Huawei Nederland logo
Huawei Nederland

Information Retrieval Algorithm Engineer

Join Huawei as an Information Retrieval Algorithm Engineer to develop cutting-edge AI technologies in Amsterdam.

Together AI logo
Together AI

Senior Backend Engineer - Java, Rust, Go

Join Together AI as a Senior Backend Engineer in Amsterdam. Work with Java, Rust, and Go to build scalable backend systems.

Nebius AI logo
Nebius AI

Senior Software Engineer (C++)

Join Nebius as a Senior Software Engineer (C++) to develop reliable cloud services in a hybrid work environment.

Cere Network logo
Cere Network

Principal AI Engineer

Join Cere Network as a Principal AI Engineer to drive AI innovation in Web3. Requires 10+ years in AI/ML, NLP, and software development.

Attio logo
Attio

Senior Product Engineer [Rust & Typescript]

Join Attio as a Senior Product Engineer working with Rust & TypeScript to build innovative CRM features. Remote work available.

Nebius AI logo
Nebius AI

Senior Backend Engineer (Go)

Join Nebius as a Senior Backend Engineer (Go) to develop fault-tolerant cloud services in a hybrid work environment.

yourfirm GmbH logo
yourfirm GmbH

Senior Fullstack Developer for AI-Driven Mission Technologies

Seeking a Senior Fullstack Developer for AI-driven mission technologies, focusing on Java, JavaScript, Python, and C++. Remote work available.

NN Group logo
NN Group

Senior Full-stack Engineer (Angular, Node.js, TypeScript)

Join NN Group as a Senior Full-stack Engineer, leading software architecture and development with Angular, Node.js, and TypeScript.

Bitmovin logo
Bitmovin

Senior C++ Software Engineer

Join Bitmovin as a Senior C++ Software Engineer to develop scalable video streaming solutions using modern C++ and cloud-native architectures.

Pleo logo
Pleo

Senior Backend Engineer (Kotlin, Microservices)

Join Pleo as a Senior Backend Engineer, focusing on Kotlin and microservices in Berlin. Drive innovation in a dynamic, collaborative environment.

Uber logo
Uber

Senior Software Engineer (Elasticsearch)

Join Uber as a Senior Software Engineer specializing in Elasticsearch, working on sophisticated infrastructure across data centers and cloud.

Aiven logo
Aiven

Staff Software Engineer

Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.

TrueLayer logo
TrueLayer

Senior Software Engineer - C#/.NET

Join TrueLayer as a Senior Software Engineer in Milan, working with C#, .NET, AWS, and Kubernetes to build scalable systems.

Grammarly logo
Grammarly

Entry Level Back-End Software Engineer (Java)

Join Grammarly as an Entry Level Back-End Software Engineer in Berlin. Work with Java, AWS, and more in a hybrid environment.

TomTom logo
TomTom

Senior Software Engineer III - Java

Join TomTom as a Senior Software Engineer III in Amsterdam, focusing on Java and back-end development in a hybrid work environment.

Bonfy.AI logo
Bonfy.AI

Senior Software Engineer - LLM

Join Bonfy.AI as a Senior Software Engineer to develop and optimize scalable machine learning models using Python, TensorFlow, and cloud platforms.

Pleo logo
Pleo

Senior Mobile Platform Engineer

Join Pleo as a Senior Mobile Platform Engineer to empower product teams in building and maintaining mobile app features with React Native and TypeScript.