Boston Consulting Group (BCG) logo

Global IT LLM Engineer Director & Chapter Lead

Boston Consulting Group (BCG)

Job Overview

Boston Consulting Group (BCG) is seeking a Global IT LLM Engineer Director & Chapter Lead to join our team in Atlanta, GA. This role is pivotal in driving the development and optimization of GenAI products, transforming the way BCG operates. As a Squad Leader, you will leverage your expertise in full stack development, performance, and stability of custom-built products, focusing on LLM-based applications, data science/ML, and backend development.

Key Responsibilities

Develop Chapter Expertise

  • Maintain best-in-class Chapter expertise and resources to deliver the right knowledge and skills to Squads.
  • Stay updated on relevant developments and innovations in your domain, both internally and externally.
  • Continuously improve your technical knowledge and that of your Chapter members.

Develop Chapter Members

  • Oversee and provide feedback to Chapter members to enhance their domain knowledge.
  • Discuss development progress and opportunities with the Tech Area Lead.

Share Knowledge

  • Ensure alignment with established technical roadmaps and guardrails.
  • Share insights and developments within your area of expertise with Chapter members and related Chapters.
  • Actively share knowledge across the organization.

Identify Resource Needs

  • Engage with Product Owners, Tribe Leads, and Tech Area Leads to allocate Chapter members effectively.
  • Identify expertise and resource gaps, and train or hire talent to address them.

Work in a Squad

  • Advance the work of the Squad based on backlog items and priorities set by the Product Owner.
  • Collaborate cross-functionally to advance the work of the Squad.

Enable New Ways of Working

  • Model behaviors to support the organization’s transformation to a new way of working.
  • Create and maintain a positive culture within the Chapter based on Agile leadership behaviors.

Skills and Qualifications

Mandatory

  • BA degree in Computer Science, Statistics, or related field with a focus on AI, Machine Learning, or NLP.
  • At least 10 years of working experience, with 2+ years in developing and experimenting with LLMs and 6+ years in AI/ML technologies.
  • Proficiency in Python and associated data science libraries and frameworks.
  • Strong knowledge in AI, machine learning, and natural language processing.
  • Experience with key LLM models APIs (e.g., OpenAI, Anthropic) and LLM Frameworks (e.g., LangChain, LlamaIndex).
  • Experience with multi-agent frameworks/systems and understanding of their applications.
  • Expertise in using LlamaIndex for building and querying knowledge bases.
  • Experience in constructing and querying knowledge graphs, including technologies like Neo4j or RDF triplestores.

Nice to Have

  • Experience with cloud infrastructure for AI/ML.
  • Experience with LLM guardrails and monitoring.
  • Experience with security related to LLM integration.

Work Environment

This position is based in Atlanta, GA, and requires on-site presence. You will work closely with your AI Engineering team, Tribe Leaders, Product Owners, and Agile Coaches to ensure effective collaboration and adoption of agile principles.

About BCG

Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. We embrace a transformational approach aimed at benefiting all stakeholders, empowering organizations to grow, build sustainable competitive advantage, and drive positive societal impact.

Join us in this exciting role to lead and innovate in the field of AI and machine learning, contributing to the transformation of BCG and its clients.

Similar jobs

Last update: 23 minutes ago

BCG X logo
BCG X

AI Software Engineer Intern

Join BCG X as an AI Software Engineer Intern to develop AI solutions and partner with clients across industries.

BCG X logo
BCG X

AI Software Engineer Intern

Join BCG X as an AI Software Engineer Intern to develop AI solutions and collaborate with global teams.

DwellFi  logo
DwellFi

AI Solutions Software Engineer

Join DwellFi as an AI Solutions Software Engineer to develop innovative AI solutions using LangChain or Llama. Remote position in Palo Alto, CA.

Poggio logo
Poggio

Senior AI Engineer

Join Poggio as a Senior AI Engineer to innovate AI systems for enterprise sales, focusing on AI capabilities and system performance.

UKG logo
UKG

Lead AI Full Stack Developer

Lead AI Full Stack Developer role in Alpharetta, GA, focusing on AI-driven applications using GCP, full-stack development, and MLOps.

micro1 logo
micro1

LLM Engineer with Python and JavaScript

Join us as an LLM Engineer to design and develop scalable software solutions using Python, JavaScript, and AWS in a remote setting.

Poggio logo
Poggio

Senior AI Engineer

Join Poggio as a Senior AI Engineer to revolutionize sales with AI. Work remotely, leverage LLMs, and enhance AI systems.

Unisys logo
Unisys

LLM Engineer

Join Unisys as an LLM Engineer to revolutionize ITSM with large language models. Work remotely in Vilnius, Lithuania.

Blueprint logo
Blueprint

AI Engineer - Machine Learning and Robotics

Join Blueprint as an AI Engineer in Machine Learning and Robotics, focusing on scalable AI model training systems. Hybrid role in Redmond, WA.

Stripe logo
Stripe

ML Engineering Manager, LLM Foundation

Lead ML engineering team at Stripe, focusing on LLMs and AI/ML systems. Drive innovation and manage high-impact projects.

EQT Ventures logo
EQT Ventures

Fullstack LLM Engineer

Join EQT Ventures as a Fullstack LLM Engineer to drive AI innovation in venture capital. Work with cutting-edge AI tools and data-driven insights.

Unicon, Inc. logo
Unicon, Inc.

Senior Software Developer - AI/LLM

Join Unicon as a Senior Software Developer specializing in AI/LLM, working on cutting-edge AI technologies in a hybrid role in Gilbert, AZ.

Shopify logo
Shopify

Machine Learning Platform Engineer

Join Shopify as a Machine Learning Platform Engineer to build cutting-edge AI infrastructure and tools. Work remotely in a dynamic environment.

NVIDIA logo
NVIDIA

Machine Learning Engineer - LLM Fine-tuning and Performance

Join NVIDIA as a Machine Learning Engineer specializing in LLM fine-tuning and performance optimization. Work with cutting-edge ML technologies.

Abridge logo
Abridge

Senior Full Stack Engineer, LLM APIs

Join Abridge as a Senior Full Stack Engineer to build innovative ML-powered solutions in healthcare AI, focusing on LLM APIs and cloud services.

Bonfy.AI logo
Bonfy.AI

Senior Software Engineer - LLM

Join Bonfy.AI as a Senior Software Engineer to develop and optimize scalable machine learning models using Python, TensorFlow, and cloud platforms.

Grab logo
Grab

Lead Data Scientist - Computer Vision and Machine Learning

Lead Data Scientist role focusing on computer vision and machine learning for map automation at Grab in Cluj-Napoca.

Aleph logo
Aleph

Frontend Engineer, AI

Join Aleph as a Frontend Engineer focusing on AI to develop innovative features using React.js and AI technologies in a remote role.

Neon logo
Neon

Lead AI Engineer

Lead AI Engineer role focusing on building AI Agents for Neon platform, leading a small team, and enhancing developer experience.

Stream logo
Stream

Python AI Developer Advocate

Join Stream as a Python AI Developer Advocate to build community and enhance AI integrations. Engage with developers and influence product roadmaps.

Snowflake logo
Snowflake

Senior Software Engineer - LLM

Join Snowflake as a Senior Software Engineer to build scalable machine learning platforms with LLMs, leveraging Python and TensorFlow.

LILT logo
LILT

Senior Full Stack Engineer (Java, React, MySQL)

Join LILT as a Senior Full Stack Engineer, working with Java, React, and MySQL to drive AI translation solutions. Remote with future hybrid work.

Norma logo
Norma

Senior Data Scientist

Join Norma as a Senior Data Scientist to lead data insights projects using AI and machine learning in a hybrid work environment.

MoonPay logo
MoonPay

Machine Learning Engineer

Join MoonPay as a Machine Learning Engineer to build and maintain ML infrastructure, collaborating with data scientists and cross-functional teams.