Boston Consulting Group (BCG) logo

Global IT LLM Engineer Director & Chapter Lead

Boston Consulting Group (BCG)

Job Overview

Boston Consulting Group (BCG) is seeking a Global IT LLM Engineer Director & Chapter Lead to join our team in Atlanta, GA. This role is pivotal in driving the development and optimization of GenAI products, transforming the way BCG operates. As a Squad Leader, you will leverage your expertise in full stack development, performance, and stability of custom-built products, focusing on LLM-based applications, data science/ML, and backend development.

Key Responsibilities

Develop Chapter Expertise

  • Maintain best-in-class Chapter expertise and resources to deliver the right knowledge and skills to Squads.
  • Stay updated on relevant developments and innovations in your domain, both internally and externally.
  • Continuously improve your technical knowledge and that of your Chapter members.

Develop Chapter Members

  • Oversee and provide feedback to Chapter members to enhance their domain knowledge.
  • Discuss development progress and opportunities with the Tech Area Lead.

Share Knowledge

  • Ensure alignment with established technical roadmaps and guardrails.
  • Share insights and developments within your area of expertise with Chapter members and related Chapters.
  • Actively share knowledge across the organization.

Identify Resource Needs

  • Engage with Product Owners, Tribe Leads, and Tech Area Leads to allocate Chapter members effectively.
  • Identify expertise and resource gaps, and train or hire talent to address them.

Work in a Squad

  • Advance the work of the Squad based on backlog items and priorities set by the Product Owner.
  • Collaborate cross-functionally to advance the work of the Squad.

Enable New Ways of Working

  • Model behaviors to support the organization’s transformation to a new way of working.
  • Create and maintain a positive culture within the Chapter based on Agile leadership behaviors.

Skills and Qualifications

Mandatory

  • BA degree in Computer Science, Statistics, or related field with a focus on AI, Machine Learning, or NLP.
  • At least 10 years of working experience, with 2+ years in developing and experimenting with LLMs and 6+ years in AI/ML technologies.
  • Proficiency in Python and associated data science libraries and frameworks.
  • Strong knowledge in AI, machine learning, and natural language processing.
  • Experience with key LLM models APIs (e.g., OpenAI, Anthropic) and LLM Frameworks (e.g., LangChain, LlamaIndex).
  • Experience with multi-agent frameworks/systems and understanding of their applications.
  • Expertise in using LlamaIndex for building and querying knowledge bases.
  • Experience in constructing and querying knowledge graphs, including technologies like Neo4j or RDF triplestores.

Nice to Have

  • Experience with cloud infrastructure for AI/ML.
  • Experience with LLM guardrails and monitoring.
  • Experience with security related to LLM integration.

Work Environment

This position is based in Atlanta, GA, and requires on-site presence. You will work closely with your AI Engineering team, Tribe Leaders, Product Owners, and Agile Coaches to ensure effective collaboration and adoption of agile principles.

About BCG

Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. We embrace a transformational approach aimed at benefiting all stakeholders, empowering organizations to grow, build sustainable competitive advantage, and drive positive societal impact.

Join us in this exciting role to lead and innovate in the field of AI and machine learning, contributing to the transformation of BCG and its clients.

Similar jobs

Last update: 23 minutes ago

BCG X logo
BCG X

AI Software Engineer Intern

Join BCG X as an AI Software Engineer Intern to develop AI solutions and partner with clients across industries.

BCG X logo
BCG X

AI Software Engineer Intern

Join BCG X as an AI Software Engineer Intern to develop AI solutions and collaborate with global teams.

Poggio logo
Poggio

Senior AI Engineer

Join Poggio as a Senior AI Engineer to innovate AI systems for enterprise sales, focusing on AI capabilities and system performance.

micro1 logo
micro1

LLM Engineer with Python and JavaScript

Join us as an LLM Engineer to design and develop scalable software solutions using Python, JavaScript, and AWS in a remote setting.

DwellFi  logo
DwellFi

AI Solutions Software Engineer

Join DwellFi as an AI Solutions Software Engineer to develop innovative AI solutions using LangChain or Llama. Remote position in Palo Alto, CA.

UKG logo
UKG

Lead AI Full Stack Developer

Lead AI Full Stack Developer role in Alpharetta, GA, focusing on AI-driven applications using GCP, full-stack development, and MLOps.

Blueprint logo
Blueprint

AI Engineer - Machine Learning and Robotics

Join Blueprint as an AI Engineer in Machine Learning and Robotics, focusing on scalable AI model training systems. Hybrid role in Redmond, WA.

Stripe logo
Stripe

ML Engineering Manager, LLM Foundation

Lead ML engineering team at Stripe, focusing on LLMs and AI/ML systems. Drive innovation and manage high-impact projects.

Unicon, Inc. logo
Unicon, Inc.

Senior Software Developer - AI/LLM

Join Unicon as a Senior Software Developer specializing in AI/LLM, working on cutting-edge AI technologies in a hybrid role in Gilbert, AZ.

EQT Ventures logo
EQT Ventures

Fullstack LLM Engineer

Join EQT Ventures as a Fullstack LLM Engineer to drive AI innovation in venture capital. Work with cutting-edge AI tools and data-driven insights.

micro1 logo
micro1

Senior LLM Engineer

Join our team as a Senior LLM Engineer, leveraging AWS, Python, and JavaScript to develop scalable AI solutions.

Abridge logo
Abridge

Senior Full Stack Engineer, LLM APIs

Join Abridge as a Senior Full Stack Engineer to build innovative ML-powered solutions in healthcare AI, focusing on LLM APIs and cloud services.

NVIDIA logo
NVIDIA

Machine Learning Engineer - LLM Fine-tuning and Performance

Join NVIDIA as a Machine Learning Engineer specializing in LLM fine-tuning and performance optimization. Work with cutting-edge ML technologies.

Beyond, Inc. logo
Beyond, Inc.

Senior Machine Learning Scientist

Join Beyond, Inc. as a Senior Machine Learning Scientist to develop cutting-edge e-commerce technologies in Sligo, Ireland.

Neon logo
Neon

Lead AI Engineer

Lead AI Engineer role focusing on building AI Agents for Neon platform, leading a small team, and enhancing developer experience.

Shopify logo
Shopify

Machine Learning Platform Engineer

Join Shopify as a Machine Learning Platform Engineer to build cutting-edge AI infrastructure and tools. Work remotely in a dynamic environment.

Belfius logo
Belfius

AI Engineer

Join Belfius as an AI Engineer in Brussels, leveraging ML to solve business challenges in a dynamic team.

Snowflake logo
Snowflake

Senior Software Engineer - LLM

Join Snowflake as a Senior Software Engineer to build scalable machine learning platforms with LLMs, leveraging Python and TensorFlow.

GlobalLogic logo
GlobalLogic

Senior Machine Learning/Generative AI Engineer

Join GlobalLogic as a Senior ML/GenAI Engineer to develop and optimize AI chatbots using LLMs. Remote work available.

xai logo
xai

Product AI Engineer

Join xAI as a Product AI Engineer to develop cutting-edge AI consumer products using ML, Python, and Rust in Palo Alto, CA.

Snowflake logo
Snowflake

Senior Software Engineer - LLM

Join Snowflake as a Senior Software Engineer to build scalable machine learning platforms with LLMs, leveraging Python and TensorFlow.

Norma logo
Norma

Senior Data Scientist

Join Norma as a Senior Data Scientist to lead data insights projects using AI and machine learning in a hybrid work environment.

Grab logo
Grab

Lead Data Scientist - Computer Vision and Machine Learning

Lead Data Scientist role focusing on computer vision and machine learning for map automation at Grab in Cluj-Napoca.

Pass App logo
Pass App

Machine Learning Engineer with Web3 and NLP Experience

Join Pass App as a Machine Learning Engineer to build AI solutions for web3, focusing on NLP and data pipelines.