Global IT LLM Engineer Director & Chapter Lead

Job Overview

Boston Consulting Group (BCG) is seeking a Global IT LLM Engineer Director & Chapter Lead to join our team in Atlanta, GA. This role is pivotal in driving the development and optimization of GenAI products, transforming the way BCG operates. As a Squad Leader, you will leverage your expertise in full stack development, performance, and stability of custom-built products, focusing on LLM-based applications, data science/ML, and backend development.

Key Responsibilities

Develop Chapter Expertise

• Maintain best-in-class Chapter expertise and resources to deliver the right knowledge and skills to Squads.
• Stay updated on relevant developments and innovations in your domain, both internally and externally.
• Continuously improve your technical knowledge and that of your Chapter members.

Develop Chapter Members

• Oversee and provide feedback to Chapter members to enhance their domain knowledge.
• Discuss development progress and opportunities with the Tech Area Lead.

Share Knowledge

• Ensure alignment with established technical roadmaps and guardrails.
• Share insights and developments within your area of expertise with Chapter members and related Chapters.
• Actively share knowledge across the organization.

Identify Resource Needs

• Engage with Product Owners, Tribe Leads, and Tech Area Leads to allocate Chapter members effectively.
• Identify expertise and resource gaps, and train or hire talent to address them.

Work in a Squad

• Advance the work of the Squad based on backlog items and priorities set by the Product Owner.
• Collaborate cross-functionally to advance the work of the Squad.

Enable New Ways of Working

• Model behaviors to support the organization’s transformation to a new way of working.
• Create and maintain a positive culture within the Chapter based on Agile leadership behaviors.

Skills and Qualifications

Mandatory

• BA degree in Computer Science, Statistics, or related field with a focus on AI, Machine Learning, or NLP.
• At least 10 years of working experience, with 2+ years in developing and experimenting with LLMs and 6+ years in AI/ML technologies.
• Proficiency in Python and associated data science libraries and frameworks.
• Strong knowledge in AI, machine learning, and natural language processing.
• Experience with key LLM models APIs (e.g., OpenAI, Anthropic) and LLM Frameworks (e.g., LangChain, LlamaIndex).
• Experience with multi-agent frameworks/systems and understanding of their applications.
• Expertise in using LlamaIndex for building and querying knowledge bases.
• Experience in constructing and querying knowledge graphs, including technologies like Neo4j or RDF triplestores.

Nice to Have

• Experience with cloud infrastructure for AI/ML.
• Experience with LLM guardrails and monitoring.
• Experience with security related to LLM integration.

Work Environment

This position is based in Atlanta, GA, and requires on-site presence. You will work closely with your AI Engineering team, Tribe Leaders, Product Owners, and Agile Coaches to ensure effective collaboration and adoption of agile principles.

About BCG

Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. We embrace a transformational approach aimed at benefiting all stakeholders, empowering organizations to grow, build sustainable competitive advantage, and drive positive societal impact.

Join us in this exciting role to lead and innovate in the field of AI and machine learning, contributing to the transformation of BCG and its clients.