Global IT Software Engineer Senior Manager – Gen AI/ LLM SDK

3 weeks ago

London England, United Kingdom Boston Consulting Group Full time
WHAT YOU'LL DO

Scroll down for a complete overview of what this job will require Are you the right candidate for this opportunity
We are seeking a highly skilled and experienced full-stack Software Engineer Expert Senior Manager with Gen AI /LLM expertise to join our Gen AI platform team. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development. The ideal candidate will have a strong background in reusable software components, frameworks, SDKs, microservices and APIs, cloud infrastructure, and DevOps/MLOps/LLMOps, with a passion for creating scalable, reliable, and efficient systems.
YOU'RE GOOD AT

  • Being a great hands-on engineer passionate of building platform capabilities.

  • Performing successfully in a fast-paced, multi-cultural and service-oriented environment

  • Verbal and written communication at a business and technical level

  • High level of initiative, self-motivation, resourcefulness, and collaboration

  • Are passionate, intellectually curious, and enjoy learning new skills and capabilities.

  • Building relationships and reliable team player, displaying consideration and respect for others

  • Interpreting rules and guidelines flexibly to enhance the business and aligning with BCG’s values and culture

  • Exhibiting ownership and accountability for the squad deliverables

  • Servicing customer teams / platform users with a strong customer centricity

  • Attention to detail, well organized, able to set priorities and take decisions

  • Being flexible to be available outside of normal business hours for international calls as needed


YOU BRING (EXPERIENCE & QUALIFICATIONS)

  • Bachelor’s degree in computer science engineering (or equivalent degree or experience)

  • Proven Experience in Gen AI, Artificial Intelligence, Machine Learning, or Natural Language Processing

  • 12+ years of relevant experience in delivering platform or complex technology solutions with strong technical background, preferably in global organization/ enterprise.

  • 2+ years’ experience in experimenting and developing with LLM.

  • 1+ years of experience developing with LLMs for production use case.  

  • 8+years of experience in leading Enterprise scale software engineering/ platform engineering teams.

  • Passionate expert in Modern Engineering, DevOps practices - Strong understanding of CI/CD, AI/ ML pipelines and automation tools.

Experience & Skills (Mandatory) 

  • Strong knowledge and experience in Generative AI/ LLM based development.

  • Strong knowledge and experience in building conversational agent-based UX.

  • Strong knowledge and experience in building SDKs and libraries used by other developers.

  • Strong experience working with key LLM models APIs (e.g. AWS Bedrock, Azure Open AI/ OpenAI) and LLM Frameworks (e.g. LangChain, LlamaIndex) 

  • Experience with multi-agent frameworks and an understanding of multi-agent systems and their applications in complex, multi-step problem-solving scenarios. 

  • Expertise in building enterprise grade, secure data ingestion pipelines for unstructured data – including indexing, search, and advance retrieval patterns. 

  • Proficiency in generating and working with text embeddings with understanding of embedding spaces and their applications in semantic search and information retrieval. 

  • Knowledge and Experience in building knowledge graphs in production.

  • Experience with RAG concepts and fundamentals (VectorDBs, AWS OpenSearch, semantic search, etc.), Expertise in implementing RAG systems that combine knowledge bases with Generative AI models. 

  • Proficiency in Python, TypeScript, NodeJS, ReactJS (and equivalent) and all associated GenAI libraries and frameworks. 

  • Experience with containerization and orchestration technologies (Kubernetes, Docker).

Experience & Skills (Nice to have) 

  • Experience with LLM guardrails 

  • Experience with security related to LLM integration

  • Experience in LLM Testing and Evaluation

  • LLM Security


YOU'LL WORK WITH

  • Your Gen AI Platform Engineering chapter in Cloud and Platform Engineering Portfolio

  • Product Owners, Chapter Leads and other squad members.

  • Agile Coaches and Scrum Leads, that will ensure that you adopt agile principles, mindset and ways of working into your daily routine and who will coach you during the transformation.


  • Senior Manager

    7 days ago

    London, Greater London, United Kingdom Boston Consulting Group Full time

    Job SummaryWe are seeking a highly skilled and experienced Senior Manager to lead our Gen AI platform team. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development.Key ResponsibilitiesLead the development of reusable software components, frameworks, SDKs,...

  • Senior Manager

    7 days ago

    London, Greater London, United Kingdom Boston Consulting Group Full time

    Job SummaryWe are seeking a highly skilled and experienced full-stack Software Engineer Expert Senior Manager with Gen AI /LLM expertise to join our Gen AI platform team at Boston Consulting Group. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development.Key...

  • Senior Manager

    2 days ago

    London, Greater London, United Kingdom Boston Consulting Group Full time

    Job SummaryWe are seeking a highly skilled and experienced Senior Manager to lead our Gen AI platform team at Boston Consulting Group. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development.Key ResponsibilitiesLead the development of reusable software components,...

  • Global IT Software Engineer Senior Manager

    1 month ago

    London, United Kingdom Boston Consulting Group Full time

    WHAT YOU'LL DOWe are seeking a highly skilled and experienced full-stack Software Engineer Expert Senior Manager with Gen AI /LLM expertise to join our Gen AI platform team. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development. The ideal candidate will have a...

  • Global IT Software Engineer Senior Manager – Gen AI/ LLM SDK

    2 weeks ago

    London, UK, United Kingdom Boston Consulting Group Full time

    WHAT YOU'LL DOWe are seeking a highly skilled and experienced full-stack Software Engineer Expert Senior Manager with Gen AI /LLM expertise to join our Gen AI platform team. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development. The ideal candidate will have...

  • Global IT Software Engineer Senior Manager – Gen AI/ LLM SDK

    2 weeks ago

    London, United Kingdom Boston Consulting Group Full time

    WHAT YOU'LL DOWe are seeking a highly skilled and experienced full-stack Software Engineer Expert Senior Manager with Gen AI /LLM expertise to join our Gen AI platform team. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development. The ideal candidate will have...

  • Global IT Software Engineer Senior Manager

    4 weeks ago

    London, United Kingdom Boston Consulting Group Full time

    WHAT YOU'LL DOWe are seeking a highly skilled and experienced full-stack Software Engineer Expert Senior Manager with Gen AI /LLM expertise to join our Gen AI platform team. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development. The ideal candidate will have a...

  • Global IT Software Engineer Senior Manager

    4 weeks ago

    London, United Kingdom Boston Consulting Group Full time

    WHAT YOU'LL DOHave you got the right qualifications and skills for this job Find out below, and hit apply to be considered.We are seeking a highly skilled and experienced full-stack Software Engineer Expert Senior Manager with Gen AI /LLM expertise to join our Gen AI platform team. This role focuses on building and maintaining cloud-native platforms...

  • Global IT Software Engineer Senior Manager

    2 days ago

    London, Greater London, United Kingdom Boston Consulting Group Full time

    Job OverviewWe are seeking a highly skilled and experienced full-stack Software Engineer Expert Senior Manager with Gen AI /LLM expertise to join our Gen AI platform team at Boston Consulting Group.Key ResponsibilitiesPlatform Engineering: Design and develop cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM)...

  • Senior Manager of Global IT Software Engineering – Generative AI and LLM SDK

    3 weeks ago

    London, Greater London, United Kingdom Boston Consulting Group Full time

    ROLE OVERVIEWWe are on the lookout for a highly proficient and seasoned **Senior Manager** in **Software Engineering** with a focus on **Generative AI** and **Large Language Models (LLM)** to join our dynamic **Gen AI platform team**. This position is centered around the development and upkeep of **cloud-native platforms** tailored for **Generative AI** and...

  • Senior IT Software Engineer Manager

    2 days ago

    London, Greater London, United Kingdom Boston Consulting Group Full time

    Job OverviewWe are seeking a highly skilled and experienced full-stack Software Engineer Expert Senior Manager with Gen AI /LLM expertise to join our Gen AI platform team at Boston Consulting Group.Key ResponsibilitiesLead the development and maintenance of cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM)...

  • Senior Manager of Global IT Software Engineering – Generative AI/LLM SDK

    3 weeks ago

    London, Greater London, United Kingdom Boston Consulting Group Full time

    ROLE OVERVIEWWe are on the lookout for a highly proficient and seasoned full-stack Software Engineering Senior Manager with expertise in Generative AI and Large Language Models (LLM) to become a vital part of our Gen AI platform team. This position is centered around the development and upkeep of cloud-native platforms tailored for Generative AI and LLM...

  • Senior Manager of Global IT Software Engineering – Generative AI and LLM SDK

    3 weeks ago

    London, Greater London, United Kingdom Boston Consulting Group Full time

    YOUR ROLEWe are in search of a highly proficient and seasoned Full-Stack Software Engineering Senior Manager with expertise in Generative AI and Large Language Models (LLM) to become a vital part of our Gen AI platform team. This position is centered on the development and upkeep of cloud-native platforms tailored for Generative AI and LLM innovation. The...

  • Senior Manager of Global IT Software Engineering – Generative AI and LLM Solutions

    3 weeks ago

    London, Greater London, United Kingdom Boston Consulting Group Full time

    ROLE OVERVIEWWe are in search of a highly proficient and seasoned Senior Manager specializing in Software Engineering with a focus on Generative AI and Large Language Models (LLM). This pivotal role is part of our dedicated team working on the Gen AI platform, concentrating on the development and upkeep of cloud-native solutions tailored for Generative AI...

  • Expert Software Engineering Manager – Generative AI and SDK Innovations

    3 weeks ago

    London, Greater London, United Kingdom Boston Consulting Group Full time

    ROLE OVERVIEWWe are on the lookout for a highly proficient and seasoned Full-Stack Software Engineering Senior Manager with expertise in Generative AI and Large Language Models (LLM) to become a vital part of our Gen AI platform team. This position is centered around the creation and upkeep of cloud-native platforms specifically tailored for Generative AI...

  • Global IT Domain Architect Expert Director – Gen AI/ LLM

    3 weeks ago

    London, England, United Kingdom Boston Consulting Group Full time

    WHAT YOU'LL DOIf you are interested in applying for this job, please make sure you meet the following requirements as listed below.We are seeking a highly skilled and experienced Gen AI /LLM Domain Architect Expert Director to join our Gen AI platform team. This role focuses on building and maintaining cloud-native platforms specifically designed for...

  • Global IT Domain Architect Expert Director – Gen AI/ LLM

    2 weeks ago

    London, UK, United Kingdom Boston Consulting Group Full time

    WHAT YOU'LL DOWe are seeking a highly skilled and experienced Gen AI /LLM Domain Architect Expert Director to join our Gen AI platform team. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development. The ideal candidate will have a strong background in platform...

  • Global IT Domain Architect Expert Director – Gen AI/ LLM

    2 weeks ago

    London, United Kingdom Boston Consulting Group Full time

    WHAT YOU'LL DOWe are seeking a highly skilled and experienced Gen AI /LLM Domain Architect Expert Director to join our Gen AI platform team. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development. The ideal candidate will have a strong background in platform...

  • Global IT Domain Architect Expert Director

    1 month ago

    London, United Kingdom Boston Consulting Group Full time

    WHAT YOU'LL DO We are seeking a highly skilled and experienced Gen AI /LLM Domain Architect Expert Director to join our Gen AI platform team. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development. The ideal candidate will have a strong background in platform...

  • Global IT Domain Architect Expert Director

    1 month ago

    London, United Kingdom Boston Consulting Group Full time

    WHAT YOU'LL DO We are seeking a highly skilled and experienced Gen AI /LLM Domain Architect Expert Director to join our Gen AI platform team. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development. The ideal candidate will have a strong background in platform...