Global IT Software Engineer Senior Manager – Gen AI/ LLM SDK

2 weeks ago


London, UK, United Kingdom Boston Consulting Group Full time
WHAT YOU'LL DO
We are seeking a highly skilled and experienced full-stack Software Engineer Expert Senior Manager with Gen AI /LLM expertise to join our Gen AI platform team. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development. The ideal candidate will have a strong background in reusable software components, frameworks, SDKs, microservices and APIs, cloud infrastructure, and DevOps/MLOps/LLMOps, with a passion for creating scalable, reliable, and efficient systems.
YOU'RE GOOD AT

* Being a great hands-on engineer passionate of building platform capabilities.

* Performing successfully in a fast-paced, multi-cultural and service-oriented environment

* Verbal and written communication at a business and technical level

* High level of initiative, self-motivation, resourcefulness, and collaboration

* Are passionate, intellectually curious, and enjoy learning new skills and capabilities.

* Building relationships and reliable team player, displaying consideration and respect for others

* Interpreting rules and guidelines flexibly to enhance the business and aligning with BCG’s values and culture

* Exhibiting ownership and accountability for the squad deliverables

* Servicing customer teams / platform users with a strong customer centricity

* Attention to detail, well organized, able to set priorities and take decisions

* Being flexible to be available outside of normal business hours for international calls as needed

YOU BRING (EXPERIENCE & QUALIFICATIONS)

* Bachelor’s degree in computer science engineering (or equivalent degree or experience)

* Proven Experience in Gen AI, Artificial Intelligence, Machine Learning, or Natural Language Processing

* 12+ years of relevant experience in delivering platform or complex technology solutions with strong technical background, preferably in global organization/ enterprise.

* 2+ years’ experience in experimenting and developing with LLM.

* 1+ years of experience developing with LLMs for production use case.  

* 8+years of experience in leading Enterprise scale software engineering/ platform engineering teams.

* Passionate expert in Modern Engineering, DevOps practices - Strong understanding of CI/CD, AI/ ML pipelines and automation tools.

Experience & Skills (Mandatory) 

* Strong knowledge and experience in Generative AI/ LLM based development.

* Strong knowledge and experience in building conversational agent-based UX.

* Strong knowledge and experience in building SDKs and libraries used by other developers.

* Strong experience working with key LLM models APIs (e.g. AWS Bedrock, Azure Open AI/ OpenAI) and LLM Frameworks (e.g. LangChain, LlamaIndex) 

* Experience with multi-agent frameworks and an understanding of multi-agent systems and their applications in complex, multi-step problem-solving scenarios. 

* Expertise in building enterprise grade, secure data ingestion pipelines for unstructured data – including indexing, search, and advance retrieval patterns. 

* Proficiency in generating and working with text embeddings with understanding of embedding spaces and their applications in semantic search and information retrieval. 

* Knowledge and Experience in building knowledge graphs in production.

* Experience with RAG concepts and fundamentals (VectorDBs, AWS OpenSearch, semantic search, etc.), Expertise in implementing RAG systems that combine knowledge bases with Generative AI models. 

* Proficiency in Python, TypeScript, NodeJS, ReactJS (and equivalent) and all associated GenAI libraries and frameworks. 

* Experience with containerization and orchestration technologies (Kubernetes, Docker).

Experience & Skills (Nice to have) 

* Experience with LLM guardrails 

* Experience with security related to LLM integration

* Experience in LLM Testing and Evaluation

* LLM Security

YOU'LL WORK WITH

* Your Gen AI Platform Engineering chapter in Cloud and Platform Engineering Portfolio

* Product Owners, Chapter Leads and other squad members.

* Agile Coaches and Scrum Leads, that will ensure that you adopt agile principles, mindset and ways of working into your daily routine and who will coach you during the transformation.



  • London, UK, United Kingdom Boston Consulting Group Full time

    WHAT YOU'LL DOWe are seeking a highly skilled and experienced Gen AI /LLM Domain Architect Expert Director to join our Gen AI platform team. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development. The ideal candidate will have a strong background in platform...


  • London, UK, UK, United Kingdom Veer Full time

    Hi, we're Veer–an early-stage, AI-first, fast-paced Oxford University AI startup that aims to empower everyone to better plan their future careers. And we're looking for a talented software engineer with experience in AI/ML Engineering and Software Engineering to join us.You will play a key role in designing and engineering our first product: an...

  • Gen AI Consultant

    3 months ago


    London,, UK, United Kingdom InterEx Group Full time

    Job Title: Gen AI ConsultantLocation: Fully RemoteJob Type: Contract/Contract-to-hireResponsibilities:Data Engineering:Collaborate with cross-functional teams to design and implement data pipelines, ensuring efficient extraction, transformation, and loading (ETL) processes.Work with diverse healthcare datasets, integrating and cleaning data from various...

  • AI Engineer

    3 days ago


    London,, UK, United Kingdom Aurum Search Limited Full time

    We are expanding our AI Platform and Research Team and are seeking an experienced Software Engineer to join this innovative unit. As a leading hedge fund, we are continuously exploring novel ways to leverage technology to enhance our business operations. In this role, you will play a key part in identifying opportunities for AI to add value and drive growth....


  • London,, UK, United Kingdom Osmii Full time

    Job Title: Senior Machine Learning Engineer - LLM & Deep Learning SpecialistLocation: London/RemoteJob Type: Full-TimeSalary: Competitive. Open to contract or permanent options About the Client:Our client is a leading innovator in the technology sector, renowned for developing state-of-the-art machine learning and AI solutions that transform industries. They...


  • London,, UK, United Kingdom Fruition IT Full time

    Senior Machine Learning Engineer£90-110k (leadership track)UK Remote (go to London office 1 time per month)Why Join?AI/ML driven businessTransition into leadership quicklyInnovation is core to business successWork with massive brandsWork anywhere in the UKScale up environmentPivotal role for new product offeringExperience fine-tuning open-source LLMs, such...


  • London,, UK, United Kingdom Pixelated People Full time

    PRODUCT DESIGNERS - NEW CONTRACT ROLE ALERT!⏳6-month gigHYBRID/LONDONStart in 2/3 weeks‍Ai Driven Virtual Assistant£450-600pd DOE (Inside)Conversational UI and Gen Ai exp will be required The product is currently in the proof-of-concept (POC) stage for a flagship B2B product — an Ai driven case team assistant. It functions as a virtual sparring...

  • Data Scientist

    2 weeks ago


    London,, UK, United Kingdom Harnham Full time

    DATA SCIENTIST (LLM)£60,000 to £80,000London (HYBRID)The Company:As a Data Scientist, you will be working with experienced Data Scientists and Data Engineers to deliver and create models of impact. You will be exposed to the latest technologies, and you will be given the opportunity to be part of an ever-growing industry.The position requires developing,...


  • London,, UK, United Kingdom Harnham Full time

    AI Engineer - FinTech£80,000 to £90,000LondonThe Company:As an AI Engineer, you will be working with experienced Data Scientists and Data Engineers to deliver and create models of impact. You will be exposed to the latest technologies, and you will be given the opportunity to be part of an ever-growing industry.The position requires developing,...

  • Generative AI Engineer

    2 months ago


    London,, UK, United Kingdom Harnham Full time

    Founding AI Engineer Up to £100,000London (Hybrid 1-2 days per week)Company:This is a chance to be a Founding AI Engineer, part of an 8 strong team at a LegalTech startup. Strong initial funding with set growth plans with 2 co-founders with over 20 years of Legal experience. Harnham are working exclusively on this exciting role!Responsibilities:Scaling...


  • London,, UK, United Kingdom Oho Group Ltd Full time

    Machine Learning Engineer - London - Exciting AI Start-Up Permanent + Exceptional Team + EquityAre you a Machine Learning Engineer looking for an exciting and challenging position?Here's a fantastic opportunity for you to join a small and all-star team! This AI start-up has just raised a large seed round and are looking to use AI agents with their...

  • Program Manager

    2 weeks ago


    London,, UK, United Kingdom Computappoint Full time

    This exciting Programme Manager role focusing around AI Solutions is a fantastic opportunity for an experienced Programme Manager to join the AI Service department of a global service provider client of ours who champion a health work-life balance. In this role, you will be overseeing multiple projects and liaising with clients as the primary point of...


  • London,, UK, United Kingdom Better Placed Ltd - A Sunday Times Top 10 Employer in 2023! Full time

    Lead AI Engineer London £100k-140K D.O.E + Stock Looking to speak to AI leads in the UK who are looking to join a well backed AI led business with an impressive founding team. The business is currently growing 30% MoM and has an ever growing user base which comes with complex challenges which require the brightest minds to solve. In return you’ll receive...


  • London,, UK, United Kingdom Pixelated People Full time

    PRODUCT DESIGNERS - NEW CONTRACT ROLE ALERT!⏳6-month gigHYBRID/LONDONStart in 2/3 weeks‍Ai Driven Virtual Assistant£450-600pd DOE (Inside)A huge bonus if you have experience with Ai designThe product is currently in the proof-of-concept (POC) stage for a flagship B2B product — an Ai driven case team assistant. It functions as a virtual sparring...


  • London,, UK, United Kingdom Fruition IT Full time

    Senior Machine Learning Engineer£90-120k 5-15% equityUK Remote (go to London to meet team)Why Join?Personalised medicine start upTech for goodSolutions benefiting 500 million +Freedom to pick tools, technologyGenerous equity packageWork directly with founderChance to work with agentic workflowsResponsibilities:Use your expertise to apply machine learning...

  • Founding AI Engineer

    2 weeks ago


    London,, UK, United Kingdom kadence Full time

    About the CompanyOur client is 6 person start-up founded by 3 individuals through their YC accelerator programme. They are helping clients solve problems within the legal and patent IP field. They are looking for super-talented founding AI Research Engineers to help us define our AI workflows as well as building our back-end of our products extremely fast....


  • London,, UK, United Kingdom Nord Group - A GenHive Partner Full time

    Nord Group is a leading consultancy specialising in Financial Services and private sectors. We drive business growth by optimising our clients’ workforce through data-driven strategies. Over the past 10 years, we have a proven track record of building niche feature teams across Software, Data|AI, Cloud and Cybersecurity in top financial institutions across...

  • Full Stack Engineer

    6 hours ago


    London,, UK, United Kingdom Nord Group - A GenHive Partner Full time

    Nord Group is a leading consultancy specialising in Financial Services and private sectors. We drive business growth by optimising our clients’ workforce through data driven strategies. Over the past 10 years, we have a proven track record of building niche feature teams across Software, Data|AI, Cloud and Cybersecurity in top financial institutions across...

  • Senior AI Researcher

    3 months ago


    London,, UK, United Kingdom Harnham Full time

    Senior AI Researcher (Multimodal AI/LLM)West-London£120,000Join a team who are revolutionizing Multimodal AI, working on cutting-edge research and solving real-world problems for next-generation devices. Be at the forefront of innovation and publish in top-tier conferences and journals.ROLE: Perform cutting-edge research on Multimodal AI at Samsung R&D...


  • London,, UK, United Kingdom Coltech Global Full time

    AI & ML Engineer - Energy - London - HybridWe are partnering with a leading global technology company driving the transformation of the energy sector through cutting-edge AI and machine learning.You would be joining a global AI/ML team to develop cutting-edge, AI-powered features, working across the entire product lifecycle from concept to deployment....