Lead Data Scientist

3 weeks ago


London, Greater London, United Kingdom Core Consultants Full time
About the Role:

We are Core Consultants, a leading consulting firm, and we are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a critical role in designing and implementing our internal data ingestion platform, leveraging Apache Spark, Kafka, and Airflow.

The successful candidate will lead a team of data engineers, driving the development of configurable Spark ETL pipelines and leveraging modern data architecture principles. They will act as the product owner for the internal data ingestion platform, ensuring alignment with business needs and long-term scalability.

This is a high-impact role that requires expertise in designing scalable systems to handle diverse datasets efficiently. The ideal candidate will have extensive experience with Apache Spark, Kafka, and Airflow, as well as proficiency in designing and deploying solutions on Azure Kubernetes Service (AKS).

**Key Responsibilities:**

  • Design and implement a robust data ingestion platform using Apache Spark, Kafka, and Airflow.
  • Lead a team of data engineers to develop configurable Spark ETL pipelines and ensure adherence to best practices.
  • Act as the product owner for the internal data ingestion platform, ensuring alignment with business needs and long-term scalability.
  • Collaborate with cross-functional teams to ensure seamless integration with downstream analytics and visualisation tools.

**Required Skills and Qualifications:**

  • Extensive experience with Apache Spark, Kafka, and Airflow for data ingestion and orchestration.
  • Proficiency in designing and deploying solutions on Azure Kubernetes Service (AKS).
  • Deep understanding of Databricks for data preprocessing and transformation.
  • Hands-on experience with Snowflake, SQL warehouses, and Delta Lake for data storage.

**Estimated Salary: $180,000 - $240,000 per annum.


  • Data Scientist

    2 weeks ago


    London, Greater London, United Kingdom Data Idols Full time £65,000 - £80,000

    Data ScientistCentral London (1 day per week in the office)We are seeking a talented Data Scientist to join our team at Data Idols. As a key member of our data team, you will play a crucial role in delivering high-quality educational resources that have the power to improve society and empower policy makers.This is an exciting opportunity for someone who is...

  • Data Scientist Lead

    2 weeks ago


    London, Greater London, United Kingdom Tribal Tech - The Digital, Data & AI Specialists Full time

    Job Overview:Tribal Tech - The Digital, Data & AI Specialists is a leading tech company in London at the forefront of data science innovation. We are seeking a talented Data Scientist to join our dynamic team in a hybrid work environment. This role presents an exciting opportunity to work on cutting-edge projects and contribute to driving business decisions...


  • London, Greater London, United Kingdom Data Bene Full time

    Job OverviewWe are seeking a highly skilled Data Analysis Scientist to join our Operations Strategy team at Data Bene. As a key member of this team, you will play a pivotal role in utilizing data-driven insights to drive strategic improvements in our service delivery.About UsData Bene is a leading financial services provider dedicated to empowering small...

  • Data Scientist Role

    3 weeks ago


    London, Greater London, United Kingdom Data Bene Full time

    Job OverviewWe're seeking a skilled Data Scientist to join our Operations Strategy team. As a data-driven professional, you'll help us harness insights to drive strategic improvements in our service delivery.


  • London, Greater London, United Kingdom Tribal Tech - The Digital, Data & AI Specialists Full time

    Job DescriptionTribal Tech - The Digital, Data & AI Specialists is seeking a Senior Lead Data Scientist to lead their AI team in London.The ideal candidate will have extensive experience in machine learning, AI, and deep learning, with a strong background in software development and engineering.This is an exciting opportunity to drive innovation in AI and...


  • London, Greater London, United Kingdom Data Idols Full time £80,000 - £90,000

    Job Description:Data Idols, a top global retail company's partner, seeks a Senior Data Scientist to enhance its loyalty scheme department. The Opportunity:You will work on various projects in loyalty, including customer segmentation, retention, profiling, and marketing.You will create and build data science models using Python, Pyspark, Databricks, and other...

  • Data Scientist Lead

    2 weeks ago


    London, Greater London, United Kingdom Tribal Tech - The Digital, Data & AI Specialists Full time

    About Tribal TechTribal Tech - The Digital, Data & AI Specialists is a leading tech company in London that's at the forefront of data science innovation.We're seeking a talented Data Scientist to join our dynamic team and work on cutting-edge projects in a hybrid work environment.Job OverviewDevelop and implement advanced machine learning models and...


  • London, Greater London, United Kingdom Data Science Talent Full time

    Senior Data Scientist - F1 MotorsportWe are seeking a highly skilled Senior Data Scientist to join our team at Data Science Talent. This role is focused on transforming how we utilize data to achieve peak performance in Formula 1. Key responsibilities include developing and implementing innovative data-driven solutions to enhance lap time performance,...

  • Data Scientist Leader

    2 weeks ago


    London, Greater London, United Kingdom Data Science Talent Full time

    About Data Science Talent">We're a team of innovators driving the future of data-driven performance at F1. With a strong focus on delivering cutting-edge insights, we're shaping the racing car's competitive edge.Job Title: Senior Data ScientistKey Responsibilities:Transforming data utilisation strategies to enhance peak performanceExploring innovative...

  • Data Scientist Lead

    3 weeks ago


    London, Greater London, United Kingdom RAPP Full time

    RAPP is a leading data science team within the Marketing Sciences Department, seeking a seasoned data scientist to lead our team and drive innovative solutions in the marketing industry. As Principal / Lead Data Scientist, you will be at the forefront of leveraging AI to reinvent marketing for some of the world's biggest brands.About the RoleWe are looking...

  • Data Scientist Lead

    3 weeks ago


    London, Greater London, United Kingdom J&C Associates Ltd Full time

    Job Title: Data Scientist LeadWe are seeking an experienced and passionate Data Scientist Lead to join our team at J&C Associates Ltd. as a hybrid role of data science and data engineering.The successful candidate will drive the rapid growth of our UK Express business by using their data science and data engineering skills to generate actionable data-driven...


  • London, Greater London, United Kingdom RAPP Full time

    Principal / Lead Data ScientistThis role is ideal for a seasoned data scientist with experience in leading teams and driving innovative solutions in the marketing industry. As a Principal / Lead Data Scientist at RAPP, you'll be part of a world-class Data Science team that leverages AI to reinvent marketing for top brands.The position is for a Principal or...

  • Data Scientist Role

    1 week ago


    London, Greater London, United Kingdom Data Bene Full time

    Unlock the Power of Data ScienceAt Data Bene, we're on a mission to revolutionize the way businesses operate by leveraging cutting-edge data science techniques. As a Data Scientist in our Operations Strategy team, you'll play a crucial role in helping us achieve this goal.About the RoleThis is an exciting opportunity to join our dynamic team and contribute...


  • London, Greater London, United Kingdom Data Science Festival Full time

    **Job Title:** Senior Data Scientist**Location:** London, HybridAt Data Science Festival, we are seeking a skilled Senior Data Scientist to join our loyalty scheme department. The ideal candidate will have experience in using modern technologies such as Python, Pyspark, and Databricks.**Key Responsibilities: Design and implement data science models for...

  • Data Scientist

    3 weeks ago


    London, Greater London, United Kingdom Data Science Talent Full time

    Data Scientist - Advanced Analytics ExpertAre you a data expert looking to accelerate your career? Join our world-class team at Data Science Talent as a Senior Data Scientist. Our organisation is renowned for its innovative approach to data-driven decision making, and we're seeking an exceptional individual to help us enhance the racing car's performance and...

  • Data Scientist Lead

    2 weeks ago


    London, Greater London, United Kingdom Harnham Full time

    Job DescriptionWe are seeking a highly skilled Data Scientist Lead to join our team at Harnham. In this role, you will be responsible for leading the development of data science models and integrating them into product features.The ideal candidate will have 3+ years of experience in data science or a related field, with a strong background in machine...


  • London, Greater London, United Kingdom Data Science Festival Full time

    Senior Data Scientist – LoyaltyData Idols is working with a top global retail company to expand its data capabilities by hiring a Senior Data Scientist within its loyalty scheme department. The successful candidate will work on various projects across loyalty, including customer segmentation, customer retention, customer profiling, and customer marketing...

  • Data Scientist Lead

    2 weeks ago


    London, Greater London, United Kingdom Codat LLC Full time

    At Codat LLC, we are seeking a skilled Data Scientist Lead to spearhead the development of our generative AI models. This is an exceptional opportunity for a talented professional to join our team and drive innovation in machine learning engineering.About the RoleWe are looking for a seasoned Machine Learning Architect to lead the establishment of our...

  • Data Scientist

    1 week ago


    London, Greater London, United Kingdom Open Data Science Conferenc Full time

    About the RoleWe are seeking a highly skilled Data Scientist to join our team at Nationwide Building Society. As an Associate, you will be responsible for developing and validating advanced machine learning models to predict customer outcomes.With a strong background in mathematical modelling and advanced analytics techniques, you will work closely with...

  • Data Scientist Lead

    2 weeks ago


    London, Greater London, United Kingdom Harnham Full time

    Harnham is working with a leading UK insurance company to find a Data Scientist Lead.As a key member of the team, you will be responsible for spearheading Machine Learning Initiatives and collaborating with cross-functional teams to identify opportunities for leveraging data-driven insights.The role offers a unique blend of technical leadership and people...