Big Data Engineer Lead

5 days ago


London, Greater London, United Kingdom Thoughtworks Inc. Full time

About the Opportunity:

We are looking for an experienced Big Data Engineer Lead to lead our big data initiatives and drive innovation in data engineering.

About You:

  • You have a proven track record of successfully leading big data projects and teams.
  • You have extensive experience with big data tools, frameworks, and technologies, including distributed storage and computing systems.
  • You have a strong background in software development and architecture, with expertise in designing and implementing large-scale data pipelines and applications.
  • You have excellent leadership and communication skills and can effectively collaborate with cross-functional teams to deliver high-quality results.

About the Job:

  • $140,000 - $170,000 per year salary based on location and experience.
  • Lead big data initiatives and drive innovation in data engineering.
  • Develop and maintain modern data architectures to meet business objectives and provide end-to-end data solutions.
  • Collaborate with data scientists to design scalable implementations of their models.
  • Incorporate data quality into daily work and ensure timely delivery.

Key Skills:

  • Distributed storage and computing technologies (e.g., Hadoop, Spark, Kafka).
  • Data modeling and modern data engineering tools and platforms (e.g., Apache Beam, Flink).
  • Software development and architecture (e.g., Java, Python, Scala).
  • Continuous delivery practices (e.g., Jenkins, Docker).


  • London, Greater London, United Kingdom Data Science Festival Full time

    **Job Overview**Data Science Festival is seeking an experienced Big Data Engineering Lead to join their team in London – hybrid. This is a fantastic opportunity for a skilled professional to drive data transformation and deliver value throughout the company.This hands-off role requires someone with extensive experience in managing teams, stakeholder...


  • London, Greater London, United Kingdom Athsai Full time

    Athsai is looking for a highly skilled Lead Big Data Engineer to oversee the design, development, and deployment of large-scale data engineering projects. This is an excellent opportunity for a qualified professional to showcase their technical expertise and leadership skills.You will work closely with cross-functional teams to deliver complex data...


  • London, Greater London, United Kingdom Quantexa Full time

    Key ResponsibilitiesAs a lead data engineer at Quantexa, your key responsibilities will include:• Leading a team of junior data engineers within an agile framework• Writing defensive, fault-tolerant, and efficient code for production-level data processing systems• Configuring and deploying Quantexa's software using tools such as Spark, Hadoop, Scala,...


  • London, Greater London, United Kingdom ZipRecruiter Full time

    Required Skills and Qualifications: We are looking for an exceptional Big Data Technical Lead with a deep understanding of big data technologies, including PySpark and SQL. You will be responsible for leading the development of a cutting-edge data platform, ensuring high-quality delivery, and mentoring junior engineers.About the Role:Lead the development of...


  • London, Greater London, United Kingdom JobHoller Full time

    Job OverviewWe are recruiting a skilled Lead Big Data Engineer to work with our team at JobHoller in central London.The ideal candidate will have experience with big data tools such as Hadoop, Cloudera or Elasticsearch and a strong background in Java.

  • Big Data Engineer

    5 days ago


    London, Greater London, United Kingdom Xcede Full time

    Job Summary: Xcede is seeking a Big Data Engineer to join our team in London. The successful candidate will be responsible for designing and implementing scalable big data architectures, ensuring the quality and security of data processes, and collaborating with cross-functional teams to deliver projects.Key Responsibilities: Design, build, and maintain...


  • London, Greater London, United Kingdom S&P Global Full time

    About the Team:S&P Global Market Intelligence is a division of S&P Global, a leading provider of data and analytics solutions for the financial industry. We understand the importance of accurate, deep, and insightful information and are committed to delivering unrivaled insights and leading data and technology solutions.The Job Description: As a Senior...


  • London, Greater London, United Kingdom CV-Library Full time

    Job DescriptionWe are currently seeking a highly skilled Data Engineer Tech Lead to lead the development of our client's data Lakehouse platform. This is a 12-month contract, hybrid role with weekly visits to our Central London office.The successful candidate will have extensive experience with Databricks, Apache Spark, and data lakes, as well as proficiency...


  • London, Greater London, United Kingdom CV-Library Full time

    CV-Library is seeking a Big Data Engineering Manager to lead our data engineering efforts. The ideal candidate will have extensive experience in designing and implementing large-scale data systems, managing a team of engineers, and collaborating with stakeholders to drive business outcomes.RequirementsProven track record in leading data engineering...


  • London, Greater London, United Kingdom Entain Full time

    At Entain, we're committed to transforming the gaming sector by creating exciting and trusted experiences for our customers. As a Senior Data Engineer - Big Data Analytics, you'll be responsible for leading the design, development, and deployment of big data analytics solutions to drive business growth and improvement.ResponsibilitiesBig Data Analytics:...


  • London, Greater London, United Kingdom Mastek Full time

    Key ResponsibilitiesThe Lead Big Data Specialist will be responsible for leading cross-functional teams to understand and address data requirements, developing and maintaining documentation for data processes and architecture, and providing technical leadership and mentorship to junior data engineers.They will also troubleshoot and resolve any issues related...


  • London, Greater London, United Kingdom InterEx Group Full time

    Are you a highly motivated and tech-passionate individual looking for a new challenge? Do you have experience in designing and implementing big data solutions? If so, we would like to hear from you!Job OverviewWe are InterEx Group, a leading provider of big data solutions, and we are currently seeking a Big Data Solutions Engineer to join our team. The...


  • London, Greater London, United Kingdom Kingfisher Full time

    We are seeking a highly motivated and experienced Lead Big Data Architect to lead our data engineering team at Kingfisher. As a Senior Data Engineer, you will be responsible for providing technical leadership and guidance on all aspects of data engineering practices.The ideal candidate will have extensive experience in building large-scale distributed data...


  • London, Greater London, United Kingdom Turner & Townsend Full time

    Job DescriptionWe are seeking an experienced Big Data Engineering Lead to join our team in Turner & Townsend. As a key member of our organization, you will be responsible for leading the development and implementation of big data solutions for our clients.The ideal candidate will have a strong background in managing teams and architecting data landscapes...


  • London, Greater London, United Kingdom LexisNexis Intellectual Property Solutions Full time

    LexisNexis Intellectual Property Solutions is seeking an experienced Big Data Transformation Lead to drive the transformation of our patent data processing, management, and utilization. The successful candidate will have expertise in Python, PySpark, and Databricks, as well as experience in leading and mentoring technical data engineering teams.This role...


  • London, Greater London, United Kingdom Searchability Full time

    Job Title: Cyber Security Big Data Engineering Lead PositionCompany Overview:We are a leading national security company based in central London, offering exciting career opportunities for skilled professionals. Our team is dedicated to designing and developing innovative solutions that meet the highest standards of security and performance.Salary:The salary...

  • Big Data Architect

    4 days ago


    London, Greater London, United Kingdom WorksHub Full time

    WorksHub is a leading technology company that specializes in delivering innovative data solutions to businesses. We are currently seeking a Big Data Architect to join our team in London and lead the design and implementation of our data architecture.The successful candidate will have a strong background in big data technologies, including Spark, Kafka, and...

  • Lead Data Architect

    5 days ago


    London, Greater London, United Kingdom Cornwallis Elt Full time

    Unlock Business Potential as a Lead Data ArchitectWe are seeking a highly skilled Lead Data Architect to join our team, with an estimated annual salary of £145,000 - £180,000.Cornwallis Elt, a leading workplace pensions provider in London, is looking for a seasoned data professional to lead their data engineering team. The successful candidate will have...


  • London, Greater London, United Kingdom InterEx Group Full time

    About the RoleWe are seeking an experienced Data Engineering Lead to join our team in Madrid. As a key member of our data engineering team, you will be responsible for designing and implementing big data solutions using cloud-based technologies.The ideal candidate will have over 5 years of experience in big data implementation projects, with a focus on...


  • London, Greater London, United Kingdom Noir Full time

    Join Our Team:Noir Consulting is a pioneering company in the technology sector, driven by innovation and excellence. We are looking for a Big Data Technical Lead to spearhead our data engineering efforts and create cutting-edge data solutions.About the Role:Lead the development of complex data ETL and ML pipelines and projections.Collaborate with architects...