Big Data Engineering Lead

6 days ago


London, Greater London, United Kingdom ENGINEERINGUK Full time

About the Role

">

We are seeking a Big Data Engineering Lead to join our Worldwide Operations Finance Standardization & Automation (WWSnA) team. The successful candidate will be responsible for designing, implementing, and supporting scalable data infrastructure solutions using Python, Airflow, and SQL. Experience with big data technologies such as Hadoop, Hive, Spark, EMR is an added advantage.

">

Key Responsibilities

">
  • Lead a team of data engineers to design, implement, and support scalable data infrastructure solutions.
  • Interface with other technology teams to extract, transform, and load data from various sources.
  • Designing and implementing complex pipelines and other Data Engineering solutions.
">

BASIC QUALIFICATIONS

">
  • 3+ years of experience in data engineering.
  • Experience with data modeling, warehousing, and building ETL pipelines.
  • Experience with one or more query languages (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala).
  • Experience with one or more scripting languages (e.g., Python, KornShell).
  • Bachelor's degree.
  • Knowledge of distributed systems as it pertains to data storage and computing.
">

Salary Information

">

The estimated salary for this role is between £120,000 and £150,000 per annum, depending on experience. We offer a competitive benefits package including health insurance, pension scheme, and flexible working hours.

">

Benefits Package

">

In addition to the salary, we offer a comprehensive benefits package, including health insurance, pension scheme, and flexible working hours. We also provide opportunities for professional development and growth within the company.



  • London, Greater London, United Kingdom Data Science Festival Full time

    **Job Overview**Data Science Festival is seeking an experienced Big Data Engineering Lead to join their team in London – hybrid. This is a fantastic opportunity for a skilled professional to drive data transformation and deliver value throughout the company.This hands-off role requires someone with extensive experience in managing teams, stakeholder...


  • London, Greater London, United Kingdom Source Technology Full time

    Job Details:Job Title: Engineering Lead for Big DataWe are seeking an experienced Engineering Lead for Big Data to lead our team in delivering next-generation big data infrastructure and enabling advanced AI/ML capabilities. The successful candidate will have a strong background in data engineering, Azure data services, and leading high-performing teams.Key...


  • London, Greater London, United Kingdom Thoughtworks Inc. Full time

    About the Opportunity:We are looking for an experienced Big Data Engineer Lead to lead our big data initiatives and drive innovation in data engineering.About You:You have a proven track record of successfully leading big data projects and teams.You have extensive experience with big data tools, frameworks, and technologies, including distributed storage and...


  • London, Greater London, United Kingdom Athsai Full time

    Athsai is looking for a highly skilled Lead Big Data Engineer to oversee the design, development, and deployment of large-scale data engineering projects. This is an excellent opportunity for a qualified professional to showcase their technical expertise and leadership skills.You will work closely with cross-functional teams to deliver complex data...


  • London, Greater London, United Kingdom Amazon Full time

    Job OverviewWe are seeking an experienced Big Data Engineering Lead to join our team at Amazon. As a senior member of our team, you will be responsible for leading the development of big data solutions and working closely with other technology teams to extract, transform, and load data from a wide variety of data sources.Our team is passionate about using...


  • London, Greater London, United Kingdom Quantexa Full time

    Key ResponsibilitiesAs a lead data engineer at Quantexa, your key responsibilities will include:• Leading a team of junior data engineers within an agile framework• Writing defensive, fault-tolerant, and efficient code for production-level data processing systems• Configuring and deploying Quantexa's software using tools such as Spark, Hadoop, Scala,...


  • London, Greater London, United Kingdom ZipRecruiter Full time

    Required Skills and Qualifications: We are looking for an exceptional Big Data Technical Lead with a deep understanding of big data technologies, including PySpark and SQL. You will be responsible for leading the development of a cutting-edge data platform, ensuring high-quality delivery, and mentoring junior engineers.About the Role:Lead the development of...

  • Big Data Engineer

    2 days ago


    London, Greater London, United Kingdom ADLIB Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at ADLIB. The ideal candidate will have experience with Databricks and SQL, as well as strong communication skills.About the Role:Lead the migration of data from legacy DB to Databricks.Design, implement, and optimize data pipelines using Databricks, PySpark, and...


  • London, Greater London, United Kingdom JobHoller Full time

    Job OverviewWe are recruiting a skilled Lead Big Data Engineer to work with our team at JobHoller in central London.The ideal candidate will have experience with big data tools such as Hadoop, Cloudera or Elasticsearch and a strong background in Java.

  • Big Data Engineer

    2 weeks ago


    London, Greater London, United Kingdom Xcede Full time

    Job Summary: Xcede is seeking a Big Data Engineer to join our team in London. The successful candidate will be responsible for designing and implementing scalable big data architectures, ensuring the quality and security of data processes, and collaborating with cross-functional teams to deliver projects.Key Responsibilities: Design, build, and maintain...


  • London, Greater London, United Kingdom Harnham Full time £55,000 - £65,000

    AWS Big Data Engineer: We are seeking an experienced AWS big data engineer to join our team at Harnham. As a key member of our product engineering organisation, you will be responsible for designing and implementing a new data lake on AWS.About the Company:Harnham is a leading recruitment agency specialising in technology and data roles. We are partnering...


  • London, Greater London, United Kingdom S&P Global Full time

    About the Team:S&P Global Market Intelligence is a division of S&P Global, a leading provider of data and analytics solutions for the financial industry. We understand the importance of accurate, deep, and insightful information and are committed to delivering unrivaled insights and leading data and technology solutions.The Job Description: As a Senior...


  • London, Greater London, United Kingdom CV-Library Full time

    Job DescriptionWe are currently seeking a highly skilled Data Engineer Tech Lead to lead the development of our client's data Lakehouse platform. This is a 12-month contract, hybrid role with weekly visits to our Central London office.The successful candidate will have extensive experience with Databricks, Apache Spark, and data lakes, as well as proficiency...

  • Big Data Engineer

    1 week ago


    London, Greater London, United Kingdom Xcede Group Full time

    Job Summary: Xcede Group is seeking a talented Big Data Engineer to join our team in London. As a Big Data Engineer, you will be responsible for designing, building, and implementing big data solutions to enable the capture, ingestion, storage, and provision of terabyte-sized alternate datasets. You will work closely with Trading, Quant Research, and...


  • London, Greater London, United Kingdom SR2 | Socially Responsible Recruitment | Certified B Corporation™ Full time

    Data Engineering Career Opportunity:Sr2 is seeking a seasoned Senior Big Data Engineer to lead our data engineering efforts in London. As a senior member of the team, you will oversee the design, development, and implementation of large-scale data systems, ensuring they are efficient, reliable, and meet the needs of our clients.The ideal candidate will have...


  • London, Greater London, United Kingdom Hellowork Consultants Full time

    Job DescriptionHellowork Consultants is hiring a Senior Big Data Engineer to lead the development of complex data processing systems. You will be responsible for designing and implementing data pipelines, working with large datasets, and ensuring data quality and integrity. Your expertise in big data technologies, such as Hadoop and Spark, will be crucial in...


  • London, Greater London, United Kingdom CV-Library Full time

    CV-Library is seeking a Big Data Engineering Manager to lead our data engineering efforts. The ideal candidate will have extensive experience in designing and implementing large-scale data systems, managing a team of engineers, and collaborating with stakeholders to drive business outcomes.RequirementsProven track record in leading data engineering...


  • London, Greater London, United Kingdom Amazon Full time

    Job OverviewThis role offers a chance to work with prominent startups and large enterprises to architect scalable Big Data solutions. The ideal candidate will have extensive experience in software development, cloud computing, systems engineering, infrastructure, security, networking, and data & analytics.Requirements8+ years of specific technology domain...

  • Senior Data Engineer

    2 weeks ago


    London, Greater London, United Kingdom Entain Full time

    At Entain, we're committed to transforming the gaming sector by creating exciting and trusted experiences for our customers. As a Senior Data Engineer - Big Data Analytics, you'll be responsible for leading the design, development, and deployment of big data analytics solutions to drive business growth and improvement.ResponsibilitiesBig Data Analytics:...


  • London, Greater London, United Kingdom Publica LLC Full time

    About the RoleWe are seeking an experienced Staff Software Engineer to join our team at Publica LLC. The successful candidate will have a strong background in software engineering, a passion for big data, and experience working with cloud technologies.The ideal candidate will have a degree in Software Engineering or a related STEM field and will have...