Data Engineering Manager

1 week ago


Charing Cross, United Kingdom Matchtech Full time
About the Role

We are seeking a highly skilled Data Lead to join our progressive team at Matchtech. As a Data Lead, you will be responsible for leading and mentoring a team of data engineers and developers in building, testing, deploying, and maintaining scalable, reliable, and secure data pipelines and platforms.

Key Responsibilities
  • Collaborate with data engineering manager, business analysts, data architects, and other stakeholders to understand business requirements and design the data lakehouse solution.
  • Implement data ingestion, processing, storage, and delivery systems using technologies such as Spark, Databricks, AWS, Kinesis, Kafka, Airflow, Glue, Qlik, Great Expectations, GitHub, CodePipeline, Terraform, and Python.
  • Optimize the performance, reliability, and cost-efficiency of the data lakehouse solution.
  • Troubleshoot and resolve any data-related issues to ensure data quality and integrity.
  • Research and evaluate new technologies and trends in data engineering to propose innovative solutions.
Requirements
  • Bachelor's degree or higher in computer science, engineering, mathematics, statistics, or a related field.
  • Proven experience in data engineering or a similar role, with significant expertise in Spark, GitHub, CI/CD, Python, and AWS technologies.
  • Strong big data development background with experience building scalable, distributed, and fault-tolerant systems using microservices architecture and API strategy development.
  • Excellent SQL skills and experience with various relational and non-relational databases.
  • Preferably experienced with Databricks, Glue, Kafka, Airflow, Great Expectations, Qlik, Terraform, or related technologies.
  • Excellent communication skills (both verbal and written) and the ability to present complex technical concepts clearly.
  • Strong problem-solving and analytical thinking skills.
  • Ability to work independently and collaboratively in a fast-paced environment.
What We Offer
  • Competitive salary
  • Opportunity to work on cutting-edge fintech and technology projects
  • Professional development and training opportunities
  • Supportive and innovative work culture
  • Comprehensive benefits package


  • Charing Cross, United Kingdom Future Engineering Full time

    About the RoleWe are seeking a highly motivated and ambitious Junior Quantity Surveyor to join our team at Future Engineering. As a Junior Quantity Surveyor, you will play a key role in the delivery of large-scale data centre projects, working closely with senior management and directors to develop your skills and knowledge.Key ResponsibilitiesShadow senior...


  • Charing Cross, United Kingdom La Fosse Associates Ltd Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineering Manager to lead our data engineering team in delivering cutting-edge data solutions. As a key member of our team, you will be responsible for designing and implementing cloud-based solutions on AWS, focusing on efficient and scalable data architecture.Key ResponsibilitiesLead and mentor a...


  • Charing Cross, United Kingdom Sky Full time

    About the RoleWe're seeking a highly skilled Senior Engineering Manager to lead our Data Engineering team in delivering scalable and reliable data infrastructure solutions. As a key member of our team, you'll be responsible for designing, implementing, and managing data infrastructure components to ensure high availability and optimal performance.Key...


  • Charing Cross, United Kingdom Sky Full time

    About the RoleWe're seeking a highly skilled Senior Engineering Manager to lead our Data Engineering team in delivering scalable and reliable data infrastructure solutions. As a key member of our team, you'll be responsible for designing, implementing, and managing data infrastructure components to ensure high availability and optimal performance.Key...

  • Data Engineer

    1 week ago


    Charing Cross, United Kingdom In Technology Group Limited Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at In Technology Group Limited. The successful candidate will be responsible for working on various workstreams, including migration from SQL to Azure Databricks and data integration with 3rd party systems.Key Responsibilities:Migrate data from CRM to Azure DatabricksWork...

  • Data Engineer

    1 week ago


    Charing Cross, United Kingdom In Technology Group Limited Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at In Technology Group Limited. The successful candidate will be responsible for working on various workstreams, including migration from SQL to Azure Databricks and data integration with 3rd party systems.Key Responsibilities:Migrate data from CRM to Azure DatabricksWork...


  • Charing Cross, United Kingdom Morrison Data Services Full time

    About the RoleIncrease your chances of success by reading the following overview of this position before applying.Morrison Data Services is currently seeking a highly skilled Electrical Design Engineer to join our Renewable Connections team, working with clients across the UK.As an Electrical Design Engineer, you will be part of our team responsible for the...


  • Charing Cross, United Kingdom Morrison Data Services Full time

    About the RoleIncrease your chances of success by reading the following overview of this position before applying.Morrison Data Services is currently seeking a highly skilled Electrical Design Engineer to join our Renewable Connections team, working with clients across the UK.As an Electrical Design Engineer, you will be part of our team responsible for the...


  • Charing Cross, United Kingdom Dornan Engineering Full time

    About the RoleDornan Engineering is seeking an experienced Electrical Supervisor to join our team on a Data Centre project in London. As an Electrical Supervisor, you will play a key role in ensuring the successful delivery of the project.Key ResponsibilitiesCoordinate the establishment, implementation, and maintenance of the project Quality Plan and system...


  • Charing Cross, United Kingdom Dornan Engineering Full time

    About the RoleDornan Engineering is seeking an experienced Electrical Supervisor to join our team on a Data Centre project in London. As an Electrical Supervisor, you will play a key role in ensuring the successful delivery of the project.Key ResponsibilitiesCoordinate the establishment, implementation, and maintenance of the project Quality Plan and system...


  • Charing Cross, United Kingdom Experis UK Full time

    Job OverviewPlease ensure you read the below overview and requirements for this employment opportunity completely.We are seeking an experienced Senior Azure Data Engineer to join our team. This is a fully remote position, and the successful candidate must hold DV clearance. You will be working for Experis UK, delivering solutions for our clients. This role...


  • Charing Cross, United Kingdom Experis UK Full time

    Job OverviewPlease ensure you read the below overview and requirements for this employment opportunity completely.We are seeking an experienced Senior Azure Data Engineer to join our team. This is a fully remote position, and the successful candidate must hold DV clearance. You will be working for Experis UK, delivering solutions for our clients. This role...


  • Charing Cross, United Kingdom Amazon TA Full time

    Business Intelligence Solutions DeveloperAmazon TA is seeking a highly skilled Business Intelligence Solutions Developer to join our team. As a Business Intelligence Solutions Developer, you will play a key role in driving business performance, innovation, and execution in our delivery operations.This position will be responsible for creating tools and...


  • Charing Cross, United Kingdom Sky Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Engineering Manager to join our team at Sky. As a key member of our engineering organization, you will be responsible for leading and mentoring a team of front-end and back-end engineers, providing technical guidance and support to ensure the reliability and performance of our systems.Key...


  • Charing Cross, United Kingdom Datatech Analytics Full time

    About the RoleWe are seeking a highly experienced Data Manager to join our Data Strategy team at Datatech Analytics. As a key member of our team, you will be responsible for leading the migration of our Customer Data Platform (CDP) and ensuring the delivery of high-quality data and technology solutions to support our marketing strategy.Key...

  • Lead Data Engineer

    2 weeks ago


    Charing Cross, United Kingdom Searchability NS&D Ltd Full time

    About the RoleWe are seeking a highly skilled Lead Data Engineer to join our team at Searchability NS&D Ltd. As a Lead Data Engineer, you will play a key role in designing and implementing scalable data systems that meet the security and compliance requirements of our clients in the national security sector.Key ResponsibilitiesDesign and implement data...

  • Lead Data Engineer

    3 weeks ago


    Charing Cross, United Kingdom Searchability NS&D Ltd Full time

    About the RoleWe are seeking a highly skilled Lead Data Engineer to join our team at Searchability NS&D Ltd. As a Lead Data Engineer, you will play a key role in designing and implementing scalable data systems that meet the security and compliance requirements of our clients in the national security sector.Key ResponsibilitiesDesign and implement data...


  • Charing Cross, United Kingdom Dornan Engineering Full time

    Dornan Engineering is seeking an experienced Electrical Project Manager to lead our site team in central London. As a key member of our team, you will be responsible for the effective day-to-day running of site activities, ensuring compliance with programme, materials deliveries, engineering, quality, and safety standards. Your expertise in electrical...


  • Charing Cross, United Kingdom Dornan Engineering Full time

    Dornan Engineering is seeking an experienced Electrical Project Manager to lead our site team in central London. As a key member of our team, you will be responsible for the effective day-to-day running of site activities, ensuring compliance with programme, materials deliveries, engineering, quality, and safety standards. Your expertise in electrical...


  • Charing Cross, United Kingdom Morrison Data Services Full time

    About the RoleWe are seeking an experienced Electrical Design Engineer to join our Renewable Connections business. As a key member of our team, you will be responsible for designing and delivering electrical works for clients across the UK.Key ResponsibilitiesLead and develop cost-effective, efficient, and innovative solutions to complex problemsAssess and...