Data Engineering Lead

1 week ago

Manchester, United Kingdom idpp Full time £70,000 - £90,000

Data Engineering Role

About the Job:

We're looking for a seasoned Senior Data Engineer to join our team at idpp. As a key member of our data engineering team, you'll be responsible for designing, developing, and maintaining robust data pipelines and ETL processes for our Dynamic Metadata system and risk index technology.

Key Responsibilities:

Data Engineering:

  • Design and implement scalable data architectures to support real-time data processing and analytics.
  • Develop and maintain data pipelines using AWS services such as S3, Redshift, EMR, Lambda, and Kinesis.
  • Collaborate with cross-functional teams to ensure seamless deployment and integration of data solutions.

AWS Cloud Architecture:

  • Design and implement scalable cloud architecture using AWS services.
  • Implement best practices for security, monitoring, and cost management within the AWS ecosystem.
  • Collaborate with DevOps teams to ensure seamless deployment and integration of cloud-based data solutions.

Data Governance and Metadata Management:

  • Establish and enforce data governance policies to ensure data quality, integrity, and compliance.
  • Develop and maintain metadata management frameworks to support dynamic data processing and real-time analytics.
  • Collaborate with cross-functional teams to define data standards and ensure consistency across the organization.

Qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Proven experience as a Data Engineer, with a focus on data governance and metadata management.
  • Strong proficiency in AWS services and cloud architecture.
  • Advanced skills in Python programming and related libraries.
  • Experience with real-time data processing frameworks is a plus.

What We Offer:

  • Competitive salary and benefits package.
  • Opportunity to work with a dynamic and innovative team at the forefront of insurance technology.
  • Professional development and growth opportunities.
  • Flexible working environment with a focus on work-life balance.

Apply Now

  • Data Engineer

    1 month ago

    Manchester, United Kingdom Data Privacy Full time

    WEX Europe Services Ltd, a rapidly expanding business with offices across Europe and the US, is seeking a skilled Data Engineer to connect data with the rest of the organization. As a Data Engineer at WEX, you will work with stakeholders to meet business needs using SQL-first transformation workflows.This role involves creating optimized data pipelines,...

  • Data Warehouse Team Lead

    6 months ago

    Manchester, United Kingdom Data Idols Full time

    **Data Warehouse Team Lead**: Data Idols is working with one of the world’s largest gaming organisations to hire multiple Data Warehouse Developers. With this they are looking for an experienced Data Warehouse Team Lead to manage and coordinate the teams actvities and productivity. This is an opportunity to work at scale with a fantastic team of people to...

  • Data Analytics Lead

    3 weeks ago

    Manchester, United Kingdom Aspire Data Recruitment Full time

    Job SummaryAspire Data Recruitment seeks a highly skilled Data Analytics Lead to lead a team of analysts and drive data-led decision making across the division. The successful candidate will be responsible for maintaining a project portfolio of analysis projects, working on complex and technically demanding projects, and providing both technical and...

  • Lead Data Engineer

    1 day ago

    Manchester, United Kingdom {Devlogic} Full time

    Lead Data Engineer Manchester City Centre, UK (Hybrid) We're working with a growing fintech company that's changing the way businesses use data to drive decisions.They're looking for a Lead Data Engineer to take charge of building and managing scalable data solutions that support their vision for the future.In this role, you'll be responsible for the entire...

  • Lead Data Engineer

    2 weeks ago

    Manchester, United Kingdom Recann Full time

    Job Description Job Title: Lead Data Engineer Location: Hybrid (2 days per week onsite in Greater Manchester) Type: Permanent, Full-Time Shape the Future of Data Engineering Recann is recruiting on behalf of a prestigious organization in the health research sector, offering a highly rewarding opportunity for a Lead Data Engineer . This high-profile role...

  • Lead Data Engineer

    3 weeks ago

    Manchester, United Kingdom Recann Full time

    Job Title: Lead Data EngineerLocation: Hybrid (2 days per week onsite in Greater Manchester)Type: Permanent, Full-TimeShape the Future of Data EngineeringRecann is recruiting on behalf of a prestigious organization in the health research sector, offering a highly rewarding opportunity for a Lead Data Engineer. This high-profile role will allow you to build...

  • Lead Data Engineer

    3 weeks ago

    Manchester,, Greater Manchester, United Kingdom Recann Full time

    Job Title: Lead Data EngineerLocation: Hybrid (2 days per week onsite in Greater Manchester)Type: Permanent, Full-TimeShape the Future of Data EngineeringRecann is recruiting on behalf of a prestigious organization in the health research sector, offering a highly rewarding opportunity for a Lead Data Engineer. This high-profile role will allow you to build...

  • Lead Data Engineer

    3 weeks ago

    Manchester, United Kingdom Recann Full time

    Job Title: Lead Data EngineerLocation: Hybrid (2 days per week onsite in Greater Manchester)Type: Permanent, Full-TimeShape the Future of Data EngineeringRecann is recruiting on behalf of a prestigious organization in the health research sector, offering a highly rewarding opportunity for a Lead Data Engineer. This high-profile role will allow you to build...

  • Lead Data Engineer

    3 days ago

    Manchester, United Kingdom {DevLogic} Full time

    Lead Data EngineerManchester City Centre, UK (Hybrid) We’re working with a growing fintech company that’s changing the way businesses use data to drive decisions. They’re looking for a Lead Data Engineer to take charge of building and managing scalable data solutions that support their vision for the future.In this role, you’ll be responsible for the...

  • Lead Data Engineer

    3 days ago

    Manchester, United Kingdom {DevLogic} Full time

    Lead Data Engineer Manchester City Centre, UK (Hybrid) We’re working with a growing fintech company that’s changing the way businesses use data to drive decisions. They’re looking for a Lead Data Engineer to take charge of building and managing scalable data solutions that support their vision for the future. In this role, you’ll be responsible...

  • Lead Data Engineer

    2 days ago

    Manchester, United Kingdom {DevLogic} Full time

    Lead Data Engineer Manchester City Centre, UK (Hybrid) We’re working with a growing fintech company that’s changing the way businesses use data to drive decisions. They’re looking for a Lead Data Engineer to take charge of building and managing scalable data solutions that support their vision for the future. In this role, you’ll be...

  • Lead Data Engineer

    3 days ago

    Manchester, United Kingdom {DevLogic} Full time

    Lead Data Engineer Manchester City Centre, UK (Hybrid) We’re working with a growing fintech company that’s changing the way businesses use data to drive decisions. They’re looking for a Lead Data Engineer to take charge of building and managing scalable data solutions that support their vision for the future. In this role, you’ll be responsible...

  • Lead Data Engineer

    3 days ago

    Manchester, United Kingdom {DevLogic} Full time

    Lead Data EngineerManchester City Centre, UK (Hybrid) We’re working with a growing fintech company that’s changing the way businesses use data to drive decisions. They’re looking for a Lead Data Engineer to take charge of building and managing scalable data solutions that support their vision for the future.In this role, you’ll be responsible for the...

  • Lead Data Engineer

    2 days ago

    Manchester, United Kingdom {DevLogic} Full time

    Lead Data Engineer Manchester City Centre, UK (Hybrid) We’re working with a growing fintech company that’s changing the way businesses use data to drive decisions. They’re looking for a Lead Data Engineer to take charge of building and managing scalable data solutions that support their vision for the future. In this role, you’ll be responsible...

  • Lead Data Engineer

    3 days ago

    Manchester, United Kingdom {DevLogic} Full time

    Lead Data EngineerManchester City Centre, UK (Hybrid) We’re working with a growing fintech company that’s changing the way businesses use data to drive decisions. They’re looking for a Lead Data Engineer to take charge of building and managing scalable data solutions that support their vision for the future.In this role, you’ll be responsible for the...

  • Data Engineer Lead

    5 days ago

    Manchester, United Kingdom Socium Recruitment Full time

    As a key member of our Data team, you will play a pivotal role in shaping the future of our data platform. We are seeking a seasoned Senior Data Engineer to lead the migration of our on-premises SQL and Cosmos DB to Azure, leveraging the latest cloud technologies to boost data capabilities and drive innovation.The ideal candidate will have a strong...

  • Lead Engineer/Data Engineer

    4 weeks ago

    Manchester, United Kingdom Harnham Full time €70,000 - €80,000

    Role: Data Engineering Lead Hybrid: 2 days a week in office This global organisation is dominating the UK market at the moment and looking for a Data Engineer Lead to join their dynamic team! The ideal candidate will have 5 years experience in Data Engineering, with 2 years (minimum) experience with managing junior people. ETL pipelines,...

  • Data Engineering Lead

    7 days ago

    Manchester, United Kingdom N Brown Full time

    We are seeking a skilled Data Engineering Lead to join our Data Engineering team and drive the development of our analytics platform.As a key member of the team, you will be responsible for leading a team of engineers in creating, maintaining, and extending our analytics platform. This includes designing patterns for ingesting, transforming, and exposing...

  • Data Insights Specialist

    2 weeks ago

    Manchester, United Kingdom Data Privacy Full time

    About UsWe are First Central Insurance & Technology Group, a market-leading insurance company driven by innovation and data expertise. Our technology and data teams work together to deliver cutting-edge solutions that drive business success.Job DescriptionWe are seeking a skilled Data Business Analyst to join our team. The successful candidate will be...

  • Lead Data Engineer

    2 months ago

    Manchester, United Kingdom Head Resourcing Full time

    Lead Data Engineer - £75k plus bonus & benefits - hybrid 2 days in ManchesterAn exciting opportunity has arisen to join this leading household name, based in Manchester city centre (hybrid).The role will be critical in delivering and ensuring data quality, consistency, and reliability working closely with other data engineers in the team as well as the...