Data Engineering Lead

3 weeks ago


Manchester, United Kingdom idpp Full time £70,000 - £90,000

Job Title: Senior Data Engineer

We are seeking a highly skilled Senior Data Engineer to join our forward-thinking team at idpp. If you have a strong background in data engineering, data governance, and metadata management, along with expertise in AWS and Python, we would like to hear from you.

Data Engineering:

  • Design, develop, and maintain robust data pipelines and ETL processes for a Dynamic Metadata system and risk index technology.
  • Implement real-time data processing solutions to ensure timely and accurate data for our clients' product.
  • Optimize data storage and retrieval processes to enhance system performance and scalability.

AWS:

  • Utilize AWS services (S3, Redshift, EMR, Lambda, Kinesis) to build and manage scalable data infrastructure.
  • Implement best practices for security, monitoring, and cost management within the AWS ecosystem.
  • Collaborate with DevOps teams to ensure seamless deployment and integration of data solutions.

Data Governance and Metadata Management:

  • Establish and enforce data governance policies to ensure data quality, integrity, and compliance.
  • Develop and maintain metadata management frameworks to support dynamic data processing and real-time analytics.
  • Collaborate with cross-functional teams to define data standards and ensure consistency across the organization.

Python Programming:

  • Develop and maintain Python scripts and applications for data processing, analysis, and automation tasks.
  • Implement machine learning algorithms and statistical models to enhance risk assessment and insurance policy calculations.

Requirements:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Proven experience as a Data Engineer, with a focus on data governance and metadata management.
  • Strong proficiency in AWS services and cloud architecture.
  • Advanced skills in Python programming and related libraries.

What We Offer:

  • Competitive salary and benefits package.
  • Professional development and growth opportunities.
  • Flexible working environment with a focus on work-life balance.

  • Data Engineer

    1 month ago


    Manchester, United Kingdom Data Privacy Full time

    Unlock Your Potential as a Data Engineer at WEXWEX Europe Services Ltd, a leading provider of fuel card solutions, is seeking a talented Data Engineer to join its team. As a Data Engineer at WEX, you will play a crucial role in connecting data with the rest of the organization, working closely with stakeholders to meet business needs using SQL-first...

  • Data Engineer

    1 month ago


    Manchester, United Kingdom Data Privacy Full time

    Unlock Your Potential as a Data Engineer at WEXWEX Europe Services Ltd, a leading provider of fuel card solutions, is seeking a talented Data Engineer to join its team. As a Data Engineer at WEX, you will play a crucial role in connecting data with the rest of the organization, working closely with stakeholders to meet business needs using SQL-first...

  • Data Product Lead

    4 weeks ago


    Manchester, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Data Product LeadHarnham - Data & Analytics Recruitment is seeking a Data Product Lead to join their team. The successful candidate will be responsible for leading the development and implementation of data products to drive impactful business outcomes.Key Responsibilities:Collaborate with stakeholders and business leaders to gather requirements and produce...

  • Data Engineer

    4 weeks ago


    Manchester, United Kingdom Data Privacy Full time

    WEX Europe Services Ltd, a rapidly expanding business with offices across Europe and the US, is seeking a skilled Data Engineer to connect data with the rest of the organization. As a Data Engineer at WEX, you will work with stakeholders to meet business needs using SQL-first transformation workflows.This role involves creating optimized data pipelines,...


  • Manchester, United Kingdom Data Idols Full time

    **Data Warehouse Team Lead**: Data Idols is working with one of the world’s largest gaming organisations to hire multiple Data Warehouse Developers. With this they are looking for an experienced Data Warehouse Team Lead to manage and coordinate the teams actvities and productivity. This is an opportunity to work at scale with a fantastic team of people to...

  • Data Analytics Lead

    1 week ago


    Manchester, United Kingdom Aspire Data Recruitment Full time

    Job SummaryAspire Data Recruitment seeks a highly skilled Data Analytics Lead to lead a team of analysts and drive data-led decision making across the division. The successful candidate will be responsible for maintaining a project portfolio of analysis projects, working on complex and technically demanding projects, and providing both technical and...

  • Lead Data Engineer

    1 month ago


    Manchester, United Kingdom Harnham Full time

    Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer to join our team in Manchester. As a key member of our data engineering team, you will be responsible for developing and maintaining data pipelines, working with the architecture team on frameworks for ingestion and transformation, and ensuring data quality.Key Responsibilities:Design and...

  • Lead Data Engineer

    1 month ago


    Manchester, United Kingdom Harnham Full time

    Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer to join our team in Manchester. As a key member of our data engineering team, you will be responsible for developing and maintaining data pipelines, working with the architecture team on frameworks for ingestion and transformation, and ensuring data quality.Key Responsibilities:Design and...

  • Lead Data Engineer

    3 days ago


    Manchester, United Kingdom Recann Full time

    Job Description Job Title: Lead Data Engineer Location: Hybrid (2 days per week onsite in Greater Manchester) Type: Permanent, Full-Time Shape the Future of Data Engineering Recann is recruiting on behalf of a prestigious organization in the health research sector, offering a highly rewarding opportunity for a Lead Data Engineer . This high-profile role...

  • Lead Data Engineer

    4 days ago


    Manchester, United Kingdom Recann Full time

    Job Title: Lead Data EngineerLocation: Hybrid (2 days per week onsite in Greater Manchester)Type: Permanent, Full-TimeShape the Future of Data EngineeringRecann is recruiting on behalf of a prestigious organization in the health research sector, offering a highly rewarding opportunity for a Lead Data Engineer. This high-profile role will allow you to build...

  • Lead Data Engineer

    4 days ago


    Manchester, United Kingdom Recann Full time

    Job Title: Lead Data EngineerLocation: Hybrid (2 days per week onsite in Greater Manchester)Type: Permanent, Full-TimeShape the Future of Data EngineeringRecann is recruiting on behalf of a prestigious organization in the health research sector, offering a highly rewarding opportunity for a Lead Data Engineer. This high-profile role will allow you to build...

  • Lead Data Engineer

    4 days ago


    Manchester,, Greater Manchester, United Kingdom Recann Full time

    Job Title: Lead Data EngineerLocation: Hybrid (2 days per week onsite in Greater Manchester)Type: Permanent, Full-TimeShape the Future of Data EngineeringRecann is recruiting on behalf of a prestigious organization in the health research sector, offering a highly rewarding opportunity for a Lead Data Engineer. This high-profile role will allow you to build...


  • Manchester, United Kingdom Data Idols Full time £75,000 - £80,000

    Data Warehouse ArchitectData Idols, a leading entertainment organisation, is seeking a skilled Data Warehouse Architect to join their Data Engineering department. As a key member of the team, you will be responsible for designing and implementing data warehouses that meet the organisation's growing needs.Key responsibilities include:Designing and...


  • Manchester, United Kingdom Data Idols Full time £75,000 - £80,000

    Data Warehouse Architect OpportunityData Idols, a leading entertainment organization, is seeking a skilled Data Warehouse Architect to join their rapidly growing global operations. As a key member of the Data Engineering department, you will play a crucial role in designing and implementing a robust data warehouse solution.Key Responsibilities:Design and...

  • Data Engineering Lead

    4 weeks ago


    Manchester, United Kingdom ODEON Full time

    Job Title: Data Engineering LeadJob Summary:The Data Engineering Lead is responsible for implementing the strategy for Data Engineering aligned to the Data Strategy in ODEON Cinemas Group (OCG). This includes overseeing activities required in the delivery and maintenance of quality data to support our Data Analyst communities. The role involves the...

  • Data Engineering Lead

    3 weeks ago


    Manchester, United Kingdom ODEON Full time

    Job Title: Data Engineering LeadJob Purpose:The Data Engineering Lead will oversee the implementation of the Data Engineering strategy aligned to the Data Strategy in ODEON Cinemas Group (OCG). This includes the development, operation, and maintenance of data pipelines to extract, load, and transform data sources from both internal and external providers....


  • Manchester, United Kingdom Harnham Full time €70,000 - €80,000

    Role: Data Engineering Lead Hybrid: 2 days a week in office This global organisation is dominating the UK market at the moment and looking for a Data Engineer Lead to join their dynamic team! The ideal candidate will have 5 years experience in Data Engineering, with 2 years (minimum) experience with managing junior people. ETL pipelines,...

  • Data Engineering Lead

    3 weeks ago


    Manchester, United Kingdom Lloyds Banking Group Full time

    Job Title: Data Engineering LeadJob Summary:We are seeking a highly skilled Data Engineering Lead to join our team at Lloyds Banking Group. As a Data Engineering Lead, you will be responsible for leading a large and diverse agile engineering team, building pipelines, patterns, and frameworks that enable data to be efficiently and effectively processed at...

  • Data Engineering Lead

    4 weeks ago


    Manchester, United Kingdom Harnham Full time

    Role: Data Engineering LeadLocation: ManchesterHybrid: 2 days a week in officeSalary: £70,000 - £80,000 (dependent on experience)About the CompanyThis global organisation is a market leader in the UK, seeking a Data Engineer Lead to join their dynamic team. The ideal candidate will have 5 years of experience in Data Engineering, with 2 years of experience...

  • Data Engineering Lead

    2 months ago


    Manchester, United Kingdom ODEON Full time

    Job Purpose:The Data Engineering Lead plays a pivotal role in implementing the Data Strategy for ODEON Cinemas Group, overseeing the delivery and maintenance of high-quality data to support the Data Analyst community. This involves developing, operating, and maintaining data pipelines to extract, load, and transform data from internal and external sources....