Senior Data Engineering Manager

4 weeks ago


Manchester, New Hampshire, United Kingdom idpp Full time

Job Title: Senior Data Engineering Manager

Job Summary: We are seeking a highly skilled Senior Data Engineering Manager to lead our data engineering team at idpp. The ideal candidate will have a strong background in data governance, metadata management, and cloud architecture.

Key Responsibilities:

Data Engineering:

  • Design, develop, and maintain robust data pipelines and ETL processes for a Dynamic Metadata system and risk index technology.
  • Implement real-time data processing solutions to ensure timely and accurate data for our clients' products.
  • Optimize data storage and retrieval processes to enhance system performance and scalability.

AWS:

  • Utilize AWS services (S3, Redshift, EMR, Lambda, Kinesis) to build and manage scalable data infrastructure.
  • Implement best practices for security, monitoring, and cost management within the AWS ecosystem.
  • Collaborate with DevOps teams to ensure seamless deployment and integration of data solutions.

Data Governance and Metadata Management:

  • Establish and enforce data governance policies to ensure data quality, integrity, and compliance.
  • Develop and maintain metadata management frameworks to support dynamic data processing and real-time analytics.
  • Collaborate with cross-functional teams to define data standards and ensure consistency across the organization.

Python Programming:

  • Develop and maintain Python scripts and applications for data processing, analysis, and automation tasks.
  • Implement machine learning algorithms and statistical models to enhance risk assessment and insurance policy calculations.
  • Write clean, efficient, and well-documented code to ensure maintainability and reproducibility.

Qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Proven experience as a Data Engineer, with a focus on data governance and metadata management.
  • Strong proficiency in AWS services and cloud architecture.
  • Advanced skills in Python programming and related libraries (e.g., pandas, NumPy, scikit-learn).
  • Experience with real-time data processing frameworks (e.g., Apache Kafka, Apache Spark) is a plus.
  • Solid understanding of data security, privacy regulations, and compliance standards.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills.

What We Offer:

  • Competitive salary and benefits package.
  • Opportunity to work with a dynamic and innovative team at the forefront of insurance technology.
  • Professional development and growth opportunities.
  • Flexible working environment with a focus on work-life balance.

  • Senior Data Engineer

    3 weeks ago


    Manchester, New Hampshire, United Kingdom idpp Full time

    Job Title: Senior Data EngineerJob Summary: We are seeking a highly skilled Senior Data Engineer to lead our data engineering team and drive the development of our dynamic metadata system and risk index technology.Key Responsibilities:Data Engineering:Design, develop, and maintain robust data pipelines and ETL processes to ensure timely and accurate data for...

  • Senior Data Engineer

    2 weeks ago


    Manchester, New Hampshire, United Kingdom Apply Recruitment Full time

    Senior Data Engineer Role OverviewApply Recruitment is seeking an experienced Senior Data Engineer to join our client's team in Manchester or Preston. This is a hybrid working opportunity that offers the flexibility to work from home 2-3 days a week, with the remaining days spent in the office. The role requires strong expertise in ETL data pipelines, Azure...


  • Manchester, New Hampshire, United Kingdom Head Resourcing Full time

    Lead Data EngineerJob Summary:We are seeking an experienced Lead Data Engineer to join our team at Head Resourcing. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines using Azure Data Lake, Databricks, and Azure Data Factory.Key Responsibilities:Lead a small team of data...


  • Manchester, New Hampshire, United Kingdom Head Resourcing Full time

    Job Title: Lead Data EngineerJob Summary:We are seeking a highly skilled Lead Data Engineer to join our team at Head Resourcing. As a Lead Data Engineer, you will be responsible for delivering and ensuring data quality, consistency, and reliability.Key Responsibilities:Develop, operate, and maintain data pipelines to extract, load, and transform data sources...

  • Senior Data Analyst

    2 weeks ago


    Manchester, New Hampshire, United Kingdom NC Associates Full time

    NC Associates is seeking an experienced Senior Data Analyst to join a growing PE Backed SME. The ideal candidate will have a strong background in E-Commerce with expertise in data warehouse management, system migration, and data visualization.Key Responsibilities:Systems:Lead the migration and optimization of systems to ensure smooth transitions and minimal...


  • Manchester, New Hampshire, United Kingdom bet365 Full time

    About the RoleWe are seeking a highly skilled Senior IT Engineering Manager to lead and manage our IT engineering capabilities across Technical Services. As a key member of our team, you will be responsible for developing and delivering our technology services to our internal customer base.The ideal candidate will have a thorough technical understanding and...

  • Data Engineer

    4 weeks ago


    Manchester, New Hampshire, United Kingdom Formula Recruitment Full time

    Analytics EngineerFormula Recruitment is seeking a skilled Analytics Engineer to join their dynamic Data team. This is an exciting opportunity for those looking to leverage cutting-edge technology to gain deep insights into consumers' digital lives.Key Responsibilities:Design and develop data monitoring systems to aid the identification and alerting of data...

  • Data Engineer

    4 weeks ago


    Manchester, New Hampshire, United Kingdom Formula Recruitment Full time

    Role OverviewWe are seeking a skilled Data Engineer to join our dynamic Data team at Formula Recruitment. This is an exciting opportunity for those looking to leverage cutting-edge technology to gain deep insights into consumers' digital lives.Key Responsibilities:Design and develop data monitoring systems that aid the identification and alerting of data...


  • Manchester, New Hampshire, United Kingdom bet365 Full time

    Job SummaryWe are seeking a highly skilled and experienced Technical Lead to join our Data Distribution and Analytics team. As a Senior Database Development Manager, you will be responsible for leading a team of engineers in delivering high-quality reporting and data extracts to the Business.The ideal candidate will have a strong background in database...

  • Senior Data Architect

    4 weeks ago


    Manchester, New Hampshire, United Kingdom Insight Investment Full time

    About the RoleWe are seeking an experienced Data Platform Architect to join our team at Insight Investment. As a key member of our Data Platform team, you will play a pivotal role in shaping and executing our data strategy, leveraging our data assets to drive business growth and innovation.Key ResponsibilitiesDesign and implement a robust and scalable data...


  • Manchester, New Hampshire, United Kingdom Apply Recruitment Full time

    As a Data Architect with Business Intelligence Expertise, you will join a dynamic team at Apply Recruitment, working on a challenging Enterprise Scale Business project in Manchester or Preston. This is a hybrid working opportunity, offering 2 to 3 days in your nearest office, with the others remotely.The role requires a Senior Data Engineer to work with...

  • Senior Data Scientist

    4 weeks ago


    Manchester, New Hampshire, United Kingdom Harnham Full time

    Senior Research Data ScientistManchester (Hybrid, 3 days per week)Harnham is a global leader in Customer Data Science, working across customer analytics and loyalty processes as a consultancy service.We are seeking a Senior Research Data Scientist to join our Price & Promotions team.Key Responsibilities:Design and build advanced demand forecasting...


  • Manchester, New Hampshire, United Kingdom Impellam Group Full time

    Senior Project ManagerWe are seeking a highly skilled Senior Project Manager to lead the delivery of projects across multiple workstreams.The ideal candidate will have experience working closely with software engineering teams in a fast-paced delivery environment, prioritizing development pieces and working at scale.The successful candidate will have solid...

  • Data Scientist

    4 weeks ago


    Manchester, New Hampshire, United Kingdom be:technology Full time

    Data Engineer OpportunityBe:technology is seeking a skilled Data Engineer to contribute to our expanding data science and analytics initiatives.Your role will involve designing, building, and maintaining data pipelines, ensuring seamless data flow into our central Microsoft Azure repository. You will collaborate with Data Analysts and Scientists to optimise...

  • Data Engineer

    1 week ago


    Manchester, New Hampshire, United Kingdom Escode, Part of NCC Group Full time

    About Escode, Part of NCC GroupEscode, a global leader in software escrow solutions, is dedicated to protecting businesses from unforeseen disruptions. We ensure that business-critical software applications and source code are safe, secure, and always available.We are seeking a skilled Data Engineer to drive the successful creation of a brand-new data...


  • Manchester, New Hampshire, United Kingdom Apply Recruitment Full time

    Senior Business Intelligence DeveloperWe are seeking a highly skilled Senior Business Intelligence Developer to join our team at Apply Recruitment. As a Senior Business Intelligence Developer, you will be responsible for designing, developing, and maintaining complex ETL data pipelines in an Azure focused environment using tools such as Azure Data Factory...

  • Senior NetIQ Engineer

    4 weeks ago


    Manchester, New Hampshire, United Kingdom The University of Manchester Full time

    About the RoleThe University of Manchester is seeking a highly skilled Senior NetIQ Engineer to join its IDAM engineering team. As a key member of the team, you will be responsible for designing, implementing, testing, and maintaining the IDAM frameworks, systems, and protocols.Key ResponsibilitiesDesign and implement IDAM systems, including physical data...


  • Manchester, New Hampshire, United Kingdom bet365 Full time

    Job Title: Data Management Systems Team LeadWe are seeking a highly skilled Data Management Systems Team Lead to join our Data Distribution and Analytics (DDA) department. As a key member of our team, you will be responsible for leading a team of engineers in delivering high-quality reporting and data extracts to the Business.The ideal candidate will have...


  • Manchester, New Hampshire, United Kingdom Wynne Consulting Full time

    Job SummaryWe are seeking a highly skilled Senior PI Software Engineer to join our team at Wynne Consulting. As a key member of our team, you will be responsible for providing technical expertise and consulting services to our clients using the AVEVA PI software portfolio.Key ResponsibilitiesTranslate customer requirements into technical solutions to scope...


  • Manchester, New Hampshire, United Kingdom ECOM Full time

    ECOM is seeking a Senior Frontend Engineering Manager to lead their frontend development team in Manchester or remotely.About the Role:This is an excellent opportunity for an experienced technical leader to join a scaling tech company and shape how things are done within their very own team.Key Responsibilities:Maintain a 50/50 balance between team...