Management Information Lead Data Engineer

4 weeks ago

Redditch, United Kingdom Halfords Full time

We are looking for a Lead Data Engineer, who will help us design, implement and manage data solutions on the Microsoft Azure cloud platform. The Lead will work to migrate the business from legacy systems. The job involves planning and management for solution design and technical delivery, ensuring that the right tools and roadmap are available. The Lead manages a team who create and maintain data pipelines, data storage solutions, data processing and data integration for data-driven decision-making inside Halfords, including the organisation’s stakeholders. The Lead will plan, execute and manage data migration from legacy systems using Azure Data Factory and Azure Databricks.

Responsibilities

Current Platform

  • To determine the technical data engineering roadmap that delivers the Halfords requirements using appropriate technologies and tools.
  • To manage, develop and mentor other members of the Data Engineering Team.
  • To act as design authority for new developments within the Data Engineering Team.
  • To manage the handover of ongoing data engineering solutions to support teams and assist in resolution of issues where appropriate.
  • Communicate effectively with management and other stakeholders to explain data concepts, solutions and benefits.
  • Design, develop and maintain data pipelines using Azure Data Factory.
  • Implement data validation and cleansing procedures to ensure the quality, integrity and reliability of the data.
  • Optimize pipeline performance and scalability using Databricks workspace configuration, cluster and notebook optimization.
  • Work with big data technologies like Azure Databricks and Apache Spark to handle and analyse large volumes of data.
  • Support data analytics, machine learning and other data-driven applications using Azure ML, Logic Apps and Power BI.
  • Design and implement data storage systems using Azure Blob Storage.
  • Ensure data security, privacy and compliance with relevant standards and regulations.
  • Stay updated with the latest trends and technologies in the data field and evaluate new tools and frameworks.

Legacy

  • Assess the current state of the data and analytics solutions on the legacy systems, such as SAP Business Warehouse, Qlik, Alteryx and Business Objects
  • Define the target state of the data and analytics solutions on the Azure cloud platform, using Azure Databricks.
  • Design, develop and test data migration strategies and pipelines using Azure Data Factory.
  • Ensure the data quality, integrity and consistency during and after the migration process.
  • Monitor and troubleshoot the data migration issues and resolve them in a timely manner.
  • Document and communicate the data migration progress, status and results to management.
  • Coordinate and align with the report re-writing team to ensure the compatibility and integration of the data and reports on the Azure platform.

Requirements

  • Degree in Computer Science, Engineering, Mathematics, Statistics or related field of experience as a data engineer or similar role.
  • Microsoft Certified: Azure Data Engineer Associate certification or equivalent.
  • People development, coaching and mentoring skills.
  • Stakeholder management skills.
  • Network externally to understand emerging trends and technologies.
  • Analytical and creative approach to problem solving.
  • Proficiency in SQL and data modelling concepts.
  • Understanding of legacy architectures and platforms such as SAP BW, Alteryx and BusinessObjects.
  • Experience with Azure data services and tools, such as Azure Data Factory, Azure Databricks, Azure Storage Account and Azure SQL DB.
  • Experience with data migration projects, especially from SAP BW to Azure Databricks or similar platforms.
  • Experience with data visualization and reporting tools like Power BI.
  • Experience with data integration and ETL processes.
  • Experience with Python, Scala, Java or other programming languages.
  • Experience with Azure DevOps or other version control and CI/CD tools.
  • Experience with leading and managing a team of data engineers.
  • Excellent communication, presentation and interpersonal skills.
  • Awareness of retail-specific business processes and IT solutions.
  • Ability to work independently and collaboratively in a fast-paced environment.
  • Ability to learn new technologies and frameworks quickly.
  • Knowledge of AI and machine learning concepts and platforms, such as Google Vertex and Microsoft Fabric, is a plus.

  • Lead Engineer

    2 weeks ago

    Redditch, United Kingdom Michael Page Full time

    The interim Lead Engineer will be responsible for the availability and development of plant and equipment across a fast paces manufacturing facility based in Redditch. Client Details Our client is a globally recognised organisation within the building products manufacturing sector. The Redditch based operation is a small plant undergoing significant...

  • Lead Engineer

    2 weeks ago

    Redditch, United Kingdom Michael Page Full time

    The interim Lead Engineer will be responsible for the availability and development of plant and equipment across a fast paces manufacturing facility based in Redditch. Client DetailsOur client is a globally recognised organisation within the building products manufacturing sector. The Redditch based operation is a small plant undergoing significant growth...

  • Head of Data Management

    4 weeks ago

    Redditch, United Kingdom Halfords Full time

    **Are you ready to take on a critical role in shaping and implementing the data strategy for the UK's leading provider of motoring and cycling products and services?** At Halfords, we are seeking a Head of Data Management and Governance to lead the way in managing data platforms and teams. Your role will be pivotal in ensuring data integrity, quality, and...

  • Microsoft Data Engineer

    7 days ago

    Redditch, Worcestershire, United Kingdom Kemp Recruitment Limited Full time

    Data Centre Engineer Rota: Monday – Friday – DAYS My client, a leading plant company, is seeking a skilled and experienced Data Centre Engineer to join their team. Main responsibilities of the Data Centre Engineer will include; Monitor and maintain computer systems, troubleshooting area networks, servers, and routers. Provide...

  • Data Centre Engineer in Redditch)

    7 days ago

    Redditch, Worcestershire, United Kingdom Kemp Recruitment Limited Full time

    Data Centre Engineer Salary: £36,000 Location: Redditch Rota: Monday – Friday – DAYS My client, a leading plant company, is seeking a skilled and experienced Data Centre Engineer to join their team. Main responsibilities of the Data Centre Engineer will include; Monitor and maintain computer systems, troubleshooting area networks,...

  • Assistant Data Engineer

    1 day ago

    Redditch, Worcestershire, United Kingdom Pertemps Redditch Industrial Full time

    Assistant Data Engineer Contract Type: Permanent Our client is seeking a dedicated and reliable Assistant Data Engineer to join their team. The ideal candidate will be responsible for assisting with the installation, servicing, and decommissioning of audio-visual systems, in addition to managing cabling and wireless network solutions for both educational...

  • Business Service Engineer

    1 week ago

    Redditch, United Kingdom Optima Plus Recruitment Full time

    Job Title: Business Service EngineerCompany: Optima Plus RecruitmentLocation: RedditchHours - 37 Hours per week (Monday to Friday) - Hybrid (Flexible with home / office workingDaily Rate: £18.81 umbrella £24.45 PAYE per hourAbout Us: Optima Plus Recruitment is a leading recruitment agency dedicated to connecting talented individuals with rewarding...

  • Lead Engineer

    2 weeks ago

    Redditch, Worcestershire, United Kingdom Michael Page Full time

    The interim Lead Engineer will be responsible for the availability and development of plant and equipment across a fast paces manufacturing facility based in Redditch. Client Details Our client is a globally recognised organisation within the building products manufacturing sector. The Redditch based operation is a small plant undergoing significant...

  • Engineering Manager

    5 days ago

    Redditch, United Kingdom Adecco Full time

    **Engineering Manager** **Redditch** **Permanent** **Monday - Friday-7.30am - 5.30pm** **£45,000.00-£48,000.00 per year** Reporting to the head of engineering, the focus will be to ensure a safe, punctual, reliable and cost-effective delivery of service through robust management of the Engineering performance, providing accurate information on costs,...

  • Lead Engineer

    2 weeks ago

    Redditch, Worcestershire, United Kingdom Michael Page (UK) Full time

    About Our Client Our client is a globally recognised organisation within the building products manufacturing sector. The Redditch based operation is a small plant undergoing significant growth and investment. Job Description The Lead Engineer is a hands on role tasked with improving plant availability and developing maintenance systems across the site....

  • Lead Quality Verification Engineer

    2 days ago

    Redditch, United Kingdom Redline Group Ltd Full time

    An exciting job opportunity has arisen for a Lead Quality Verification Engineer to join a globally recognised organisation involved within the exciting technology sector of battery and power supplies, based at their site in Crewkerne, Somerset.Due to continued growth my client in Crewkerne, Somerset is seeking a Lead Quality Verification Engineer to lead the...

  • Lead Engineer

    2 weeks ago

    Redditch, Worcestershire, United Kingdom Michael Page Full time

    The interim Lead Engineer will be responsible for the availability and development of plant and equipment across a fast paces manufacturing facility based in Redditch. Client Details Our client is a globally recognised organisation within the building products manufacturing sector. The Redditch based operation is a small plant undergoing significant growth...

  • Metrology Quality Engineer

    4 weeks ago

    Redditch, United Kingdom Redline Group Ltd Full time

    An exciting new job opportunity has arisen for a Metrology Quality Engineer, urgently required in the Redditch area. This is an excellent opportunity to join a dynamic, high-performance design, and manufacturer, supplying into the automotive sector. The Metrology Quality Engineer, based in Redditch, will be responsible in supporting all metrology and...

  • Metrology Quality Engineer

    3 weeks ago

    Redditch, United Kingdom Redline Group Ltd Full time

    An exciting new job opportunity has arisen for a Metrology Quality Engineer, urgently required in the Redditch area.This is an excellent opportunity to join a dynamic, high-performance design, and manufacturer, supplying into the automotive sector.The Metrology Quality Engineer, based in Redditch, will be responsible in supporting all metrology and...

  • Lead Temporary Works Engineer

    4 days ago

    Redditch, Worcestershire, United Kingdom Michael Page Full time

    The interim Lead Engineer will be responsible for the availability and development of plant and equipment across a fast paces manufacturing facility based in Redditch. Our client is a globally recognised organisation within the building products manufacturing sector. The Redditch based operation is a small plant undergoing significant growth and...

  • Lead Engineer

    2 weeks ago

    Redditch, Worcestershire, United Kingdom Michael Page (UK) Full time

    Our client is a globally recognised organisation within the building products manufacturing sector. The Redditch based operation is a small plant undergoing significant growth and investment. The Lead Engineer is a hands on role tasked with improving plant availability and developing maintenance systems across the site. Identifying and resolving downtime...

  • Business Service Engineer

    2 days ago

    Redditch, Worcestershire, United Kingdom Optima Plus Recruitment Full time

    Job Title: Business Service Engineer Company: Optima Plus Recruitment Location: Redditch Hours - 37 Hours per week (Monday to Friday) - Hybrid (Flexible with home / office working Daily Rate: £18.81 umbrella £24.45 PAYE per hour About Us: Optima Plus Recruitment is a leading recruitment agency dedicated to connecting talented individuals with...

  • Business Service Engineer

    7 days ago

    Redditch, Worcestershire, United Kingdom Optima Plus Recruitment Full time

    Job Title: Business Service Engineer Company: Optima Plus Recruitment Location: Redditch Hours - 37 Hours per week (Monday to Friday) - Hybrid (Flexible with home / office working Daily Rate: £18.81 umbrella £24.45 PAYE per hour About Us: Optima Plus Recruitment is a leading recruitment agency dedicated to connecting talented individuals with...

  • Metrology Quality Engineer

    3 weeks ago

    Redditch, United Kingdom Redline Group Ltd Full time

    An exciting new job opportunity has arisen for a Metrology Quality Engineer, urgently required in the Redditch area.This is an excellent opportunity to join a dynamic, high-performance design, and manufacturer, supplying into the automotive sector.The Metrology Quality Engineer, based in Redditch, will be responsible in supporting all metrology and...

  • Maintenance Team Lead

    2 weeks ago

    Redditch, United Kingdom Amazon TA Full time

    Our Reliability Maintenance Engineering (RME) team is central to Amazon's commitment to innovation. As Amazon evolves and adapts, this team makes sure that the tools and technologies we use do as well. As a Senior RME Technician, you'll help us stay one step ahead, adopting the latest technologies and identifying new and efficient ways of working. In this...