Management Information Lead Data Engineer

4 weeks ago


Worcestershire, United Kingdom Halfords Full time

We are looking for a Lead Data Engineer, who will help us design, implement and manage data solutions on the Microsoft Azure cloud platform. The Lead will work to migrate the business from legacy systems. The job involves planning and management for solution design and technical delivery, ensuring that the right tools and roadmap are available. The Lead manages a team who create and maintain data pipelines, data storage solutions, data processing and data integration for data-driven decision-making inside Halfords, including the organisation’s stakeholders. The Lead will plan, execute and manage data migration from legacy systems using Azure Data Factory and Azure Databricks.

Responsibilities

Current Platform

To determine the technical data engineering roadmap that delivers the Halfords requirements using appropriate technologies and tools.To manage, develop and mentor other members of the Data Engineering Team.To act as design authority for new developments within the Data Engineering Team.To manage the handover of ongoing data engineering solutions to support teams and assist in resolution of issues where appropriate. Communicate effectively with management and other stakeholders to explain data concepts, solutions and benefits.Design, develop and maintain data pipelines using Azure Data Factory.Implement data validation and cleansing procedures to ensure the quality, integrity and reliability of the data.Optimize pipeline performance and scalability using Databricks workspace configuration, cluster and notebook optimization.Work with big data technologies like Azure Databricks and Apache Spark to handle and analyse large volumes of data.Support data analytics, machine learning and other data-driven applications using Azure ML, Logic Apps and Power BI.Design and implement data storage systems using Azure Blob Storage.Ensure data security, privacy and compliance with relevant standards and regulations.Stay updated with the latest trends and technologies in the data field and evaluate new tools and frameworks.

Legacy

Assess the current state of the data and analytics solutions on the legacy systems, such as SAP Business Warehouse, Qlik, Alteryx and Business ObjectsDefine the target state of the data and analytics solutions on the Azure cloud platform, using Azure Databricks.Design, develop and test data migration strategies and pipelines using Azure Data Factory.Ensure the data quality, integrity and consistency during and after the migration process.Monitor and troubleshoot the data migration issues and resolve them in a timely manner.Document and communicate the data migration progress, status and results to management.Coordinate and align with the report re-writing team to ensure the compatibility and integration of the data and reports on the Azure platform.

Requirements

Degree in Computer Science, Engineering, Mathematics, Statistics or related field of experience as a data engineer or similar role.Microsoft Certified: Azure Data Engineer Associate certification or equivalent.People development, coaching and mentoring skills.Stakeholder management skills.Network externally to understand emerging trends and technologies.Analytical and creative approach to problem solving.Proficiency in SQL and data modelling concepts.Understanding of legacy architectures and platforms such as SAP BW, Alteryx and BusinessObjects.Experience with Azure data services and tools, such as Azure Data Factory, Azure Databricks, Azure Storage Account and Azure SQL DB.Experience with data migration projects, especially from SAP BW to Azure Databricks or similar platforms.Experience with data visualization and reporting tools like Power BI.Experience with data integration and ETL processes.Experience with Python, Scala, Java or other programming languages.Experience with Azure DevOps or other version control and CI/CD tools.Experience with leading and managing a team of data engineers.Excellent communication, presentation and interpersonal skills.Awareness of retail-specific business processes and IT solutions.Ability to work independently and collaboratively in a fast-paced environment.Ability to learn new technologies and frameworks quickly.Knowledge of AI and machine learning concepts and platforms, such as Google Vertex and Microsoft Fabric, is a plus.

  • Redditch, Worcestershire, United Kingdom Kemp Recruitment Limited Full time

    Data Centre Engineer Rota: Monday – Friday – DAYS My client, a leading plant company, is seeking a skilled and experienced Data Centre Engineer to join their team. Main responsibilities of the Data Centre Engineer will include; Monitor and maintain computer systems, troubleshooting area networks, servers, and routers. Provide...


  • Worcestershire, United Kingdom Focus Management Consultants Full time

    Site Services Engineer, Days Worcestershire £Excellent opportunity for a Site Services Engineer to join a leading food manufacturing business! Exciting chance for a Site Services Engineer to become part of a prominent food manufacturing company, where your expertise in maintenance and improvements will be instrumental in the operation of fast paced...


  • Worcestershire, United Kingdom Focus Management Consultants Full time

    Job Description Site Services Engineer, Days Excellent opportunity for a Site Services Engineer to join a leading food manufacturing business! Exciting chance for a Site Services Engineer to become part of a prominent food manufacturing company, where your expertise in maintenance and improvements will be instrumental in the operation of fast paced...


  • Worcester, Worcestershire, United Kingdom West Mercia Police Full time

    The main purpose of the Data Engineer role is to manage the Data Engineering capabilities of West Mercia, developing and implementing data access mechanisms as per the customer need ensuring that they are fit for purpose across the Force. To contribute as part of a Digital team working to improve both the robustness and access of West Mercia’s data and...


  • Worcester, Worcestershire, United Kingdom Michael Page (UK) Full time

    Large Government Organisation Large Government Organisation require a Database Developer / Data Engineer to support on a data transformation and data analytics enhancement programme. You will work in a team to support Analysts to generate new insight and reports in Power BI whilst working with the IT function on their journey in transition to MS Azure. ...


  • Redditch, Worcestershire, United Kingdom Kemp Recruitment Limited Full time

    Data Centre Engineer Salary: £36,000 Location: Redditch Rota: Monday – Friday – DAYS My client, a leading plant company, is seeking a skilled and experienced Data Centre Engineer to join their team. Main responsibilities of the Data Centre Engineer will include; Monitor and maintain computer systems, troubleshooting area networks,...


  • Kidderminster, Worcestershire, United Kingdom Hitachi ABB Power Grids Full time

    Senior Lead Engineer Senior Lead Engineer Seize this opportunity as a Senior Technical Lead Engineer to support in all engineering activities related to the automation scope of medium and high voltage substations, including testing and commissioning activities of substation automation projects in PGGA United Kingdom (HUB Europe Region). Based in...


  • Redditch, Worcestershire, United Kingdom Pertemps Redditch Industrial Full time

    Assistant Data Engineer Contract Type: Permanent Our client is seeking a dedicated and reliable Assistant Data Engineer to join their team. The ideal candidate will be responsible for assisting with the installation, servicing, and decommissioning of audio-visual systems, in addition to managing cabling and wireless network solutions for both educational...


  • Bromsgrove, Worcestershire, United Kingdom PSR Solutions Full time

    We are an electrical contractor carrying out projects for some of the world's leading retail and commercial enterprises. Issuing tender enquiries to sub-contractors Logging sub-contractor pricing information Communication with customers, suppliers, project managers and site staff Previous experience in building services environment would be beneficial...

  • Lead Engineer

    2 weeks ago


    Redditch, Worcestershire, United Kingdom Michael Page Full time

    The interim Lead Engineer will be responsible for the availability and development of plant and equipment across a fast paces manufacturing facility based in Redditch. Client Details Our client is a globally recognised organisation within the building products manufacturing sector. The Redditch based operation is a small plant undergoing significant...

  • Lead Engineer

    2 weeks ago


    Redditch, Worcestershire, United Kingdom Michael Page (UK) Full time

    About Our Client Our client is a globally recognised organisation within the building products manufacturing sector. The Redditch based operation is a small plant undergoing significant growth and investment. Job Description The Lead Engineer is a hands on role tasked with improving plant availability and developing maintenance systems across the site....


  • Wychavon, Worcestershire, United Kingdom Cranfield University Full time

    Full time salary is normally in the range of £48,039 to £51,307 per annum In this role you will help us shape the future of education in this field. As Course Lead you will take overall responsibility for the content and quality of our new Data Analyst Apprenticeship course, and you will work with your learners and Course Reps as well as with our...

  • Lead Engineer

    2 weeks ago


    Redditch, Worcestershire, United Kingdom Michael Page Full time

    The interim Lead Engineer will be responsible for the availability and development of plant and equipment across a fast paces manufacturing facility based in Redditch. Client Details Our client is a globally recognised organisation within the building products manufacturing sector. The Redditch based operation is a small plant undergoing significant growth...


  • Kidderminster, Worcestershire, United Kingdom Hitachi ABB Power Grids Full time

    This job is brought to you by Jobs/Redefined, the UK's leading over-50s age inclusive jobs board. Senior Lead Engineer Apply now Home Careers Open Jobs Job Details Senior Lead Engineer Share this job Seize this opportunity as a Senior Technical Lead Engineer to support in all engineering activities related to the automation scope of medium and...


  • Bromsgrove, Worcestershire, United Kingdom Red Rock Consultants Ltd Full time

    Red Rock Consultants are currently working with a reputable and leading Electrical installations Contractor that works within the Domestic, Commercial, and Industrial sectors. Our client is currently looking for an Estimating Administrator to join the business who will help in supporting the estimating team on a day-to-day basis. Vetting subcontractor...

  • Lead Engineer

    7 days ago


    Elmbridge, Worcestershire, United Kingdom Invictus Group Full time

    An industry leading M&E service provider is seeking an M&E Lead Maintenance Engineer to work at a large commercial site based in Weybridge, Surrey. With fantastic opportunities to develop and progress within the industry. You will be required to work Monday - Friday, 8am - 5pm specialist and well respected provider of commercial services in the industry and...

  • Design Lead

    5 days ago


    Wyre Forest, Worcestershire, United Kingdom Map Talent Full time

    Design Manager - Can be based from Kidderminster or Daventry with site travel Job Summary Responsible for the management and delivery of design information in accordance with the agreed design programme and deliverable schedule (which will encompass input at both pre-construction and construction stage of a tender and project). Responsible for the...

  • Database Developer

    1 day ago


    Worcester, Worcestershire, United Kingdom Michael Page Full time

    Large Government Organisation require a Database Developer / Data Engineer to support on a data transformation and data analytics enhancement programme. You will work in a team to support Analysts to generate new insight and reports in Power BI whilst working with the IT function on their journey in transition to MS Azure. Client Details Large Government...

  • Finance Manager

    4 weeks ago


    Bromsgrove, Worcestershire, United Kingdom AFH Wealth Management Full time

    Finance Accounting Manager A fantastic opportunity to join one of the UK’s leading independent financial advisory and wealth management firms. We have an exciting opportunity to join our existing Finance Acquisitions team. We are looking for those of you who wish to grow with us as a business in our Bromsgrove office with hybrid working opportunities....


  • Bromsgrove, Worcestershire, United Kingdom AFH Wealth Management Full time

    Finance Accounting Manager A fantastic opportunity to join one of the UK's leading independent financial advisory and wealth management firms. We have an exciting opportunity to join our existing Finance Acquisitions team. We are looking for those of you who wish to grow with us as a business in our Bromsgrove office with hybrid working...