Management Information Lead Data Engineer
4 weeks ago
We are looking for a Lead Data Engineer, who will help us design, implement and manage data solutions on the Microsoft Azure cloud platform. The Lead will work to migrate the business from legacy systems. The job involves planning and management for solution design and technical delivery, ensuring that the right tools and roadmap are available. The Lead manages a team who create and maintain data pipelines, data storage solutions, data processing and data integration for data-driven decision-making inside Halfords, including the organisation’s stakeholders. The Lead will plan, execute and manage data migration from legacy systems using Azure Data Factory and Azure Databricks.
Responsibilities
Current Platform
To determine the technical data engineering roadmap that delivers the Halfords requirements using appropriate technologies and tools.To manage, develop and mentor other members of the Data Engineering Team.To act as design authority for new developments within the Data Engineering Team.To manage the handover of ongoing data engineering solutions to support teams and assist in resolution of issues where appropriate. Communicate effectively with management and other stakeholders to explain data concepts, solutions and benefits.Design, develop and maintain data pipelines using Azure Data Factory.Implement data validation and cleansing procedures to ensure the quality, integrity and reliability of the data.Optimize pipeline performance and scalability using Databricks workspace configuration, cluster and notebook optimization.Work with big data technologies like Azure Databricks and Apache Spark to handle and analyse large volumes of data.Support data analytics, machine learning and other data-driven applications using Azure ML, Logic Apps and Power BI.Design and implement data storage systems using Azure Blob Storage.Ensure data security, privacy and compliance with relevant standards and regulations.Stay updated with the latest trends and technologies in the data field and evaluate new tools and frameworks.Legacy
Assess the current state of the data and analytics solutions on the legacy systems, such as SAP Business Warehouse, Qlik, Alteryx and Business ObjectsDefine the target state of the data and analytics solutions on the Azure cloud platform, using Azure Databricks.Design, develop and test data migration strategies and pipelines using Azure Data Factory.Ensure the data quality, integrity and consistency during and after the migration process.Monitor and troubleshoot the data migration issues and resolve them in a timely manner.Document and communicate the data migration progress, status and results to management.Coordinate and align with the report re-writing team to ensure the compatibility and integration of the data and reports on the Azure platform.Requirements
Degree in Computer Science, Engineering, Mathematics, Statistics or related field of experience as a data engineer or similar role.Microsoft Certified: Azure Data Engineer Associate certification or equivalent.People development, coaching and mentoring skills.Stakeholder management skills.Network externally to understand emerging trends and technologies.Analytical and creative approach to problem solving.Proficiency in SQL and data modelling concepts.Understanding of legacy architectures and platforms such as SAP BW, Alteryx and BusinessObjects.Experience with Azure data services and tools, such as Azure Data Factory, Azure Databricks, Azure Storage Account and Azure SQL DB.Experience with data migration projects, especially from SAP BW to Azure Databricks or similar platforms.Experience with data visualization and reporting tools like Power BI.Experience with data integration and ETL processes.Experience with Python, Scala, Java or other programming languages.Experience with Azure DevOps or other version control and CI/CD tools.Experience with leading and managing a team of data engineers.Excellent communication, presentation and interpersonal skills.Awareness of retail-specific business processes and IT solutions.Ability to work independently and collaboratively in a fast-paced environment.Ability to learn new technologies and frameworks quickly.Knowledge of AI and machine learning concepts and platforms, such as Google Vertex and Microsoft Fabric, is a plus.-
Microsoft Data Engineer
1 week ago
Redditch, Worcestershire, United Kingdom Kemp Recruitment Limited Full timeData Centre Engineer Rota: Monday – Friday – DAYS My client, a leading plant company, is seeking a skilled and experienced Data Centre Engineer to join their team. Main responsibilities of the Data Centre Engineer will include; Monitor and maintain computer systems, troubleshooting area networks, servers, and routers. Provide...
-
Site Services Engineer
1 month ago
Worcestershire, United Kingdom Focus Management Consultants Full timeSite Services Engineer, Days Worcestershire £Excellent opportunity for a Site Services Engineer to join a leading food manufacturing business! Exciting chance for a Site Services Engineer to become part of a prominent food manufacturing company, where your expertise in maintenance and improvements will be instrumental in the operation of fast paced...
-
Site Services Engineer
4 days ago
Worcestershire, United Kingdom Focus Management Consultants Full timeJob Description Site Services Engineer, Days Excellent opportunity for a Site Services Engineer to join a leading food manufacturing business! Exciting chance for a Site Services Engineer to become part of a prominent food manufacturing company, where your expertise in maintenance and improvements will be instrumental in the operation of fast paced...
-
Senior Engineer, Data Engineering
3 weeks ago
Worcester, Worcestershire, United Kingdom West Mercia Police Full timeThe main purpose of the Data Engineer role is to manage the Data Engineering capabilities of West Mercia, developing and implementing data access mechanisms as per the customer need ensuring that they are fit for purpose across the Force. To contribute as part of a Digital team working to improve both the robustness and access of West Mercia’s data and...
-
Data / Database engineer
1 week ago
Worcester, Worcestershire, United Kingdom Michael Page (UK) Full timeLarge Government Organisation Large Government Organisation require a Database Developer / Data Engineer to support on a data transformation and data analytics enhancement programme. You will work in a team to support Analysts to generate new insight and reports in Power BI whilst working with the IT function on their journey in transition to MS Azure. ...
-
Data Centre Engineer in Redditch)
1 week ago
Redditch, Worcestershire, United Kingdom Kemp Recruitment Limited Full timeData Centre Engineer Salary: £36,000 Location: Redditch Rota: Monday – Friday – DAYS My client, a leading plant company, is seeking a skilled and experienced Data Centre Engineer to join their team. Main responsibilities of the Data Centre Engineer will include; Monitor and maintain computer systems, troubleshooting area networks,...
-
Remote Lead Engineer
6 days ago
Kidderminster, Worcestershire, United Kingdom Hitachi ABB Power Grids Full timeSenior Lead Engineer Senior Lead Engineer Seize this opportunity as a Senior Technical Lead Engineer to support in all engineering activities related to the automation scope of medium and high voltage substations, including testing and commissioning activities of substation automation projects in PGGA United Kingdom (HUB Europe Region). Based in...
-
Assistant Data Engineer
5 days ago
Redditch, Worcestershire, United Kingdom Pertemps Redditch Industrial Full timeAssistant Data Engineer Contract Type: Permanent Our client is seeking a dedicated and reliable Assistant Data Engineer to join their team. The ideal candidate will be responsible for assisting with the installation, servicing, and decommissioning of audio-visual systems, in addition to managing cabling and wireless network solutions for both educational...
-
Administrator - Data Project
4 weeks ago
Bromsgrove, Worcestershire, United Kingdom PSR Solutions Full timeWe are an electrical contractor carrying out projects for some of the world's leading retail and commercial enterprises. Issuing tender enquiries to sub-contractors Logging sub-contractor pricing information Communication with customers, suppliers, project managers and site staff Previous experience in building services environment would be beneficial...
-
Lead Engineer
2 weeks ago
Redditch, Worcestershire, United Kingdom Michael Page Full timeThe interim Lead Engineer will be responsible for the availability and development of plant and equipment across a fast paces manufacturing facility based in Redditch. Client Details Our client is a globally recognised organisation within the building products manufacturing sector. The Redditch based operation is a small plant undergoing significant...
-
Lead Engineer
2 weeks ago
Redditch, Worcestershire, United Kingdom Michael Page (UK) Full timeAbout Our Client Our client is a globally recognised organisation within the building products manufacturing sector. The Redditch based operation is a small plant undergoing significant growth and investment. Job Description The Lead Engineer is a hands on role tasked with improving plant availability and developing maintenance systems across the site....
-
Lecturer and Course Lead
1 week ago
Wychavon, Worcestershire, United Kingdom Cranfield University Full timeFull time salary is normally in the range of £48,039 to £51,307 per annum In this role you will help us shape the future of education in this field. As Course Lead you will take overall responsibility for the content and quality of our new Data Analyst Apprenticeship course, and you will work with your learners and Course Reps as well as with our...
-
Lead Engineer
2 weeks ago
Redditch, Worcestershire, United Kingdom Michael Page Full timeThe interim Lead Engineer will be responsible for the availability and development of plant and equipment across a fast paces manufacturing facility based in Redditch. Client Details Our client is a globally recognised organisation within the building products manufacturing sector. The Redditch based operation is a small plant undergoing significant growth...
-
Senior Lead Engineer
1 day ago
Kidderminster, Worcestershire, United Kingdom Hitachi ABB Power Grids Full timeThis job is brought to you by Jobs/Redefined, the UK's leading over-50s age inclusive jobs board. Senior Lead Engineer Apply now Home Careers Open Jobs Job Details Senior Lead Engineer Share this job Seize this opportunity as a Senior Technical Lead Engineer to support in all engineering activities related to the automation scope of medium and...
-
Administrator - Data Project
2 weeks ago
Bromsgrove, Worcestershire, United Kingdom Red Rock Consultants Ltd Full timeRed Rock Consultants are currently working with a reputable and leading Electrical installations Contractor that works within the Domestic, Commercial, and Industrial sectors. Our client is currently looking for an Estimating Administrator to join the business who will help in supporting the estimating team on a day-to-day basis. Vetting subcontractor...
-
Lead Engineer
7 days ago
Elmbridge, Worcestershire, United Kingdom Invictus Group Full timeAn industry leading M&E service provider is seeking an M&E Lead Maintenance Engineer to work at a large commercial site based in Weybridge, Surrey. With fantastic opportunities to develop and progress within the industry. You will be required to work Monday - Friday, 8am - 5pm specialist and well respected provider of commercial services in the industry and...
-
Design Lead
5 days ago
Wyre Forest, Worcestershire, United Kingdom Map Talent Full timeDesign Manager - Can be based from Kidderminster or Daventry with site travel Job Summary Responsible for the management and delivery of design information in accordance with the agreed design programme and deliverable schedule (which will encompass input at both pre-construction and construction stage of a tender and project). Responsible for the...
-
Database Developer
1 day ago
Worcester, Worcestershire, United Kingdom Michael Page Full timeLarge Government Organisation require a Database Developer / Data Engineer to support on a data transformation and data analytics enhancement programme. You will work in a team to support Analysts to generate new insight and reports in Power BI whilst working with the IT function on their journey in transition to MS Azure. Client Details Large Government...
-
Finance Manager
4 weeks ago
Bromsgrove, Worcestershire, United Kingdom AFH Wealth Management Full timeFinance Accounting Manager A fantastic opportunity to join one of the UK’s leading independent financial advisory and wealth management firms. We have an exciting opportunity to join our existing Finance Acquisitions team. We are looking for those of you who wish to grow with us as a business in our Bromsgrove office with hybrid working opportunities....
-
Financial Accounting Manager
3 weeks ago
Bromsgrove, Worcestershire, United Kingdom AFH Wealth Management Full timeFinance Accounting Manager A fantastic opportunity to join one of the UK's leading independent financial advisory and wealth management firms. We have an exciting opportunity to join our existing Finance Acquisitions team. We are looking for those of you who wish to grow with us as a business in our Bromsgrove office with hybrid working...