Lead Data Engineer

4 weeks ago

Avonmouth, United Kingdom CV-Library Full time

Lead Data Engineer required by our market leading, award winning, retail sector client based in Avonmouth. Our client have recently migrated across to Microsoft Dynamics Business Central and require a Lead Data Engineer to lead the development, maintenance, support, and integration across an increasing array of data sources into an Azure-hosted SQL data warehouse and the Power BI platform.

This is a hybrid role with 2-3 days a week onsite but with flexibility.

The Lead Data Engineer will oversee the technical aspects of Reporting & BI solutions within the Technology team, providing robust reporting capabilities to support Commercial, Operational, and Finance functions.

Main Responsibilities

* Analyse, optimise, and refactor existing stored procedures, ETL jobs, and data workflows to improve performance and reduce load times on the current data warehouse.

* Clean up and enhance the efficiency of the current Power BI Premium (P1) instance, ensuring optimal resource allocation and utilisation as data volumes and complexity grow.

* Review and maintain the scheduling of data jobs to ensure timeliness and reliability, improving operational processes to meet evolving business needs.

* Implement data quality checks, governance, and performance monitoring for both ETL processes and reporting outputs.

* Lead and actively execute the long-term migration of the on-premises data warehouse to Microsoft Fabric, including hands-on development and implementation of a robust strategy for transitioning datasets, ETL pipelines, and reporting solutions to the cloud.

* Build scalable ETL processes using Azure Data Factory, Azure Synapse, and other Fabric-native tools, ensuring a smooth integration between the on-prem and future cloud environments.

* Design and implement Azure-based data architecture, leveraging tools like Azure Data Lake, Azure Synapse Analytics, and Fabric’s data capabilities to future-proof the platform.

* Utilise Azure tools such as Synapse Analytics, Logic Apps, and Azure Functions to streamline data processing and orchestration across the business.

* Empower stakeholders to build their own reports and dashboards by enhancing data accessibility and developing self-service capabilities.

Required Background

* Extensive experience in maintaining and optimising on-premises SQL Server data warehouses, focusing on stored procedures, indexing, partitioning, and load performance.

* Deep understanding of Azure cloud tools such as Azure Synapse Analytics, Azure Data Lake, Azure Data Factory, and Logic Apps

* Hands-on experience with Microsoft Fabric or similar modern cloud platforms, with a strong focus on data migration strategies and ETL development

* Proficiency in writing advanced SQL queries, stored procedures, and Python scripts for data manipulation, pipeline development, and automation

* Experience with ETL tools (both on-prem like SSIS, and cloud-based like Azure Data Factory) for creating, optimising, and maintaining data pipelines

* Skilled in Power BI Premium, including data modelling, DAX, performance tuning, and advanced reporting features like composite models and incremental refresh

* Strong understanding of data governance, security best practices, and compliance requirements (GDPR, etc.)

* Experience working with Agile methodologies

* Excellent communication skills, capable of collaborating with both technical and non-technical stakeholders to translate business needs into effective data solutions.

The ‘Nice to Haves’

* Experience with Microsoft Dynamics 365 Business Central

* Experience of defining and operating within data management best practice frameworks

* Experience working in a Retail environment

This fantastic opportunity comes with a competitive starting salary which is accompanied by the following benefits: 7-10% annual bonus, Health Cash Plan, Life Assurance, 25 days annual leave and a generous staff discount to name but a few

  • Electrical Maintenance Engineer

    1 month ago

    Avonmouth, United Kingdom CV-Library Full time

    Job Title: Electrical Maintenance Engineer Job Reference: JBTBRI Rate - £37+ per hour Job Type: Contract Job Description - Electrical maintenance engineer My Client is a manufacturing site looking for a Maintenance Engineer with FMCG experience. Undertaking day to day reactive maintenance to the site and continuous improvement work. ...

  • Condition Monitoring Reliability Engineer

    2 months ago

    Avonmouth, United Kingdom CV-Library Full time

    Condition Monitoring Reliability Engineer The Company: With the company's success continuing to grow steadily, they are looking at expanding the work force on site in order to maintain production levels. They are a market leader within a highly profitable medium-heavy manufacturing industry and are looking forward to another successful year within this...

  • Condition Monitoring Reliability Engineer

    2 months ago

    Avonmouth, United Kingdom Kingston Barnes Ltd Full time

    Condition Monitoring Reliability EngineerThe Company: With the company's success continuing to grow steadily, they are looking at expanding the work force on site in order to maintain production levels. They are a market leader within a highly profitable medium-heavy manufacturing industry and are looking forward to another successful year within this...

  • Forklift Engineer

    5 days ago

    Avonmouth, United Kingdom Path Recruitment Full time

    Are you a forklift engineer looking for your next role? We have a forklift engineer opportunity for you to join the UK's leading material handling equipment provider | Up to 27 days holiday + bank holidays | Discounts and healthcare scheme | Career opportunities available! Benefits of the forklift engineer Certified training as well as manufacturer...

  • Forklift Engineer

    6 days ago

    Avonmouth, United Kingdom CV-Library Full time

    Are you a forklift engineer looking for your next role? We have a forklift engineer opportunity for you to join the UK's leading material handling equipment provider | Up to 27 days holiday + bank holidays | Discounts and healthcare scheme | Career opportunities available! Benefits of the forklift engineer Certified training as well as manufacturer...

  • Commercial Lead

    2 weeks ago

    Avonmouth, United Kingdom CV-Library Full time

    As Commercial Lead, you will oversee key contracts, guide the commercial team, and ensure successful delivery of projects in line with client agreements and company goals. You will manage commercial processes, maintain compliance, and drive financial performance. Additionally, you'll develop and mentor the commercial team to prepare for future...

  • Commercial Lead

    1 week ago

    Avonmouth, United Kingdom Astute People Full time

    As Commercial Lead, you will oversee key contracts, guide the commercial team, and ensure successful delivery of projects in line with client agreements and company goals. You will manage commercial processes, maintain compliance, and drive financial performance. Additionally, you'll develop and mentor the commercial team to prepare for future...

  • Project Engineer

    1 month ago

    Avonmouth, United Kingdom CV-Library Full time

    Project Engineer £50,000 - £60,000 + 10% bonus Avonmouth Are you a Project Engineer looking for an exciting new opportunity in the Avonmouth area? Does the idea of working with a market leading company who offer excellent progression opportunities interest you? Then reach out! Kingston Barnes is recruiting a Project Engineer for one of our...

  • Design Engineer

    2 months ago

    Avonmouth, United Kingdom CV-Library Full time

    Astute's Nuclear team is exclusively partnering with a leading provider in the nuclear energy sector to recruit a Design Engineer for its Avonmouth and Cranfield site. The Design Engineer role comes with a salary up to £35,000, a comprehensive pension scheme, and opportunities for professional growth. If you're passionate about...

  • Test Engineer

    3 weeks ago

    Avonmouth, United Kingdom CV-Library Full time

    Job Title: Test Engineer Job Type: Permanent Salary: £35-38K per annum (D.O.E) + 18% Shift Allowance Location: Severn Beach, Bristol Key Responsibilities (but not limited to): Deliver a fully functional tested system. Ability to follow test procedures Take ownership for the product allocated to you and proactively seek resolution of any...

  • Test Engineer

    1 week ago

    Avonmouth, United Kingdom Mane Contract Services Full time

    Job Title: Test Engineer Job Type: Permanent Salary: £35-38K per annum (D.O.E) + 18% Shift Allowance Location: Severn Beach, Bristol Key Responsibilities (but not limited to): Deliver a fully functional tested system. Ability to follow test procedures Take ownership for the product allocated to you and proactively seek resolution of any issues Ensure...

  • Electrical/Mechanical Engineer

    7 days ago

    Avonmouth, United Kingdom Attega Group Ltd Full time

    Senior Electrical Engineer - Pumps/Rotating Equipment Circa £50k Bristol Full Time & Permanent role Are you an established Senior Electrical Engineer looking for a new opportunity? Or, an Electrical Engineer looking to take a step up into a Senior role? Attega Group is currently partnering with our client in recruiting a Senior Electrical Engineer to...

  • Electrical/Mechanical Engineer

    7 days ago

    Avonmouth, United Kingdom CV-Library Full time

    Senior Electrical Engineer - Pumps/Rotating Equipment Circa £50k Bristol Full Time & Permanent role Are you an established Senior Electrical Engineer looking for a new opportunity? Or, an Electrical Engineer looking to take a step up into a Senior role? Attega Group is currently partnering with our client in recruiting a Senior Electrical...

  • Electrical Test Engineer

    1 week ago

    Avonmouth, United Kingdom Mane Contract Services Full time

    Job Title: Electrical Test Engineer Job Type: Permanent Salary: £35-38K per annum (D.O.E) + 18% Shift Allowance Location: Severn Beach, Bristol Key Responsibilities (but not limited to): Deliver a fully functional tested system. Ability to follow test procedures Take ownership for the product allocated to you and proactively seek resolution of any...

  • Electrical Test Engineer

    2 weeks ago

    Avonmouth, United Kingdom CV-Library Full time

    Job Title: Electrical Test Engineer Job Type: Permanent Salary: £35-38K per annum (D.O.E) + 18% Shift Allowance Location: Severn Beach, Bristol Key Responsibilities (but not limited to): Deliver a fully functional tested system. Ability to follow test procedures Take ownership for the product allocated to you and proactively seek resolution of any...

  • Automation Engineering Professional Development Opportunity

    3 weeks ago

    Avonmouth, Bristol, United Kingdom Amazon Full time

    Are you eager to kickstart your career in automation engineering? Do you have a passion for learning and a willingness to develop new skills? If so, this Automation Engineering Apprentice position at Amazon is the perfect chance for you to take the first step towards a successful future.About the RoleThis 48-month apprenticeship program offers a...

  • Field Service Engineer

    2 months ago

    Avonmouth, United Kingdom CV-Library Full time

    Your New Company A leading brand in the supply and maintenance of construction machinery across the UK are looking for a skilled plant engineer to join their team. Key duties and responsibilities of the Field Service Engineer: * Repairing and maintaining machines on customers sites as required to ensure conformance with manufacturer’s...

  • Field Service Engineer

    1 week ago

    Avonmouth, United Kingdom ADR Eng Specialists Ltd Full time

    Your New Company A leading brand in the supply and maintenance of construction machinery across the UK are looking for a skilled plant engineer to join their team. Key duties and responsibilities of the Field Service Engineer: * Repairing and maintaining machines on customers sites as required to ensure conformance with manufacturer’s specification ...

  • Production Line Engineer

    1 month ago

    Avonmouth, United Kingdom CV-Library Full time

    PRODUCTION LINE ENGINEER | PERMANENT | £51,721 We are looking for a versatile and experienced Multi-Skilled Engineer with an Electrical bias to join our dynamic manufacturing team. This role is pivotal in ensuring the smooth operation and maintenance of production line equipment, with a focus on electrical systems. The ideal candidate will have a...

  • Production Line Engineer

    3 weeks ago

    Avonmouth, United Kingdom Encirc Full time

    PRODUCTION LINE ENGINEER | PERMANENT | £51,721We are looking for a versatile and experienced Multi-Skilled Engineer with an Electrical bias to join our dynamic manufacturing team. This role is pivotal in ensuring the smooth operation and maintenance of production line equipment, with a focus on electrical systems. The ideal candidate will have a robust...