Data Engineering Lead

1 month ago


Middlesex, United Kingdom CV-Library Full time

Data Engineering Lead - AWS & Snowflake
Hybrid working: 3 days inTW6, Middlesex offices & 2 days homer/remote
Salary: Negotiable to £70.,000 DOE plus 40 % bonus potential
Job Reference: J12869

Full UK working rights required/no sponsorship available

THE ROLE
Looking for a challenge in one of the world's largest airfreight logistics organisation and a FTSE 100 company?
Within the Digital and Information function, the Data Engineering Lead will play a pivotal role in delivering and operating data products. Reporting to the Head of Data, Insights & Operational Research, this position holds significant responsibility within the data leadership team, ensuring our data solutions and business processes are fully aligned and contribute to the vision and strategic direction of the organisation.
The successful candidate will join the team at an exciting time. They are in the early stages of a major programme of work to modernise their data infrastructure, tooling and processes to migrate from an on-premise to a cloud native environment and the Data Engineering Lead will be essential to the success of the transformation.
Using your strong communication skills combined with a determined attitude you will be responsible for managing and developing a team of data engineers to develop effective and innovative solutions aligning to our architectural principles and the business need. You will ensure the team adheres to best practices in data engineering and contributes to the continuous improvement of our data systems.

DUTIES
Key responsibilities for this role include:
• Lead the design, development, and deployment of scalable and efficient data pipelines and architectures.
• Manage and mentor a team of data engineers, ensuring a culture of collaboration and excellence.
• Manage demand for data engineering resources, prioritising tasks and projects based on business needs and strategic goals.
• Monitor and report on the progress of data engineering projects, addressing any issues or risks that may arise.
• Collaborate closely with Analytics Leads, Data Architects, and the wider Digital and Information team to ensure seamless integration and operation of data solutions.
• Develop and implement a robust data operations capability to ensure the smooth running and reliability of our data estate.
• Drive the adoption of cloud technologies and modern data engineering practices within the team.
• Ensure data governance and compliance with relevant regulations and standards.
• Work with the team to define and implement best practices for data engineering, including coding standards, documentation, version control.

PERSON SPECIFICATION
Skills
• Expert in SQL and database concepts including performance tuning and optimisation
• Solid understanding of data warehousing principles and data modelling practice
• Strong engineering skills, preferably in the following toolsets
oAWS services (S3, EC2, Lambda, Glue)
oETL Tools (e.g. Apache Airflow)
oStreaming processing tools (e.g. Kinesis)
oSnowflake
oPython
• Excellent knowledge of creation and maintenance of data pipelines
• Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve complex data-related issues
• Proficient in data integration techniques including APIs and real-time ingestion
• Excellent communication and collaboration skills to work effectively with cross-functional teams
• Capable of building, leading, and developing a team of data engineers
• Strong project management skills and an ability to manage multiple projects and priorities
Experience
• Experienced and confident leadership of data engineering activities (essential)
• Expert in data engineering practise on cloud data platforms (essential)
• Background in data analysis and preparation, including experience with large data sets and unstructured data (desirable)
• Knowledge of AI/Data Science principles (desirable)

If you would like to hear more, please do get in touch



  • Middlesex, United Kingdom CV-Library Full time

    Note: A Senior Analyst in Sky is typically equivalent to a Manager level in other organisations) Osterley / Livingston Watermark House We’re Sky, Europe’s biggest entertainment brand. Think top-quality shows. Breaking news. Must-have tech. Careers here mean you can make an impact. And as part of our close-knit team, you’ll enjoy plenty of...


  • Middlesex, United Kingdom CV-Library Full time

    We believe in better. And we make it happen. Better content. Better products. And better careers. Working in Tech, Product or Data at Sky is about building the next and the new. From broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we never stand still. We optimise and innovate. We turn big ideas into the products, content and services...

  • Quality Lead

    3 days ago


    Middlesex, United Kingdom CV-Library Full time

    Quality Lead Up to £31,000 - £34,000 per annum Diamond Search Recruitment are seeking a Quality Lead to join a well-established food manufacturing business based in Middlesex. The ideal candidate will play a crucial role in ensuring that our products meet the highest standards. You will be responsible for overseeing the quality control...

  • Stairlift Engineer

    6 months ago


    Middlesex, United Kingdom Stannah Full time

    Stairlift Engineer jobs Middlesex at Stannah join the team!Are you a qualified Stairlift Engineer looking for a Stairlift Engineer job at a market-leading family-run business? Stannah, a global leader in the lift industry, is looking to recruit qualified Stairlift Engineers.This job is to cover a route across Middlesex and the surrounding areas.It is...


  • Middlesex, United Kingdom CV-Library Full time

    Want to do the best work of your life? With 24 million customers in 7 countries, make your mark at Europe’s leading media and entertainment brand. A workplace where you can proudly be yourself; our people make Sky a truly exciting and inclusive place to work. The Trading Performance Lead will be at the heart of providing business direction in relation...

  • Field Service Engineer

    5 months ago


    Middlesex, United Kingdom Stannah Full time

    Stairlift Engineer jobs Middlesex at Stannah join the team! Are you a qualified Stairlift Engineer looking for a Stairlift Engineer job at a market-leading family-run business? Stannah, a global leader in the lift industry, is looking to recruit qualified Stairlift Engineers. This job is to cover a route across Middlesex and the surrounding areas. It is...

  • Senior Instrumentation

    5 months ago


    Middlesex, United Kingdom McDermott Full time

    **Job Overview**: Control and instrumentation design engineering. Work includes studies, specification writing, layout development, design calculations and supervising vendor packages. **Key Tasks and Responsibilities**: - Be accountable to both Project and Engineering Management as well as the Departmental Manager - Coordinate the required flow of design...


  • Middlesex, United Kingdom McDermott Full time

    **Company Overview**: People power our future. That is why advancing a dynamic, inclusive environment, where everyone grows and thrives is critically important to us. Our ingenuity fuels daily life. Together, we’ve forged some of the most trusted partnerships across the energy value chain to make what was once just an idea a reality: laying subsea...

  • Apprentice Electrician

    6 months ago


    Middlesex, United Kingdom PHS Group Full time

    **Apprentice Electrician - Hayes** If you are enthusiastic about learning a new trade and becoming an Electrician, we at phs Compliance have the role for you! **The role of an Apprentice Electrician will involve,** - Completing the required academic and practical training requirements of the apprenticeship as provided for by the Company’s nominated...


  • Middlesex, United Kingdom Sky Full time

    Want to do the best work of your life? With 24 million customers in 6 countries, make your mark at Europe's leading media and entertainment brand. A workplace where you can proudly be yourself; our people make Sky a truly exciting and inclusive place to work. Our streaming video SDK is at the forefront of technology, leveraging modern video codecs,...

  • Site Administrator

    2 weeks ago


    Middlesex, United Kingdom CV-Library Full time

    An International Engineering Contractor focusing on delivering Mission Critical Projects across various sectors, is currently seeking a Site Administrator  to join them on a Data Project in London.   Ideally, the Site Administrator  will have a boast experience in the construction or engineering industry and strong administration...

  • Senior Architect

    3 weeks ago


    Middlesex, United Kingdom Sky Full time

    Better content. Working in Tech, Product or Data at Sky is about building the next and the new. broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we never stand still. We turn big ideas into the products, content and services millions of people love. Drive the Architecture strategy on device and end to end ecosystems on business - critical ...


  • Middlesex, United Kingdom The Hillingdon Hospitals NHS Foundation Trust Full time

    Rtt Validators are responsible for validating patient pathways across the entire Trust PTL to ensure accurate and robust information to support performance reporting, high data quality and to assist in managing patients’ through their RTT pathway. The Trust is undergoing a major change in the collection of 18 weeks information through a new Data...

  • Accounts Assistant

    6 months ago


    Middlesex, United Kingdom Worldwide Flight Services Full time

    **Description**: **Do you have experience in accurate financial record-keeping and reporting?** *** **Do you have previous working experience in accounts payable processing ensuring accuracy in the invoicing process?** *** **Are you known for your attention to detail and strong numerical aptitude?** If so, then we have an exciting opportunity for you to...


  • Middlesex, United Kingdom The Hillingdon Hospitals NHS Foundation Trust Full time

    The postholder will be responsible for the day-to-day running of the Legal Services - Access to Health Records Service in conjunction with the Legal Services Assistant. The postholder will ensure that the Trust complies with the terms and conditions as laid down in the Data Protection Act 2018, the General Data Protection Regulations and Access to Health...

  • Senior Administrator

    5 months ago


    Middlesex, United Kingdom Uxbridge Employment Agency Full time

    **Exclusive Opportunity: Senior Administrator / Legal Secretary** **About the Role**: Are you a seasoned administrative professional looking for an opportunity to make your mark in the legal world? We are excited to present a prestigious position for a Senior Legal Secretary within a leading law firm's crime team. This role is tailored for individuals with...


  • Middlesex, United Kingdom The Hillingdon Hospitals NHS Foundation Trust Full time

    The Referral To Treatment (RTT) Validation Team Leader will be responsible for the day to day supervision of the RTT Validation Team with a remit for undertaking detailed patient level validation to ensure accurate and robust information to support performance reporting, high data quality and to assist in managing patients’ through their RTT pathway. The...

  • CNC Waterjet Operator

    1 month ago


    Middlesex, United Kingdom CV-Library Full time

    CNC Waterjet Machinist Wanted! Are you a precision-driven individual with a passion for machining? We’re looking for a skilled CNC Waterjet Machinist to join our dynamic team! What You’ll Do: Operate CNC waterjet machinery to cut a wide range of materials. Interpret technical drawings and specifications to set up jobs...


  • Middlesex, United Kingdom SAP Full time

     We help the world run better At SAP, we enable you to bring out your best. Our company culture is focused on collaboration and a shared passion to help the world run better. How? We focus every day on building the foundation for tomorrow and creating a workplace that embraces differences, values flexibility, and is aligned to our purpose-driven and...


  • Harrow, Middlesex, United Kingdom Ripple Labs Full time

    At Ripple, we’re building a world where value moves like information does today. It’s big, it’s bold, and we’re already doing it. Through our crypto solutions for financial institutions, businesses, governments and developers, we are improving the global financial system and creating greater economic fairness and opportunity for more people, in more...