Data Engineering Lead
1 month ago
Data Engineering Lead - AWS & Snowflake
Hybrid working: 3 days inTW6, Middlesex offices & 2 days homer/remote
Salary: Negotiable to £70.,000 DOE plus 40 % bonus potential
Job Reference: J12869
Full UK working rights required/no sponsorship available
THE ROLE
Looking for a challenge in one of the world's largest airfreight logistics organisation and a FTSE 100 company?
Within the Digital and Information function, the Data Engineering Lead will play a pivotal role in delivering and operating data products. Reporting to the Head of Data, Insights & Operational Research, this position holds significant responsibility within the data leadership team, ensuring our data solutions and business processes are fully aligned and contribute to the vision and strategic direction of the organisation.
The successful candidate will join the team at an exciting time. They are in the early stages of a major programme of work to modernise their data infrastructure, tooling and processes to migrate from an on-premise to a cloud native environment and the Data Engineering Lead will be essential to the success of the transformation.
Using your strong communication skills combined with a determined attitude you will be responsible for managing and developing a team of data engineers to develop effective and innovative solutions aligning to our architectural principles and the business need. You will ensure the team adheres to best practices in data engineering and contributes to the continuous improvement of our data systems.
DUTIES
Key responsibilities for this role include:
• Lead the design, development, and deployment of scalable and efficient data pipelines and architectures.
• Manage and mentor a team of data engineers, ensuring a culture of collaboration and excellence.
• Manage demand for data engineering resources, prioritising tasks and projects based on business needs and strategic goals.
• Monitor and report on the progress of data engineering projects, addressing any issues or risks that may arise.
• Collaborate closely with Analytics Leads, Data Architects, and the wider Digital and Information team to ensure seamless integration and operation of data solutions.
• Develop and implement a robust data operations capability to ensure the smooth running and reliability of our data estate.
• Drive the adoption of cloud technologies and modern data engineering practices within the team.
• Ensure data governance and compliance with relevant regulations and standards.
• Work with the team to define and implement best practices for data engineering, including coding standards, documentation, version control.
PERSON SPECIFICATION
Skills
• Expert in SQL and database concepts including performance tuning and optimisation
• Solid understanding of data warehousing principles and data modelling practice
• Strong engineering skills, preferably in the following toolsets
oAWS services (S3, EC2, Lambda, Glue)
oETL Tools (e.g. Apache Airflow)
oStreaming processing tools (e.g. Kinesis)
oSnowflake
oPython
• Excellent knowledge of creation and maintenance of data pipelines
• Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve complex data-related issues
• Proficient in data integration techniques including APIs and real-time ingestion
• Excellent communication and collaboration skills to work effectively with cross-functional teams
• Capable of building, leading, and developing a team of data engineers
• Strong project management skills and an ability to manage multiple projects and priorities
Experience
• Experienced and confident leadership of data engineering activities (essential)
• Expert in data engineering practise on cloud data platforms (essential)
• Background in data analysis and preparation, including experience with large data sets and unstructured data (desirable)
• Knowledge of AI/Data Science principles (desirable)
If you would like to hear more, please do get in touch
-
Data Management Senior Analyst
1 month ago
Middlesex, United Kingdom CV-Library Full timeNote: A Senior Analyst in Sky is typically equivalent to a Manager level in other organisations) Osterley / Livingston Watermark House We’re Sky, Europe’s biggest entertainment brand. Think top-quality shows. Breaking news. Must-have tech. Careers here mean you can make an impact. And as part of our close-knit team, you’ll enjoy plenty of...
-
Data Domain Senior Analyst
1 month ago
Middlesex, United Kingdom CV-Library Full timeWe believe in better. And we make it happen. Better content. Better products. And better careers. Working in Tech, Product or Data at Sky is about building the next and the new. From broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we never stand still. We optimise and innovate. We turn big ideas into the products, content and services...
-
Quality Lead
3 days ago
Middlesex, United Kingdom CV-Library Full timeQuality Lead Up to £31,000 - £34,000 per annum Diamond Search Recruitment are seeking a Quality Lead to join a well-established food manufacturing business based in Middlesex. The ideal candidate will play a crucial role in ensuring that our products meet the highest standards. You will be responsible for overseeing the quality control...
-
Stairlift Engineer
6 months ago
Middlesex, United Kingdom Stannah Full timeStairlift Engineer jobs Middlesex at Stannah join the team!Are you a qualified Stairlift Engineer looking for a Stairlift Engineer job at a market-leading family-run business? Stannah, a global leader in the lift industry, is looking to recruit qualified Stairlift Engineers.This job is to cover a route across Middlesex and the surrounding areas.It is...
-
Trading Performance Lead – NOW Sports and Boost
2 months ago
Middlesex, United Kingdom CV-Library Full timeWant to do the best work of your life? With 24 million customers in 7 countries, make your mark at Europe’s leading media and entertainment brand. A workplace where you can proudly be yourself; our people make Sky a truly exciting and inclusive place to work. The Trading Performance Lead will be at the heart of providing business direction in relation...
-
Field Service Engineer
5 months ago
Middlesex, United Kingdom Stannah Full timeStairlift Engineer jobs Middlesex at Stannah join the team! Are you a qualified Stairlift Engineer looking for a Stairlift Engineer job at a market-leading family-run business? Stannah, a global leader in the lift industry, is looking to recruit qualified Stairlift Engineers. This job is to cover a route across Middlesex and the surrounding areas. It is...
-
Senior Instrumentation
5 months ago
Middlesex, United Kingdom McDermott Full time**Job Overview**: Control and instrumentation design engineering. Work includes studies, specification writing, layout development, design calculations and supervising vendor packages. **Key Tasks and Responsibilities**: - Be accountable to both Project and Engineering Management as well as the Departmental Manager - Coordinate the required flow of design...
-
Senior Civil/structural Designer
5 months ago
Middlesex, United Kingdom McDermott Full time**Company Overview**: People power our future. That is why advancing a dynamic, inclusive environment, where everyone grows and thrives is critically important to us. Our ingenuity fuels daily life. Together, we’ve forged some of the most trusted partnerships across the energy value chain to make what was once just an idea a reality: laying subsea...
-
Apprentice Electrician
6 months ago
Middlesex, United Kingdom PHS Group Full time**Apprentice Electrician - Hayes** If you are enthusiastic about learning a new trade and becoming an Electrician, we at phs Compliance have the role for you! **The role of an Apprentice Electrician will involve,** - Completing the required academic and practical training requirements of the apprenticeship as provided for by the Company’s nominated...
-
Video Player Technology
2 weeks ago
Middlesex, United Kingdom Sky Full timeWant to do the best work of your life? With 24 million customers in 6 countries, make your mark at Europe's leading media and entertainment brand. A workplace where you can proudly be yourself; our people make Sky a truly exciting and inclusive place to work. Our streaming video SDK is at the forefront of technology, leveraging modern video codecs,...
-
Site Administrator
2 weeks ago
Middlesex, United Kingdom CV-Library Full timeAn International Engineering Contractor focusing on delivering Mission Critical Projects across various sectors, is currently seeking a Site Administrator to join them on a Data Project in London. Ideally, the Site Administrator will have a boast experience in the construction or engineering industry and strong administration...
-
Senior Architect
3 weeks ago
Middlesex, United Kingdom Sky Full timeBetter content. Working in Tech, Product or Data at Sky is about building the next and the new. broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we never stand still. We turn big ideas into the products, content and services millions of people love. Drive the Architecture strategy on device and end to end ecosystems on business - critical ...
-
Rtt/patient Pathway Validator
5 months ago
Middlesex, United Kingdom The Hillingdon Hospitals NHS Foundation Trust Full timeRtt Validators are responsible for validating patient pathways across the entire Trust PTL to ensure accurate and robust information to support performance reporting, high data quality and to assist in managing patients’ through their RTT pathway. The Trust is undergoing a major change in the collection of 18 weeks information through a new Data...
-
Accounts Assistant
6 months ago
Middlesex, United Kingdom Worldwide Flight Services Full time**Description**: **Do you have experience in accurate financial record-keeping and reporting?** *** **Do you have previous working experience in accounts payable processing ensuring accuracy in the invoicing process?** *** **Are you known for your attention to detail and strong numerical aptitude?** If so, then we have an exciting opportunity for you to...
-
Subject Access Request Coordinator
6 months ago
Middlesex, United Kingdom The Hillingdon Hospitals NHS Foundation Trust Full timeThe postholder will be responsible for the day-to-day running of the Legal Services - Access to Health Records Service in conjunction with the Legal Services Assistant. The postholder will ensure that the Trust complies with the terms and conditions as laid down in the Data Protection Act 2018, the General Data Protection Regulations and Access to Health...
-
Senior Administrator
5 months ago
Middlesex, United Kingdom Uxbridge Employment Agency Full time**Exclusive Opportunity: Senior Administrator / Legal Secretary** **About the Role**: Are you a seasoned administrative professional looking for an opportunity to make your mark in the legal world? We are excited to present a prestigious position for a Senior Legal Secretary within a leading law firm's crime team. This role is tailored for individuals with...
-
Rtt Validation Team Leader
6 months ago
Middlesex, United Kingdom The Hillingdon Hospitals NHS Foundation Trust Full timeThe Referral To Treatment (RTT) Validation Team Leader will be responsible for the day to day supervision of the RTT Validation Team with a remit for undertaking detailed patient level validation to ensure accurate and robust information to support performance reporting, high data quality and to assist in managing patients’ through their RTT pathway. The...
-
CNC Waterjet Operator
1 month ago
Middlesex, United Kingdom CV-Library Full timeCNC Waterjet Machinist Wanted! Are you a precision-driven individual with a passion for machining? We’re looking for a skilled CNC Waterjet Machinist to join our dynamic team! What You’ll Do: Operate CNC waterjet machinery to cut a wide range of materials. Interpret technical drawings and specifications to set up jobs...
-
SAP Solutions Senior Marketing Manager
1 month ago
Middlesex, United Kingdom SAP Full timeWe help the world run better At SAP, we enable you to bring out your best. Our company culture is focused on collaboration and a shared passion to help the world run better. How? We focus every day on building the foundation for tomorrow and creating a workplace that embraces differences, values flexibility, and is aligned to our purpose-driven and...
-
Senior Security Engineer, Detection and Response
3 weeks ago
Harrow, Middlesex, United Kingdom Ripple Labs Full timeAt Ripple, we’re building a world where value moves like information does today. It’s big, it’s bold, and we’re already doing it. Through our crypto solutions for financial institutions, businesses, governments and developers, we are improving the global financial system and creating greater economic fairness and opportunity for more people, in more...