Data Engineering Lead

1 week ago

London Area, United Kingdom Datatech Analytics Full time

Data Engineering Lead - AWS & Snowflake, Hybrid working: 3 days inTW6, Middlesex offices & 2 days homer/remote, Salary: Negotiable to £70.,000 DOE plus 40 % bonus potential, Job Reference: J12869


Full UK working rights required/no sponsorship available


The role


Looking for a challenge in one of the worlds largest airfreight logistics organisation and a FTSE 100 company?


Within the Digital and Information function, the Data Engineering Lead will play a pivotal role in delivering and operating data products. Reporting to the Head of Data, Insights & Operational Research, this position holds significant responsibility within the data leadership team, ensuring our data solutions and business processes are fully aligned and contribute to the vision and strategic direction of the organisation.


The successful candidate will join the team at an exciting time. They are in the early stages of a major programme of work to modernise their data infrastructure, tooling and processes to migrate from an on-premise to a cloud native environment and the Data Engineering Lead will be essential to the success of the transformation.


Using your strong communication skills combined with a determined attitude you will be responsible for managing and developing a team of data engineers to develop effective and innovative solutions aligning to our architectural principles and the business need. You will ensure the team adheres to best practices in data engineering and contributes to the continuous improvement of our data systems.


Duties

Key responsibilities for this role include:

• Lead the design, development, and deployment of scalable and efficient data pipelines and architectures.

• Manage and mentor a team of data engineers, ensuring a culture of collaboration and excellence.

• Manage demand for data engineering resources, prioritising tasks and projects based on business needs and strategic goals.

• Monitor and report on the progress of data engineering projects, addressing any issues or risks that may arise.

• Collaborate closely with Analytics Leads, Data Architects, and the wider Digital and Information team to ensure seamless integration and operation of data solutions.

• Develop and implement a robust data operations capability to ensure the smooth running and reliability of our data estate.

• Drive the adoption of cloud technologies and modern data engineering practices within the team.

• Ensure data governance and compliance with relevant regulations and standards.

• Work with the team to define and implement best practices for data engineering, including coding standards, documentation, version control.



Skills


• Expert in SQL and database concepts including performance tuning and optimisation

• Solid understanding of data warehousing principles and data modelling practice

• Strong engineering skills, preferably in the following toolsets

- AWS services (S3, EC2, Lambda, Glue)

- ETL Tools (e.g. Apache Airflow)

- Streaming processing tools (e.g. Kinesis)

- Snowflake

- Python

• Excellent knowledge of creation and maintenance of data pipelines

• Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve complex data-related issues

• Proficient in data integration techniques including APIs and real-time ingestion

• Excellent communication and collaboration skills to work effectively with cross-functional teams

• Capable of building, leading, and developing a team of data engineers

• Strong project management skills and an ability to manage multiple projects and priorities


Experience


• Experienced and confident leadership of data engineering activities (essential)

• Expert in data engineering practise on cloud data platforms (essential)

• Background in data analysis and preparation, including experience with large data sets and unstructured data (desirable)

• Knowledge of AI/Data Science principles (desirable)


If you would like to hear more, please do get in touch.


Alternatively, you can refer a friend or colleague by taking part in our fantastic referral schemes If you have a friend or colleague who would be interested in this role, please refer them to us. For each relevant candidate that you introduce to us (there is no limit) and we place, you will be entitled to our general gift/voucher scheme.


Datatech is one of the UK’s leading recruitment agencies in the field of analytics and host of the critically acclaimed event, Women in Data. For more information, visit our website: www.datatech.org.uk

  • Lead Engineer/Data Engineer

    2 weeks ago

    London, United Kingdom Data Idols Full time €90,000 - €110,000

    Lead Data Engineer Location: London - Hybrid We are currently looking for a Lead Data Engineer to join our dynamic and forward-thinking team at a prominent British Insurance Company. This role is integral to our operations as it involves both maintenance of existing systems and the development of new projects. As a Lead Data Engineer, you will report...

  • Lead Engineer/Data Engineer

    2 weeks ago

    London, United Kingdom Data Idols Full time €90,000 - €110,000

    Lead Data Engineer Location: London - Hybrid We are currently looking for a Lead Data Engineer to join our dynamic and forward-thinking team at a prominent British Insurance Company. This role is integral to our operations as it involves both maintenance of existing systems and the development of new projects. As a Lead Data Engineer, you will report...

  • Lead Engineer/Data Engineer

    2 weeks ago

    London, United Kingdom Data Idols Full time

    Lead Data Engineer Location: London - Hybrid We are currently looking for a Lead Data Engineer to join our dynamic and forward-thinking team at a prominent British Insurance Company. This role is integral to our operations as it involves both maintenance of existing systems and the development of new projects. As a Lead Data Engineer, you will report...

  • Chief Data Engineering Lead

    3 weeks ago

    London, Greater London, United Kingdom Data Idols Full time

    Data Idols is looking for a Chief Data Engineering Lead to support the delivery of data transformation.As a key member of the team, you will collaborate with the wider data teams and drive high standards across the data function. The role involves building pipelines to deliver insights enabling the company to be more data driven in their decision making.Key...

  • Senior Data Engineer Lead

    2 weeks ago

    London, Greater London, United Kingdom Data Idols Full time

    The OpportunityWe are looking for a skilled Data Engineering Manager who has extensive experience in managing teams, implementing data strategy, and working with Azure. As a hands-off role, you will have the autonomy to lead the team and drive results.Your key responsibilities include:Implementing data strategy to drive business valueManaging and mentoring...

  • Senior Data Engineering Lead

    4 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time

    We are seeking a highly skilled Data Engineering Manager to support the delivery of data transformation during an exciting time at Data Science Festival.As a key member of the Data Engineering team, you will work closely with cross-functional teams to implement data strategy and deliver value across the organization.The ideal candidate will have extensive...

  • Data Engineering Manager

    3 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time

    Data Engineering Manager Role OverviewAt the forefront of our company's innovative landscape, we seek a seasoned Data Engineering Manager to spearhead data transformation initiatives. With an exciting tenure at one of the UK's most renowned retail brands, this pivotal role requires expertise in implementing data strategy and delivering value across the...

  • Big Data Engineering Lead

    3 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time

    **Job Overview**Data Science Festival is seeking an experienced Big Data Engineering Lead to join their team in London – hybrid. This is a fantastic opportunity for a skilled professional to drive data transformation and deliver value throughout the company.This hands-off role requires someone with extensive experience in managing teams, stakeholder...

  • Data Engineering Manager

    1 month ago

    London, Greater London, United Kingdom Data Science Festival Full time

    Data Engineering Manager OpportunityWe are seeking an experienced Data Engineering Manager to lead our team in implementing data strategy and delivering value throughout the company.The RoleThe successful candidate will have extensive experience in managing teams, stakeholder management, and implementing data strategy. They will work closely with the teams...

  • Lead Data Engineer

    1 month ago

    London Area, United Kingdom Xcede Full time

    Lead Data Engineer London (central) x3 days per week in office Up to £100,000 Salary + Discretionary Bonus OVERVIEW ESG driven asset management company are hiring for a Lead Data Engineer to spearhead their Data Engineering team in London! Interesting and varied role where you can work across the whole pipeline on a breadth of impactful projects! Great...

  • Data Engineering Lead

    4 weeks ago

    London Area, United Kingdom Xcede Full time

    Data Engineering Lead London (central) x3 days per week in office Up to £100,000 Salary + Discretionary Bonus OVERVIEW ESG driven asset management company are hiring for a Lead Data Engineer to spearhead their Data Engineering team in London! Interesting and varied role where you can work across the whole pipeline on a breadth of impactful projects!...

  • Data Engineering Lead

    2 months ago

    London Area, United Kingdom Xcede Full time

    Data Engineering LeadLondon (central) x3 days per week in officeUp to £100,000 Salary + Discretionary BonusOVERVIEWESG driven asset management company are hiring for a Lead Data Engineer to spearhead their Data Engineering team in London! Interesting and varied role where you can work across the whole pipeline on a breadth of impactful projects! Great scope...

  • Lead Data Engineer

    2 months ago

    London Area, United Kingdom Xcede Full time

    Lead Data Engineer London (central) x3 days per week in officeUp to £100,000 Salary + Discretionary BonusOVERVIEWESG driven asset management company are hiring for a Lead Data Engineer to spearhead their Data Engineering team in London! Interesting and varied role where you can work across the whole pipeline on a breadth of impactful projects! Great scope...

  • Lead Data Engineer

    2 months ago

    London Area, United Kingdom Xcede Full time

    Lead Data Engineer London (central) x3 days per week in officeUp to £100,000 Salary + Discretionary BonusOVERVIEWESG driven asset management company are hiring for a Lead Data Engineer to spearhead their Data Engineering team in London! Interesting and varied role where you can work across the whole pipeline on a breadth of impactful projects! Great scope...

  • Data Engineering Lead

    2 months ago

    London Area, United Kingdom Xcede Full time

    Data Engineering LeadLondon (central) x3 days per week in officeUp to £100,000 Salary + Discretionary BonusOVERVIEWESG driven asset management company are hiring for a Lead Data Engineer to spearhead their Data Engineering team in London! Interesting and varied role where you can work across the whole pipeline on a breadth of impactful projects! Great scope...

  • Lead Data Engineer

    3 months ago

    London Area, United Kingdom Cornwallis Elt Full time

    Lead Data Engineer – Python, SQL, dbt, AWS, Dremio, Data Mesh, ETL, Data Pipelines, Data Warehousing, DWH, S3, Glue, Data Lake, Automation, LondonA Lead Data Engineer is sought after by a leading workplace pensions provider, to run their expanding data engineering team in their London City office. The team have recently built out a next-gen data lake...

  • Lead Data Engineer

    2 months ago

    London Area, United Kingdom Cornwallis Elt Full time

    Lead Data Engineer – Python, SQL, dbt, AWS, Dremio, Data Mesh, ETL, Data Pipelines, Data Warehousing, DWH, S3, Glue, Data Lake, Automation, LondonA Lead Data Engineer is sought after by a leading workplace pensions provider, to run their expanding data engineering team in their London City office. The team have recently built out a next-gen data lake...

  • Lead Data Engineer

    2 months ago

    London Area, United Kingdom Cornwallis Elt Full time

    Lead Data Engineer – Python, SQL, dbt, AWS, Dremio, Data Mesh, ETL, Data Pipelines, Data Warehousing, DWH, S3, Glue, Data Lake, Automation, London A Lead Data Engineer is sought after by a leading workplace pensions provider, to run their expanding data engineering team in their London City office. The team have recently built out a next-gen data lake...

  • Lead Data Engineer

    1 month ago

    London Area, United Kingdom Mastek Full time

    Lead Data EngineerPermanent OpportunityLocation: London, UK – 2 days travel to officeOverview: We are seeking a highly skilled Lead Data Engineer to join our team for a critical project with NHS England. The project involves migrating Privacy Enhancement Technology (PET) from the existing Privitar system to IQVIA across multiple data platforms. The ideal...

  • Lead Data Engineer

    3 days ago

    London Area, United Kingdom Mastek Full time

    Lead Data Engineer Permanent Opportunity Location: London, UK – 2 days travel to office Overview: We are seeking a highly skilled Lead Data Engineer to join our team for a critical project with NHS England. The project involves migrating Privacy Enhancement Technology (PET) from the existing Privitar system to IQVIA across multiple data platforms. The...