Data Engineering Lead

7 days ago

London, United Kingdom Datatech Analytics Full time

Data Engineering Lead - AWS & Snowflake, Hybrid working: 3 days inTW6, Middlesex offices & 2 days homer/remote, Salary: Negotiable to £70.,000 DOE plus 40 % bonus potential, Job Reference: J12869


Full UK working rights required/no sponsorship available


The role


Looking for a challenge in one of the worlds largest airfreight logistics organisation and a FTSE 100 company?


Within the Digital and Information function, the Data Engineering Lead will play a pivotal role in delivering and operating data products. Reporting to the Head of Data, Insights & Operational Research, this position holds significant responsibility within the data leadership team, ensuring our data solutions and business processes are fully aligned and contribute to the vision and strategic direction of the organisation.


The successful candidate will join the team at an exciting time. They are in the early stages of a major programme of work to modernise their data infrastructure, tooling and processes to migrate from an on-premise to a cloud native environment and the Data Engineering Lead will be essential to the success of the transformation.


Using your strong communication skills combined with a determined attitude you will be responsible for managing and developing a team of data engineers to develop effective and innovative solutions aligning to our architectural principles and the business need. You will ensure the team adheres to best practices in data engineering and contributes to the continuous improvement of our data systems.


Duties

Key responsibilities for this role include:

• Lead the design, development, and deployment of scalable and efficient data pipelines and architectures.

• Manage and mentor a team of data engineers, ensuring a culture of collaboration and excellence.

• Manage demand for data engineering resources, prioritising tasks and projects based on business needs and strategic goals.

• Monitor and report on the progress of data engineering projects, addressing any issues or risks that may arise.

• Collaborate closely with Analytics Leads, Data Architects, and the wider Digital and Information team to ensure seamless integration and operation of data solutions.

• Develop and implement a robust data operations capability to ensure the smooth running and reliability of our data estate.

• Drive the adoption of cloud technologies and modern data engineering practices within the team.

• Ensure data governance and compliance with relevant regulations and standards.

• Work with the team to define and implement best practices for data engineering, including coding standards, documentation, version control.



Skills


• Expert in SQL and database concepts including performance tuning and optimisation

• Solid understanding of data warehousing principles and data modelling practice

• Strong engineering skills, preferably in the following toolsets

- AWS services (S3, EC2, Lambda, Glue)

- ETL Tools (e.g. Apache Airflow)

- Streaming processing tools (e.g. Kinesis)

- Snowflake

- Python

• Excellent knowledge of creation and maintenance of data pipelines

• Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve complex data-related issues

• Proficient in data integration techniques including APIs and real-time ingestion

• Excellent communication and collaboration skills to work effectively with cross-functional teams

• Capable of building, leading, and developing a team of data engineers

• Strong project management skills and an ability to manage multiple projects and priorities


Experience


• Experienced and confident leadership of data engineering activities (essential)

• Expert in data engineering practise on cloud data platforms (essential)

• Background in data analysis and preparation, including experience with large data sets and unstructured data (desirable)

• Knowledge of AI/Data Science principles (desirable)


If you would like to hear more, please do get in touch.


Alternatively, you can refer a friend or colleague by taking part in our fantastic referral schemes If you have a friend or colleague who would be interested in this role, please refer them to us. For each relevant candidate that you introduce to us (there is no limit) and we place, you will be entitled to our general gift/voucher scheme.


Datatech is one of the UK’s leading recruitment agencies in the field of analytics and host of the critically acclaimed event, Women in Data. For more information, visit our website: www.datatech.org.uk

  • Lead Engineer/Data Engineer

    2 weeks ago

    London, United Kingdom Data Idols Full time €90,000 - €110,000

    Lead Data Engineer Location: London - Hybrid We are currently looking for a Lead Data Engineer to join our dynamic and forward-thinking team at a prominent British Insurance Company. This role is integral to our operations as it involves both maintenance of existing systems and the development of new projects. As a Lead Data Engineer, you will report...

  • Lead Engineer/Data Engineer

    2 weeks ago

    London, United Kingdom Data Idols Full time €90,000 - €110,000

    Lead Data Engineer Location: London - Hybrid We are currently looking for a Lead Data Engineer to join our dynamic and forward-thinking team at a prominent British Insurance Company. This role is integral to our operations as it involves both maintenance of existing systems and the development of new projects. As a Lead Data Engineer, you will report...

  • Lead Engineer/Data Engineer

    2 weeks ago

    London, United Kingdom Data Idols Full time

    Lead Data Engineer Location: London - Hybrid We are currently looking for a Lead Data Engineer to join our dynamic and forward-thinking team at a prominent British Insurance Company. This role is integral to our operations as it involves both maintenance of existing systems and the development of new projects. As a Lead Data Engineer, you will report...

  • Chief Data Engineering Lead

    3 weeks ago

    London, Greater London, United Kingdom Data Idols Full time

    Data Idols is looking for a Chief Data Engineering Lead to support the delivery of data transformation.As a key member of the team, you will collaborate with the wider data teams and drive high standards across the data function. The role involves building pipelines to deliver insights enabling the company to be more data driven in their decision making.Key...

  • Senior Data Engineer Lead

    2 weeks ago

    London, Greater London, United Kingdom Data Idols Full time

    The OpportunityWe are looking for a skilled Data Engineering Manager who has extensive experience in managing teams, implementing data strategy, and working with Azure. As a hands-off role, you will have the autonomy to lead the team and drive results.Your key responsibilities include:Implementing data strategy to drive business valueManaging and mentoring...

  • Senior Data Engineering Lead

    4 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time

    We are seeking a highly skilled Data Engineering Manager to support the delivery of data transformation during an exciting time at Data Science Festival.As a key member of the Data Engineering team, you will work closely with cross-functional teams to implement data strategy and deliver value across the organization.The ideal candidate will have extensive...

  • Data Engineering Manager

    3 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time

    Data Engineering Manager Role OverviewAt the forefront of our company's innovative landscape, we seek a seasoned Data Engineering Manager to spearhead data transformation initiatives. With an exciting tenure at one of the UK's most renowned retail brands, this pivotal role requires expertise in implementing data strategy and delivering value across the...

  • Big Data Engineering Lead

    3 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time

    **Job Overview**Data Science Festival is seeking an experienced Big Data Engineering Lead to join their team in London – hybrid. This is a fantastic opportunity for a skilled professional to drive data transformation and deliver value throughout the company.This hands-off role requires someone with extensive experience in managing teams, stakeholder...

  • Data Engineering Manager

    1 month ago

    London, Greater London, United Kingdom Data Science Festival Full time

    Data Engineering Manager OpportunityWe are seeking an experienced Data Engineering Manager to lead our team in implementing data strategy and delivering value throughout the company.The RoleThe successful candidate will have extensive experience in managing teams, stakeholder management, and implementing data strategy. They will work closely with the teams...

  • Data Lead

    6 months ago

    London, United Kingdom Data Idols Full time

    **Data Science Lead**: Data Idols are working with a disrupter within the delivery service space. They are looking for a Data Science Lead to join their growing team and support them as they invest heavily in their data platform. **The Opportunity**: This opportunity comes with huge growth and the chance to really put your mark on this role. The company are...

  • Data Centre Engineering Lead

    4 weeks ago

    London, Greater London, United Kingdom Future Engineering Full time

    Job Title: Associate DirectorCompany: Future EngineeringIndustry: Data Centre and Mission Critical engineeringThis is an exciting opportunity to lead and inspire teams on cutting-edge projects in London. As an Associate Director, you will oversee complex, large-scale Data Centre projects that are set to define the future of mission-critical facilities. With...

  • Data Engineer

    2 months ago

    London, United Kingdom Data Idols Full time

    Data Engineer Salary: £400 - £500 a day Location: London, Hybrid Data Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports. ...

  • Data Engineer

    2 months ago

    London, United Kingdom Data Idols Full time

    Data Engineer Salary: £400 - £500 a dayLocation: London, HybridData Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports.The...

  • Data Engineer

    2 months ago

    London, United Kingdom Data Idols Full time €400 - €500

    Data Engineer Salary: £400 - £500 a day Location: London, Hybrid Data Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports. ...

  • Data Engineer

    2 months ago

    London, United Kingdom Data Idols Full time

    Data Engineer Salary: £400 - £500 a dayLocation: London, HybridData Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports.The...

  • Data Engineer

    2 months ago

    London, United Kingdom Data Idols Full time

    Data Engineer Salary: £400 - £500 a dayLocation: London, HybridData Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports.The...

  • Data Engineer

    1 month ago

    London, United Kingdom Data Idols Full time

    Data Engineer Salary: £400 - £500 a dayLocation: London, HybridData Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports.The...

  • Enterprise Data Engineering Lead

    3 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time

    About Our ClientOur client is a renowned software company dedicated to providing innovative data solutions to the public sector. With a strong focus on collaboration and customer satisfaction, they strive to make a positive impact on society.They are now seeking a talented Full-stack Data Engineer to join their team for an initial three-month contract. This...

  • Data Systems Engineer

    4 weeks ago

    London, Greater London, United Kingdom Data Privacy Full time

    About the Role:We are seeking a skilled Data Systems Engineer to join our team at Houseful.Key Responsibilities:Design and implement data warehousing solutions using AWS technologies.Collaborate with senior engineers to ensure data accuracy and implement validation checks.Develop and maintain ETL/ELT pipelines, ensuring alignment with business...

  • Data Engineer

    1 month ago

    London, Greater London, United Kingdom Data Idols Full time £400 - £500

    Role OverviewData Idols is seeking a skilled Data Engineer to assist in modernising data pipelines, data standards and data reports for a national software company.Key ResponsibilitiesImprove data structures, pipelines and reportingCollaborate with the CTO to review reports and implement necessary changes or improvementsWhat You'll GainUp to £500 a...