Data Engineering Lead

2 weeks ago

London, Greater London, United Kingdom Butterworths Limited Company Full time

About the Role

As the technical lead for the data engineering team at Butterworths Limited Company, you will play a pivotal role in executing our data strategy for the Data Platform. Your expertise will be instrumental in developing and implementing advanced solutions for data integration, quality control, and continuous delivery, driving our data operations to new heights.

Key Responsibilities

  • Architect and lead the development of our patent data ingestion pipeline using Databricks, Python, and PySpark.
  • Mentor and guide a team of data engineers, fostering a collaborative environment that encourages growth and innovation.
  • Ensure the pipeline is efficient, scalable, and robust, capable of handling terabytes of data with low latency.
  • Contribute to the overall data engineering strategy and drive the adoption of best practices in coding, architecture, and deployment.
  • Identify and resolve technical challenges, ensuring the smooth operation of the data ingestion pipeline.
  • Automate routine tasks, enabling the team to focus on complex and challenging problems.

Requirements

  • Demonstrate expertise in Python and PySpark, with the ability to lead skill development within the team.
  • Demonstrate expertise in Databricks, with a strong understanding of its capabilities and limitations.
  • Demonstrate ability to design and implement scalable data architectures for both batch and streaming data processing.
  • Demonstrate proficiency in using cloud platforms such as AWS, Azure, or Google Cloud for data infrastructure management.
  • Knowledge of data governance practices, including data quality management, metadata management, and data lineage.
  • Proven experience in leading and mentoring technical data engineering teams.

What We Offer

  • A healthy work-life balance, with flexible working hours and a range of wellbeing initiatives.
  • A competitive salary and benefits package, including a generous holiday allowance and access to a contributory pension scheme.
  • Opportunities for professional development and growth, with access to extensive learning and development resources.
  • A collaborative and dynamic work environment, with a strong focus on teamwork and innovation.

  • Data Engineering Delivery Lead

    2 weeks ago

    London, Greater London, United Kingdom NTT DATA Full time

    Lead Data Engineering Projects at a Global IT LeaderNTT DATA, a world-renowned IT service provider, is seeking a skilled and experienced Data Engineering Delivery Manager to join our dynamic team. As the 6th largest IT Service Provider globally, we are dedicated to driving business change and technology transformation across diverse industries.Your Role:In...

  • Data Engineering Delivery Lead

    4 days ago

    London, Greater London, United Kingdom NTT DATA Full time

    Lead Data Engineering Projects at a Global IT LeaderNTT DATA, a world-renowned IT service provider, is seeking a skilled and experienced Data Engineering Delivery Manager to join our dynamic team. As the 6th largest IT Service Provider globally, we are dedicated to driving business change and technology transformation across diverse industries.Your Role:In...

  • Technical Delivery Lead

    5 days ago

    London, Greater London, United Kingdom NTT DATA Full time

    About the RoleWe are seeking an experienced Senior Data Engineering Project Manager to join our team at NTT DATA. As a key member of our Data Engineering service line, you will be responsible for overseeing Data Engineering projects and programmes across our Data transformation portfolio.Key ResponsibilitiesLead highly-skilled technical teams in a...

  • Technical Delivery Lead

    4 days ago

    London, Greater London, United Kingdom NTT DATA Full time

    About the RoleWe are seeking an experienced Senior Data Engineering Project Manager to join our team at NTT DATA. As a key member of our Data Engineering service line, you will be responsible for overseeing Data Engineering projects and programmes across our Data transformation portfolio.Key ResponsibilitiesLead highly-skilled technical teams in a...

  • Lead Data Engineering Specialist

    4 days ago

    London, Greater London, United Kingdom ON Data Staffing Full time

    About the RoleWe are seeking a highly skilled Senior Data Solutions Architect to join our team at ON Data Staffing. As a key member of our data engineering team, you will play a pivotal role in delivering innovative big data solutions to our clients.Key ResponsibilitiesClient EngagementCollaborate directly with our clients to understand their business...

  • Lead Data Engineering Specialist

    6 days ago

    London, Greater London, United Kingdom ON Data Staffing Full time

    About the RoleWe are seeking a highly skilled Senior Data Solutions Architect to join our team at ON Data Staffing. As a key member of our data engineering team, you will play a pivotal role in delivering innovative big data solutions to our clients.Key ResponsibilitiesClient EngagementCollaborate directly with our clients to understand their business...

  • Data Engineering Lead

    6 days ago

    London, Greater London, United Kingdom Tribal Tech - The Digital, Data & AI Specialists Full time

    Job DescriptionSenior Data Engineer - A Key Role in Our Data-Driven OrganizationTribal Tech, a leading digital, data, and AI specialist, is seeking an experienced Senior Data Engineer to join our innovative team. This role offers a unique opportunity to shape the future of data-driven decision-making within a rapidly growing organization.OverviewAs a Senior...

  • Lead Data Solutions Engineer

    6 days ago

    London, Greater London, United Kingdom Tribal Tech - The Digital, Data & AI Specialists Full time

    Job DescriptionJob Title: Lead Data EngineerCompany: Tribal Tech - The Digital, Data & AI SpecialistsLocation: UK-based, Hybrid WorkingJob Type: Full-timeSalary: £80,000 - £100,000 per annum (depending on experience)About the Role:We are seeking an exceptional Lead Data Engineer to join our innovative team. This role offers a unique opportunity to shape...

  • Lead Data Center Design

    2 weeks ago

    London, Greater London, United Kingdom Vantage Data Centers Full time

    Vantage Data Centers is seeking a seasoned Senior Design Manager to spearhead design and engineering initiatives within our London market. This role demands a strategic leader with extensive data center design management experience, capable of driving excellence in complex projects. As the heart of our design process, you will oversee the entire lifecycle,...

  • Data Technical Lead

    1 day ago

    London, Greater London, United Kingdom Data Idols Full time

    About the RoleWe are seeking a highly skilled Data Technical Lead to join our team at Data Idols. As a key member of our organization, you will play a vital role in leading the software architecture design and evolving functions to meet the needs of our clients.Key ResponsibilitiesLead architectural design and solution engineering in creating and building...

  • Data Technical Lead

    1 day ago

    London, Greater London, United Kingdom Data Idols Full time

    About the RoleWe are seeking a highly skilled Data Technical Lead to join our team at Data Idols. As a key member of our organization, you will play a vital role in leading the software architecture design and evolving functions to meet the needs of our clients.Key ResponsibilitiesLead architectural design and solution engineering in creating and building...

  • Data Strategy Lead

    6 days ago

    London, Greater London, United Kingdom Data Idols Full time

    Job Overview**Data Idols** is seeking a seasoned professional to lead their data function and drive strategic growth. As the **Director of Data**, you will be responsible for overseeing the entire data function, collaborating closely with the CEO and CTO, and developing a data strategy that aligns with the company's vision.**Key Responsibilities:**Develop...

  • Data Center Design Lead

    4 days ago

    London, Greater London, United Kingdom Vantage Data Centers Full time

    About Vantage Data CentersVantage Data Centers is a leading provider of data center solutions, committed to delivering high-quality infrastructure and exceptional customer service. We strive to create a workplace of inclusion, equity, respect, and acceptance, where diversity is celebrated and valued.Our MissionWe power, cool, protect, and connect the...

  • Data Center Design Lead

    6 days ago

    London, Greater London, United Kingdom Vantage Data Centers Full time

    About Vantage Data CentersVantage Data Centers is a leading provider of data center solutions, committed to delivering high-quality infrastructure and exceptional customer service. We strive to create a workplace of inclusion, equity, respect, and acceptance, where diversity is celebrated and valued.Our MissionWe power, cool, protect, and connect the...

  • Senior Data Engineering Project Manager

    5 days ago

    London, Greater London, United Kingdom NTT DATA Full time

    About the RoleWe are seeking an experienced Senior Data Engineering Project Manager to join our team at NTT DATA. As a key member of our Data Engineering service line, you will be responsible for overseeing Data Engineering projects and programmes across our Data transformation portfolio.Key ResponsibilitiesLead highly-skilled technical teams in a...

  • Senior Data Engineering Project Manager

    4 days ago

    London, Greater London, United Kingdom NTT DATA Full time

    About the RoleWe are seeking an experienced Senior Data Engineering Project Manager to join our team at NTT DATA. As a key member of our Data Engineering service line, you will be responsible for overseeing Data Engineering projects and programmes across our Data transformation portfolio.Key ResponsibilitiesLead highly-skilled technical teams in a...

  • Lead Data Architect

    6 days ago

    London, Greater London, United Kingdom Tribal Tech - The Digital, Data & AI Specialists Full time £80,000 - £100,000

    Transformative Data Engineering OpportunityTribal Tech, a pioneering digital, data, and AI specialist, is seeking an exceptional Lead Data Engineer to spearhead the development of cutting-edge data infrastructure and drive data-driven decision-making across the organization.Role OverviewAs a Lead Data Engineer, you will be responsible for designing,...

  • Lead Data Architect

    4 days ago

    London, Greater London, United Kingdom Tribal Tech - The Digital, Data & AI Specialists Full time £80,000 - £100,000

    Transformative Data Engineering OpportunityTribal Tech, a pioneering digital, data, and AI specialist, is seeking an exceptional Lead Data Engineer to spearhead the development of cutting-edge data infrastructure and drive data-driven decision-making across the organization.Role OverviewAs a Lead Data Engineer, you will be responsible for designing,...

  • Data Engineering Leader

    6 days ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Job Title: Director of Data EngineerCompany: Harnham - Data & Analytics RecruitmentJob Type: Full-timeLocation: RemoteJob Description:Overview:We are seeking an experienced Director of Data Engineer to lead our data engineering team and drive the development of our data platform. As a key member of our leadership team, you will be responsible for building...

  • Data Engineering Leader

    4 days ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Job Title: Director of Data EngineerCompany: Harnham - Data & Analytics RecruitmentJob Type: Full-timeLocation: RemoteJob Description:Overview:We are seeking an experienced Director of Data Engineer to lead our data engineering team and drive the development of our data platform. As a key member of our leadership team, you will be responsible for building...