Lead Data Engineer

4 days ago


UK, UK, United Kingdom Eden Smith Group Full time

Lead Data Engineer

London, remote, hybrid

Up to £90,000 per annum + Bonus


An excellent opportunity has arisen for an experienced and engaging Lead Data Engineer, to join a well-known organisation within the legal/tech sector.


The successful applicant will join a well established team as the go-to Data Lead. They will drive performance, share expertise, and inspire the team to excel. They will manage a skilled team of data engineers, fostering a culture of best practices and continuous improvement. A good balance of soft and hard skills are required, as the role is 50% Leadership focussed and 50% hands on/technical.


Main duties:


  • Lead a team of data engineers to effectively create, optimise and maintain automated systems and processes across a given project(s) or technical domain.
  • Coordinate engineering resources ensuring adherence to standards and effective delivery. Provide mentorship and guidance where required.
  • Write clean and testable code using SQL and Python scripting languages, to enable our customer data products and business applications
  • Build and manage data pipelines and notebooks, deploying code in a structured, trackable and safe manner
  • Effectively create, optimise and maintain automated systems and processes across a given project(s) or technical domain
  • Data Analyse, profile and plan work, aligned with project priorities
  • Perform reviews of code, refactoring where necessary
  • Deploy code in a structured, trackable and safe manner
  • Document your data developments and operational procedures
  • Ensure adherence to data/software delivery standards and effective delivery.
  • Help monitor, troubleshoot and resolve production data issues when they occur
  • Contribute to the continuous improvement of the team


Required skills:


  • Proven experience within a Lead Data Engineering role
  • Excellent understanding of Databricks and Pyspark
  • Strong knowledge of Azure Cloud Services
  • Excellent understanding of SQL
  • Good exposure to Azure Data Lake technologies such as ADF, HDFS and Synapse
  • Good knowledge of Data Governance, Data Catalog, Master Data Management
  • Excellent communication and stakeholder management skills


Experience within a media, publishing, research, or a similar consumer focused industry is desirable but not essential.


This represents the chance to drive your own technical and professional development within a highly innovative and growth focussed environment.


This role is based in London, but can be worked as a hybrid model with 2 office days per week as the preference.


If you are interested, please apply for full details.


  • Lead Data Engineer

    4 weeks ago


    UK, UK, United Kingdom ON Data Staffing Full time

    Our client, a Data & AI firm in London is actively seeking a Lead Data Engineer to play a pivotal role in delivering innovative big data solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks/Snowflake and exceptional communication skills to understand and address clients' diverse data...

  • Data Technical Lead

    5 days ago


    UK, UK, United Kingdom Data Idols Full time

    Data Technical LeadSalary: up to £80k Location: RemoteData Idols is working with one of the world's largest gaming organisations to hire a Data Technical Lead. This is an opportunity to work at scale on leading the software architecture design as well as evolve and formulate functions. You will collaborate with wider teams to implement technical designs...

  • Senior Data Engineer

    3 months ago


    UK, UK, United Kingdom ON Data Staffing Full time

    Our client, a Data & AI firm in London is actively seeking a Senior Data Engineer to play a pivotal role in delivering innovative big data solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks/Snowflake and exceptional communication skills to understand and address clients' diverse data...


  • UK, UK, United Kingdom ON Data Staffing Full time

    Our client is a renowned Data & AI Consultancy, providing advanced data transformation, cloud solutions, and AI-driven decision-making strategies to businesses across various industries. They specialize in delivering modern data platforms and engineering solutions, leveraging technologies like Snowflake, Databricks, and the latest cloud data...

  • Lead Data Engineer

    2 weeks ago


    UK, UK, United Kingdom Noir Full time

    Lead Data Engineer (Python, PySpark) - Remote(Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI / CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead,...

  • Lead Data Engineer

    3 weeks ago


    UK, UK, United Kingdom Maxwell Bond Full time

    If Azure, Greenfield projects, and the thrill of leading a team light you up, this role is bound to be your next adventure!A leading financial and legal services business in Liverpool, with an average year-on-year growth of 20%, are at the point of levelling up and scaling their entire tech team. As part of this, they are looking for a Lead Data Engineer to...

  • Lead Data Engineer

    4 days ago


    UK, UK, United Kingdom La Fosse Full time

    Lead Data Engineer - £85k-£95k + bonus - remoteLa Fosse are recruiting an experienced Lead Data Engineer for a long-standing insights company.With huge growth and development across the business (they've massively scaled their data and product function over the last 12 months with ambition to move towards advanced analytics and data science in 2025),...

  • Lead Data Engineer

    1 week ago


    London, UK, UK, United Kingdom The React Hub Full time

    Role: Lead Data EngineerAbout the role:An exciting opportunity has arisen for an experienced Lead Data Engineer to join the Engineering team within the Digital & Product Department. In this role, the successful candidate will lead a team of data engineers in designing and creating scalable and repeatable data pipelines. This hands-on position involves...

  • Lead Data Engineer

    3 weeks ago


    London, UK, UK, United Kingdom FinTop Consulting Full time

    About the role:An exciting opportunity has arisen for an experienced Lead Data Engineer to join the Engineering team within the Digital & Product Department. In this role, the successful candidate will lead a team of data engineers in designing and creating scalable and repeatable data pipelines. This hands-on position involves discussing requirements,...


  • UK, UK, United Kingdom ON Data Staffing Full time

    ON Data Staffing is currently seeking a talented Machine Learning Engineer with expertise in Databricks ML to join our client's remote team in the United Kingdom.As a key member of our client's Data Science and Machine Learning team, the Databricks ML Engineer will play a crucial role in developing and implementing state-of-the-art machine learning...

  • Technical Lead

    2 weeks ago


    UK, UK, United Kingdom HAYS Full time

    Technical Lead / Data Engineer City of LondonDuration: 12 MonthsHybrid workingInside IR35We are currently seeking a Technical Lead/Data Engineer to assist with a large-scale cloud migration project.Data Engineer Must haveAdvanced SQLJavaBig Data PlatformHDFSParquetWeb Apps (inc spring boot)Should haveClouderaData modellingBash scriptETL PrinciplesTeam...


  • UK, UK, United Kingdom Revolution Technology Full time

    Our client are a global consultancy, working on an exciting project in the Insurance space. They are on the lookout for a Lead Azure Data Engineer to come in on a contract basis.Key Skills/Requirements:Strong Azure Data Factory experienceAzure pipelines experienceAzure Synapse Analytics experienceData Integration (ETL) PlatformsPySpark experienceMust have...


  • UK, UK, United Kingdom Davies Full time

    Lead Data Science EngineerPermanent, full-timeRemoteDavies is seeking a highly skilled and experienced Lead Data Science Engineer to join our forward-thinking, award-winning in-house software development team. The ideal candidate will have 8-10 years of commercial software development and data science experience, including Python, Scikit-learn, Terraform and...

  • Data Team Lead

    2 weeks ago


    UK, UK, United Kingdom developrec Full time

    Lead Data Engineer - Remote - ~ £80,000 with flex DOEYou will be tasked with integrating APIs for data ingestion and maintaining synchronization between the data layer and the GraphQL API layer. The role requires an agile approach to development, enabling the incremental build-out of sophisticated data engineering solutions. Knowledge sharing and continuous...


  • UK, UK, United Kingdom Nationwide Building Society Part time

    This role will focus on delivering data within the SAS toolset to support the business in generating compelling insight and value to the Society, helping establish an in-house engineering capability and being an active part in driving forwards the data and analytics strategy of the society.Combining accountabilities for delivery, continuous improvement and...

  • Data Engineer

    5 days ago


    UK, UK, United Kingdom Simon James IT Ltd Full time

    Data Engineer / Analyst - SnowflakeAre you an experience Data Engineer with experience of cloud transition projects?Are you keen to find a role with a Global Fintech organisation where you can define and impact their strategy?We’re looking for a strong Data Analyst with excellent communication skills to lead conversations with stakeholders, not just to...


  • UK, UK, United Kingdom Wave Talent Full time

    An AI intelligence platform, focusing on the Banking sector, is looking for a Data Team Lead/Head of Data This is an exciting greenfield opportunity, where you can drive technical direction in a fast-growing organisation. As in any start-up, this role will require you to be a hands-on leader, but also set the vision and direction as we look to grow.Current...

  • Data Engineer

    2 weeks ago


    UK, UK, United Kingdom Paragon Alpha - Hedge Fund Talent Business Full time

    Data EngineerLondon, UKWe are currently partnered with a leading quantitative investment company who are seeking a data engineer to join the Core Technology Team as a key player in building and scaling the company’s data platform, one of the cornerstones of their research infrastructure. Key ResponsibilitiesDevelop efficient, scalable data and research...

  • Data Engineer

    2 weeks ago


    UK, UK, United Kingdom La Fosse Full time

    Data Engineer – Market Research - £60k-£75k + Bonus – RemoteLa Fosse are recruiting an experienced Data Engineer for a leading independent market research and insights company.With huge growth and development across the business (they've massively scaled their data and product function over the last 12 months, with ambition to move towards advanced...

  • Data Engineer

    4 days ago


    UK, UK, United Kingdom Rebel Recruiters Full time

    Role: Lead Data Engineer – ConservationLocation: Remote, UK or EuropeSalary: Up to £55k plus benefitsYou love working with data. But you love the planet even more. And, up until now, you’ve not had a chance to combine those two passions in your career.Maybe you are stuck creating mind-bogglingly brilliant data engineering solutions for a faceless bank,...