Lead Data Engineer

1 week ago


London UK, UK, United Kingdom The React Hub Full time

Role: Lead Data Engineer


About the role:


An exciting opportunity has arisen for an experienced Lead Data Engineer to join the Engineering team within the Digital & Product Department. In this role, the successful candidate will lead a team of data engineers in designing and creating scalable and repeatable data pipelines. This hands-on position involves discussing requirements, designing solutions, and writing code to automate data ingestion, cleansing, and transforming data to achieve the target format.


You will collaborate with the Products, Engineering, Data, and Business Analytics teams to understand source and target data requirements and develop data integration solutions for necessary migrations. The Data Engineer will support software developers, PowerBI developers, data analysts, and data scientists on data initiatives, ensuring optimal data delivery architecture across ongoing projects. You must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products.


Responsibilities:


  • Develop and maintain ETL and data integration solutions using various technologies and data sources.
  • Oversee and update the Data Engineering Architecture.
  • Analyze and organize raw data from diverse sources.
  • Investigate methods to improve data quality and reliability.
  • Identify, design, and implement internal process improvements, such as automating manual processes and optimizing data delivery.
  • Utilize cloud-based infrastructure (Azure) for hosting data solutions and applications.
  • Collaborate with architects, data analysts, and data scientists to achieve business objectives.


Requirements:


  • Previous experience as a data engineer.
  • Proven track record in developing and maintaining ETL/ELT processes within a medallion architecture.
  • Solid experience in data modeling within a cloud-based data platform.
  • Extensive experience with SQL Server and relational databases.
  • Strong knowledge of the Azure data engineering stack, including Azure Synapse and Azure Data Lake.
  • Proficiency in programming with Python, PySpark, and T-SQL.
  • Familiarity with wider Azure data solutions, such as Azure ML Studio.
  • Previous experience with Azure DevOps and a good understanding of CI/CD.
  • Analytical skills for working with structured and unstructured datasets.
  • Excellent written and verbal communication skills.
  • Experience in supporting and collaborating with cross-functional teams in a dynamic environment.

  • Lead Data Engineer

    4 weeks ago


    UK, UK, United Kingdom ON Data Staffing Full time

    Our client, a Data & AI firm in London is actively seeking a Lead Data Engineer to play a pivotal role in delivering innovative big data solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks/Snowflake and exceptional communication skills to understand and address clients' diverse data...

  • Data Technical Lead

    4 days ago


    UK, UK, United Kingdom Data Idols Full time

    Data Technical LeadSalary: up to £80k Location: RemoteData Idols is working with one of the world's largest gaming organisations to hire a Data Technical Lead. This is an opportunity to work at scale on leading the software architecture design as well as evolve and formulate functions. You will collaborate with wider teams to implement technical designs...

  • Senior Data Engineer

    3 months ago


    UK, UK, United Kingdom ON Data Staffing Full time

    Our client, a Data & AI firm in London is actively seeking a Senior Data Engineer to play a pivotal role in delivering innovative big data solutions to their end clients.This client-facing role requires a unique blend of technical prowess in Databricks/Snowflake and exceptional communication skills to understand and address clients' diverse data...


  • UK, UK, United Kingdom ON Data Staffing Full time

    Our client is a renowned Data & AI Consultancy, providing advanced data transformation, cloud solutions, and AI-driven decision-making strategies to businesses across various industries. They specialize in delivering modern data platforms and engineering solutions, leveraging technologies like Snowflake, Databricks, and the latest cloud data...

  • Lead Data Engineer

    2 weeks ago


    UK, UK, United Kingdom Noir Full time

    Lead Data Engineer (Python, PySpark) - Remote(Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI / CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead,...

  • Lead Data Engineer

    3 weeks ago


    UK, UK, United Kingdom Maxwell Bond Full time

    If Azure, Greenfield projects, and the thrill of leading a team light you up, this role is bound to be your next adventure!A leading financial and legal services business in Liverpool, with an average year-on-year growth of 20%, are at the point of levelling up and scaling their entire tech team. As part of this, they are looking for a Lead Data Engineer to...

  • Lead Data Engineer

    2 days ago


    UK, UK, United Kingdom La Fosse Full time

    Lead Data Engineer - £85k-£95k + bonus - remoteLa Fosse are recruiting an experienced Lead Data Engineer for a long-standing insights company.With huge growth and development across the business (they've massively scaled their data and product function over the last 12 months with ambition to move towards advanced analytics and data science in 2025),...

  • Lead Data Engineer

    2 days ago


    UK, UK, United Kingdom Eden Smith Group Full time

    Lead Data EngineerLondon, remote, hybridUp to £90,000 per annum + BonusAn excellent opportunity has arisen for an experienced and engaging Lead Data Engineer, to join a well-known organisation within the legal/tech sector.The successful applicant will join a well established team as the go-to Data Lead. They will drive performance, share expertise, and...

  • Lead Data Engineer

    3 weeks ago


    London, UK, UK, United Kingdom FinTop Consulting Full time

    About the role:An exciting opportunity has arisen for an experienced Lead Data Engineer to join the Engineering team within the Digital & Product Department. In this role, the successful candidate will lead a team of data engineers in designing and creating scalable and repeatable data pipelines. This hands-on position involves discussing requirements,...


  • UK, UK, United Kingdom ON Data Staffing Full time

    ON Data Staffing is currently seeking a talented Machine Learning Engineer with expertise in Databricks ML to join our client's remote team in the United Kingdom.As a key member of our client's Data Science and Machine Learning team, the Databricks ML Engineer will play a crucial role in developing and implementing state-of-the-art machine learning...

  • Technical Lead

    1 week ago


    UK, UK, United Kingdom HAYS Full time

    Technical Lead / Data Engineer City of LondonDuration: 12 MonthsHybrid workingInside IR35We are currently seeking a Technical Lead/Data Engineer to assist with a large-scale cloud migration project.Data Engineer Must haveAdvanced SQLJavaBig Data PlatformHDFSParquetWeb Apps (inc spring boot)Should haveClouderaData modellingBash scriptETL PrinciplesTeam...


  • UK, UK, United Kingdom Davies Full time

    Lead Data Science EngineerPermanent, full-timeRemoteDavies is seeking a highly skilled and experienced Lead Data Science Engineer to join our forward-thinking, award-winning in-house software development team. The ideal candidate will have 8-10 years of commercial software development and data science experience, including Python, Scikit-learn, Terraform and...

  • Data Team Lead

    2 weeks ago


    UK, UK, United Kingdom developrec Full time

    Lead Data Engineer - Remote - ~ £80,000 with flex DOEYou will be tasked with integrating APIs for data ingestion and maintaining synchronization between the data layer and the GraphQL API layer. The role requires an agile approach to development, enabling the incremental build-out of sophisticated data engineering solutions. Knowledge sharing and continuous...


  • UK, UK, United Kingdom Nationwide Building Society Part time

    This role will focus on delivering data within the SAS toolset to support the business in generating compelling insight and value to the Society, helping establish an in-house engineering capability and being an active part in driving forwards the data and analytics strategy of the society.Combining accountabilities for delivery, continuous improvement and...

  • Data Engineer

    3 days ago


    UK, UK, United Kingdom Simon James IT Ltd Full time

    Data Engineer / Analyst - SnowflakeAre you an experience Data Engineer with experience of cloud transition projects?Are you keen to find a role with a Global Fintech organisation where you can define and impact their strategy?We’re looking for a strong Data Analyst with excellent communication skills to lead conversations with stakeholders, not just to...


  • UK, UK, United Kingdom Wave Talent Full time

    An AI intelligence platform, focusing on the Banking sector, is looking for a Data Team Lead/Head of Data This is an exciting greenfield opportunity, where you can drive technical direction in a fast-growing organisation. As in any start-up, this role will require you to be a hands-on leader, but also set the vision and direction as we look to grow.Current...

  • Data Engineer

    1 week ago


    UK, UK, United Kingdom Paragon Alpha - Hedge Fund Talent Business Full time

    Data EngineerLondon, UKWe are currently partnered with a leading quantitative investment company who are seeking a data engineer to join the Core Technology Team as a key player in building and scaling the company’s data platform, one of the cornerstones of their research infrastructure. Key ResponsibilitiesDevelop efficient, scalable data and research...

  • Data Engineer

    2 weeks ago


    UK, UK, United Kingdom La Fosse Full time

    Data Engineer – Market Research - £60k-£75k + Bonus – RemoteLa Fosse are recruiting an experienced Data Engineer for a leading independent market research and insights company.With huge growth and development across the business (they've massively scaled their data and product function over the last 12 months, with ambition to move towards advanced...

  • SQL Support Engineer

    3 weeks ago


    London, UK, UK, United Kingdom Data Idols Full time

    SQL Support Engineer Salary: Up to £45k Location: Remote/Hybrid Data Idols are working with one of the largest entertainment organisations growing rapidly within their global operations.With innovation, creativity, and data at the company's heart, they are looking for a SQL Support Engineer to help them push technological boundaries. The Opportunity As...

  • Data Engineer

    2 days ago


    UK, UK, United Kingdom Rebel Recruiters Full time

    Role: Lead Data Engineer – ConservationLocation: Remote, UK or EuropeSalary: Up to £55k plus benefitsYou love working with data. But you love the planet even more. And, up until now, you’ve not had a chance to combine those two passions in your career.Maybe you are stuck creating mind-bogglingly brilliant data engineering solutions for a faceless bank,...