Lead Data Engineer

4 weeks ago


London, UK, United Kingdom Venn Group Full time
We are working with a Financial Services firm to support their digital transformation. The Lead Data Engineering will shape the data engineering practice and build the company’s new data and analytics architecture. This role requires deep engineering and data architecture expertise, particularly in greenfield or start-up environments. The candidate will work closely with data architects, engineers, and business stakeholders, influencing data modeling and tool selection. Broad technical skills and hands-on experience are essential.
Responsibilities: Leadership
• Design data solutions and lead data engineering teams.

Data Management
• Establish protocols for data quality, security, and privacy.

Data Pipeline Development
• Design and develop data pipelines ensuring integrity and quality.

Data Modeling
• Implement data models for efficient querying and analysis.

Performance Optimization
• Optimize data components to reduce latency and costs.

Automation
• Automate workflows, validation, and monitoring processes.

Collaboration
• Work with analysts, scientists, engineers, and stakeholders to meet data needs.

Documentation
• Maintain documentation for data pipelines and architecture.

Essential Knowledge & Experience: • Strong background in data engineering or related fields.
• Experience with Google Cloud Platform and mentoring teams.
• Multi-cloud environment experience.
• Strong data architecture and programming skills (Python, SQL).
• Proven experience in data platforms, BI environments, and data modeling.

Desirable Knowledge & Experience: • Experience with Microsoft Azure and multi-cloud setups.
• Knowledge of cloud data management frameworks (e.g., CDMC).
• Familiarity with data governance tools (e.g., Alation).
• Banking sector experience.


  • Lead Data Engineer

    1 week ago


    London,, UK, United Kingdom Dragonfly People Full time

    Lead Data EngineerData | Engineer | Lead | AWS | Python | SQL | Airflow | Snowflake | DBT | Fintech A Lead Data Engineer is required by a rapidly growing consumer Fin-Tech business who are based in London. The Lead Data Engineer will mentor and coach a team of Data Engineers, while driving automation and seeking opportunities to optimise data resources. You...

  • Lead Data Engineer

    2 weeks ago


    London,, UK, United Kingdom Vallum Associates Full time

    Lead Data Engineer - Outside IR35 - Hybrid - London6 months initial contract Hybrid - two days a week in London office near Oxford CircusOutside IR35Competitive daily rates on offer! As a Lead Data Engineer, you’ll play a key role in developing and maintaining robust cloud-based solutions for the benefit of data scientists, analysts, traders, and other...

  • Engineering Lead

    1 week ago


    London,, UK, United Kingdom Provide Full time

    Engineering Lead - Data£120,000 + 30% bonus50/50 hybrid model in Central LondonWe are working exclusively with a global asset management company who have a long, successful history and are looking to take on an Engineering Lead within their Marketing Technology team to lead the data and software engineering function across their data space. You would come...

  • Lead Data Engineer

    2 weeks ago


    London,, UK, United Kingdom Opus Recruitment Solutions Full time

    Lead Data Engineer:AI company£70k Base Salary plus Bonus About the RoleI am exclusively supporting an AI company who are looking for a to take on board a Lead Data Engineer to define the long-term vision and lead execution of the data platform.As Data Engineer you will play a critical role in designing, developing, and maintaining our data infrastructure....

  • Lead Data Engineer

    2 days ago


    London, UK, UK, United Kingdom The React Hub Full time

    Role: Lead Data EngineerAbout the role:An exciting opportunity has arisen for an experienced Lead Data Engineer to join the Engineering team within the Digital & Product Department. In this role, the successful candidate will lead a team of data engineers in designing and creating scalable and repeatable data pipelines. This hands-on position involves...

  • Lead Data Engineer

    2 weeks ago


    London, UK, UK, United Kingdom FinTop Consulting Full time

    About the role:An exciting opportunity has arisen for an experienced Lead Data Engineer to join the Engineering team within the Digital & Product Department. In this role, the successful candidate will lead a team of data engineers in designing and creating scalable and repeatable data pipelines. This hands-on position involves discussing requirements,...

  • Lead Data Engineer

    2 weeks ago


    London,, UK, United Kingdom Swoop Recruitment Full time

    An exciting opportunity for an experienced Data Engineer to join the Engineering team working within the Digital & Product Department.Location: Chiswick (West London)Work Type: 3 days in office, 2 day from homeSalary: £80k - £100k dependent on experienceThe successful candidate will lead a team of 2 data engineers to design and create scalable data...

  • Lead Data Engineer

    2 weeks ago


    London,, UK, United Kingdom La Fosse Full time

    Lead Data Engineer - Specialty Manufacturing - £85k-£95k - London (1dpw)La Fosse are working alongside a niche manufacturer, producing, servicing and consulting on essential and life-changing equipment across the globe.With significant investment being pumped into data over the last year and moving from a buy to build model, they are now looking for a...

  • Lead Data Engineer

    2 weeks ago


    London,, UK, United Kingdom Oliver Bernard Full time

    Senior/Lead Data Engineer - Financial ServciesWe are working with a leading Financial services client, who is on the lookout for a Senior/Lead Data EngineerMainly coding in Kotlin/Python with GitHub and ArgoCD for CI/CDManaging Data PipelinesDeploying apps on AWSWorking in small, agile teams.Technical...

  • Lead Data Engineer

    2 weeks ago


    London,, UK, United Kingdom Mirai Talent Full time

    Data Engineering Lead An incredible opportunity to join a fast-growing consultancy who are disrupting the industry! As Data Engineering Lead you will be expected to act as a key figure and technical point of contact in client projects, while playing a major role in growing the team, and by extension, the organisation.Your day-to-day will involve leading our...


  • London,, UK, United Kingdom Cititec Talent Full time

    Our client, a world-leading commodities trading company, is embarking on a monumental digital transformation to become a data-driven organisation. This initiative, spearheaded by top leadership, represents a significant cultural shift and a massive technological overhaul.We seek a Lead Data Integration Engineer/Architect with extensive experience in data...


  • London,, UK, United Kingdom Oliver Bernard Full time

    Lead/Principal Data Engineer - JVM - Java, Kotlin, ETL, Data WarehouseA long-term client of OB's in the consulting space have recently won a long-term project with a Tier 1 Investment Bank and are looking for highly skilled Senior Data Engineers to come and work on an incredibly exciting new greenfield project.This is a large scale Data Warehousing...

  • Lead Data Engineer

    2 weeks ago


    London, UK, United Kingdom Macquarie Group Full time

    The commodities and global markets data analytics team within technology is building a leading data and analytics platform. We partner and build batch and real-time analytics solutions for traders, quants, desk analysts and central data teams across the business. At Macquarie, our advantage is bringing together diverse people and empowering them to shape...

  • Technical Lead

    5 days ago


    London, UK, United Kingdom eFinancialCareers Full time

    Technical Lead / Data Engineer City of London Duration: 12 Months Hybrid working Inside IR35 We are currently seeking a Technical Lead/Data Engineer to assist with a large-scale cloud migration project. Data Engineer Must have Advanced SQL Java Big Data Platform HDFS Parquet Web Apps (inc spring boot) Should have Cloudera Data modelling Bash script...


  • London,, UK, United Kingdom Eden Smith Group Full time

    Senior/Lead Data EngineerLondon (1-2 days per week)/Remote (3-4 days per week)Salary up to £80,000 per annumAn exciting opportunity has arisen to join us here at Eden Smith in a permanent position. Due to expansion, the new Senior Data Engineer will be crucial in building robust data pipelines and data flows for our clients on Azure cloud platforms. They...

  • Lead Data Architect

    2 weeks ago


    London,, UK, United Kingdom Digital Republic Talent Full time

    Google Expert | Director AI | Head of Machine Learning | Head of Data Engineering | Lead Data Architect | Lead Data Engineer | Lead Machine Learning Engineer Calling all Google Experts! If your looking for a Contract and have Google Certifications, please read on! Our Client-Partner is seeking a Google Expert in the Data Engineering, Machine Learning &...


  • London,, UK, United Kingdom Revolution Technology Full time

    Our client are a global consultancy, working on an exciting project in the Insurance space. They are on the lookout for a Lead Azure Data Engineer to come in on a contract basis.Key Skills/Requirements:Strong Azure Data Factory experienceAzure pipelines experienceAzure Synapse Analytics experienceData Integration (ETL) PlatformsPySpark experienceContract is...


  • London,, UK, United Kingdom Lyra, formerly ICAS World Full time

    Job Title: Lead, International Data Reporting to: Chief Technology Officer, International Technology Location: UK Job Description The successful candidate will set and execute the data engineering roadmap for International systems to align with the goals of the Lyra global data strategy and Lyra International Technology roadmap. You will be responsible for...

  • Data Engineer

    2 weeks ago


    London,, UK, United Kingdom Prism Digital Full time

    Lead Data Engineer | Microsoft & Azure Stack | Data AI ConsultancyLead position: 50% hands-on 50% consulting/working with strategy£100-120k + benefits packageI’m working with a fast-growing data consulting firm on the frontier of AI. They were established in 2020, have 10 employees and are growing fast. The Founder and leadership team come from an...

  • Data Engineer

    5 days ago


    London,, UK, United Kingdom Prism Digital Full time

    Lead Data Engineer | Microsoft & Azure Stack | Data AI ConsultancyLead position: 50% hands-on 50% consulting/customer engagement£90k-120k + benefits packageI’m working with a fast-growing data consulting firm on the frontier of AI. They were established in 2020, have 10 employees and are growing fast. The Founder and leadership team come from an...