Current jobs related to Lead Data Engineer - London, UK - Generative

  • Lead Data Engineer

    4 weeks ago

    London,, UK, United Kingdom Dragonfly People Full time

    Lead Data EngineerData | Engineer | Lead | AWS | Python | SQL | Airflow | Snowflake | DBT | Fintech A Lead Data Engineer is required by a rapidly growing consumer Fin-Tech business who are based in London. The Lead Data Engineer will mentor and coach a team of Data Engineers, while driving automation and seeking opportunities to optimise data resources. You...

  • Lead Data Engineer

    1 month ago

    London,, UK, United Kingdom Vallum Associates Full time

    Lead Data Engineer - Outside IR35 - Hybrid - London6 months initial contract Hybrid - two days a week in London office near Oxford CircusOutside IR35Competitive daily rates on offer! As a Lead Data Engineer, you’ll play a key role in developing and maintaining robust cloud-based solutions for the benefit of data scientists, analysts, traders, and other...

  • Engineering Lead

    4 weeks ago

    London,, UK, United Kingdom Provide Full time

    Engineering Lead - Data£120,000 + 30% bonus50/50 hybrid model in Central LondonWe are working exclusively with a global asset management company who have a long, successful history and are looking to take on an Engineering Lead within their Marketing Technology team to lead the data and software engineering function across their data space. You would come...

  • Lead Data Engineer

    1 month ago

    London,, UK, United Kingdom Opus Recruitment Solutions Full time

    Lead Data Engineer:AI company£70k Base Salary plus Bonus About the RoleI am exclusively supporting an AI company who are looking for a to take on board a Lead Data Engineer to define the long-term vision and lead execution of the data platform.As Data Engineer you will play a critical role in designing, developing, and maintaining our data infrastructure....

  • Lead Data Engineer

    3 weeks ago

    London, UK, UK, United Kingdom The React Hub Full time

    Role: Lead Data EngineerAbout the role:An exciting opportunity has arisen for an experienced Lead Data Engineer to join the Engineering team within the Digital & Product Department. In this role, the successful candidate will lead a team of data engineers in designing and creating scalable and repeatable data pipelines. This hands-on position involves...

  • Lead Data Engineer

    1 month ago

    London, UK, UK, United Kingdom FinTop Consulting Full time

    About the role:An exciting opportunity has arisen for an experienced Lead Data Engineer to join the Engineering team within the Digital & Product Department. In this role, the successful candidate will lead a team of data engineers in designing and creating scalable and repeatable data pipelines. This hands-on position involves discussing requirements,...

  • Lead Data Engineer

    4 weeks ago

    London,, UK, United Kingdom Swoop Recruitment Full time

    An exciting opportunity for an experienced Data Engineer to join the Engineering team working within the Digital & Product Department.Location: Chiswick (West London)Work Type: 3 days in office, 2 day from homeSalary: £80k - £100k dependent on experienceThe successful candidate will lead a team of 2 data engineers to design and create scalable data...

  • Lead Data Engineer

    1 month ago

    London,, UK, United Kingdom La Fosse Full time

    Lead Data Engineer - Specialty Manufacturing - £85k-£95k - London (1dpw)La Fosse are working alongside a niche manufacturer, producing, servicing and consulting on essential and life-changing equipment across the globe.With significant investment being pumped into data over the last year and moving from a buy to build model, they are now looking for a...

  • Lead Data Engineer

    1 month ago

    London,, UK, United Kingdom Oliver Bernard Full time

    Senior/Lead Data Engineer - Financial ServciesWe are working with a leading Financial services client, who is on the lookout for a Senior/Lead Data EngineerMainly coding in Kotlin/Python with GitHub and ArgoCD for CI/CDManaging Data PipelinesDeploying apps on AWSWorking in small, agile teams.Technical...

  • Lead Data Engineer

    1 month ago

    London,, UK, United Kingdom Mirai Talent Full time

    Data Engineering Lead An incredible opportunity to join a fast-growing consultancy who are disrupting the industry! As Data Engineering Lead you will be expected to act as a key figure and technical point of contact in client projects, while playing a major role in growing the team, and by extension, the organisation.Your day-to-day will involve leading our...

  • Lead Data Engineer/Architect

    4 weeks ago

    London,, UK, United Kingdom Cititec Talent Full time

    Our client, a world-leading commodities trading company, is embarking on a monumental digital transformation to become a data-driven organisation. This initiative, spearheaded by top leadership, represents a significant cultural shift and a massive technological overhaul.We seek a Lead Data Integration Engineer/Architect with extensive experience in data...

  • Lead/Principal Data Engineer

    3 weeks ago

    London,, UK, United Kingdom Oliver Bernard Full time

    Lead/Principal Data Engineer - JVM - Java, Kotlin, ETL, Data WarehouseA long-term client of OB's in the consulting space have recently won a long-term project with a Tier 1 Investment Bank and are looking for highly skilled Senior Data Engineers to come and work on an incredibly exciting new greenfield project.This is a large scale Data Warehousing...

  • Lead Data Engineer

    4 weeks ago

    London, UK, United Kingdom Macquarie Group Full time

    The commodities and global markets data analytics team within technology is building a leading data and analytics platform. We partner and build batch and real-time analytics solutions for traders, quants, desk analysts and central data teams across the business. At Macquarie, our advantage is bringing together diverse people and empowering them to shape...

  • Technical Lead

    3 weeks ago

    London, UK, United Kingdom eFinancialCareers Full time

    Technical Lead / Data Engineer City of London Duration: 12 Months Hybrid working Inside IR35 We are currently seeking a Technical Lead/Data Engineer to assist with a large-scale cloud migration project. Data Engineer Must have Advanced SQL Java Big Data Platform HDFS Parquet Web Apps (inc spring boot) Should have Cloudera Data modelling Bash script...

  • Lead Data engineer

    7 days ago

    London,, UK, United Kingdom Coforge Full time

    Role : Lead Data engineerJob Type : Full TimeJob Location : LondonMandatory Skills : SQL, Snowflakes, DBT (Data Build Tool) Job Description:-• Good knowledge of SQL programming.• Strong knowledge of Snowflake Cloud Data warehouse. Snowflake Functions and Procedures.• Good knowledge of Python, DBT.• In-depth understanding of Data Warehouse, ETL...

  • Senior/Lead Data Engineer

    4 weeks ago

    London,, UK, United Kingdom Eden Smith Group Full time

    Senior/Lead Data EngineerLondon (1-2 days per week)/Remote (3-4 days per week)Salary up to £80,000 per annumAn exciting opportunity has arisen to join us here at Eden Smith in a permanent position. Due to expansion, the new Senior Data Engineer will be crucial in building robust data pipelines and data flows for our clients on Azure cloud platforms. They...

  • Lead Data Architect

    1 month ago

    London,, UK, United Kingdom Digital Republic Talent Full time

    Google Expert | Director AI | Head of Machine Learning | Head of Data Engineering | Lead Data Architect | Lead Data Engineer | Lead Machine Learning Engineer Calling all Google Experts! If your looking for a Contract and have Google Certifications, please read on! Our Client-Partner is seeking a Google Expert in the Data Engineering, Machine Learning &...

  • Lead Azure Data Engineer

    1 month ago

    London,, UK, United Kingdom Revolution Technology Full time

    Our client are a global consultancy, working on an exciting project in the Insurance space. They are on the lookout for a Lead Azure Data Engineer to come in on a contract basis.Key Skills/Requirements:Strong Azure Data Factory experienceAzure pipelines experienceAzure Synapse Analytics experienceData Integration (ETL) PlatformsPySpark experienceContract is...

  • International Data Lead

    1 month ago

    London,, UK, United Kingdom Lyra, formerly ICAS World Full time

    Job Title: Lead, International Data Reporting to: Chief Technology Officer, International Technology Location: UK Job Description The successful candidate will set and execute the data engineering roadmap for International systems to align with the goals of the Lyra global data strategy and Lyra International Technology roadmap. You will be responsible for...

  • Lead Design Manager

    2 weeks ago

    London,, UK, United Kingdom Colt Data Centre Services Full time

    Mission:We are seeking an agile Engineering Location Lead for the UK to support our Delivery Team at Colt DCS. The role will deliver technical excellence and leadership across the UK projects to ensure on time and on budget delivery. You will lead and manage a multi-disciplinary technical and design management team in the UK delivering multiple Hyperscale...

Lead Data Engineer

3 months ago

London, UK, United Kingdom Generative Full time

JOB ALERT FOR


We are currently recruiting for a LEAD DATA ENGINEER for one of our clients in the insurance industry.


The Lead Data Engineer will be responsible for:


Leading a team of developers and data engineers who build and deliver the components of modern Data platform – Data Lakehouse Architecture in Azure, leveraging data lake, delta Lake for data storage Utilizing Azure Data Factory for data integration Databricks for data transformation Data governance using purview Profisee for MDM Synapse and Power BI for end-user data analytics layer and reporting. In the pipeline – Co Pilot and Fabric.


Key responsibilities


Lead data engineer responsible of:


• Mixture of hands on and lead a newly established data engineering team through both strategic development projects and day-to-day data management (BAU) activities.

o Defining and orchestrating tasks and deliverables in support of the project/scrum master.

o Setting the standard of what good looks like.

• Design, develop, and hold accountability for core data engineering services, encompassing the end-to-end data lifecycle journey from ingestion through to end user reporting.

• Data acquisition from various data sources (API, XML, Json, parquet, flat file systems and relational data.

• Skills in data modelling (both structured and unstructured data) working directly with the business & data architects and SME’s.

• Administering CICD pipelines, completing peer/code reviews, ensuring the integrity of data, and holding accountability for access and security permission.

• Design and develop metadata driven data ingestion (ETL/ELT) processes, data lake house architecture, data warehouse, data marts, reports, and dashboards; in-line with the company data management framework and enterprise data strategy.

• Work in collaboration with Data Architects and act as a Senior contributor on the design, build, and management of the Data Platform; taking direct ownership of data engineering activities and responsibilities and ensure that all new data requirements are met using the most appropriate architecture components and engineering practices.

• Design and develop models using delta lake both relational and dimensional to support reporting requirements.

• Create reporting solutions in line with standards, architectural principles, and practices.

• Work in an agile, proactive manner, delivering high quality solutions in agreed timescales.

• Mentor and support data engineers/developers in the team.

• Team leadership of both senior and general data engineers and BI developers.

• Stay abreast of technology trends, state-of-the-art platforms, data engineering techniques/standards and industry trends to provide input on strategic roadmap including Fabric and AI copilot

• Develop Proof of Concepts to prove that business requirements can be met by technical solutions.


Highly Desirable Skills and Knowledge:


• Microsoft Fabric – Data engineering, Lake house

• Experience with Co Pilot

• REST API Data sources (MongoDB, Cosmos DB)

• Experience in design and developing MDM solutions ie MDS, Profisee

• MS SSIS, MS SQL Server Reporting

• Data Governance – Purview, Databricks Unity catalogue.