Current jobs related to Lead Data Engineer - London, UK - Swoop Recruitment

  • Lead Data Engineer

    4 weeks ago

    London,, UK, United Kingdom Dragonfly People Full time

    Lead Data EngineerData | Engineer | Lead | AWS | Python | SQL | Airflow | Snowflake | DBT | Fintech A Lead Data Engineer is required by a rapidly growing consumer Fin-Tech business who are based in London. The Lead Data Engineer will mentor and coach a team of Data Engineers, while driving automation and seeking opportunities to optimise data resources. You...

  • Lead Data Engineer

    1 month ago

    London,, UK, United Kingdom Vallum Associates Full time

    Lead Data Engineer - Outside IR35 - Hybrid - London6 months initial contract Hybrid - two days a week in London office near Oxford CircusOutside IR35Competitive daily rates on offer! As a Lead Data Engineer, you’ll play a key role in developing and maintaining robust cloud-based solutions for the benefit of data scientists, analysts, traders, and other...

  • Lead Data Engineer

    2 days ago

    London,, UK, United Kingdom Cornwallis Elt Full time

    Lead Data Engineer – Python, SQL, dbt, AWS, Dremio, Data Mesh, ETL, Data Pipelines, Data Warehousing, DWH, S3, Glue, Data Lake, Automation, LondonA Lead Data Engineer is sought after by a leading workplace pensions provider, to run their expanding data engineering team in their London City office. The team have recently built out a next-gen data lake...

  • Engineering Lead

    4 weeks ago

    London,, UK, United Kingdom Provide Full time

    Engineering Lead - Data£120,000 + 30% bonus50/50 hybrid model in Central LondonWe are working exclusively with a global asset management company who have a long, successful history and are looking to take on an Engineering Lead within their Marketing Technology team to lead the data and software engineering function across their data space. You would come...

  • Lead Data Engineer

    1 month ago

    London,, UK, United Kingdom Opus Recruitment Solutions Full time

    Lead Data Engineer:AI company£70k Base Salary plus Bonus About the RoleI am exclusively supporting an AI company who are looking for a to take on board a Lead Data Engineer to define the long-term vision and lead execution of the data platform.As Data Engineer you will play a critical role in designing, developing, and maintaining our data infrastructure....

  • Lead Data Engineer

    3 weeks ago

    London, UK, UK, United Kingdom The React Hub Full time

    Role: Lead Data EngineerAbout the role:An exciting opportunity has arisen for an experienced Lead Data Engineer to join the Engineering team within the Digital & Product Department. In this role, the successful candidate will lead a team of data engineers in designing and creating scalable and repeatable data pipelines. This hands-on position involves...

  • Lead Data Engineer

    1 month ago

    London, UK, UK, United Kingdom FinTop Consulting Full time

    About the role:An exciting opportunity has arisen for an experienced Lead Data Engineer to join the Engineering team within the Digital & Product Department. In this role, the successful candidate will lead a team of data engineers in designing and creating scalable and repeatable data pipelines. This hands-on position involves discussing requirements,...

  • Lead Data Engineer

    1 month ago

    London,, UK, United Kingdom Swoop Recruitment Full time

    An exciting opportunity for an experienced Data Engineer to join the Engineering team working within the Digital & Product Department.Location: Chiswick (West London)Work Type: 3 days in office, 2 day from homeSalary: £80k - £100k dependent on experienceThe successful candidate will lead a team of 2 data engineers to design and create scalable data...

  • Lead Data Engineer

    1 month ago

    London,, UK, United Kingdom La Fosse Full time

    Lead Data Engineer - Specialty Manufacturing - £85k-£95k - London (1dpw)La Fosse are working alongside a niche manufacturer, producing, servicing and consulting on essential and life-changing equipment across the globe.With significant investment being pumped into data over the last year and moving from a buy to build model, they are now looking for a...

  • Lead Data Engineer

    1 month ago

    London,, UK, United Kingdom Oliver Bernard Full time

    Senior/Lead Data Engineer - Financial ServciesWe are working with a leading Financial services client, who is on the lookout for a Senior/Lead Data EngineerMainly coding in Kotlin/Python with GitHub and ArgoCD for CI/CDManaging Data PipelinesDeploying apps on AWSWorking in small, agile teams.Technical...

  • Strategy & Data Consultant Engineer

    2 days ago

    London,, UK, United Kingdom she does data. Full time

    Strategy & Data Consultant EngineerWe are on the lookout for a superstar Data Engineer for a start-up scale-up consultancy who are on a mission to change the narrative! You will work on client-facing projects as well as take an active role in the strategic and operational side of our clients business.What you’ll be doing:Supporting the development of...

  • Lead Data Engineer

    1 month ago

    London,, UK, United Kingdom Mirai Talent Full time

    Data Engineering Lead An incredible opportunity to join a fast-growing consultancy who are disrupting the industry! As Data Engineering Lead you will be expected to act as a key figure and technical point of contact in client projects, while playing a major role in growing the team, and by extension, the organisation.Your day-to-day will involve leading our...

  • Lead Data Engineer/Architect

    4 weeks ago

    London,, UK, United Kingdom Cititec Talent Full time

    Our client, a world-leading commodities trading company, is embarking on a monumental digital transformation to become a data-driven organisation. This initiative, spearheaded by top leadership, represents a significant cultural shift and a massive technological overhaul.We seek a Lead Data Integration Engineer/Architect with extensive experience in data...

  • Lead/Principal Data Engineer

    4 weeks ago

    London,, UK, United Kingdom Oliver Bernard Full time

    Lead/Principal Data Engineer - JVM - Java, Kotlin, ETL, Data WarehouseA long-term client of OB's in the consulting space have recently won a long-term project with a Tier 1 Investment Bank and are looking for highly skilled Senior Data Engineers to come and work on an incredibly exciting new greenfield project.This is a large scale Data Warehousing...

  • Lead Data Engineer

    4 weeks ago

    London, UK, United Kingdom Macquarie Group Full time

    The commodities and global markets data analytics team within technology is building a leading data and analytics platform. We partner and build batch and real-time analytics solutions for traders, quants, desk analysts and central data teams across the business. At Macquarie, our advantage is bringing together diverse people and empowering them to shape...

  • Technical Lead

    4 weeks ago

    London, UK, United Kingdom eFinancialCareers Full time

    Technical Lead / Data Engineer City of London Duration: 12 Months Hybrid working Inside IR35 We are currently seeking a Technical Lead/Data Engineer to assist with a large-scale cloud migration project. Data Engineer Must have Advanced SQL Java Big Data Platform HDFS Parquet Web Apps (inc spring boot) Should have Cloudera Data modelling Bash script...

  • Lead Data engineer

    1 week ago

    London,, UK, United Kingdom Coforge Full time

    Role : Lead Data engineerJob Type : Full TimeJob Location : LondonMandatory Skills : SQL, Snowflakes, DBT (Data Build Tool) Job Description:-• Good knowledge of SQL programming.• Strong knowledge of Snowflake Cloud Data warehouse. Snowflake Functions and Procedures.• Good knowledge of Python, DBT.• In-depth understanding of Data Warehouse, ETL...

  • Data Engineering Lead

    2 days ago

    London,, UK, United Kingdom Wanstor Full time

    Are you a passionate, self-motivated data professional ready to take the next big step in your career? At Wanstor, an established IT MSP and respected Microsoft Partner, we're looking for an ambitious individual to help expand our Data, Development, and AI services.This is a unique opportunity to step into a leadership role and make a real impact. If you...

  • Senior/Lead Data Engineer

    1 month ago

    London,, UK, United Kingdom Eden Smith Group Full time

    Senior/Lead Data EngineerLondon (1-2 days per week)/Remote (3-4 days per week)Salary up to £80,000 per annumAn exciting opportunity has arisen to join us here at Eden Smith in a permanent position. Due to expansion, the new Senior Data Engineer will be crucial in building robust data pipelines and data flows for our clients on Azure cloud platforms. They...

  • Lead Data Engineer

    13 hours ago

    London,, UK, United Kingdom Zebra People Full time

    Role title: Senior & Lead Data Engineer contracts (SC Cleared)Duration of role: 6 months (potential to extend)Location: London (Will need to be able to travel to London relatively regularly (eg, weekly to fortnightly)Day rate: £600 per day - INSIDE IR35UK based candidates with full UK residency only pleaseAny extra Clearance requiredSC requiredParagraph...

Lead Data Engineer

3 months ago

London, UK, United Kingdom Swoop Recruitment Full time

An exciting opportunity for an experienced Data Engineer to join the Engineering team working within the Digital & Product Department.


Location: Chiswick (West London)

Work Type: 3 days in office, 2 day from home

Salary: £80k - £90k dependent on experience



The successful candidate will lead a team of 2 data engineers to design and create scalable data pipelines. This hands-on role involves discussing requirements, designing solutions, and coding to automate data ingestion, cleansing, and transformation.



You'll collaborate with Products, Engineering, Data, and Business Analytics teams to understand data requirements and develop integration solutions for necessary migrations. The Data Engineer will support software developers, PowerBI developers, data analysts, and data scientists, ensuring a consistent and optimal data delivery architecture across projects. Self-direction and comfort in supporting multiple teams, systems, and products are essential.


DUTIES & RESPONSIBILITIES


  • Understand, build and develop ETL and data integration solutions using a wide array of technologies and data sources
  • Manage and update the Data Engineering Architecture
  • Analyse and organise raw data from different sources
  • Explore ways to enhance data quality and reliability
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, etc.
  • Work with cloud-based infrastructure (Azure) for hosting data solutions and applications
  • Collaborate with architects, data analysts and data scientists to help meet the business goals


SKILLS REQUIRED

  • Previous experience as a data engineer
  • Proven experience in development and maintenance of ETL/ELT processes within a medallion architecture
  • Good experience in Data Modeling within a cloud-based data platform
  • Strong experience with SQL Server and relational databases
  • Good knowledge of the Azure data engineering stack, including Azure Synapse and Azure Data Lake
  • Programming experience in Python, PySpark and T-SQL
  • Familiarity with the wider Azure Data Solutions such as Azure ML Studio
  • Previous experience with Azure DevOps and understanding of CI/CD
  • Analytical skills related to working with structured and unstructured datasets
  • Excellent written and verbal communication skills
  • Experience supporting and working with cross-functional teams in a dynamic environment