Current jobs related to Senior Data Engineer - London, UK - Undisclosed

  • Senior Data Engineer

    1 month ago

    London,, UK, United Kingdom Found By Few Full time

    Senior Data Engineer – 6 months - £650-£850 per day (outside IR35) - London Contract Senior Data Engineer required to join a leading AI Research and Product Development Lab backed by highly successful Asset Management firm.This role will suit a Data Engineer who has exceptional ETL/Data Pipeline building experience and is motivated by working with...

  • Senior Data Engineer

    4 days ago

    London,, UK, United Kingdom Understanding Recruitment Full time

    Senior Data Engineer | IoT | Flex RemoteUp to £85,000 per annum (DOE) | Mostly remote, with meetups in London (1x per month or quarterly)I am looking for a Senior Data Engineer to join a cutting edge start-up that’s leading the charge in IoT, and data-driven services across Europe!They are revolutionising the driving experience with cutting-edge in-car...

  • Senior Data Platform Engineer

    4 weeks ago

    London,, UK, United Kingdom Oho Group Ltd Full time

    Senior Data Platform Engineer - High-Growth Start Up A Tech for Good start up are looking for a Senior Data Platform Engineer to take the lead in building a cutting-edge data platform from the ground up. As a Senior Data Platform Engineer you'll play a key role be the driving force behind their data platform, leading the design and development of...

  • Senior Data Engineer

    2 months ago

    London,, UK, United Kingdom Peaple Talent Full time

    Senior Data Engineer | Fully Remote | up to £60,000Peaple Talent have partnered with a leading provider of land and property search information, who provide a range of services across digital mapping, environmental risk reports and sophisticated property management tools.Due to exciting growth plans in the Data team we are now seeking a selection of Senior...

  • Senior Data Engineer

    2 months ago

    London,, UK, United Kingdom numi Full time

    Join a Deep Tech AI company with FAANG Leaders - Senior Data Engineer - Up to £100,000 Welcome to a world where data drives enterprise transformation with precision and innovation.Are you ready to join a cutting-edge company that's revolutionizing decision-making with its advanced AI platform?With their AI-driven solutions, they empower businesses to...

  • Senior Data Engineer

    4 days ago

    London,, UK, United Kingdom MarkJames Search Full time

    We are seeking a highly experienced Senior Data Engineer to lead and design complex data flows and pipelines. This role involves working across operational systems, data analytics, and BI systems, ensuring seamless integration and high-quality data solutions. If you have a strong background in data engineering and hold SC clearance, we’d love to hear from...

  • Senior Data Engineer

    4 weeks ago

    London,, UK, United Kingdom In Technology Group Full time

    Title: Senior Data Analytics EngineerLocation: London (3 days a week onsite in Central district) Salary: Up to £80,000 DOEAre you ready to utilise your skills in data analysis and drive meaningful insights for one of the UK’s leading retail companies? Do you have knowledge of SQL, DBT, Snowflake and data modeling? Join us as a Data Analytics EngineerThe...

  • Data Engineer

    4 weeks ago

    London,, UK, United Kingdom Higher - AI recruitment Full time

    OVO Group is a leading energy technology company determined to create a world with clean, affordable energy for everyone. Since launching in 2009, they have welcomed over a million members, planted a million trees, and set their sights on helping save the planet. They are on a mission to change energy for the better, including driving progress towards the...

  • Data Engineer

    3 weeks ago

    London,, UK, United Kingdom Higher - AI recruitment Full time

    OVO Group is a leading energy technology company determined to create a world with clean, affordable energy for everyone. Since launching in 2009, they have welcomed over a million members, planted a million trees, and set their sights on helping save the planet. They are on a mission to change energy for the better, including driving progress towards the...

  • Senior Java Developer Data Engineering

    5 months ago

    London, UK, United Kingdom JJA - James Joseph Associates Full time

    Our client is looking for the very best and you will be working with an exceptionally talented team with a flat management structure. This will be a business facing role where you are given the freedom to build solutions in the way you see fit to ensure that your front office clients have the tools, they need to enhance profitability. In return they are...

  • Senior Data Engineer

    4 weeks ago

    London,, UK, United Kingdom In Technology Group Full time

    Role: Data Engineering Manager Salary: up to £90,000 DOELocation: London, Hybrid 3 days a week onsiteReady to utilize your engineering management experience? Are you passionate about building scalable data infrastructure?Join us as a Data Engineering Manager!They are a purpose-led transformation company, built on belief. We do not just help businesses to...

  • Data Engineer

    1 month ago

    London,, UK, United Kingdom The IN Group Full time

    Role: Senior Data EngineerLocation: London (2x per week onsite)Calling all data engineers with experience in Apache Spark, Scala and ideally commercial and enterprise applications!We are currently supporting a leading SaaS provider, based in London, who are on an exciting journey of transformational growth. As a business, they are a product focused company,...

  • Senior Data Engineer

    2 months ago

    London, UK, United Kingdom Transact Full time

    Job Description We are currently recruiting an exciting opportunity for a Senior Data Engineer with significant advanced experience to join our Business Intelligence team. As the business looks to take an increasingly data driven approach to change, we are expanding the team to provide additional capabilities and support, ensuring we continue to deliver...

  • Senior Data Engineer

    1 month ago

    London,, UK, United Kingdom Recruitment Gamechangers Full time

    Senior Data EngineerSalary: £60-75k (plus very attractive bonus on top)Location: London/Leeds (hybrid working or fully remote an option, if preferred)*We are looking to fill 2 roles. Please only apply if you have a strong interest in sports analytics/betting, you will be asked questions on this*Purpose of role:We have an exciting opportunity for a Senior...

  • Data Engineer

    1 month ago

    London,, UK, United Kingdom Collabera Digital Full time

    We are looking for a Senior Azure Data Engineer to join an existing team building a new strategic big data platform for our client.Minimum 5 years of experience with Azure Data Factory, Databricks, Data Mesh.The new platform will be an Azure based data lake with APIs and events to allow consumption of data by analytics teams and will replace the existing...

  • Senior Data Engineer Python Spark AWS

    4 days ago

    London, UK, UK, United Kingdom Client Server Full time

    Senior Data Engineer (Python Spark AWS) Remote UK to £90kAre you a tech savvy Data Engineer with strong Python coding skills?You could be progressing your career in a senior, hands-on Data Engineer role as part of a friendly and supportive international team at a growing and hugely successful European car insurance tech company as they expand their UK...

  • Senior Data Engineer

    5 days ago

    London, UK, United Kingdom Rightmove Full time

    Millions of people visit the Rightmove website every day, to view more property listings than any other portal in the UK. We have a huge amount of data describing how people use our site, and what this means to our customers. Rightmove also has significant existing data infrastructure, across Google Cloud, on-premises and in SaaS environments. This role will...

  • Data Engineer

    1 month ago

    London,, UK, United Kingdom IWSR Full time

    Data Engineer – Price Data TeamRemuneration: Competitive salary plus bonusLocation: London, SE1, with an established hybrid working policyProducts: The world’s leading data source for the beverage alcohol industryThis is an exciting opportunity for a Data Engineer to work within our Price Data team and collaborate with the Research teams globally. IWSR...

  • Senior Data Scientist

    5 days ago

    London, UK, United Kingdom Zopa Bank Full time

    We started our journey back in 2005, building the first ever peer-to-peer lending company. Fast forward to 2020 and we launched Zopa Bank. A bank that listens to what our customers don’t like about finance and does the opposite. We’re redefining what it feels like to work in finance. Our vision for a new era of banking puts people front and centre —...

  • Data Engineer

    4 days ago

    London,, UK, United Kingdom MarkJames Search Full time

    Location: London (Hybrid - 2 to 3 days in the office)Contract Duration: 6 months (with potential for extension)We are looking for a skilled Data Engineer to join our team on a contract basis. This is an exciting opportunity for someone with experience in designing and implementing data pipelines and data stores, and ensuring data quality. You will be part of...

Senior Data Engineer

2 months ago

London, UK, United Kingdom Undisclosed Full time

Senior Data Engineer - GCP, Python, ML

The location of the role is London (hybrid working/remote).

The duration of the contract is 6 months.

The pay rate on offer is £500 - £550 per day (via Umbrella).


Key accountabilities of the role

  • Execute migration of raw and derived datasets between on-prem and cloud data locations (e.g. GCP, Azure, AWS). Datasets magnitude vary between small scale (Gb) up to large scale (Tb).
  • Ensure consistency between the data ingested and the data manifests.
  • Organise raw and derived data into appropriate hierarchies.
  • Collaborate with AI/ML engineers and product managers to
  1. Develop data pipelines for incoming batch data and update existing pipelines where necessary.
  2. Design and implement well decoupled, modularized, reusable, and scalable scripts and code for the retrieval and pre-processing of large-scale histopathology images into the AI/ML pipeline (i.e. each one with order of magnitude of gigabytes)
  • Document data flows and ingestion pipelines, data use and re-use
  • Implement data flows to connect operational systems, data for analytics and business intelligence (BI) systems (e.g. Power-BI)
  • Ensure completion of requisite documentation i.e. ingestion form and any related IHD documentation
  • Track & report completion of data migration to AIML & Onyx stakeholders and raise blockers preventing migration.
  • Migrate ML pipelines from on-prem HPC solutions to the cloud.
  • Migrate ML pipelines between cloud environments and across cloud computing providers.
  • Optimise and parallelise said ML pipelines for scalability, speed and cost efficiency.


Key skills and experience

  • 5+ years of work experience as a professional data/software engineer.
  • Machine learning experience / background
  • CICD experience
  • Expert level and industrial experience in design, development and deployment of data engineering pipelines.
  • Advanced programming expertise in Python and in developing and delivering robust software solutions.
  • Advanced programming expertise in SQL and/or similar database languages.
  • Experience with cloud platforms, such as Google Cloud Platform, Azure, AWS (preference GCP)
  • Experience in handling big data at scale.
  • Experience with large-size images and data formats for computational pathology would be a plus (e.g. .svs, .tiff, .h5).
  • Experience with business intelligence platforms, e.g. Power-BI