Cloud Data Pipeline Developer

1 week ago


London, Greater London, United Kingdom Aqovia Full time
About Aqovia

We are a forward-thinking technology company driven by social impact and purpose, focusing on mitigating the existential threat posed by climate change.

Our platforms enable clients to reduce their costs in achieving Net-zero by providing modules to plan, procure, and manage their Net-zero targets with minimal price impact.

We pride ourselves on employing the best and brightest technologists, energy experts, and leaders.

Role Overview

This is an exciting opportunity to join our consulting projects team as a Data Engineer.

You will be responsible for designing and building ETL data pipelines, developing and managing real-time and batch data pipelines, and providing technical support and mentorship to other team members.

The estimated salary for this role in London is £80,000 - £110,000 per annum.

Responsibilities
  • Design and develop ETL data pipelines to load customer data into the platform.
  • Manage and maintain real-time and batch data pipelines to meet evolving business needs.
  • Provide technical guidance and support to other team members on standards, problem-solving, and best practices.
  • Implement data solutions using APIs.
Tech Requirements
  • Expertise in building, testing, and deploying data pipelines on the Azure platform.
  • Proficient in Databricks, Parquet, on-prem to cloud migrations, and both SQL and NoSQL data stores.
  • Experience in data deduplication, transformation, and conformance from source to target structures.
  • Strong knowledge of building and supporting batch and real-time data pipelines.
  • Ability to implement solutions to improve observability, findability, data privacy, and other data governance and architectural concerns.
  • Proficient in logical and physical data modeling and the detailed physical design of data storage solutions.
  • Experience in implementing data transformation rules for batch and streaming data in SQL and Python.
  • Experience in software development and cloud computing.


  • London, Greater London, United Kingdom Cloud Decisions Full time

    Cloud DecisionsA globally renowned leader in delivering cutting-edge enterprise data engineering projects and programmes for a variety of Private and Public sector organisations, including banking, pharma, and government.Salary: Up to £75k + Up to £10K cash incentives/bonusAbout the Role:We are seeking a highly experienced Data Engineering Manager who will...


  • London, Greater London, United Kingdom Data Science Festival Full time

    We are recruiting a Highly Skilled Data Pipeline Specialist to join our team at the Data Science Festival. This role involves designing and developing data pipelines using Azure cloud platform, maintaining and improving existing data solutions, and collaborating with wider data teams to ensure delivery of high-quality data insights.About YouThe ideal...


  • London, Greater London, United Kingdom Hyre AI Limited Full time

    In pursuit of a more sustainable tomorrow, we're recruiting a Cloud-Native Data Pipeline Architect to help shape the future of ESG management solutions. This critical role involves designing, implementing, and maintaining robust data pipelines that efficiently collect, process, and store data from multiple sources.Applicants should hold 3+ years of...

  • Senior Data Engineer

    1 month ago


    London, Greater London, United Kingdom Time Out Group Plc Full time

    Job Title: Senior Data Engineer - Cloud Data PipelinesLocation: Remote (with occasional visits to our London office)Department: Product & EngineeringReporting to: Scrum MasterRole Overview:We are seeking a talented Data Engineer to join our team and play a key role in building and maintaining our data infrastructure on Google Cloud Platform (GCP) with a...


  • London, Greater London, United Kingdom Data Science Festival Full time

    We are seeking a talented Senior Data Solutions Developer to join our team at the Data Science Festival. This role involves building and maintaining reliable and high-quality data solutions, supporting the team in building pipelines to deliver insights, and enabling the company to be more data-driven with their decision making.About the RoleThe ideal...


  • London, Greater London, United Kingdom KE Technology Full time

    We are KE Technology, a pioneering AI business transforming the industry with cutting-edge technological solutions. Our next-generation products are designed to be accessible and easy to operate.Job OverviewWe are seeking an experienced Senior Cloud ML Pipeline Engineer to join our team. As a key member of our engineering department, you will play a crucial...


  • London, Greater London, United Kingdom Data Intellect Full time

    Job SummaryWe are seeking a highly skilled Cloud Data Engineering Team Lead to spearhead our Databricks practice. This is a leadership role responsible for driving the growth, innovation, and successful delivery of cloud-based data solutions for our clients leveraging Databricks.Key ResponsibilitiesPractice LeadershipDevelop and lead the Databricks practice,...


  • London, Greater London, United Kingdom NTT DATA Full time

    OverviewWe are a global business empowering local teams, undertaking exciting work that's genuinely changing the world.SalaryAn estimated annual salary of £90,000 to £110,000 based on experience and qualifications.Job DescriptionThe Principal AWS DevOps Engineer will be a critical team member in designing, implementing, and optimising end-to-end DevOps...


  • London, Greater London, United Kingdom Cognitive Group | Part of the Focus Cloud Group Full time

    Job OverviewCognitive Group | Part of the Focus Cloud Group is seeking an experienced Cloud Software Development Specialist to join their team. This is a 1-month contract with long-term extensions available.About the RoleAs a Cloud Software Development Specialist, you will be responsible for rearchitecting a multi-VM Azure architecture into a single VM and...


  • London, Greater London, United Kingdom Abound Full time

    Your New RoleWe are seeking an experienced Data Engineer to join our team at Abound, a leading player in consumer lending. The successful candidate will be responsible for designing, building, and maintaining ETL pipelines to support our data-driven business decisions.The role involves working closely with data scientists, analysts, and other stakeholders to...


  • London, Greater London, United Kingdom Hexegic Full time

    Data Pipelines Specialist: We're looking for an experienced data engineer to join our team as a data pipelines specialist. As a data pipelines specialist, you'll be responsible for designing, building, and maintaining data pipelines and applications using Python or similar languages, API awareness for data retrieval and integration, front-end/user-facing...

  • Data Strategist

    1 week ago


    London, Greater London, United Kingdom Monte Carlo Data, Inc. Full time

    About Monte Carlo Data, Inc.A data reliability company that's mission-critical for businesses to power digital products and drive better decision-making. Our end-to-end Data Observability platform has been recognized as a Best Workplace for 2024, a DBTA Readers Choice for Best Data Observability Solution for 2024, a G2 Best Product for 2023, and the 'New...

  • Cloud Data Architect

    2 weeks ago


    London, Greater London, United Kingdom Amazon Development Centre (London) Limited Full time

    We are seeking an experienced Cloud Data Architect to join our team at Amazon Development Centre (London) Limited.Job DescriptionA key aspect of this role is working closely with cross-functional teams to design, build and deploy large-scale cloud-based data systems. This will involve collaborating with our engineers to develop and implement new data models,...


  • London, Greater London, United Kingdom Fifty-Five Full time

    About Fifty-FiveFifty-Five is a leader in the field of data analytics, providing cutting-edge solutions to help businesses make informed decisions. Our team of experts is dedicated to delivering high-quality data solutions that meet the evolving needs of our clients.We are currently seeking an experienced Cloud Data Scientist to join our team. This role will...


  • London, Greater London, United Kingdom Deerfoot IT Resources Full time

    About Deerfoot IT ResourcesWe are a leading provider of cloud data solutions, and we are seeking an experienced Cloud Data Engineer to join our team.Job DescriptionThis is a remote/hybrid position that offers flexibility across our UK offices. As a Cloud Data Engineer, you will play a key role in driving our customers' digital and data transformation journey...


  • London, Greater London, United Kingdom Freshtechit Full time

    Freshtechit: Unlocking Your Data PotentialWe are seeking an exceptional Cloud Data Engineer to join our team in Central London. This is a fantastic opportunity for a skilled professional with a passion for scalable data solutions and a talent for leading the execution of data platforms.About the Role:The successful candidate will be responsible for defining...


  • London, Greater London, United Kingdom Harnham Full time

    Job Title: Cloud Platform DeveloperCompany Overview: Harnham is a leading international retailer with a strong presence in over 30 countries.Job Summary: We are seeking a highly skilled Cloud Platform Developer to join our growing Data and Analytics team. The successful candidate will be responsible for the development and maintenance of our cloud platform...

  • Data Consultant

    3 weeks ago


    London, Greater London, United Kingdom Sparta Global Full time

    About Sparta GlobalAt Sparta Global, we empower individuals to embark on transformative careers in the tech industry. Our commitment to diversity, innovation, and passion for technology creates a dynamic environment where you can thrive.About this roleAs a Data Consultant, you will become versatile in a wide array of tools across topics covering data-focused...

  • Cloud Data Engineer

    1 week ago


    London, Greater London, United Kingdom Luxoft Full time

    We are seeking a talented Cloud Data Engineer to join our team at Luxoft. As a key member of our Group Risk IT Concorde program, you will play a crucial role in designing and implementing modern, scalable data solutions using a range of new and emerging technologies.About the RoleIn this position, you will be responsible for developing and supporting the AWS...


  • London, Greater London, United Kingdom Boston Hale Full time

    Data Engineer - Cloud Data SolutionsAt Boston Hale, we are seeking an experienced Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines and infrastructure to support business intelligence and analytics.Key Responsibilities:Design and develop data pipelines to extract, transform,...