Cloud Data Engineer

17 hours ago


London, Greater London, United Kingdom TESTQ Technologies Limited Full time
Job Description:

We are seeking a highly skilled and experienced Senior AWS Data Engineer to join our team at TESTQ Technologies Limited. As a key member of our data engineering team, you will be responsible for designing, implementing, and optimizing data pipelines for various data integration and transformation tasks using AWS services such as Glue and Athena.

Key Responsibilities:
  • Design and implement scalable data systems, leveraging AWS services like Glue, Athena, Terraform, RDS, and Lambda.
  • Build and maintain data lakes using AWS Glue, ensuring efficient data extraction, transformation, and loading (ETL) processes.
  • Develop and manage Terraform scripts to automate the deployment of AWS infrastructure, ensuring that the data pipeline and lake infrastructure is scalable, reliable, and cost-effective.
  • Collaborate with the data team to create efficient, fault-tolerant, and cost-efficient data processing workflows.
  • Leverage AWS Lambda to create serverless functions for various data processing tasks, ensuring scalability and low-latency performance.


Required Skills and Qualifications:

* 10+ years of overall experience as a Data Engineer or similar role with a strong background in data processing, ETL, and database management.
* 7+ years of hands-on experience with AWS technologies, including but not limited to AWS Glue, AWS Athena, Terraform, AWS RDS, and AWS Lambda.
* Solid experience working with data lakes and data pipelines, especially in AWS ecosystems.
* Strong programming skills in languages such as Python or Scala, with an emphasis on data engineering tasks.

Salary Range: £120,000 - £180,000 per annum. This salary range is based on industry standards and takes into account the candidate's level of experience and qualifications.

  • London, Greater London, United Kingdom Cloud Decisions Full time

    Cloud DecisionsA globally renowned leader in delivering cutting-edge enterprise data engineering projects and programmes for a variety of Private and Public sector organisations, including banking, pharma, and government.Salary: Up to £75k + Up to £10K cash incentives/bonusAbout the Role:We are seeking a highly experienced Data Engineering Manager who will...


  • London, Greater London, United Kingdom Data Idols Full time £80,000 - £90,000

    Data Engineering OpportunityData Idols is seeking a skilled Senior Data Platform Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining a robust data platform using Azure Services.This is an exciting opportunity to work with cutting-edge cloud-based technologies and collaborate...


  • London, Greater London, United Kingdom Cloud Decisions Full time

    Key ResponsibilitiesBuilding and maintaining data pipelinesIdentifying and patching issues and bugs identified in the pipeline/architectureWorking as part of a data specialist team to deliver quality serviceProviding access and identity management to onboard new customers onto the pre-existing platformCommunicating with key stakeholders to define data...


  • London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000

    **Career Opportunity**Join Data Idols as a Senior Data Engineer and take your career to the next level. As a key member of our data function, you will have the opportunity to design, build, and maintain complex data pipelines that drive business growth.The ideal candidate will have a strong background in data engineering, with expertise in cloud-based...


  • London, Greater London, United Kingdom Data Science Festival Full time

    About the RoleAs a Staff Data Engineer at the Data Science Festival, you will play a key role in driving high standards across the data function. You will design, develop, and maintain data pipelines using Python and Azure, and collaborate with the wider data teams to achieve business objectives. The ideal candidate will have extensive experience with data...


  • London, Greater London, United Kingdom Cloud Decisions Full time

    Job DescriptionWe are seeking a highly experienced Data Engineering Manager to join our team in London. As a Data Engineering Manager, you will be responsible for building and maintaining data pipelines, identifying and patching issues and bugs identified in the pipeline/architecture, working as part of a data specialist team to deliver quality service,...


  • London, Greater London, United Kingdom Cloud Decisions Full time

    About the RoleThe Data Engineering Manager will be responsible for delivering high-quality data engineering projects/programmes for a variety of Private and Public sector organisations including banking, pharma and government. The role requires the ability to work with the latest multi-vendor cloud technologies and a proven track record of delivering leading...


  • London, Greater London, United Kingdom Cloud Decisions Full time £95,000

    Job Title: Cloud Data Governance LeadAbout the Role:We are seeking an experienced Cloud Data Governance Lead to join our team at Cloud Decisions. As a key member of our organization, you will play a critical role in designing, implementing, and optimizing data governance and compliance solutions using Microsoft Purview.Responsibilities:- Design and implement...


  • London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000

    **About Data Idols**Data Idols is a renowned retail brand in the UK, seeking an exceptional Senior Data Engineer to drive data transformation. As a Senior Data Engineer at Data Idols, you will play a pivotal role in delivering high-quality data solutions.The ideal candidate will have extensive experience with data pipelines, data warehousing, and cloud-based...


  • London, Greater London, United Kingdom Vantage Data Centers Full time

    We are seeking a skilled Technical Sales Manager to lead the development and execution of advanced technical solutions supporting both pre-sales and technical initiatives.About Vantage Data CentersVantage Data Centers powers the technology of the world's well-known hyperscalers, cloud providers, and large enterprises.The ideal candidate will have proven...


  • London, Greater London, United Kingdom Data Idols Full time £80,000 - £90,000

    About the RoleAs a Senior Data Platform Engineer at Data Idols, you will play a pivotal role in shaping the company's data landscape. With a focus on designing, implementing, and maintaining a robust data platform using Azure Services, you will work closely with cross-functional teams to deliver high-quality data solutions.This is an exciting opportunity to...


  • London, Greater London, United Kingdom NTT DATA Full time

    OverviewWe are a global business empowering local teams, undertaking exciting work that's genuinely changing the world.SalaryAn estimated annual salary of £90,000 to £110,000 based on experience and qualifications.Job DescriptionThe Principal AWS DevOps Engineer will be a critical team member in designing, implementing, and optimising end-to-end DevOps...


  • London, Greater London, United Kingdom Cloud Decisions Full time

    Hybrid RoleThis exciting opportunity requires office presence 2-3 days per week in London. As a successful Data Engineering Manager, you will have relevant commercial experience, team management skills, and expertise in cloud data engineering. You will be responsible for building and maintaining data pipelines, identifying and patching issues, and working as...

  • Cloud Data Engineer

    3 days ago


    London, Greater London, United Kingdom Cognizant Full time

    Cognizant is a leading global professional services company that helps clients drive growth, efficiency, and innovation by transforming their business, operating, and technology models for the digital age. Our expert consultants provide strategic advice and deliver high-quality results to clients across various industries.We are seeking an experienced Cloud...


  • London, Greater London, United Kingdom BASE Media Cloud Limited Full time

    Transformative Cloud Solutions RoleAbout the Opportunity:We are seeking a seasoned Senior Support Engineer to spearhead our cloud engineering efforts and drive the delivery of cutting-edge media solutions. Based in London, this is a full-time role that offers a competitive salary of £80,000 - £100,000 per annum.Job Description:This pivotal role requires a...

  • Cloud Data Engineer

    3 days ago


    London, Greater London, United Kingdom Burns Sheehan Full time £85,000 - £105,000

    Job Title: Cloud Data EngineerAbout the Role:We are seeking a skilled Cloud Data Engineer to join our team at Burns Sheehan. The successful candidate will be responsible for designing, implementing, and maintaining large-scale data architectures on cloud platforms.About You:To be successful in this role, you will have experience with cloud-based data...

  • Cloud Data Engineer

    3 weeks ago


    London, Greater London, United Kingdom Freshtechit Full time

    Freshtechit: Unlocking Your Data PotentialWe are seeking an exceptional Cloud Data Engineer to join our team in Central London. This is a fantastic opportunity for a skilled professional with a passion for scalable data solutions and a talent for leading the execution of data platforms.About the Role:The successful candidate will be responsible for defining...


  • London, Greater London, United Kingdom Data Careers Ltd Full time

    We are seeking a highly skilled Cloud Data Platform Specialist to join our team. As a Cloud Data Platform Specialist, you will play a key role in the presales process, working closely with our Sales Team to identify customer needs and design innovative solutions.Your expertise in cloud-based data platforms, such as Azure Data Platform, and your ability to...

  • Cloud Data Engineer

    3 days ago


    London, Greater London, United Kingdom Conexus Full time

    Job DescriptionWe are seeking an experienced Cloud Data Engineer to join our team at Conexus in London.Key Responsibilities:Design, develop, and optimize cloud-based data architectures using Microsoft Azure.Develop and maintain data models, data lakes, and data warehouses.Ensure data governance and compliance with security standards.Collaborate with...


  • London, Greater London, United Kingdom Regal Cloud Full time £80,000

    Regal Cloud is seeking a highly experienced Cloud Architect to lead our cloud engineering team.We are looking for an expert in cloud architecture with a strong track record of delivering complex cloud-based solutions. As a key member of our team, you will be responsible for designing and implementing scalable, secure, and efficient cloud architectures that...