Cloud-Based Data Engineering Professional

2 weeks ago


London, Greater London, United Kingdom TalentHawk Full time £500
About the Role:

TalentHawk is seeking an experienced Cloud-Based Data Engineering Professional to join our team. As a senior member of our data engineering team, you will be responsible for designing and implementing complex data solutions using cloud-based technologies.

The ideal candidate will have expertise in AWS Glue, PySpark, Apache Kafka, and MySQL, with experience in managing large-scale data lakes on S3. You will work closely with our business intelligence team to ensure seamless integration with their dashboards and reports.

This role involves managing and optimizing AWS-based data processes, orchestrating data flows, and supporting business intelligence capabilities. You will maintain MySQL databases on AWS (approx. 25TB) as primary data sources feeding the data pipeline, utilize Apache Kafka to manage data flows from MySQL into AWS S3 buckets, and implement ETL processes using AWS Glue and PySpark to build data lakes within S3 for further analysis.

We estimate the salary for this position to be around £500 per day, based on industry standards for similar roles in remote locations.

Responsibilities:
  1. Design and implement complex data solutions using cloud-based technologies
  2. Manage and optimize AWS-based data processes
  3. Orchestrate data flows and support business intelligence capabilities
  4. Maintain MySQL databases on AWS
  5. Utilize Apache Kafka for real-time data ingestion
  6. Implement ETL processes using AWS Glue and PySpark


  • London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000

    **Career Opportunity**Join Data Idols as a Senior Data Engineer and take your career to the next level. As a key member of our data function, you will have the opportunity to design, build, and maintain complex data pipelines that drive business growth.The ideal candidate will have a strong background in data engineering, with expertise in cloud-based...


  • London, Greater London, United Kingdom Data Science Festival Full time

    We are seeking a highly skilled Cloud-Based Data Architect to join our talented, collaborative team and contribute to shaping the data landscape.About the TeamYou'll be working alongside a group of experts who are passionate about building, optimising, and securing scalable data infrastructure using cutting-edge cloud-based technologies.In this role, you'll...


  • London, Greater London, United Kingdom Data Science Festival Full time

    About the OpportunityAt the Data Science Festival, we are committed to driving innovation and excellence in data engineering. We are seeking a Cloud Data Engineering Lead to join our team and play a key role in shaping our data strategy.Key ResponsibilitiesDevelop and implement data pipeline architectures using modern cloud technologiesLead cross-functional...


  • London, Greater London, United Kingdom HCLTech Full time

    We are seeking a highly skilled Cloud-Based Data Professional to join our team in the Banking & Financial Services sector. With over 219,000 employees across 54 countries, we deliver industry-leading capabilities centered on digital, engineering and cloud.The ideal candidate will have a strong background in databases, SQL expertise, and experience with Big...


  • London, Greater London, United Kingdom Cloud Decisions Full time

    **About the Role**This is an exciting opportunity for a seasoned Data Engineering Manager to lead our team's efforts in delivering cloud-based data solutions. The ideal candidate will have a strong track record of managing teams, developing cloud data engineering projects, and working with cloud platforms.**Responsibilities**Develop and maintain data...


  • London, Greater London, United Kingdom BGL Group Full time

    Job Description:We are seeking a highly skilled Cloud-Based Data Engineer to join our team. As a Cloud-Based Data Engineer, you will be responsible for designing and implementing scalable data architectures that support business growth.Key Responsibilities:Design and implement data pipelines and workflows that enable reliable and efficient data...


  • London, Greater London, United Kingdom WeShape Full time

    About the OpportunityWe are looking for a highly skilled Cloud-Based Data Engineer to join our team at WeShape. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing our real-time data platform.Key ResponsibilitiesDesign and implement data pipelines and streaming systems using cloud-based data...


  • London, Greater London, United Kingdom Artemis Recruits Full time

    We are currently looking for a Cloud-Based Data Engineer to join one of our esteemed clients. As a Cloud-Based Data Engineer, you will play a crucial role in designing, developing, and maintaining an infrastructure for streaming, processing, and storage of data in the cloud.">Key Responsibilities:">">Design, develop, and maintain an infrastructure for...


  • London, Greater London, United Kingdom TwentyAI Full time

    Cloud-Based Data Engineering OpportunityWe are seeking a talented Cloud-Based Data Engineer to join our team at TwentyAI. The ideal candidate will possess extensive knowledge of AWS serverless environments, Python programming languages, and ETL processing techniques.About the RoleThis is an exciting opportunity to work on large-scale data projects.You will...


  • London, Greater London, United Kingdom DELIVEROO Full time

    Senior Analytics Professional RoleWe are seeking an experienced Senior Analytics Professional to join our analytics engineering team as a Cloud-Based Data Specialist. The ideal candidate will have 6+ years of experience in Analytics Engineering / Data Engineering / BI Engineering and possess a strong understanding of data warehousing, data modelling...


  • London, Greater London, United Kingdom Arcus Search Full time

    Cloud-Based Data EngineerArcus Search is committed to advancing towards a global circular economy by addressing sustainability from the perspectives of people, the planet, and finance.We're looking for a talented Cloud-Based Data Engineer to join our new data team.This is an exciting opportunity to be part of building a scalable data infrastructure from the...


  • London, Greater London, United Kingdom Cloud Decisions Full time £65,000

    Lead Engineer OpportunityWe are seeking an experienced Azure Cloud Professional to join our team as a Lead Engineer. As a key member of our Cloud Decisions team, you will play a critical role in designing and implementing secure, scalable cloud solutions on Microsoft Azure.Key ResponsibilitiesDesign and deploy secure, high-performance solutions on Azure....


  • London, Greater London, United Kingdom Xcede Recruitment Solutions Full time

    Job Title: Cloud Data Engineering ProfessionalXcede Recruitment Solutions is looking for an experienced Cloud Data Engineering Professional to lead the development of scalable data architectures.About the Company:A successful AI Scale Up in Medical Technology/Digital Health, hiring for a Data Engineer with a focus on optimising data architecture and building...


  • London, Greater London, United Kingdom Data Intellect Full time

    Lead Data Engineer & ArchitectWe are looking for a highly skilled Cloud Data Architect Lead to lead our Databricks practice and drive innovation in data-driven solutions. This role requires experience in designing and deploying large-scale data pipelines, ETL processes, and data lakes using Databricks.The successful candidate will have a solid understanding...


  • London, Greater London, United Kingdom X4 Engineering Full time £900

    X4 Engineering is seeking a Cloud and Data Expertise professional to join their team on a 12-month contract (with likely extension).As a Digital Solution Architect, you will provide end-to-end accountability for the architecture of IT projects. You will address and integrate aspects of Business Process, Data, Application/Cloud, Technical, and Information...


  • London, Greater London, United Kingdom Data Idols Full time

    Job DescriptionAs a Senior Data Engineer at Data Idols, you will be responsible for building and maintaining high-quality data solutions that meet business needs. Your primary focus will be on designing and implementing data pipelines using modern cloud technologies, ensuring seamless data integration and insights delivery.Key ResponsibilitiesDesign and...


  • London, Greater London, United Kingdom Data Science Festival Full time

    About the RoleAs a Staff Data Engineer at the Data Science Festival, you will play a key role in driving high standards across the data function. You will design, develop, and maintain data pipelines using Python and Azure, and collaborate with the wider data teams to achieve business objectives. The ideal candidate will have extensive experience with data...


  • London, Greater London, United Kingdom Macquarie Bank Limited Full time

    **Cloud-Based Data Engineering Opportunities**Are you an experienced AWS Cloud Engineer looking for a new challenge? Do you have a passion for designing, developing, and implementing cloud-based data pipelines, data lakes, and real-time analytics solutions?As a senior Data Engineer at Macquarie Bank Limited, you will be part of the Commodities and Global...

  • Cloud Data Architect

    2 weeks ago


    London, Greater London, United Kingdom Data Idols Full time

    **Cloud Data Architect Role at Data Idols**We are looking for a highly skilled Cloud Data Architect to join our team and drive the design and implementation of our cloud-based data architecture. As a key member of the team, you will be responsible for building pipelines to deliver insights that enable informed decision-making.In this role, you will...


  • London, Greater London, United Kingdom Computappoint Full time £90,000

    Job Description:We're looking for a seasoned Data Engineer to help us develop and maintain our cloud-based data platforms. The ideal candidate will have extensive experience working with Big Data (Hadoop/Hive/Spark) and Cloud technologies.Your Tasks:• Design, implement, and maintain scalable data engineering solutions• Collaborate with our...