AWS Data Engineering Lead

3 days ago


London, Greater London, United Kingdom TalentHawk Full time £500

We are seeking a highly skilled Data Engineer to join our team at TalentHawk, responsible for leading the development of data pipelines, implementing ETL processes, and collaborating with stakeholders to deliver high-quality business intelligence capabilities.

Key Responsibilities:

  • Develop and implement data pipelines using Apache Kafka to manage data flows from MySQL into AWS S3 buckets.
  • Implement ETL processes using AWS Glue and PySpark to build data lakes within S3 for further analysis.
  • Facilitate data availability for Business Intelligence purposes, supporting daily updates and aiming to move from overnight batch jobs to near-real-time 15-minute refreshes.
  • Collaborate on BI dashboard and reporting creation to provide actionable insights.

Requirements:

  • Proficiency with MySQL, Apache Kafka, AWS Glue, PySpark, and AWS S3.
  • Experience in designing and maintaining BI reports and dashboards with frequent data refresh capabilities.
  • Skilled in reconciling transactional data across diverse systems, operators, and currencies.

Salary: Approximately £500 Per Day



  • London, Greater London, United Kingdom Data Science Festival Full time

    Job SummaryWe are seeking a skilled AWS Data Engineer to join our team at Data Science Festival. This is a fully remote opportunity with an estimated salary range of £80,000 - £110,000 per annum.The successful candidate will be responsible for building and maintaining reliable data pipelines, collaborating with the wider data teams, and driving high...


  • London, Greater London, United Kingdom Charlotte Tilbury Beauty Ltd Full time

    About the Role:We are seeking an experienced AWS Cloud Data Engineering Lead to join our team at Charlotte Tilbury Beauty Ltd. This is a fantastic opportunity to lead architectural decisions, provide technical leadership, and mentor colleagues in data engineering.Key Responsibilities:Lead the design, development, implementation, and maintenance of data...


  • London, Greater London, United Kingdom Curveanalytics Full time

    Job DescriptionWe're looking for an experienced AWS Lead Data Engineer to join our Technology Practice, leading the design, build and deployment of innovative data solutions, in the cloud, from scratch.The ideal candidate will have a proven track record of developing leading data solutions in cloud environments, with experience working with Databricks,...


  • London, Greater London, United Kingdom Harnham Full time £55,000 - £65,000

    Lead AWS Data SpecialistSalary estimate: £62,000 - £72,000 per annumHarnham is currently seeking an experienced Lead AWS Data Specialist to join our team. As a senior member of our product engineering organisation, you will be responsible for designing and implementing best practices in data engineering using big data tools like Spark and Python.About the...


  • London, Greater London, United Kingdom Ogury Ltd Full time

    Ogury Ltd is a global leader in AdTech, empowering brands and publishers with cutting-edge data solutions.We're seeking an exceptional AWS Data Engineering Director to spearhead our data platform strategy, driving innovation and excellence across the organization.The ideal candidate will possess a strong background in cloud-based data engineering, with...

  • AWS Technical Lead

    2 days ago


    London, Greater London, United Kingdom Woolf GroupPython AWS Platform Dev Full time

    Job Description: As an AWS technical lead, you will be part of a team responsible for designing, implementing, and maintaining advanced cloud infrastructure at Woolf GroupPython AWS Platform Dev. The ideal candidate will have experience in cloud engineering and advanced analytical skills.Main ResponsibilitiesDesign and implement scalable cloud...

  • Data Engineer

    4 weeks ago


    London, Greater London, United Kingdom Data Privacy Full time

    About UsHouseful is a leading property technology company known for its innovative approach to the property market. With brands like Zoopla, Alto, Hometrack, Calcasa, Mojo, and Prime location, we leverage software, data, and insights to drive progress in the industry.Company OverviewWe're committed to helping everyone make informed decisions about their...


  • London, Greater London, United Kingdom amber labs Full time

    Job Title: AWS DevOps Engineer Lead">Location: Remote - must be UK based">Work Pattern: Full Time/FTC">At Amber Labs, we are a leading technology consultancy that prioritises innovation, collaboration, and client satisfaction.">We are seeking an experienced Lead AWS DevOps Engineer to join our dynamic team. As a key member of our team, you will be...


  • London, Greater London, United Kingdom Harnham Full time £75,000 - £95,000

    Exciting Opportunity for a Senior Data EngineerWe are a fast-growing e-commerce trading company based in London, and we're looking for an experienced Senior Data Engineer to join our expanding Data and Analytics team. The ideal candidate will have a strong background in data engineering and experience with AWS, Python, and Kafka.About the RoleAs a Senior...


  • London, Greater London, United Kingdom ITV Full time

    AWS Data Infrastructure Manager OpportunityWe are looking for an experienced Lead AWS Data Infrastructure Manager to join our team at ITV. As a key member of our cloud infrastructure team, you will be responsible for designing and building scalable data pipelines and products using Databricks.This role involves leading a team of data engineers and...

  • AWS Data Engineer

    3 days ago


    London, Greater London, United Kingdom Accelero Full time £65,000

    Average salary: £80,000 - £110,000 per annumAt Accelero, we're on a mission to revolutionize education through advanced data insights. As an AWS Data Engineer, you'll play a critical role in shaping the way education data is processed and utilized.We're looking for an experienced Data Engineer to join our team in London. In this role, you'll design, build,...

  • AWS Engineering Lead

    3 hours ago


    London, Greater London, United Kingdom Veeva Systems, Inc. Full time

    At Veeva Systems, Inc., we're committed to revolutionizing the life sciences industry by building connected data applications that improve research and patient outcomes.Our Veeva Link platform supports professionals in finding relevant people, such as clinical trials, education programs, or advisory boards.This streamlined access helps reduce time-to-market...


  • London, Greater London, United Kingdom DataCareers Full time £65,000 - £75,000

    Data Engineer RoleWe are seeking a highly skilled Data Engineer to join our team at DataCareers. The successful candidate will be responsible for designing, building, and maintaining efficient data pipelines to process and transform raw data into structured data products.This is a key role in the development of our organization's analytics platform, and we...


  • London, Greater London, United Kingdom Flint Technology Services Ltd Full time

    Job Title: Data Engineering Cloud LeadType: ContractThe successful candidate will be responsible for overseeing the migration of our data infrastructure to Amazon Web Services (AWS), ensuring seamless integration and delivery across various business units. This involves managing a high-performing team of data engineers, architects, and cloud specialists, as...

  • Data Engineering Lead

    6 hours ago


    London, Greater London, United Kingdom Domestic & General Service GmbH Full time

    At Domestic & General Service GmbH, we are expanding our horizons and seeking a highly skilled Data Engineering Lead to join our technology team. As a key member of our data engineering team, you will play a critical role in designing, developing, and maintaining highly scalable and performant data infrastructures. This exciting opportunity is perfect for an...

  • AWS Data Engineer

    4 weeks ago


    London, Greater London, United Kingdom Abound Full time

    Abound: A Leading Player in Consumer LendingWe are seeking a highly motivated Data Engineer to be a key member of our team, responsible for the deployment and maintenance of our data infrastructure. The ideal candidate will have experience in building and maintaining ETL pipelines and data warehouses.Our company, Abound, is a leading player in consumer...


  • London, Greater London, United Kingdom MRJ Recruitment Full time £70,000 - £80,000

    Transform Healthcare with Cutting-Edge Technology">We are seeking a talented Data Engineering Lead to join our team at MRJ Recruitment. As a key member of our HealthTech SaaS brand, you will be responsible for designing and developing robust data pipelines on AWS.With a strong focus on healthcare data, you will optimise data warehouse performance, ensure...

  • AWS Technical Lead

    3 days ago


    London, Greater London, United Kingdom Trafigura Full time

    Job Description:We are seeking an AWS Technical Lead to join our team at Trafigura. As an AWS Technical Lead, you will be responsible for developing and implementing our cloud strategy on AWS.This role requires strong experience with cloud services, including AWS IAM, data and analytics services, and automation tools like Ansible.You will collaborate with...


  • London, Greater London, United Kingdom ZipRecruiter Full time

    Job Overview:ZipRecruiter is seeking an experienced AWS Cloud Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, implementing, and managing data solutions using various AWS services.Main Responsibilities:Leverage your expertise in working with AWS services and tools to design and implement...

  • Data Engineer Lead

    4 hours ago


    London, Greater London, United Kingdom Harrington Starr Full time £70,000 - £80,000

    Company Overview:We are a leading fintech startup that is revolutionizing the investment technology landscape. Our mission is to provide innovative solutions to our clients, and we are looking for a talented Senior Data Engineer to join our team.Job Summary:This is a challenging and rewarding role that involves designing, implementing and maintaining...