AWS Senior Data Engineer

3 weeks ago


London Area, United Kingdom Datatech Analytics Full time

AWS Senior Data Engineer

Salary: Negotiable to £80,000 Dependent on Experience

London: Hybrid working 3 days per week in the office 2 days home-based

Job Ref: J12931

A leader in consumer behaviour analytics, seeks a driven Senior Data Engineer to guide data infrastructure architecture, working alongside a small talented team of engineers, analysts, and data scientists. In this role, you'll enhance the data platform, develop advanced data pipelines, and integrate cutting-edge technologies like DataOps and Generative AI, including Large Language Models (LLMs).

This is an exciting opportunity for someone looking to challenge themselves in a collaborative environment, working with a breadth of diverse data and cutting edge technologies. You'll have proven experience developing AWS Cloud platforms end to end, orchestrating data using Dagster or similar as well as coding in Python and SQL.

Key Responsibilities

  • Develop and optimize ETL/ELT processes to support data transformation and integrity for analytics.
  • Explore and evaluate new data warehousing solutions, including Snowflake, to improve data accessibility and scalability.
  • Partner with product and engineering teams to define data architecture and best practices for reporting.
  • Ensure data security, compliance, and governance across data systems.
  • Implement and maintain CI/CD pipelines to automate data workflows and enhance system reliability.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability and performance.

Essential Skills and Experience:

  • Hands-on experience with AWS services, including Lambda, Glue, Athena, RDS, and S3.
  • Strong SQL skills for data transformation, cleaning, and loading.
  • Strong coding experience with Python and Pandas.
  • Experience with any flavour of data pipeline and workflow management tools: Dagster, Celery, Airflow, etc.
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management.
  • Experience supporting and working with cross-functional teams in a dynamic environment.
  • Strong communication skills to collaborate with remote teams (US, Canada)

Nice to Have

  • Familiarity with LLMs including fine-tuning and RAG.
  • Knowledge of Statistics
  • Knowledge of DataOps best practices, including CI/CD for data workflows.

Additional Requirements

Candidates must have an existing and future right to live and work in the UK. Sponsorship at any point is not available.

If this sounds like the role for you then please apply today

Alternatively, you can refer a friend or colleague by taking part in our fantastic referral schemes If you have a friend or colleague who would be interested in this role, please refer them to us. For each relevant candidate that you introduce to us (there is no limit) and we place, you will be entitled to our general gift/voucher scheme.

Datatech is one of the UK's leading recruitment agencies in the field of analytics and host of the critically acclaimed event, Women in Data. For more information, visit our website: www.datatech.org.uk


  • Aws Data Engineer

    4 days ago


    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **AWS Data Engineer** **£450 - 550 a day, Inside IR35.** **Hybrid role, 2 days a week on-site. London office.** **6-Month Contract, potential to keep rolling** Fantastic opportunity to join an oil and gas company is an expanding team. You will join the business as an AWS Data Engineer playing a major role in a migration project that is ongoing, helping...


  • London, United Kingdom Data Idols Full time

    **Senior Data Engineer** Data Idols are working with a very exciting FinTech who are looking for a Senior Data Engineer to join their Data Team. This role will initially be remote but as restrictions ease the role will be based in their central London office. **THE ROLE** Within this role as a Senior Data Engineer you will be working to help build a...


  • London, United Kingdom Databuzz Ltd Full time

    **Senior Data Engineer - AWS - London - Hybrid - Up To £85,000 per annum** DataBuzz are recruiting on behalf of a prestigious organisation who is looking for Senior Data Engineer - AWS. As a Senior DataEngineer - AWS, you will be expected to lead the creation of the new platform, working with the rest of the Global Tech team and users. As a Senior...


  • London, United Kingdom Data Idols Full time

    **Senior Data Engineer** Data Idols are proud to be working with a leading technology and engineering consultancy who have been running for decades globally. They work with a variety of clients across different industries on their biggest challenges. Would you like to work alongsidethis company, where you get the chance to work across a wide range of tools,...


  • London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **SENIOR DATA ENGINEER** **LONDON BASED** **£70,000-80,000 PER ANNUM** This International Food and Beverage retailer are searching for a new Senior Data Engineer to take responsibility for the development of the company's cloud platform in AWS. You will also be responsible for building new Data Pipelines using Python and SQL. **THE COMPANY** This...


  • London, United Kingdom La Fosse Associates Full time

    Senior AWS Data Engineer - Real-time data A senior AWS data engineer is required to a join an exciting renewable energy organisation, who are scaling their data function. The hiring manager is looking for AWS data engineers with previous real-time data experience and ideally renewable energy, trading,oil and gas or finance experience. You will need to...

  • AWS Data Engineer

    3 hours ago


    London, Greater London, United Kingdom Amberlabs Full time

    AWS Data Engineer (Must hold current SC)Join to apply for the AWS Data Engineer (Must hold current SC) role at Amber Labs.The CompanyAt Amber Labs, we are a cutting-edge UK and European technology consultancy that prioritises empowering autonomy, promoting experimentation, and facilitating rapid learning to provide exceptional value to our clients. Our...

  • AWS Data Engineer

    3 days ago


    London, Greater London, United Kingdom Amber Labs Full time

    AWS Data Engineer (Must hold current SC)The Company:At Amber Labs, we are a cutting-edge UK and European technology consultancy that prioritises empowering autonomy, promoting experimentation, and facilitating rapid learning to provide exceptional value to our clients. Our company culture is centred around collaboration, where all colleagues, regardless of...


  • London, Greater London, United Kingdom Barclays Full time

    Join us as Senior AWS Data Engineer working on our Market Data Store (MDS); We are embarking on an exciting initiative to revolutionize the way market data is accessed and utilized. The successful candidate will have the chance to make a significant impact in designing the platform and working on cutting-edge technologies like Databricks and Snowflake. This...


  • London Area, United Kingdom Durlston Partners Full time

    Senior Data Engineer (Python + AWS) - Leading Global Asset ManagerA leading global asset manager investing in Fixed Income & ESG is seeking a talented Senior Data Engineer for their new data-focused buildout.Their Data Office team is building the future of financial services and changing the way people invest. You will join the Analytics and Data Platform...

  • Aws Data Engineer

    2 days ago


    London, United Kingdom Explore Group Full time

    **AWS Data Engineer - £75,000 - Fully Remote Active SC Clearance or eligible to be cleared to SC level** We are looking for a talented AWS Data Engineer to join a specialist Data Engineering, Cloud and Analytics consultancy. The role is **fully remote** and the salary on offer ranges from **£75,000.** **Whats on offer?** **-**A growth focused...


  • London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **SENIOR DATA ENGINEER** **UP TO £85,000 + BENEFITS** **LONDON, CURRENTLY FLEXIBLE / REMOTE / HOMEWORKING** Harnham is partnered with a global travel company, that uses real-time data to bring together relevant information for travelers to make their journey as easy as possible. This is a hands-on role where you will be joining a team of 2, ensuring all...

  • Data Engineer

    6 days ago


    London, United Kingdom Data Idols Full time

    **Data Engineer** Data Idols are proud to be working with a leading technology and engineering consultancy who have been running for decades globally. They work with a variety of clients across different industries on their biggest challenges. Would you like to work alongsidethis company, where you get the chance to work across a wide range of tools, tech,...


  • London, United Kingdom Method Resourcing Full time

    **Senior Data Engineer | Data Engineering | Java | Docker | AWS | Kafka | Spark | London | Hybrid | £80,000 - £95,000** Our client's data engineering team is at the heart of everything they do, looking after multiple high impact projects for the business. They're looking for an experienced engineer who's familiar with time streaming for salesforce using...


  • London, Greater London, United Kingdom Barclays UK Full time

    Join us as Senior AWS Data Engineer working on our Market Data Store (MDS); We are embarking on an exciting initiative to revolutionize the way market data is accessed and utilized. The successful candidate will have the chance to make a significant impact in designing the platform and working on cutting-edge technologies like Databricks and Snowflake. This...


  • London, United Kingdom Sanderson Full time

    **Role**:Senior Data Engineer **Location**:Leeds/London **Salary**:Up to £65,000 **Remote Working** Our client is looking for a Senior Data Engineer to join their growing Data Engineering and Analytics team. Based in Leeds/London and operating remotely, you will work closely with the business' stakeholders with the goal of driving global growth. This...


  • London Heathrow Airport, United Kingdom Xpertise Recruitment Ltd Full time

    Xpertise has partnered with an established and well-respected FTSE 100 aviation firm embarking on a vast data & IT greenfield project moving from legacy estates to AWS, waterfall to Agile methodologies, & a modern big data tech stack. The client is lookingfor several Senior & Lead Data Engineers & Data architects. Please see further details below: **Title**:...

  • AWS Data Engineer

    4 days ago


    London, Greater London, United Kingdom 慨正橡扯 Full time

    Job Title: AWS Data EngineerLocation: UK WideTravel Frequency: Hybrid (Need to travel on-site 2-3 days per week to any nearby Capgemini office)Working Pattern: Full-time PermanentThe Job You're ConsideringThe Cloud Data Platforms team is part of the Insights and Data Global Practice and has seen strong growth and continued success across a variety of...

  • AWS Data Architect

    7 days ago


    London, Greater London, United Kingdom RED Global Full time

    Direct message the job poster from RED GlobalRED are currently looking for a AWS Data SME/Architect. This opportunity will be an initial 6-12 month contract + possible extensions and our customer is allowing someone to work fully remote (but must be based in the UK).We are looking for skills in the following:Proven experience as an AWS Data SME or AWS Data...


  • London, Greater London, United Kingdom JR United Kingdom Full time

    Social network you want to login/join with:Salary: Negotiable to £80,000 Dependent on ExperienceLondon: Hybrid working 3 days per week in the office 2 days home-basedJob Ref: J12931A leader in consumer behaviour analytics seeks a driven Senior Data Engineer to guide data infrastructure architecture, working alongside a small talented team of engineers,...