AWS Lead Data Engineer

1 month ago


London, Greater London, United Kingdom Macquarie Bank Limited Full time

The Commodities and Global Markets Data Analytics team within Technology is building a leading data and analytics platform. We partner and build batch and real-time analytics solutions for traders, quants, desk analysts, and central data teams across the business.

About the Role

As a Lead Data Engineer, you will work with traders, quants, desk analysts, and central data teams to provide data and analytics solutions across our Commodities and Global Markets business lines. You'll manage a team of data engineers in London, providing technical direction and leading the development of data analytics capabilities such as the data catalog, data science workbench, visualization tools, and real-time analytics.

Key Responsibilities
  • Manage a team of data engineers in London
  • Provide technical direction and lead the development of data analytics capabilities
  • Work with traders, quants, desk analysts, and central data teams to provide data and analytics solutions
Requirements
  • Experience with AWS cloud
  • Experience programming, debugging, and running production systems in Python
  • Exposure to open-source technologies such as Presto/Trino and Airflow
About Us

Macquarie Bank Limited is a global financial services group with a strong presence in the commodities and global markets. We are committed to providing a working environment that embraces diversity, equity, and inclusion.



  • London, Greater London, United Kingdom Data Science Festival Full time

    Job SummaryWe are seeking a skilled AWS Data Engineer to join our team at Data Science Festival. This is a fully remote opportunity with an estimated salary range of £80,000 - £110,000 per annum.The successful candidate will be responsible for building and maintaining reliable data pipelines, collaborating with the wider data teams, and driving high...


  • London, Greater London, United Kingdom Cornwallis Elt Full time

    Job TitleA leading workplace pensions provider is seeking a highly skilled Lead Data Engineer to run their expanding data engineering team in their London office.The team has recently built a next-gen data lake hosted in AWS, utilizing Dremio, Data Mesh architecture, and various AWS tools. The focus now shifts to enhancing the data stored within, including...


  • London, Greater London, United Kingdom easyJet Airline Company PLC Full time

    Job DescriptionThe Lead Data Engineer is responsible for designing, delivering, and implementing data solutions within the IT estate. This role requires exceptional technical ability and inspirational leadership to achieve this goal.The Lead Data Engineer works closely with the data engineering leadership team and wider stakeholders to deliver IT change that...

  • Lead Data Engineer

    4 weeks ago


    London, Greater London, United Kingdom Two Circles Full time

    About the Role: We are seeking a talented Lead Data Engineer (AWS) to join our growing team at Two Circles and help us deliver innovative data solutions for clients and build our data management and analytics platform.

  • Data Systems Engineer

    3 weeks ago


    London, Greater London, United Kingdom Data Privacy Full time

    About the Role:We are seeking a skilled Data Systems Engineer to join our team at Houseful.Key Responsibilities:Design and implement data warehousing solutions using AWS technologies.Collaborate with senior engineers to ensure data accuracy and implement validation checks.Develop and maintain ETL/ELT pipelines, ensuring alignment with business...


  • London, Greater London, United Kingdom Charlotte Tilbury Beauty Ltd Full time

    About the Role:We are seeking an experienced AWS Cloud Data Engineering Lead to join our team at Charlotte Tilbury Beauty Ltd. This is a fantastic opportunity to lead architectural decisions, provide technical leadership, and mentor colleagues in data engineering.Key Responsibilities:Lead the design, development, implementation, and maintenance of data...


  • London, Greater London, United Kingdom Curveanalytics Full time

    Job DescriptionWe're looking for an experienced AWS Lead Data Engineer to join our Technology Practice, leading the design, build and deployment of innovative data solutions, in the cloud, from scratch.The ideal candidate will have a proven track record of developing leading data solutions in cloud environments, with experience working with Databricks,...


  • London, Greater London, United Kingdom first moment Fotografie GmbH Full time

    Job Title: Senior AWS Data EngineerJob Summary:We are seeking a highly skilled Senior AWS Data Engineer to join our team. As a Senior AWS Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data engineering solutions on AWS. You will work closely with our data science team to develop and deploy data pipelines, data...

  • Data Engineer

    1 week ago


    London, Greater London, United Kingdom Data Privacy Full time

    About UsHouseful is a leading property technology company known for its innovative approach to the property market. With brands like Zoopla, Alto, Hometrack, Calcasa, Mojo, and Prime location, we leverage software, data, and insights to drive progress in the industry.Company OverviewWe're committed to helping everyone make informed decisions about their...


  • London, Greater London, United Kingdom 83zero Limited Full time

    AWS Cloud Data Engineer Job Description83zero Limited is seeking a highly skilled AWS Cloud Data Engineer to join our team. As a Cloud Data Engineer, you will be responsible for designing and building data engineering solutions using AWS services.ResponsibilitiesDesign and build data engineering solutions using AWS services, including data platform services,...


  • London, Greater London, United Kingdom Hanover Recruitment Full time

    Job Title: AWS Lead Data EngineerWe are seeking an experienced AWS Lead Data Engineer to join our team responsible for designing, building, and maintaining cloud-based databases across multiple platforms.Design and implement scalable and secure cloud-based databases using AWS services.Collaborate with cross-functional teams to develop and maintain data...


  • London, Greater London, United Kingdom SDG Group Full time

    About SDG GroupWe are a leading provider of IT solutions, and our Business Information Services (BIS) department is at the heart of our business strategy. We provide IT solutions that empower our clients, intermediaries, regulators, and internal employees.The Data Platform TeamThe Data Platform Team is responsible for ingesting data, publishing information,...


  • London, Greater London, United Kingdom ITV Full time

    AWS Data Infrastructure Manager OpportunityWe are looking for an experienced Lead AWS Data Infrastructure Manager to join our team at ITV. As a key member of our cloud infrastructure team, you will be responsible for designing and building scalable data pipelines and products using Databricks.This role involves leading a team of data engineers and...


  • London, Greater London, United Kingdom Amazon Data Services UK Limited Full time

    About This RoleAs a Data Centre Operations Manager in Amazon Data Services UK Limited, you will be responsible for managing and developing high-performing teams of engineers, providing technical and leadership expertise to ensure the highest levels of performance. You will be maintaining existing co-located and in-house Data Centres, helping build and bring...


  • London, Greater London, United Kingdom Client Server Full time

    Data Engineering Lead Job Opportunity We are seeking a highly skilled Data Engineering Lead to join our team at Client Server. As a key member of our data engineering team, you will be responsible for leading the design, development, and maintenance of large-scale data processing applications and infrastructure. The ideal candidate will have expertise in...


  • London, Greater London, United Kingdom Checkout Group Full time

    Unlock Business Potential with Our Data PlatformAt Checkout Group, we're on a mission to empower businesses and communities to thrive in the digital economy. As a Senior AWS Data Platform Engineer, you'll play a crucial role in helping us achieve this goal.About the RoleWe're seeking a highly skilled and experienced data engineer to join our Data Platform...

  • AWS Data Architect

    4 weeks ago


    London, Greater London, United Kingdom Noir Full time

    About the Role:We are seeking a Senior AWS Data Engineer to join our team at Noir. The successful candidate will be responsible for designing and optimising scalable data pipelines, ensuring that the data systems are architecturally sound and maintainable.Main Responsibilities:• Lead the development of scalable, architecturally sound data pipelines,...

  • AWS Cloud Architect

    1 month ago


    London, Greater London, United Kingdom AWS EMEA SARL (UK Branch) Full time

    Job SummaryAWS EMEA SARL (UK Branch) is seeking a highly skilled Senior Performance Specialist to join our team. As a Senior Performance Specialist, you will be responsible for architecting and operating solutions built on AWS, with a focus on AI/ML/GenAI technical domain.About the RoleThe ideal candidate will have experience communicating across technical...


  • London, Greater London, United Kingdom Curveanalytics Full time

    About the RoleCurveanalytics is seeking an experienced AWS Lead Data Engineer to join our Technology Practice. As a key member of our team, you will lead the design, build, and deployment of innovative data solutions in the cloud, from scratch. You will report directly to the Head of Technology and collaborate with a team of Data Scientists & Engineers,...

  • AWS Data Engineer

    7 days ago


    London, Greater London, United Kingdom Abound Full time

    Abound: A Leading Player in Consumer LendingWe are seeking a highly motivated Data Engineer to be a key member of our team, responsible for the deployment and maintenance of our data infrastructure. The ideal candidate will have experience in building and maintaining ETL pipelines and data warehouses.Our company, Abound, is a leading player in consumer...