AWS Data Engineer

7 days ago

City Of London, United Kingdom N Consulting Limited Full time

We are building the next-generation data platform at FTSE Russell — and we want you to shape it with us. Your role will involve: Designing and developing scalable, testable data pipelines using Python and Apache Spark Orchestrating data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3 Applying modern software engineering practices: version control, CI/CD, modular design, and automated testing Contributing to the development of a lakehouse architecture using Apache Iceberg Collaborating with business teams to translate requirements into data-driven solutions Building observability into data flows and implementing basic quality checks Participating in code reviews, pair programming, and architecture discussions Continuously learning about the financial indices domain and sharing insights with the team WHAT YOU'LL BRING: Writes clean, maintainable Python code (ideally with type hints, linters, and tests like pytest) Understands data engineering basics: batch processing, schema evolution, and building ETL pipelines Has experience with or is eager to learn Apache Spark for large-scale data processing Is familiar with the AWS data stack (e.g. S3, Glue, Lambda, EMR) Enjoys learning the business context and working closely with stakeholders • Works well in Agile teams and values collaboration over solo heroics Nice-to-haves: It’s great (but not required) if you also bring: Experience with Apache Iceberg or similar table formats Familiarity with CI/CD tools like GitLab CI, Jenkins, or GitHub Actions Exposure to data quality frameworks like Great Expectations or Deequ Curiosity about financial markets, index data, or investment analytics Seniority Level Mid-Senior level IT Services and IT Consulting Employment Type Contract Job Functions Information Technology Skills Apache Modular Construction Continuous Integration and Continuous Delivery (CI/CD) #J-18808-Ljbffr

  • AWS Data Engineer

    1 week ago

    City Of London, United Kingdom TXP Full time

    Role: Data Engineer (AWS)Contract: 450pd- 500pd (Inside IR35)Location: Remote working with occasional travel to siteDuration: End of March 2026 (expected to extend at the new financial year)We are currently recruiting for a Data Engineer to work on a project within the Public Sector space. The role will be AWS focused and requires a Data Engineer who can...

  • Senior Security Engineer, AWS Security

    5 days ago

    City Of London, United Kingdom Amazon Web Services (AWS) Full time

    Senior Security Engineer, AWS Security Amazon Web Services (AWS) is the leading cloud provider, offering virtualized infrastructure, storage, networking, messaging, and many other services worldwide. AWS runs a globally distributed environment at massive scale, supporting customers from startups to enterprises on our multi‑tenant infrastructure. Key...

  • Senior Security Engineer, AWS Security

    2 weeks ago

    City Of London, United Kingdom Amazon Web Services (AWS) Full time

    Job DescriptionAmazon Web Services (AWS) is the leading cloud provider, delivering virtualized infrastructure, storage, networking, messaging, and a wide range of services to customers worldwide. AWS operates a globally distributed environment at massive scale, enabling businesses from startups to enterprises to run their operations and applications on its...

  • AWS Data Engineer

    4 weeks ago

    City of London, United Kingdom N Consulting Global Full time

    Role :AWS Data Engineer Location: London, UK (Hybrid)Duration:12 Months FTC We are building the next-generation data platform at FTSE Russell — and we want you to shape it with us. Your role will involve:• Designing and developing scalable, testable data pipelines using Python and Apache Spark• Orchestrating data workflows with AWS tools like Glue, EMR...

  • AWS Data Engineer

    2 weeks ago

    City of London, United Kingdom RED SAP Solutions Full time

    Data Engineer (Python/AWS) Belfast - 3 Days Onsite - 2 Days Remote 12 Month Initial Contract - Inside IR35 Key Responsibilities Design, develop, and maintain robust data pipelines and ETL processes. Build and optimise data workflows using Python. Manage workflow orchestration with Apache Airflow (MWAA). Perform data testing, validation, and produce data...

  • AWS Data Engineer

    3 weeks ago

    london (city of london), United Kingdom McGregor Boyall Full time

    AWS Data Engineer | £ 75 ,000 - £90,000 | Central London (Hybrid - 3 days on-site) We're proud to partner with a high-growth fintech on the lookout for an AWS Data Engineer to join their fast-paced, data-driven organisation. This role is a great opportunity for someone who's eager to make an impact and get hands-on with modern tools. You'll design, build,...

  • Data Center Facility Engineer, Data Center Engineering Operations

    2 weeks ago

    City Of London, United Kingdom Amazon Web Services (AWS) Full time

    Data Center Facility Engineer, Data Center Engineering OperationsJoin to apply for the Data Center Facility Engineer, Data Center Engineering Operations role at Amazon Web Services (AWS)AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. We support all AWS data centers and all of the servers,...

  • Chief Engineer, Data Centre Engineering Operations, Data Centre Engineering Operations

    20 hours ago

    City Of London, United Kingdom Amazon Web Services (AWS) Full time

    OverviewAWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we’re the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they...

  • Data Center Facility Engineer, Data Center Engineering Operations

    2 weeks ago

    City Of London, United Kingdom Amazon Web Services (AWS) Full time

    Data Center Facility Engineer, Data Center Engineering OperationsJoin to apply for the Data Center Facility Engineer, Data Center Engineering Operations role at Amazon Web Services (AWS)AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we’re the people who keep the cloud...

  • Data Center Facility Engineer, Data Center Engineering Operations

    2 weeks ago

    City Of London, United Kingdom Amazon Web Services (AWS) Full time

    Data Center Facility Engineer, Data Center Engineering Operations Join to apply for the Data Center Facility Engineer, Data Center Engineering Operations role at Amazon Web Services (AWS) AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. We support all AWS data centers and all of the servers,...