AWS Data Engineer
1 week ago
Role :AWS Data Engineer
Location: London, UK (Hybrid)
Duration:12 Months FTC
Role
We are building the next-generation data platform at FTSE Russell — and we want you to shape it with us. Your role will involve:
- Designing and developing scalable, testable data pipelines using Python and Apache Spark
- Orchestrating data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3
- Applying modern software engineering practices: version control, CI/CD, modular design, and automated testing
- Contributing to the development of a lakehouse architecture using Apache Iceberg
- Collaborating with business teams to translate requirements into data-driven solutions
- Building observability into data flows and implementing basic quality checks
- Participating in code reviews, pair programming, and architecture discussions
- Continuously learning about the financial indices domain and sharing insights with the team
What You'll Bring
- Writes clean, maintainable Python code (ideally with type hints, linters, and tests like pytest)
- Understands data engineering basics: batch processing, schema evolution, and building ETL pipelines
- Has experience with or is eager to learn Apache Spark for large-scale data processing
- Is familiar with the AWS data stack (e.g. S3, Glue, Lambda, EMR)
- Enjoys learning the business context and working closely with stakeholders
- Works well in Agile teams and values collaboration over solo heroics
Nice-to-haves
- It's great (but not required) if you also bring:
- Experience with Apache Iceberg or similar table formats
- Familiarity with CI/CD tools like GitLab CI, Jenkins, or GitHub Actions
- Exposure to data quality frameworks like Great Expectations or Deequ
- Curiosity about financial markets, index data, or investment analytics
Seniority Level
Mid-Senior level
Industry
- IT Services and IT Consulting
Employment Type
Contract
Job Functions
- Information Technology
Skills
- Apache
- Engineering
- Code Review
- Modular Construction
- Continuous Integration and Continuous Delivery (CI/CD)
- Python (Programming Language)
- Software Development
- Amazon Web S
-
AWS Data Engineer
1 week ago
London, Greater London, United Kingdom Codeconvergence Limited (CCL) Full time £60,000 - £120,000 per yearWe are building the next-generation data platform at FTSE Russell — and we want you to shape it with us. Your role will involve:• Designing and developing scalable, testable data pipelines using Python and Apache Spark• Orchestrating data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3• Applying modern software engineering...
-
Data Center Commissioning Engineer
2 weeks ago
London, Greater London, United Kingdom Amazon Web Services (AWS) Full time £60,000 - £120,000 per yearDescriptionAmazon Web Services (AWS) provides a highly reliable, scalable, low-cost infrastructure platform in the cloud that powers hundreds of thousands of businesses in 190 countries around the world. To meet the growing demand for AWS cloud computing capacity in EMEA (Europe, Middle East and Africa) we are now looking for a Commissioning Engineer to join...
-
London, Greater London, United Kingdom Amazon Web Services (AWS) Full timeDescriptionAWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation...
-
AWS Data Platform Engineer
6 days ago
London, Greater London, United Kingdom UBDS Group Full time £55,000 - £90,000 per yearWe are seeking an experience AWS Cloud Engineer with an active SC Clearance to design, implement, and optimise the cloud infrastructure and CI/CD pipelines of AWS data infrastructure. This role focuses on AWS-native data services, infrastructure automation, and orchestration to support large-scale data operations.Key Responsibilities:Provision, manage, and...
-
AWS Data Engineers
6 days ago
London, Greater London, United Kingdom UBDS Group Full time £80,000 - £120,000 per yearRayo Cloud is seeking highly skilled, Security Cleared AWS Data Engineers at all levels to design, build, and maintain scalable data pipelines and infrastructure using AWS-native services. This role focuses on data orchestration, automation, and containerisation to support high-performance data workflows across the organisation.Key Responsibilities:Develop...
-
AWS Data Architect
12 hours ago
London, Greater London, United Kingdom Capgemini Full timeLondon, Newcastle, Manchester, BirminghamAWS Data ArchitectThe Job You're ConsideringAs an AWS Data Architect within Capgemini's Insights and Data Global Practice, you will be part of the Cloud Data Platforms team, which includes Data Engineers, Platform Engineers, Solutions Architects, and Business Analysts. This team drives digital and data transformation...
-
Sr. Business Intelligence Engineer, AWS GDSP A&I
17 hours ago
London, Greater London, United Kingdom Amazon Web Services (AWS) Full timeDescriptionThe AWS Global Deal Strategy and Programs (GDSP) organization is responsible for the Private Pricing Program. The Private Pricing Analytics and Insights (PPA&I) team owns building scalable analytical solutions that enable the GDSP organization with actionable insights to make data-driven decisions. This role will focus on Analytics related to the...
-
London, Greater London, United Kingdom Amazon Web Services (AWS) Full time £130,000 - £170,000 per yearDescriptionThe Global Services, Security (GSS) team, a part of Amazon Web Services, leverages the expertise and ingenuity of our builders to establish scalable security solutions for both internal and external customers that drive business outcomes. Our goal of securing the world's workloads and building a brighter future for humanity requires us to focus on...
-
AWS Data Architect
1 week ago
London, Greater London, United Kingdom Slalom Consulting Full time £80,000 - £120,000 per yearAWS Data Architect – Senior PrincipalLondon or Manchester | HybridAbout us - SlalomSlalom is a purpose-led, global business and technology consulting company. From strategy to implementation, our approach is fiercely human. In eight countries and 53 markets, we deeply understand our customers—and their customers—to deliver practical, end-to-end...
-
DevOps AWS Consultant
4 days ago
London, Greater London, United Kingdom NTT DATA North America Full time £60,000 - £120,000 per yearReq ID: 334976Competitive salary | UK: Hybrid - 3 days/week Sheffield or London (on site) + 2 days/week remoteAt NTT DATA, we know that with the right people on board, anything is possible. The quality, integrity, and commitment of our employees are key factors in our company's growth, market presence and our ability to help our clients stay a step ahead of...