Senior Data Engineer l AWS Glue
2 days ago
Title: Senior Data Engineer (AWS Glue & Kafka) We’re seeking a hands‑on Senior Data Engineer with 10+ years experience to deliver production data pipelines on AWS. You’ll design and build streaming (Kafka) and batch pipelines using Glue/EMR (PySpark), implement data contracts and quality gates, and set up CI/CD and observability. You’ve shipped real systems, coached teams, and you document as you go. Responsibilities Architect and deliver lake/lakehouse data flows on AWS (S3 + Glue + Glue ETL/EMR). Build Kafka consumers/producers, manage schema evolution, resilience, and DLQs. Implement PySpark transformations, CDC merges, partitioning and optimization. Add quality/observability (tests, monitoring, alerting, lineage basics). Harden security (IAM least privilege, KMS, private networking). Create runbooks, diagrams, and handover materials. Qualifications Deep AWS (Glue, RDS, S3, EMR, IAM/KMS, CloudWatch). Strong Kafka (MSK/Confluent, schema registry, consumer group tuning). Python/PySpark in production with tests and CI/CD. Data modeling (bronze/silver/gold, CDC, SCD2) and data contracts. IaC (Terraform/CDK) and cost/performance tuning experience. Clear communication and stakeholder engagement. Benefits Work on cutting‑edge technologies and impactful projects. Opportunities for career growth and development. Collaborative and inclusive work environment. Competitive salary and benefits package. #J-18808-Ljbffr
-
AWS Glue Developer
1 week ago
London, United Kingdom LA International Full timeWe are seeking a skilled Data Analyst role / AWS Glue developer to join our data engineering team. The ideal candidate will have hands-on experience in building and managing ETL pipelines using AWS Glue, along with a strong understanding of cloud-based data processing, transformation, and integration.Key Responsibilities:Design, develop, and maintain...
-
Senior Data Engineer
2 weeks ago
London, Greater London, United Kingdom VE3 Full time £100,000 - £150,000 per yearTitle: Senior Data Engineer l AWS Glue & Kafka lAbout The RoleWe're seeking a hands-on Senior Data Engineer (~10 years' experience) to deliver production data pipelines on AWS. You'll design and build streaming (Kafka) and batch pipelines using Glue/EMR (PySpark), implement data contracts and quality gates, and set up CI/CD and observability. You've shipped...
-
AWS Data Engineer
2 weeks ago
City Of London, United Kingdom N Consulting Limited Full timeWe are building the next-generation data platform at FTSE Russell — and we want you to shape it with us. Your role will involve: Designing and developing scalable, testable data pipelines using Python and Apache Spark Orchestrating data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3 Applying modern software engineering practices:...
-
AWS Data Engineer
2 days ago
City of London, United Kingdom Tenth Revolution Group Full timeData Engineer - 14-Week Contract (Outside IR35) Likely to Extend Start Date: 12th January Rate: £350 per day Location: Remote (UK-based) Interview: Immediate - Offer before Christmas We are seeking an experienced Data Engineer to join a 14-week project focused on building robust data pipelines and integrating complex data sources. This is an outside...
-
Aws Data Engineer Sc Clearance Redshift Glue
2 days ago
London, United Kingdom SR2 Full time**AWS Data Engineer | SC Clearance | Redshift | Glue** **£550-600 per day | 3 months | Outside IR35** **Experience required**: - Extensive AWS suite experience - (Ec2, S3) - Active SC Clearance - Experience productionising ETLs - Python or Scala scripting - DevOps knowledge - CI/CD automation and testing - Civica API (Desired) This role is a 3-month...
-
AWS Data Engineers
6 days ago
City Of London, United Kingdom UBDS Digital Full timeOverviewRayo Cloud is seeking highly skilled, Security Cleared AWS Data Engineers at all levels to design, build, and maintain scalable data pipelines and infrastructure using AWS-native services. This role focuses on data orchestration, automation, and containerisation to support high-performance data workflows across the organisation.Key...
-
AWS Data Engineer
2 weeks ago
London, United Kingdom Technopride Ltd Full timeRole OverviewWe are developing a next-generation data platform and are looking for an experienced Senior Data Engineer to help shape its architecture reliability and scalability. The ideal candidate will have more than 10 years of hands-on engineering experience and a strong background in building modern data pipelines working with cloud-native technologies...
-
AWS Data Platform Engineer
7 days ago
City Of London, United Kingdom UBDS Digital Full timeOverviewWe are seeking an experience AWS Cloud Engineer with an active SC Clearance to design, implement, and optimise the cloud infrastructure and CI/CD pipelines of AWS data infrastructure. This role focuses on AWS-native data services, infrastructure automation, and orchestration to support large-scale data operations.ResponsibilitiesProvision, manage,...
-
Aws Data Engineer
2 weeks ago
London, United Kingdom La Fosse Associates Full time**AWS Data Engineer** La Fosse are currently partnered with an exciting and ambitious financial services start-up who are looking for a AWS Data Engineer to work with the CTO in their plans to modernise and scale up the client's tech stack. The successful PHP Developer ideally has the following experienceRequirements & skill set: - 3-5 years expereince of...
-
AWS Data Engineer
1 week ago
Greater London, United Kingdom Natobotics Full timeAWS Data Engineer at NatoboticsJob Location: London, UKEmployment type: FTC (Contract), Mode: HybridJob DescriptionDesigning and developing scalable, testable data pipelines using Python and Apache SparkOrchestrating data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3Applying modern software engineering practices: version control, CI/CD,...