Senior Data Engineer l AWS Glue
2 weeks ago
Title: Senior Data Engineer l AWS Glue & Kafka l About the role: We're seeking a hands -on Senior Data Engineer (~10 years' experience) to deliver production data pipelines on AWS. You'll design and build streaming (Kafka) and batch pipelines using Glue/EMR (PySpark), implement data contracts and quality gates, and set up CI/CD and observability. You've shipped real systems, coached teams, and you document as you go.Requirements What you'll do: • Architect and deliver lake/lakehouse data flows on AWS (S3 + Glue + Glue ETL/EMR). • Build Kafka consumers/producers, manage schema evolution, resilience, and DLQs. • Implement PySpark transformations, CDC merges, partitioning and optimization. • Add quality/observability (tests, monitoring, alerting, lineage basics). • Harden security (IAM least privilege, KMS, private networking). • Create runbooks, diagrams, and handover materials. What you'll bring: • Deep AWS (Glue, RDS. S3, EMR, IAM/KMS, CloudWatch). • Strong Kafka (MSK/Confluent, schema registry, consumer group tuning). • Python/PySpark in production with tests and CI/CD. • Data modeling (bronze/silver/gold, CDC, SCD2) and data contracts. • IaC (Terraform/CDK) and cost/performance tuning experience. • Clear communication and stakeholder engagement.Benefits Benefits: Work on cutting -edge technologies and impactful projects.Opportunities for career growth and development.Collaborative and inclusive work environment.Competitive salary and benefits package.
-
Senior Data Engineer l AWS Glue
2 weeks ago
Greater London, United Kingdom VE3 Full timeSenior Data Engineer – AWS Glue & Kafka We’re seeking a hands‑on Senior Data Engineer (~10 years’ experience) to deliver production data pipelines on AWS. You’ll design and build streaming (Kafka) and batch pipelines using Glue/EMR (PySpark), implement data contracts and quality gates, and set up CI/CD and observability. You’ve shipped real...
-
AWS Glue Developer
3 days ago
London, United Kingdom LA International Full timeWe are seeking a skilled Data Analyst role / AWS Glue developer to join our data engineering team. The ideal candidate will have hands-on experience in building and managing ETL pipelines using AWS Glue, along with a strong understanding of cloud-based data processing, transformation, and integration.Key Responsibilities:Design, develop, and maintain...
-
AWS Glue Developer
4 weeks ago
London, United Kingdom LA International Computer Consultants Ltd Full timeWe are seeking a skilled Data Analyst role / AWS Glue developer to join our data engineering team. The ideal candidate will have hands-on experience in building and managing ETL pipelines using AWS Glue, along with a strong understanding of cloud-based data processing, transformation, and integration. Key Responsibilities: Design, develop, and maintain...
-
Senior Data Engineer: AWS Glue
2 weeks ago
Greater London, United Kingdom VE3 Full timeA leading technology company in Greater London is seeking a Senior Data Engineer with extensive experience in AWS Glue and Kafka. You will be responsible for delivering robust data pipelines and ensuring data quality and security. The ideal candidate has a strong background in cloud technologies and data engineering practices. This position offers...
-
Senior Data Engineer
7 days ago
London, Greater London, United Kingdom VE3 Full time £100,000 - £150,000 per yearTitle: Senior Data Engineer l AWS Glue & Kafka lAbout The RoleWe're seeking a hands-on Senior Data Engineer (~10 years' experience) to deliver production data pipelines on AWS. You'll design and build streaming (Kafka) and batch pipelines using Glue/EMR (PySpark), implement data contracts and quality gates, and set up CI/CD and observability. You've shipped...
-
AWS Data Engineer
6 days ago
City Of London, United Kingdom N Consulting Limited Full timeWe are building the next-generation data platform at FTSE Russell — and we want you to shape it with us. Your role will involve: Designing and developing scalable, testable data pipelines using Python and Apache Spark Orchestrating data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3 Applying modern software engineering practices:...
-
AWS Data Engineer
4 weeks ago
City of London, United Kingdom N Consulting Global Full timeRole :AWS Data Engineer Location: London, UK (Hybrid)Duration:12 Months FTC We are building the next-generation data platform at FTSE Russell — and we want you to shape it with us. Your role will involve:• Designing and developing scalable, testable data pipelines using Python and Apache Spark• Orchestrating data workflows with AWS tools like Glue, EMR...
-
Senior/Lead Data Engineer
2 weeks ago
City Of London, United Kingdom EPAM Full timeThis job is brought to you by Jobs/Redefined, the UK's leading over-50s age inclusive jobs board.We are looking for a Senior Data Engineer with expertise in Python and Spark to contribute to building state-of-the-art data platforms on AWS. As part of this role, you'll be integral to designing, implementing and optimizing ETL workflows for our robust...
-
Senior Data engineer
4 weeks ago
London, United Kingdom Tenth Revolution Group Full timeLocation: London (Hybrid: 2–3 days onsite)Clearance: Must hold or be eligible for SC-level security clearanceSponsorship: Not available for this roleWe’re seeking an experienced Data Engineer to join a dynamic AWS-focused team. This role involves building and optimising data pipelines, delivering scalable solutions and collaborating with cross-functional...
-
Senior Data engineer
4 weeks ago
London, United Kingdom Tenth Revolution Group Full timeLocation: London (Hybrid: 2–3 days onsite) Clearance: Must hold or be eligible for SC-level security clearance Sponsorship: Not available for this role We’re seeking an experienced Data Engineer to join a dynamic AWS-focused team. This role involves building and optimising data pipelines, delivering scalable solutions and collaborating with...
