Current jobs related to Kafka Architect - Milton Keynes - Tech Mahindra

  • Senior Apache Kafka Architect

    1 week ago

    Milton Keynes, Milton Keynes, United Kingdom Bangura Solutions Full time

    Job Summary: We are seeking a highly skilled Senior Apache Kafka Architect to design and implement scalable and efficient data pipelines using Apache Kafka and associated technologies. The ideal candidate will have a strong background in software architecture, data engineering, and system design. Key Responsibilities:Design and implement data pipelines using...

  • Lead Cloud Infrastructure Engineer

    4 weeks ago

    Milton Keynes, Milton Keynes, United Kingdom Rightmove Full time

    Position: Lead Cloud Infrastructure Engineer Location: London / Hybrid (2 days a week in the office) Reporting to: Engineering Manager Role Overview As a Lead Cloud Infrastructure Engineer within our Cloud Foundations team, you will be instrumental in architecting, deploying, and sustaining our cloud infrastructure on Google Cloud Platform (GCP). Your...

  • Lead Cloud Infrastructure Engineer

    4 weeks ago

    Milton Keynes, Milton Keynes, United Kingdom Rightmove Full time

    Position: Lead Cloud Infrastructure Engineer - Cloud Foundations Location: Flexible / Hybrid (2 days a week in the office) Reporting to: Engineering Manager Role Overview As a Lead Cloud Infrastructure Engineer within our Cloud Foundations team, you will be instrumental in architecting, deploying, and sustaining our cloud ecosystem on Google Cloud Platform...

  • Lead Cloud Infrastructure Engineer

    2 months ago

    Milton Keynes, Milton Keynes, United Kingdom Rightmove Full time

    Position: Lead Cloud Infrastructure Engineer Location: London / Hybrid (2 days a week in the office) Reporting to: Engineering Manager Role Overview As a Lead Cloud Infrastructure Engineer within our Cloud Foundations team, you will be instrumental in architecting, deploying, and sustaining our cloud infrastructure on Google Cloud Platform (GCP). Your...

  • Lead Cloud Infrastructure Engineer

    2 months ago

    Milton Keynes, Milton Keynes, United Kingdom Rightmove Full time

    Position: Lead Cloud Infrastructure Engineer - Cloud Foundations Location: Flexible / Hybrid (2 days a week in the office) Reporting to: Engineering Manager Role Overview As a Lead Cloud Infrastructure Engineer within our Cloud Foundations team, you will be instrumental in architecting, deploying, and sustaining our cloud ecosystem on Google Cloud Platform...

  • Head of Data Engineering

    3 weeks ago

    Milton Keynes, United Kingdom Circle Recruitment Full time

    Head of Data Engineering £90k - £110k UK - Fully remote Unlimited annual leave We are seeking a Head of Data Engineering for our client, a Cyber focussed start up, on a fully remote basis. This is a great opportunity for someone who has a keen interest in Cyber Security. Alongside a starting salary of between £90k- £110k, they have some excellent...

  • Senior Cloud Infrastructure Engineer

    2 months ago

    Milton Keynes, Milton Keynes, United Kingdom Rightmove Full time

    About the RoleWe are seeking a highly skilled Senior Cloud Infrastructure Engineer to join our Cloud Foundations team at Rightmove. As a key member of our engineering team, you will play a crucial role in designing, implementing, and maintaining our cloud infrastructure on Google Cloud Platform (GCP).Key ResponsibilitiesDesign and implement scalable and...

  • Senior Cloud Infrastructure Engineer

    2 months ago

    Milton Keynes, Milton Keynes, United Kingdom Rightmove Full time

    About the RoleWe are seeking a highly skilled Senior Cloud Infrastructure Engineer to join our Cloud Foundations team at Rightmove. As a key member of our engineering team, you will play a crucial role in designing, implementing, and maintaining our cloud infrastructure on Google Cloud Platform (GCP).Key ResponsibilitiesDesign and implement scalable and...

  • Senior Platform Engineer

    3 months ago

    Milton Keynes, United Kingdom Rightmove Full time

    Senior Platform Engineer - Cloud Foundations Location: London / Hybrid (2 days a week in the office) Reporting to: Engineering Manager The role  As a Senior Platform Engineer in our Cloud Foundations team, you will play a crucial role in designing, implementing and maintaining our cloud infrastructure on Google Cloud Platform (GCP). You’ll be...

  • Platform Engineer

    3 months ago

    Milton Keynes, United Kingdom Rightmove Full time

    Platform Engineer - Cloud Foundations Location: London / Hybrid (2 days a week in the office) Reporting to: Engineering Manager The role  As a Platform Engineer in our Cloud Foundations team, you will play a crucial role in designing, implementing and maintaining our cloud infrastructure on Google Cloud Platform (GCP). You’ll be responsible for...

Kafka Architect

3 months ago

Milton Keynes, United Kingdom Tech Mahindra Full time

Job Title: Kafka Architect

Job Overview:

A Kafka Architect is responsible for designing, implementing, and managing Apache Kafka infrastructure and data pipelines. This role involves collaboration with various teams to understand business requirements and create scalable, efficient, and robust Kafka-based solutions to handle real-time data streaming needs. The Kafka Architect ensures the high availability, security, and performance of the Kafka ecosystem, providing technical leadership and guidance to developers and operations teams.

Key Responsibilities:

  1. Design and Architecture:
  • Develop and implement the architecture for Apache Kafka infrastructure to meet business and technical requirements.
  • Design data pipelines and streaming applications using Kafka and associated technologies.
  • Create and maintain documentation of the Kafka architecture, including data flow diagrams, architecture diagrams, and operational procedures.
  1. Implementation and Deployment:
  • Set up and configure Kafka clusters, topics, producers, consumers, and connectors.
  • Ensure secure, high-availability, and fault-tolerant Kafka environments.
  • Implement best practices for data retention, partitioning, replication, and monitoring.
  1. Monitoring and Optimization:
  • Monitor Kafka clusters' performance and troubleshoot issues related to scalability, latency, and throughput.
  • Optimize Kafka configurations for better performance and resource utilization.
  • Implement monitoring and alerting systems for Kafka health and performance using tools like Prometheus, Grafana, or equivalent.
  1. Collaboration and Support:
  • Work closely with data engineers, developers, and IT operations to integrate Kafka with other systems and applications.
  • Provide technical support and guidance to development teams on Kafka-related issues.
  • Conduct training sessions and workshops to upskill teams on Kafka usage and best practices.
  1. Innovation and Improvement:
  • Stay updated with the latest developments in Kafka and related technologies.
  • Evaluate and recommend new tools, technologies, and processes to improve the Kafka ecosystem.
  • Lead proof-of-concept projects to test new solutions and approaches.