Streaming Software Engineer

3 weeks ago


London, Greater London, United Kingdom Avance Consulting Full time
Job Description

At Avance Consulting, we are seeking a highly skilled Kafka Solutions Architect to join our team. As a key member of our engineering team, you will be responsible for designing and implementing scalable and reliable streaming software solutions using Apache Kafka.

Key Responsibilities
  • Strategic Planning: Collaborate with product owners, technical leads, and customers to develop 3-5 year plans for streaming software solutions.
  • Architecture Development: Produce and maintain product and platform architecture in line with central architecture governance functions.
  • Deployment Patterns: Implement patterns that provide customers with robust deployment patterns meeting HSBC service levels tiers.
  • Cost Optimization: Ensure that platform and product architectures remain cost-effective.
  • Cluster Administration: Stand up and administer on-prem clusters.
  • Kafka Expertise: Provide expertise in Kafka brokers, zookeepers, Kafka connect, schema registry, KSQL, Rest proxy, and Kafka Control Center.
  • High-Volume Data Processing: Provide expertise and hands-on experience working on Kafka connect using schema registry in high-volume environments.
  • Platform Operations: Provide administration and operations of the Kafka platform, including provisioning, access lists, Kerberos, and SSL configurations.
  • Custom Connector Development: Provide expertise and hands-on experience on custom connectors using Kafka core concepts and API.
  • Design and Capacity Review: Involve in design and capacity review meetings to provide suggestions on Kafka usage.
  • Work Planning and Estimation: Participate in work planning and estimation to ensure optimum performance, high availability, and stability of solutions.
  • Monitoring and Security: Create topics, set up redundancy clusters, deploy monitoring tools, alerts, and have good knowledge of best practices. Create stubs for producers, consumers, and consumer groups for helping onboard applications from different languages/platforms. Use automation tools like provisioning using Docker, Jenkins, and GitLab. Setting up security on Kafka, monitor, prevent, and troubleshoot security-related issues.
  • Data Benchmarking and Analysis: Ability to perform data-related benchmarking, performance analysis, and tuning.


  • London, Greater London, United Kingdom TestYantra Software Solutions Full time

    Job DescriptionJob Title: Senior Software Engineer - Cloud and StreamingCompany: TestYantra Software SolutionsJob Type: Full-timeLocation: RemoteAbout Us: TestYantra Software Solutions is a leading provider of software solutions for the global OTT platform market.Job Summary:We are seeking an experienced Senior Software Engineer - Cloud and Streaming to join...


  • London, Greater London, United Kingdom TestYantra Software Solutions Full time

    Job DescriptionJob Title: Senior Software Engineer - Cloud and StreamingCompany: TestYantra Software SolutionsJob Type: Full-timeLocation: RemoteAbout Us: TestYantra Software Solutions is a leading provider of software solutions for the global OTT platform market.Job Summary:We are seeking an experienced Senior Software Engineer - Cloud and Streaming to join...


  • London, Greater London, United Kingdom TestYantra Software Solutions Full time

    Job DescriptionWe are seeking a highly skilled Cloud and Streaming Software Engineer to join our team at TestYantra Software Solutions.Key Responsibilities:Create and deliver large-scale software engineering tooling for our Global OTT platforms.Contribute to the software and infrastructure design of our team's purpose-built platforms.Write resilient code...


  • London, Greater London, United Kingdom TestYantra Software Solutions Full time

    Job DescriptionWe are seeking a highly skilled Cloud and Streaming Software Engineer to join our team at TestYantra Software Solutions.Key Responsibilities:Create and deliver large-scale software engineering tooling for our Global OTT platforms.Contribute to the software and infrastructure design of our team's purpose-built platforms.Write resilient code...


  • London, Greater London, United Kingdom House of Kelly Consulting Full time

    Job Title: Kafka EngineerJob Summary:House of Kelly Consulting is seeking a highly skilled Kafka Engineer to join our team. As a key member of our technical team, you will be responsible for designing, implementing, and maintaining our streaming software solutions.Key Responsibilities:Strategic Planning: Collaborate with product owners, technical leads, and...


  • London, Greater London, United Kingdom House of Kelly Consulting Full time

    Job Title: Kafka EngineerJob Summary:House of Kelly Consulting is seeking a highly skilled Kafka Engineer to join our team. As a key member of our technology team, you will be responsible for designing, implementing, and maintaining our streaming software solutions.Key Responsibilities:Strategic Planning: Collaborate with product owners, technical leads, and...


  • London, Greater London, United Kingdom Rullion Full time

    Rullion is seeking a highly skilled Engineer Specialist to join our team and contribute to the development of our streaming software strategies.Key Responsibilities:Collaborate with stakeholders to develop and implement 3-5 year streaming software strategies.Participate in design reviews, capacity planning, and work estimation to ensure the successful...


  • London, Greater London, United Kingdom Opus Recruitment Solutions Full time £100,000

    Job Title: DevOps EngineerWe are seeking a highly skilled Cloud Infrastructure Specialist to contribute to the growth of our global streaming platform. As a key member of our team, you will play a crucial role in scaling our product, platform, and business.Collaborate with our team of experts to design and implement scalable infrastructure solutions in the...


  • London, Greater London, United Kingdom TestYantra Software Solutions Full time

    Job Summary:We are seeking a highly skilled Software Engineer to join our team at TestYantra Software Solutions. As a key member of our team, you will be responsible for designing, developing, and delivering large-scale software engineering tooling for our Global OTT platforms.Key Responsibilities:Design and develop software engineering tooling for our...

  • Software Engineer

    3 weeks ago


    London, Greater London, United Kingdom TestYantra Software Solutions Full time

    Job Summary:We are seeking a highly skilled Software Engineer to join our team at TestYantra Software Solutions. As a key member of our team, you will be responsible for designing, developing, and delivering large-scale software engineering tooling for our Global OTT platforms.Key Responsibilities:Design and develop software engineering tooling for our...

  • Kafka Engineer

    2 weeks ago


    London, Greater London, United Kingdom Avance Consulting Full time

    Job SummaryAvance Consulting is seeking a highly skilled Kafka Engineer to join our team. As a Kafka Engineer, you will be responsible for designing, building, and deploying Kafka clusters on both on-prem and public cloud Kubernetes environments.Key ResponsibilitiesDesign and implement Kafka clusters for high-volume data processingProvide expertise in Kafka...

  • Kafka Engineer

    3 weeks ago


    London, Greater London, United Kingdom Avance Consulting Full time

    Job SummaryAvance Consulting is seeking a highly skilled Kafka Engineer to join our team. As a Kafka Engineer, you will be responsible for designing, building, and deploying Kafka clusters on both on-prem and public cloud Kubernetes environments.Key ResponsibilitiesDesign and implement Kafka clusters for high-volume data processingProvide expertise in Kafka...


  • London, Greater London, United Kingdom SoundCloud Ltd Full time

    SoundCloud empowers artists and fans to connect and share through music. As a company, we're dedicated to providing the most progressive tools, services, and resources to help artists build and grow their careers.We're looking for a Senior Media Streaming Backend Engineer to join our team. This role will play a crucial part in leading the development and...


  • London, Greater London, United Kingdom SoundCloud Ltd Full time

    SoundCloud empowers artists and fans to connect and share through music. As a company, we're dedicated to providing the most progressive tools, services, and resources to help artists build and grow their careers.We're looking for a Senior Media Streaming Backend Engineer to join our team. This role will play a crucial part in leading the development and...


  • London, Greater London, United Kingdom SoundCloud Ltd Full time

    SoundCloud empowers artists and fans to connect and share through music. As a company, we're dedicated to providing the most progressive tools, services, and resources to help artists build and grow their careers.We're looking for a Senior Media Streaming Backend Engineer to join our team. This role will play a crucial part in leading the development and...


  • London, Greater London, United Kingdom SoundCloud Ltd Full time

    SoundCloud empowers artists and fans to connect and share through music. As a company, we're dedicated to providing the most progressive tools, services, and resources to help artists build and grow their careers.We're looking for a Senior Media Streaming Backend Engineer to join our team. This role will play a crucial part in leading the development and...


  • London, Greater London, United Kingdom SoundCloud Ltd Full time

    SoundCloud empowers artists and fans to connect and share through music. As a company, we're dedicated to providing the most progressive tools, services, and resources to help artists build and grow their careers.We're looking for a Senior Media Streaming Backend Engineer to join our Media Streaming Team. This role will play a crucial part in leading the...


  • London, Greater London, United Kingdom SoundCloud Ltd Full time

    SoundCloud empowers artists and fans to connect and share through music. As a company, we're dedicated to providing the most progressive tools, services, and resources to help artists build and grow their careers.We're looking for a Senior Media Streaming Backend Engineer to join our Media Streaming Team. This role will play a crucial part in leading the...


  • London, Greater London, United Kingdom Referment Full time

    Join Referment's Team of InnovatorsWe're a leading London-based hedge fund at the forefront of technology and innovation, and we're looking for a talented Distributed Software Engineer to join our team. As a key member of our research and development team, you'll be responsible for researching and implementing new technologies into our environment, working...


  • London, Greater London, United Kingdom Referment Full time

    Join Referment's Team of InnovatorsWe're a leading London-based hedge fund at the forefront of technology and innovation, and we're looking for a talented Distributed Software Engineer to join our team. As a key member of our research and development team, you'll be responsible for researching and implementing new technologies into our environment, working...