Kafka Solutions Architect

3 weeks ago

London, Greater London, United Kingdom iBSC Full time
Job Description

Position: Kafka Solutions Architect

Overview:

This position is aligned with a Specialist Engineering profile, where expertise in engineering and architecture is essential to develop strategies and roadmaps that cater to our clients' needs. The candidate should possess a solid understanding of prevailing technology trends, their applications by our clients, and the foresight to predict necessary advancements. This role will focus on the establishment and management of Kafka clusters in both on-premises and public cloud Kubernetes environments.

Essential Qualities:

  • Ability to engage in technical discussions with engineers and stakeholders.
  • Strong analytical and problem-solving capabilities.
  • Experience in an infrastructure as code and automation-centric environment.
  • Familiarity with the software development lifecycle, particularly the standard engineering tools utilized by the team.

Key Responsibilities:

  • Collaborate with product owners, technical leads, and clients to devise strategic plans for streaming software over the next 3-5 years.
  • Develop and uphold product and platform architecture in accordance with central architecture governance.
  • Implement deployment patterns that ensure robust solutions for clients.
  • Maintain cost-effectiveness in platform and product architectures.
  • Establish and manage on-premises clusters.
  • Provide expertise in Kafka components including brokers, zookeepers, Kafka connect, schema registry, KSQL, Rest Proxy, and Kafka Control Center.
  • Offer hands-on experience with Kafka connect using schema registry in high-volume scenarios.
  • Oversee administration and operations of the Kafka platform, including provisioning, access lists, Kerberos, and SSL configurations.
  • Deliver expertise in Kafka connectors such as MQ connectors, Elastic Search connectors, JDBC connectors, file stream connectors, JMS source connectors, tasks, workers, converters, and transforms.
  • Engage in design and capacity review meetings to provide insights on Kafka utilization.
  • Participate in work planning and estimation to ensure optimal performance, high availability, and stability of solutions.
  • Create topics, establish redundancy clusters, deploy monitoring tools, and maintain best practices.
  • Develop stubs for producers, consumers, and consumer groups to facilitate onboarding of applications across various languages and platforms.
  • Utilize automation tools for provisioning, including Docker, Jenkins, and GitLab.
  • Implement security measures on Kafka, monitor, and troubleshoot security-related issues.
  • Conduct data benchmarking, performance analysis, and tuning.

Key Technologies:

Messaging Technologies: Apache Kafka, Confluent Kafka

DevOps Tools: GitHub, JIRA, Confluence, Jenkins

Automation Tools: Ansible, Puppet

Monitoring Tools: Observability tools such as DataDog, NewRelic, Prometheus, Grafana

  • Kafka Solutions Architect

    3 weeks ago

    London, Greater London, United Kingdom Damco Solutions Full time

    Position OverviewRole: Kafka Solutions ArchitectCompany: Damco SolutionsEngagement Type: ContractualKey Responsibilities:Deliver specialized knowledge and practical experience in developing custom connectors utilizing Kafka's fundamental principles and API.Establish and manage On-Premises clusters effectively.Design topics, configure redundancy clusters,...

  • Kafka Solutions Architect

    3 days ago

    London, Greater London, United Kingdom Avance Consulting Full time

    Job DescriptionAt Avance Consulting, we are seeking a highly skilled Kafka Solutions Architect to join our team. As a key member of our engineering team, you will be responsible for designing and implementing scalable and reliable streaming software solutions using Apache Kafka.Key ResponsibilitiesStrategic Planning: Collaborate with product owners,...

  • Kafka Solutions Architect

    5 days ago

    London, Greater London, United Kingdom Avance Consulting Full time

    Job DescriptionAt Avance Consulting, we are seeking a highly skilled Kafka Solutions Architect to join our team. As a key member of our engineering team, you will be responsible for designing and implementing scalable and reliable streaming software solutions using Apache Kafka.Key ResponsibilitiesStrategic Planning: Collaborate with product owners,...

  • Kafka Solutions Architect

    3 weeks ago

    London, Greater London, United Kingdom Webologix Ltd INC Full time

    Greetings,We are pleased to present an exciting opportunity for a "Kafka Engineer" at Webologix Ltd/INC, available for remote work.Position: "Kafka Engineer"Location: RemoteRole OverviewThis position is aligned with a Specialist Engineering profile, where the integration of engineering and architectural expertise is essential to devise strategies and...

  • Kafka Solutions Architect

    5 days ago

    London, Greater London, United Kingdom House of Kelly Consulting Full time

    Job Title: Kafka EngineerJob Type: Full-timeLocation: RemoteAbout House of Kelly Consulting:We are a leading consulting firm that specializes in providing expert solutions for businesses looking to leverage the power of data. Our team of experienced professionals is dedicated to helping clients achieve their goals through innovative and effective...

  • Confluence Kafka Solutions Architect

    5 days ago

    London, Greater London, United Kingdom Vallum Associates Full time

    Job DescriptionThis is a Contract Inside IR35 position.**Job Overview**We are seeking a highly experienced professional with a strong background in integration technologies, streaming technologies, and Kafka.The ideal candidate will have a solid understanding of Kafka architecture and experience in using Confluent Kafka.**Key Responsibilities**Design and...

  • Senior Kafka Solutions Architect

    1 week ago

    London, Greater London, United Kingdom Vallum Associates Full time

    Senior Kafka EngineerContract Inside IR35About the Role:We are seeking an experienced Senior Kafka Engineer to provide strategic guidance on designing and implementing high-performance, highly available, and stable solutions using Kafka, as well as performing data-related benchmarking, performance analysis, and tuning for our clients.Key responsibilities...

  • Kafka Architect

    4 weeks ago

    London, Greater London, United Kingdom Undisclosed Company Full time

    Role Title: Kafka Architect Duration: 4 Months Location: Remote Working Rate: £610/d - Umbrella onlyWould you like to join a global leader in consulting, technology services and digital transformation?Our client is at the forefront of innovation to address the entire breadth of opportunities in the evolving world of cloud, digital and platforms.Role purpose...

  • Enterprise Solutions Architect

    1 week ago

    London, Greater London, United Kingdom N Consulting Ltd Full time

    Job Title: Enterprise ArchitectAbout the Role:N Consulting Ltd is seeking an experienced Enterprise Architect to join our team. As an Enterprise Architect, you will be responsible for designing and implementing integration solutions using Kafka and other technologies.Key Responsibilities:Design and implement integration solutions using Kafka and other...

  • Solutions Architect

    2 days ago

    London, Greater London, United Kingdom Agile Solutions Full time

    About Agile SolutionsWe are a leading provider of data-driven solutions, helping our clients to unlock the full potential of their data assets. Our team of experts is dedicated to delivering innovative and effective solutions that drive business value.Job SummaryWe are seeking an experienced Solutions Architect to join our team. As a key member of our data...

  • Solutions Architect

    2 days ago

    London, Greater London, United Kingdom Agile Solutions Full time

    About Agile SolutionsWe are a leading provider of data-driven solutions, helping our clients to unlock the full potential of their data assets. Our team of experts is dedicated to delivering innovative and effective solutions that drive business value.Job SummaryWe are seeking an experienced Solutions Architect to join our team. As a key member of our data...

  • Solution Architect

    4 days ago

    London, Greater London, United Kingdom Agile Solutions GB Full time

    About Agile Solutions GB LtdWe are a leading provider of data-driven solutions, helping our clients to unlock the full potential of their data. Our team of experts works closely with clients to understand their business needs and develop tailored solutions that drive tangible business benefits.Job SummaryWe are seeking an experienced Solution Architect to...

  • Solution Architect

    3 days ago

    London, Greater London, United Kingdom Agile Solutions GB Full time

    About Agile Solutions GB LtdWe are a leading provider of data-driven solutions, helping our clients to unlock the full potential of their data. Our team of experts works closely with clients to understand their business needs and develop tailored solutions that drive tangible business benefits.Job SummaryWe are seeking an experienced Solution Architect to...

  • Kafka Solutions Engineer

    3 weeks ago

    London, Greater London, United Kingdom Infoplus Technologies UK Limited Full time

    Join Us as a Kafka EngineerContract Position - Hybrid Work ModelCompany: Infoplus Technologies UK LimitedLocation: LondonWork Arrangement: Hybrid (2 days in office per week)Role Overview:We are seeking a skilled Kafka Engineer to enhance our product and platform architecture while adhering to established governance standards. Your role will...

  • Kafka Systems Architect

    3 weeks ago

    London, Greater London, United Kingdom Infoplus Technologies UK Limited Full time

    Join Our Team as a Kafka EngineerPosition Overview:Type: Contract | Location: Hybrid Work EnvironmentAbout the Role:We are seeking a skilled Kafka Engineer to enhance our product and platform architecture while adhering to central governance standards. The ideal candidate will ensure that our architectures are not only effective but also cost-efficient.Key...

  • Senior Kafka Architect

    3 weeks ago

    London, Greater London, United Kingdom Webologix Ltd INC Full time

    Greetings,We are pleased to present an exciting opportunity for a "Kafka Engineer" at Webologix Ltd/INC.Position: Kafka EngineerLocation: RemoteRole OverviewThis position aligns with a Specialist Engineering profile, where expertise in engineering and architecture is essential to devise strategies and roadmaps that cater to our clients' needs. The ideal...

  • Lead Solutions Architect

    3 weeks ago

    London, Greater London, United Kingdom Cititec Talent Full time

    Position OverviewLead Solutions Architect - Commodity Trading SectorCititec Talent is in search of a Lead Solutions Architect to join a prominent firm in the Commodity Trading sector. This role is pivotal in aligning the trading architecture with the innovative business strategies of the organization.The successful candidate will undertake a comprehensive...

  • Solutions Architect

    3 days ago

    London, Greater London, United Kingdom Agile Solutions Full time

    About Agile SolutionsWe are a leading provider of data-driven solutions, helping our clients to unlock the full potential of their data assets. Our team of experts is dedicated to delivering innovative and effective solutions that drive business value.Job SummaryWe are seeking an experienced Solutions Architect to join our team. The successful candidate will...

  • Solutions Architect

    4 days ago

    London, Greater London, United Kingdom Agile Solutions Full time

    About Agile SolutionsWe are a leading provider of data-driven solutions, helping our clients to unlock the full potential of their data assets. Our team of experts is dedicated to delivering innovative and effective solutions that drive business value.Job SummaryWe are seeking an experienced Solutions Architect to join our team. The successful candidate will...

  • Lead Solutions Architect

    3 weeks ago

    London, Greater London, United Kingdom Cititec Talent Full time

    Position OverviewLead Solutions Architect - Commodity Trading SectorCititec Talent is in search of a Lead Solutions Architect to join a prominent firm in the Commodity Trading industry. This role is pivotal in aligning the trading architecture with the innovative business strategies of the organization.The successful candidate will undertake a comprehensive...