kafka Architect

3 weeks ago

United Kingdom eTeam Full time

Role Title: KAFKA Specialist Engineer x2

Location: Remote

Duration: 6months

Contract Inside IR35

Role Description:


This role maps to a Specialist Engineering profile where knowledge of engineering and architecture combine to build strategies and roadmaps to align to our customers. The individual needs to be confident in understanding the general trends of the technologies in scope, how they are used by our customers, and anticipating how they need to evolve whilst meeting the end clients architecture standards. This specific role will be building and deploying Kafka clusters on both on Prem and Public cloud Kubernetes environments.


Key Qualities


• Must be able to communicate on technical levels with Engineers and stakeholders.

• Strong problem solving an analytical skill.

• Experience operating in an infrastructure as code and automation first principles environment.

• Understand the software development lifecycle process, specifically the standard engineering toolsets available to the team within CTO to design and develop software.


Key Responsibilities


• Work alongside product owners, technical leads and customers to strategize 3–5-year plans for streaming software.

• Produce and maintain product and platform architecture in line with the central architecture governance functions.

• Implement patterns that provide customers with robust deployment patterns meeting service levels tiers.

• Ensure that platform and product architectures remain cost effective.

• Standing up and administer On-Prem clusters.

• Provide expertise in Kafka brokers, zookeepers, Kafka connect, schema registry, KSQL, Rest proxy and Kafka Control center.

• Provide expertise and hands on experience working on Kafka connect using schema registry in a very high volume.

• Provide administration and operations of the Kafka platform - provisioning, access lists Kerberos and SSL configurations. Provide expertise and hands on experience working on Kafka connectors such as MQ connectors, Elastic Search connectors, JDBC connectors, File stream connector, JMS source connectors, Tasks, Workers, converters, Transforms.

• Provide expertise and hands on experience on custom connectors using the Kafka core concepts and API.

• Involve in design and capacity review meetings to provide suggestions in Kafka usage.

• Participate in work planning and estimation to ensure optimum performance, high availability, and stability of solutions.

• Create topics, setup redundancy cluster, deploy monitoring tools, alerts and has good knowledge of best practices. Create stubs for producers, consumers, and consumer groups for helping onboard applications from different languages/platforms.

• Use automation tools like provisioning using Docker, Jenkins, and GitLab.

• Setting up security on Kafka, Monitor, prevent and troubleshoot security-related issues.

• Ability to perform data related benchmarking, performance analysis and tuning.


Key Technologies


Messaging technologies –Apache Kafka, Confluent Kafka

DevOps toolsets – GitHub, JIRA, Confluence, Jenkins

Automation – Ansible, Puppet

Monitoring –Observability tools such as DataDog, NewRelic, Prometheus, Grafana ?

  • kafka Architect

    3 weeks ago

    United Kingdom eTeam Full time

    Role Title: KAFKA Specialist Engineer x2 Location: Remote Duration: 6months Contract Inside IR35 Role Description: This role maps to a Specialist Engineering profile where knowledge of engineering and architecture combine to build strategies and roadmaps to align to our customers. The individual needs to be confident in understanding the general trends...

  • Digital Solution Architect, flexible working

    2 weeks ago

    United Kingdom Whitehall Resources Full time

    An Solution Architect with strong Governance experience is required by Whitehall Resources for a permanent position based in London. The successful candidate will come from a Solution Architecture background and have strong cloud experience as well as a data and security background. Strong Data Background? Knowledge of platform, infrastructure, and data...

  • Solutions Architect

    2 weeks ago

    United Kingdom Whitehall Resources Full time

    Solution Architect An Solution Architect with strong Governance experience is required by Whitehall Resources for a permanent position based in London. This position is working with one of our long standing clients. The successful candidate will come from a Solution Architecture background and have strong cloud experience as well as a data and security...

  • Cloud Security Architect

    1 week ago

    United Kingdom Fruition Consulting Full time

    Cloud Security Architect (AWS)£700 / day - Outside IR35 Contract until EOY (very likely to extend) UK remote, very occasional site visits Fruition are currently seeking a highly skilled Cloud Security Architect (AWS) to join a well reputable technology first consultancy in the UK. You will be working closely to the Data team working on a large scale...

  • Cloud Security Architect

    1 week ago

    United Kingdom Fruition Consulting Full time

    Cloud Security Architect (AWS)£700 / day - Outside IR35 Contract until EOY (very likely to extend) UK remote, very occasional site visits Fruition are currently seeking a highly skilled Cloud Security Architect (AWS) to join a well reputable technology first consultancy in the UK. You will be working closely to the Data team working on a large scale...

  • Software Architect

    3 weeks ago

    United Kingdom Formula Recruitment Full time €85,000

    Software Architect (Golang) Type: Permanent Location: Fully Remote within Europe Salary: Up to £85,000 We are currently partnered with a customer obsessed digital consultancy who are providing digital first, world class products across a number of crucial sectors in the UK. The main aim is to help clients bring products through from ideation to...

  • Software Architect

    1 week ago

    United Kingdom Formula Recruitment Full time €85,000

    Software Architect (Golang) Type: Permanent Location: Fully Remote within Europe Salary: Up to £85,000 We are currently partnered with a customer obsessed digital consultancy who are providing digital first, world class products across a number of crucial sectors in the UK. The main aim is to help clients bring products through from ideation to...

  • Software Architect

    1 week ago

    United Kingdom Formula Recruitment Full time

    Software Architect (Golang) Type: Permanent Location: Fully Remote within Europe Salary: Up to £85,000 We are currently partnered with a customer obsessed digital consultancy who are providing digital first, world class products across a number of crucial sectors in the UK. The main aim is to help clients bring products through from ideation to...

  • Software Architect

    3 weeks ago

    United Kingdom Formula Recruitment Full time

    Software Architect (Golang)Type: PermanentLocation: Fully Remote within EuropeSalary: Up to £85,000We are currently partnered with a customer obsessed digital consultancy who are providing digital first, world class products across a number of crucial sectors in the UK. The main aim is to help clients bring products through from ideation to deployment with...

  • Software Architect

    3 weeks ago

    United Kingdom Formula Recruitment Full time

    Software Architect (Golang)Type: PermanentLocation: Fully Remote within EuropeSalary: Up to £85,000We are currently partnered with a customer obsessed digital consultancy who are providing digital first, world class products across a number of crucial sectors in the UK. The main aim is to help clients bring products through from ideation to deployment with...

  • Senior Cloud Security Architect

    1 week ago

    United Kingdom Fruition Consulting Full time

    Cloud Security Architect (AWS) ~£Contract until EOY (very likely to extend) ~ UK remote, very occasional site visits Fruition are currently seeking a highly skilled Cloud Security Architect (AWS) to join a well reputable technology first consultancy in the UK. You will be working closely to the Data team working on a large scale platform modernisation,...

  • Senior Cloud Security Architect

    1 week ago

    United Kingdom Fruition Consulting Full time

    Cloud Security Architect (AWS) ~£Contract until EOY (very likely to extend) ~ UK remote, very occasional site visits Fruition are currently seeking a highly skilled Cloud Security Architect (AWS) to join a well reputable technology first consultancy in the UK. You will be working closely to the Data team working on a large scale platform modernisation,...

  • Senior DevOps Solution Architect

    2 weeks ago

    United Kingdom Paritas Recruitment Full time

    Job Title : GCP Solutions Architect Location : London (Hybrid - 2 days a week in the office) Client: Large British Bank We're seeking a dynamic GCP Solutions Architect to lead cloud-native design and optimization, ensuring cutting-edge solutions that meet both functional and non-functional requirements. This is an exciting opportunity to join a...

  • Data Architect

    2 weeks ago

    United Kingdom PURVIEW Full time

    Data Architect12 Month Contract UK based remote workingPurview are currently recruiting for a Data Architect for our Tier 1 banking client on an initial 12 month contract. You will be a technical lead aligned to our Storage & Data Protection Services infrastructure team. Your primary focus will be on building, expanding, and optimizing our data platforms....

  • Data Architect

    2 weeks ago

    United Kingdom PURVIEW Full time

    Data Architect 12 Month Contract UK based remote working Purview are currently recruiting for a Data Architect for our Tier 1 banking client on an initial 12 month contract. You will be a technical lead aligned to our Storage & Data Protection Services infrastructure team. Your primary focus will be on building, expanding, and optimizing our data...

  • Data Architect

    2 weeks ago

    United Kingdom PURVIEW Full time

    Data Architect12 Month Contract UK based remote workingPurview are currently recruiting for a Data Architect for our Tier 1 banking client on an initial 12 month contract. You will be a technical lead aligned to our Storage & Data Protection Services infrastructure team. Your primary focus will be on building, expanding, and optimizing our data platforms....

  • GCP Solutions Architect

    2 weeks ago

    United Kingdom Paritas Recruitment Full time

    Job Title : GCP Solutions Architect Location : London (Hybrid - 2 days a week in the office) Client: Large British Bank We're seeking a dynamic GCP Solutions Architect to lead cloud-native design and optimization, ensuring cutting-edge solutions that meet both functional and non-functional requirements. This is an exciting opportunity to join a...

  • Lead Architect

    2 weeks ago

    United Kingdom Tata Technologies Full time

    At Tata Technologies we make product development dreams a reality by designing, engineering and validating the products of tomorrow for the world’s leading manufacturers. Due to our continued growth we are now recruiting for a SAP Solution Architect to be based at our office in Warwick Our Digital Enterprise Solutions (DES) Department leverages extensive...

  • Solutions Architect

    4 days ago

    United Kingdom Agile Solutions Full time

    About Agile Solutions Agile Solutions GB Ltd is focused on deriving true value from its customers data. We help them to manage, monetise, leverage and make better use of it. We provide advice, support and delivery services across various industry sectors covering a multitude of areas, ranging from Data Strategy, Governance and Security to Data Platform...

  • Solutions Architect

    4 days ago

    United Kingdom Agile Solutions Full time

    About Agile Solutions Agile Solutions GB Ltd is focused on deriving true value from its customers data. We help them to manage, monetise, leverage and make better use of it. We provide advice, support and delivery services across various industry sectors covering a multitude of areas, ranging from Data Strategy, Governance and Security to Data Platform...