Senior Kafka Platform Engineer

4 weeks ago


London, United Kingdom NewDay Ltd Full time

Permanent Full Time role in Data Architecture & Data Engineering.
Located in London - Hybrid.

Permanent Full Time Data Architecture & Data Engineering London - Hybrid 502212 Apply now

Your new roleAt NewDay

As the Senior Kafka Engineer, you will lead the architecture, design, and implementation of Kafka in a multi-tenant environment. You will ensure that the platform meets the needs of multiple teams while maintaining high levels of performance, reliability, and security. The role holder will work with Platform Engineers, Technical Architects, Data Engineers, and Analysts at NewDay and with B2B customers of the Data Platform.

  • Confluent Kafka platform configuration, deployment, administration and support.
  • Ensuring all steps in these processes are automated and observable - IaC (Terraform).
  • Troubleshoot Kafka platform in multiple type of environments.
  • Ownership of problem isolation, resolution and bug reporting.
  • Configure Kafka connectors for mainframe and enterprise database systems.
  • Fine tune brokers for various use cases.
  • Version upgrades, setting up DR solution and strategy with HA.
  • Design and implement Kafka topics, data schemas (Avro), and ksqlDB objects.
  • Work with Data Engineers to design and test performant event streaming applications and data pipelines.
  • Work with AWS and Azure Security engineers to build security into the core of all deployments.

What you’ll bring

  • Experience in building Kafka producer and consumer applications.
  • Configuration and administration of Confluent Kafka in AWS and Azure.
  • Integration of Kafka connectors with various sources of data.
  • Experience of working with distributed data systems.
  • Experienced Terraform developer; understanding of Infrastructure-as-Code and its application in modern cloud computing.
  • Strong knowledge of computer networks including cloud networks, corporate networks (Firewalls, Proxies) and VPCs.
  • AWS networks (VPC, VPN, Direct Connect, Route 53, Auto scaling, CloudWatch, GuardDuty, Network Firewall).
  • Account management (IAM, AD integration).
  • Good knowledge of virtualisation/containerisation.
  • Strong knowledge of Continuous Integration & Deployment methodologies.
  • Installation and configuration of ELK (Elastic, Fluentd, Kibana).
  • Experience with SQL and NoSQL technologies.
  • Working in Agile environments (mostly in Sprint teams).
  • A strong and enthusiastic commitment to resolving customer problems in a high quality and timely manner.

And would love you to know or learn:

  • Certifications on Confluent Kafka and Cloud Technologies are a plus
  • Snowflake Experience
  • Understanding of Data Vault design pattern

About NewDay

We help people move forward with credit,
and help our colleagues to move their careers forward too.

We use our highly flexible, scalable, and multi-product digital credit engine to power over 120 million transactions every year. Our brands include Aqua, marbles, fluid and Bip. We partner with leading brands such as John Lewis, AO, Argos and DEKO.

Over 5 million UK customers are supported by our award-winning customer service.

At NewDay, we value all types of diversity. We’re an equal opportunity employer and believe that our differences create a vibrant, authentic working culture. We want all our colleagues to feel able to bring their whole selves to work. We don’t discriminate on the basis of age, physical or mental disability, gender reassignment, marriage and civil partnership, pregnancy and carer status, race (including colour, nationality, and ethnic or national origin), religion or belief, sex and sexual orientation. We make sure that every job is crafted to be inclusive and that people with disabilities or caring responsibilities can take part in the application and interview process. Tell us if you need accommodations: we’ll put reasonable adjustments in place to support you.

Our dynamic NewDay culture

We’re focused on what will drive impact in helping people move forward with credit. Our distinctive culture is geared to spark innovation and team working – with lots of open doors for development. Our customers can rely on us because we aim high, support each other, do the right thing and build for the future.
We invest in our colleagues. On top of a strong market competitive salary, you get a bonus opportunity that matches the impact (delivery + values) you drive in your role. We also help you retire better with market leading pensions.
At NewDay, #yourwellbeing matters: You get 26 days holiday and can buy up to 5 more after probation. Then you’ll get extra days as you build your career with us.
NewWork, our flexible, hybrid working approach, helps you to manage your work/life balance - and even bolt on work time in other countries before or after your holiday. And when you’re in the office, you get free healthy breakfast, fresh juices, lunch, barista coffee etc
Our tax efficient green car and cycle to work schemes save you money (and help the planet).
Ask your Talent Acquisition Partner to tell you more about any of our perks.

Where next?

We work with Textio to make our job design and hiring inclusive

In the NewDay Tech team, you’ll join an Expert or Leader career pathway. This will guide you on what your next step here could look like, with regular and open feedback to help you build capabilities to move forward.

Showing roles with Contract types , within team types and Located in locations

#J-18808-Ljbffr

  • London, Greater London, United Kingdom NewDay Ltd Full time

    Permanent Full Time role in Data Architecture & Data Engineering. Located in London - Hybrid. Permanent Full Time Data Architecture & Data Engineering London - Hybrid Apply now Your new roleAt NewDay As the Senior Kafka Engineer, you will lead the architecture, design, and implementation of Kafka in a multi-tenant environment. You will ensure that the...


  • London, United Kingdom NewDay Ltd Full time

    Permanent Full Time role in Data Architecture & Data Engineering. Located in London - Hybrid. Permanent Full Time Data Architecture & Data Engineering London - Hybrid 502212 Apply now Your new roleAt NewDay As the Senior Kafka Engineer, you will lead the architecture, design, and implementation of Kafka in a multi-tenant environment. You will ensure...


  • London, United Kingdom NewDay Ltd Full time

    Permanent Full Time role in Data Architecture & Data Engineering. Located in London - Hybrid. Permanent Full Time Data Architecture & Data Engineering London - Hybrid 502212 Apply now Your new roleAt NewDay As the Senior Kafka Engineer, you will lead the architecture, design, and implementation of Kafka in a multi-tenant environment. You will ensure...


  • London, United Kingdom Cornwallis Elt Full time

    Job Description Senior Java/Kafka Engineer – Java 11/17, Kafka, Spring Boot, Microservices, Messaging, Hedge Fund - 12 month Fixed Term Contract A Senior Java Developer with strong knowledge of the Kafka platform and in-depth experience of real-time data streaming is sought after by a leading Hedge Fund currently undergoing a critical technology...


  • London, United Kingdom Cornwallis Elt Full time

    Job Description Senior Java/Kafka Engineer – Java 11/17, Kafka, Spring Boot, Microservices, Messaging, Hedge Fund - 12 month Fixed Term Contract A Senior Java Developer with strong knowledge of the Kafka platform and in-depth experience of real-time data streaming is sought after by a leading Hedge Fund currently undergoing a critical technology...


  • London, United Kingdom Cornwallis Elt Full time

    Job Description Senior Java/Kafka Engineer – Java 11/17, Kafka, Spring Boot, Microservices, Messaging, Hedge Fund - 12 month Fixed Term Contract A Senior Java Developer with strong knowledge of the Kafka platform and in-depth experience of real-time data streaming is sought after by a leading Hedge Fund currently undergoing a critical technology...


  • London, United Kingdom Cornwallis Elt Full time

    Senior Java/Kafka Engineer – Java 11/17, Kafka, Spring Boot, Microservices, Messaging, Hedge Fund - 12 month Fixed Term Contract A Senior Java Developer with strong knowledge of the Kafka platform and in-depth experience of real-time data streaming is sought after by a leading Hedge Fund currently undergoing a critical technology modernisation programme....


  • London, United Kingdom Cornwallis Elt Full time

    Senior Java/Kafka Engineer – Java 11/17, Kafka, Spring Boot, Microservices, Messaging, Hedge Fund - 12 month Fixed Term Contract A Senior Java Developer with strong knowledge of the Kafka platform and in-depth experience of real-time data streaming is sought after by a leading Hedge Fund currently undergoing a critical technology modernisation programme....


  • London, United Kingdom Cornwallis Elt Full time

    Senior Java/Kafka Engineer – Java 11/17, Kafka, Spring Boot, Microservices, Messaging, Hedge Fund - 12 month Fixed Term ContractScroll down to find the complete details of the job offer, including experience required and associated duties and tasks.A Senior Java Developer with strong knowledge of the Kafka platform and in-depth experience of real-time data...


  • London, United Kingdom Cornwallis Elt Full time

    Senior Java/Kafka Engineer – Java 11/17, Kafka, Spring Boot, Microservices, Messaging, Hedge Fund - 12 month Fixed Term ContractA Senior Java Developer with strong knowledge of the Kafka platform and in-depth experience of real-time data streaming is sought after by a leading Hedge Fund currently undergoing a critical technology modernisation programme....


  • London Area, United Kingdom Cornwallis Elt Full time

    Senior Java/Kafka Engineer – Java 11/17, Kafka, Spring Boot, Microservices, Messaging, Hedge Fund - 12 month Fixed Term Contract A Senior Java Developer with strong knowledge of the Kafka platform and in-depth experience of real-time data streaming is sought after by a leading Hedge Fund currently undergoing a critical technology modernisation programme....


  • London Area, United Kingdom Cornwallis Elt Full time

    Senior Java/Kafka Engineer – Java 11/17, Kafka, Spring Boot, Microservices, Messaging, Hedge Fund - 12 month Fixed Term ContractA Senior Java Developer with strong knowledge of the Kafka platform and in-depth experience of real-time data streaming is sought after by a leading Hedge Fund currently undergoing a critical technology modernisation programme....


  • London Area, United Kingdom Cornwallis Elt Full time

    Senior Java/Kafka Engineer – Java 11/17, Kafka, Spring Boot, Microservices, Messaging, Hedge Fund - 12 month Fixed Term ContractA Senior Java Developer with strong knowledge of the Kafka platform and in-depth experience of real-time data streaming is sought after by a leading Hedge Fund currently undergoing a critical technology modernisation programme....


  • London, Greater London, United Kingdom McGregor Boyall Full time

    Platform Engineer, Backend, AWS, Terraform, Kubernetes, CI/CD, Java, Spring Boot, Apache Kafka, Kafka Connect, Kafka, API, RESTSenior Platform Engineer (Backend)Permanent - £90K-110K + bonusHybrid (2x a month onsite) - LondonNo Sponsorship AvailableThe roleA leading UK wealth manager is looking for a Senior Platform Engineer (Backend) to join the team.You...


  • London, United Kingdom NewDay Full time

    This job is brought to you by Jobs/Redefined, the UK's leading over-50s age inclusive jobs board. Senior Kafka Pla form Engineer Job no: 502212 Work ype: Permanen Full ime Loca ion: London - Hybrid Ca egories: Da a Archi ec ure & Da a Engineering Your new role A NewDay As he Senior Kafka Engineer, you will lead he archi ec ure, design,...


  • London, United Kingdom NewDay Full time

    This job is brought to you by Jobs/Redefined, the UK's leading over-50s age inclusive jobs board. Senior Kafka Pla form Engineer Job no: 502212 Work ype: Permanen Full ime Loca ion: London - Hybrid Ca egories: Da a Archi ec ure & Da a Engineering Your new role A NewDay As he Senior Kafka Engineer, you will lead he archi ec ure, design,...


  • London, United Kingdom NewDay Full time

    This job is brought to you by Jobs/Redefined, the UK's leading over-50s age inclusive jobs board. Senior Kafka Pla form Engineer Job no: 502212 Work ype: Permanen Full ime Loca ion: London - Hybrid Ca egories: Da a Archi ec ure & Da a Engineering Your new role A NewDay As he Senior Kafka Engineer, you will lead he archi ec ure, design,...


  • London, United Kingdom Intapp Full time

    Intapp is seeking a dynamic professional to manage and enhance our Kafka, OpenSearch, and Redis infrastructures, ensuring high availability, reliability, and scalability. In this pivotal role, you will be instrumental in configuring Kafka for optimal data ingestion and streaming, and developing Kafka Connect connectors. Your expertise will extend to...

  • AWS DevOps Engineer

    1 month ago


    London, United Kingdom Cognizant Full time

    Cognizant is looking for an AWS DevOps Engineer (Kafka). This is a full-time role that comes with a generous salary and benefits package. Please make an application promptly if you are a good match for this role due to high levels of interest.As an AWS DevOps Engineer (Kafka), you will be responsible for building and maintaining a high-performing Confluent...

  • AWS DevOps Engineer

    1 month ago


    London, United Kingdom Cognizant Full time

    Job Description Cognizant is looking for an AWS DevOps Engineer (Kafka). This is a full-time role that comes with a generous salary and benefits package. As an AWS DevOps Engineer (Kafka), you will be responsible for building and maintaining a high-performing Confluent Kafka platform on-premise and in the AWS Cloud. In your first week in this AWS DevOps...