Senior Kafka Platform Engineer

2 weeks ago


London, Greater London, United Kingdom NewDay Ltd Full time

Permanent Full Time role in Data Architecture & Data Engineering.
Located in London - Hybrid.

Permanent Full Time Data Architecture & Data Engineering London - Hybrid Apply now

Your new roleAt NewDay

As the Senior Kafka Engineer, you will lead the architecture, design, and implementation of Kafka in a multi-tenant environment. You will ensure that the platform meets the needs of multiple teams while maintaining high levels of performance, reliability, and security. The role holder will work with Platform Engineers, Technical Architects, Data Engineers, and Analysts at NewDay and with B2B customers of the Data Platform.

  • Confluent Kafka platform configuration, deployment, administration and support.
  • Ensuring all steps in these processes are automated and observable - IaC (Terraform).
  • Troubleshoot Kafka platform in multiple type of environments.
  • Ownership of problem isolation, resolution and bug reporting.
  • Configure Kafka connectors for mainframe and enterprise database systems.
  • Fine tune brokers for various use cases.
  • Version upgrades, setting up DR solution and strategy with HA.
  • Design and implement Kafka topics, data schemas (Avro), and ksqlDB objects.
  • Work with Data Engineers to design and test performant event streaming applications and data pipelines.
  • Work with AWS and Azure Security engineers to build security into the core of all deployments.

What you'll bring

  • Experience in building Kafka producer and consumer applications.
  • Configuration and administration of Confluent Kafka in AWS and Azure.
  • Integration of Kafka connectors with various sources of data.
  • Experience of working with distributed data systems.
  • Experienced Terraform developer; understanding of Infrastructure-as-Code and its application in modern cloud computing.
  • Strong knowledge of computer networks including cloud networks, corporate networks (Firewalls, Proxies) and VPCs.
  • AWS networks (VPC, VPN, Direct Connect, Route 53, Auto scaling, CloudWatch, GuardDuty, Network Firewall).
  • Account management (IAM, AD integration).
  • Good knowledge of virtualisation/containerisation.
  • Strong knowledge of Continuous Integration & Deployment methodologies.
  • Installation and configuration of ELK (Elastic, Fluentd, Kibana).
  • Experience with SQL and NoSQL technologies.
  • Working in Agile environments (mostly in Sprint teams).
  • A strong and enthusiastic commitment to resolving customer problems in a high quality and timely manner.

And would love you to know or learn:

  • Certifications on Confluent Kafka and Cloud Technologies are a plus
  • Snowflake Experience
  • Understanding of Data Vault design pattern

About NewDay

We help people move forward with credit,
and help our colleagues to move their careers forward too.

We use our highly flexible, scalable, and multi-product digital credit engine to power over 120 million transactions every year. Our brands include Aqua, marbles, fluid and Bip. We partner with leading brands such as John Lewis, AO, Argos and DEKO.

Over 5 million UK customers are supported by our award-winning customer service.

At NewDay, we value all types of diversity. We're an equal opportunity employer and believe that our differences create a vibrant, authentic working culture. We want all our colleagues to feel able to bring their whole selves to work. We don't discriminate on the basis of age, physical or mental disability, gender reassignment, marriage and civil partnership, pregnancy and carer status, race (including colour, nationality, and ethnic or national origin), religion or belief, sex and sexual orientation. We make sure that every job is crafted to be inclusive and that people with disabilities or caring responsibilities can take part in the application and interview process. Tell us if you need accommodations: we'll put reasonable adjustments in place to support you.

Our dynamic NewDay culture

We're focused on what will drive impact in helping people move forward with credit. Our distinctive culture is geared to spark innovation and team working – with lots of open doors for development. Our customers can rely on us because we aim high, support each other, do the right thing and build for the future.
We invest in our colleagues. On top of a strong market competitive salary, you get a bonus opportunity that matches the impact (delivery + values) you drive in your role. We also help you retire better with market leading pensions.
At NewDay, #yourwellbeing matters: You get 26 days holiday and can buy up to 5 more after probation. Then you'll get extra days as you build your career with us.
NewWork, our flexible, hybrid working approach, helps you to manage your work/life balance - and even bolt on work time in other countries before or after your holiday. And when you're in the office, you get free healthy breakfast, fresh juices, lunch, barista coffee etc
Our tax efficient green car and cycle to work schemes save you money (and help the planet).
Ask your Talent Acquisition Partner to tell you more about any of our perks.

Where next?

We work with Textio to make our job design and hiring inclusive

In the NewDay Tech team, you'll join an Expert or Leader career pathway. This will guide you on what your next step here could look like, with regular and open feedback to help you build capabilities to move forward.

Showing roles with Contract types , within team types and Located in locations

#J-18808-Ljbffr

  • London, Greater London, United Kingdom McGregor Boyall Full time

    Platform Engineer, Backend, AWS, Terraform, Kubernetes, CI/CD, Java, Spring Boot, Apache Kafka, Kafka Connect, Kafka, API, RESTSenior Platform Engineer (Backend)Permanent - £90K-110K + bonusHybrid (2x a month onsite) - LondonNo Sponsorship AvailableThe roleA leading UK wealth manager is looking for a Senior Platform Engineer (Backend) to join the team.You...

  • Kafka Specialist

    2 weeks ago


    London, Greater London, United Kingdom LHH Recruitment Full time

    Role: Software Engineer - Kaffka Specialist Location: London Daily rate: £750 - £1,000 pd paid inside IR35 via umbrella Our client, a leading global FinTech is looking to hire someone with stong Kafka Operations and Admin experience to join on a six-month contractSpec below:Strong knowledge required of : Linux Admin and Management Kafka Admin and...

  • Kafka Developer

    2 weeks ago


    London, Greater London, United Kingdom Intuition IT Solutions Ltd Full time

    Job DescriptionJob Title: Kafka Developer. Location: Hybrid Working, London 1-2 Days per week. Job Type: Contract you will be responsible for building and maintaining high performant Confluent Kafka platform in on-premise and AWS Cloud.3+ years of experience with Apache Kafka and confluent platform In-Depth knowledge of Kafka Architecture.Hands on...

  • Senior Engineer

    2 weeks ago


    London, Greater London, United Kingdom NewDay Ltd Full time

    Permanent Full Time role in Data Architecture & Data Engineering. Located in London - Hybrid. Permanent Full Time Data Architecture & Data Engineering London - Hybrid Apply now Your new roleAt NewDay As the Senior Kafka Engineer, you will lead the architecture, design, and implementation of Kafka in a multi-tenant environment. You will ensure that the...

  • Platform Engineer

    1 month ago


    London, Greater London, United Kingdom Morgan Philips Executive Search Full time

    Platform Engineer required in 6 monthly terms within this blue-chip Financial Services organisation. The rate is inside IR35, including holiday pay. You will be based on-prem in their City office and 2 days remotely. Sponsorship is not available.The Platform Engineer role will focus on Automation and Application Deployment. You will be a specialist as a...


  • London, Greater London, United Kingdom Fairfield Consultancy Services Ltd Full time

    Key Responsibilities & AccountabilitiesThis role is responsible for: Design, develop and enhance the Leading Global Fixed Income etrading platform for institutional investors Be part of a scrum team comprised of skilled technology professionals with the goal to revolutionize the credit and corporate bond markets Innovate and transform business ideas into...

  • Senior Data Engineer

    2 weeks ago


    London, Greater London, United Kingdom Wave Talent Full time

    UK's leading marketplace platform is looking for aSenior Data Engineerto take a lead on several aspects of their data platform built inPython, Airflow, Kafka, Sagemaker, AWSandGCP.Salary:up to £105k + 15% bonusnLocation:can be based anywhere in the UK (with a preference for being in commuting distance to London or Portsmouth for team meet-ups)Must have...


  • London, Greater London, United Kingdom Salt Search Full time

    Role - Java EngineersTech - Java17, Springboot, Micronaut, Kafka, AWS, Docker, Kubernetes, PostgresCompensation Package - £100,000 to £130, % pension + 38 days holidayLocation - London/RemoteI am recruiting for multiple experienced Java Engineers on behalf of this software company who have significant investment from one of the largest financial...


  • London, Greater London, United Kingdom Mirus Talent Full time

    As they continue to transform their clients businesses through the power of data, they're on the lookout for a dynamic Senior Software Engineer to join their passionate team. js, PostgreSQL, Kafka, and Redis to craft cutting-edge platform features that drive innovation in data systems. js, PostgreSQL, Kafka, and Redis is a must. Seize the opportunity to...


  • London, Greater London, United Kingdom Initi8 Recruitment Full time £100,000

    Job Description Senior/Lead Engineer - You will play a pivotal role in joining at an early stage and benefit from helping shape the foundations. There will be lots of room for Greenfield Software Development. You will need a deep understanding of: , Kafka, AWS, PostgreSQL With proven experience as a Senior/Lead Engineer, you will bring your experience...

  • Platform Engineer

    2 weeks ago


    London, Greater London, United Kingdom Jobs for Humanity Full time

    Job Description Position Type : Full time Type Of Hire : Experienced (relevant combo of work and education) Education Desired : Bachelor of Computer Engineering Travel Percentage : 1 - 5%Are you ready to unleash your full potential? We're looking for people who are passionate about payments to chart Worldpay's path to being the largest and most-loved...

  • AWS Platform Engineer

    2 weeks ago


    London, Greater London, United Kingdom And Zopa Limited Full time

    We started our journey back in 2005, building the first ever peer-to-peer lending company. Fast forward to 2020 and we launched Zopa Bank. A bank that listens to what our customers don't like about finance and does the opposite. We're redefining what it feels like to work in finance. Our vision for a new era of banking puts people front and centre — we've...


  • London, Greater London, United Kingdom Cornwallis Elt Ltd Full time

    Senior Java/Kafka Engineer – Java 11/17, Kafka, Spring Boot, Microservices, Messaging, Hedge Fund - 12 month Fixed Term Contract A Senior Java Developer with strong knowledge of the Kafka platform and in-depth experience of real-time data streaming is sought after by a leading Hedge Fund currently undergoing a critical technology modernisation programme....

  • Senior Data Developer

    2 weeks ago


    London, Greater London, United Kingdom Adecco UK LTD Full time

    SENIOR KAFKA DEVELOPER REQUIRED IN LONDON Hybrid working 2 days a week office based. My client is a blue chip FMCG and retail brand that serve millions of customers every week from all over the globe. As a Senior Kafka Engineer, you will be dedicated to architecting and design, facilitating seamless consumption of Cloud and Middleware platform offerings....


  • London, Greater London, United Kingdom Nicoll Curtin Full time

    Senior Java Developer - Java, Spring Boot, Kafka, Kubernetes, Microservices, MSSQL, VerticaI am seeking a Senior Java Developer to join my client who is a leading global investment management firm based in central London. You will be joining a high-performing team, that is working on building a new Trade Capture and PnL platform which is written in Java. The...


  • London, Greater London, United Kingdom Workato Inc Full time

    Responsibilities As a Senior Data Infrastructure Engineer you will be responsible for deploying, scaling and maintenance of services at the core of Workato Data Platform such as analytical data storages, real time ingestion services, data lakes, orchestration tools. You will closely work with Data Engineers, and Developers as a part of a small, flexible...


  • London, Greater London, United Kingdom Oliver Bernard Full time

    Senior Platform Engineer – FinTech - Azure, Kubernetes, TerraformOliver Bernard are currently seeking a Senior Platform Engineer to join a well-established team for a FinTech company in London. This hire is part of a period of transformation across the business focused around expanding their global product and instilling a strong DevOps culture whilst...


  • London, Greater London, United Kingdom Formula Recruitment Full time

    Senior Platform EngineerThe experience expected from applicants, as well as additional skills and qualifications needed for this job are listed below.Salary: Up to £85,000 plus equityLocation: Remote first (onsite in Bristol 1 day per month)Type: PermanentWe are currently partnered with a FinTech-for-good start up who are enabling fund managers and...


  • London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Senior Software Engineer (Contract)Up To £850 Per Day Outside IR356-Month Initial ContractHybrid (London Based) Are you an experienced Senior Software Engineer seeking a contract role? This is an exciting opportunity to join a diverse, crossfunctional team and work on a greenfield digital transformation project. If you're looking to take the next step in...

  • Senior Data Engineer

    2 weeks ago


    London, Greater London, United Kingdom Venn Group Full time

    I am working with a market leading Advertising client, who are currently hiring a Senior Data Engineer.Data is a key component for this client, and this opportunity will allow you to shape and build there Data platform. You will be involved in the design and construction of new data capabilities from the ground up, and is a unique opportunity to influence...