Senior Data Engineer

2 days ago

UK, UK, United Kingdom Kainos Full time

When you join Kainos, you get to think beyond limitations to make an immediate and positive impact – like transforming digital services for millions of citizens or helping Fortune 500 companies get live and thrive on Workday.


You’ll be part of a people-first culture that is growing around the world. We’re a creative, committed, and diverse group of individuals who succeed as a team.


At Kainos your ideas are heard and valued and you’ll leave a legacy that you can feel proud of. Join us and discover how our people write our story.


MAIN PURPOSE OF THE ROLE & RESPONSIBILITIES IN THE BUSINESS:


As a Senior Data Engineer (Senior Associate) at Kainos, you will be responsible or designing and developing data processing and data persistence software components for solutions which handle data at scale. Working in agile teams, Senior Data Engineers provide strong development leadership and take responsibility for significant technical components of data systems . You will work within a multi-skilled agile team to design and develop large-scale data processing software to meet user needs in demanding production environments.

Your responsibilities will include:

  • Working to develop data processing software primarily for deployment in Big Data technologies. The role encompasses the full software lifecycle including design, code, test and defect resolution.
  • Working with Architects and Lead Engineers to ensure the software supports non-functional needs.
  • Collaborating with colleagues to resolve implementation challenges and ensure code quality and maintainability remains high. Leads by example in code quality.
  • Working with operations teams to ensure operational readiness
  • Advising customers and managers on the estimated effort and technical implications of user stories and user journeys.
  • Coaching and mentoring team members.


MINIMUM (ESSENTIAL) REQUIREMENTS:

  • Strong software development experience in one of Java, Scala, or Python
  • Software development experience with data-processing platforms from vendors such as AWS, Azure, GCP, Databricks.
  • Experience of developing substantial components for large-scale data processing solutions and deploying into a production environment
  • Proficient in SQL and SQL extensions for analytical queries
  • Solid understanding of ETL/ELT data processing pipelines and design patterns
  • Aware of key features and pitfalls of distributed data processing frameworks, data stores and data serialisation formats
  • Able to write quality, testable code and has experience of automated testing
  • Experience with Continuous Integration and Continuous Deployment techniques



DESIRABLE REQUIREMENTS:

  • Experience of performance tuning
  • Experience of data visualisation and complex data transformations
  • Experience with steaming and event-processing architectures including technologies such as Kafka and change-data-capture (CDC) products
  • Expertise in continuous improvement and sharing input on data best practice


So what are you waiting for? Let’s write the next incredible chapter of our story together.


Embracing our differences


At Kainos, we believe in the power of diversity, equity and inclusion. We are committed to building a team that is as diverse as the world we live in, where everyone is valued, respected, and given an equal chance to thrive. We actively seek out talented people from all backgrounds, regardless of age, race, ethnicity, gender, sexual orientation, religion, disability, or any other characteristic that makes them who they are. We also believe every candidate deserves a level playing field. Our friendly talent acquisition team is here to support you every step of the way, so if you require any accommodations or adjustments, we encourage you to reach out. We understand that everyone's journey is different, and by having a private conversation we can ensure that our recruitment process is tailored to your needs.

  • Senior Data Engineer

    4 weeks ago

    UK, UK, United Kingdom Understanding Recruitment Full time

    Senior Data Engineer | 1x per month in the London office (flex)I am looking for a Senior Data Engineer to join a cutting edge start-up that’s leading the charge in IoT, and data-driven tech across Europe!They are revolutionising the automotive space with cutting-edge in-car technology, web apps, and APIs. To accelerate the building of their greenfield...

  • Senior Data Engineer

    2 weeks ago

    UK, UK, United Kingdom Understanding Recruitment Full time

    Senior Data Engineer | 1x per month/quarter in the London office (flex)I am looking for a Senior Data Engineer to join a cutting edge start-up that’s leading the charge in IoT, and data-driven tech across Europe!They are revolutionising the automotive space with cutting-edge in-car technology, web apps, and APIs. To accelerate the building of their...

  • Senior Data Engineer

    4 weeks ago

    UK, UK, United Kingdom Harnham Full time

    Senior Data EngineerLocation: Remote working (Once a month in Oxford)Salary: £80k + competitive benefits packageRole Overview:Our client is seeking a Senior Data Engineer to elevate their data infrastructure's reliability and scalability. Reporting to the Data & Analytics Director, you will drive the development of a larger data mesh setup while...

  • Senior Data Engineer

    4 weeks ago

    UK, UK, United Kingdom Harnham Full time

    Senior Data Engineer Location: London (3 Days a week in office) Salary: £90,000Company:Our client are in the financial space and currently undertaking a greenfield build of a Snowflake data warehouse on Azure, aimed at creating a more streamlined, user-friendly data environment. This role will work closely with a data architect, senior FP&A manager to...

  • Senior Data Engineer

    2 months ago

    UK, UK, United Kingdom SPG Resourcing Full time

    Job Title: Microsoft Fabric SME / Senior Data Engineer (3-Month initial Contract)Location: Remote Day Rate: £500-£600 (Outside IR35) About the Role:We are seeking a Microsoft Fabric SME/ Senior Data Engineer to join one of our clients for a critical 3-month project within the manufacturing sector. You will play a key role in the design, setup, and scaling...

  • Senior Data Platform Engineer

    5 days ago

    UK, UK, United Kingdom Amicus Full time

    Senior Data Platform Engineer – Python / AWS / Data Platforms – Remote I am partnered with an European BioTech start-up having secured their Series A round of funding they are looking to expand their Engineering steam with addition of multiple mid-Senior engineers.CompanyThe business specialises in building tools and systems to further the drug discovery...

  • Senior Data Engineer

    3 months ago

    UK, UK, United Kingdom TLP Consultancy Ltd Full time

    £65,000 to £75,000 Permanent Near Epsom, Surrey (location is most easily reached by own transport) Hybrid working (3 days a week in the office) Generous benefits package (Performance related bonus, Pension, access to their car scheme, Birthday voucher, Workplace Nursery Benefit & Cycle Scheme, holiday purchase scheme, discounted onsite gym membership,...

  • Lead Data Engineer

    3 months ago

    UK, UK, United Kingdom Noir Full time

    Lead Data Engineer (Python, PySpark) - Remote(Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI / CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead,...

  • Senior Data Scientist

    2 days ago

    UK, UK, United Kingdom Harnham Full time

    SENIOR DATA SCIENTISTUP TO £80,000REMOTE (UK)COMPANY:We are partnered with a global player in data-driven solutions for a high-demand sector, partnering with over 150 organizations worldwide - mainly within telecoms. The company specialises in optimising revenue streams through innovative solutions, including data clearing, strategic insights, and IoT...

  • Senior Data Analyst

    4 weeks ago

    UK, UK, United Kingdom developrec Full time

    Senior Data Analyst, Central London (2 days per week), £70k - £80k + Bonus & Benefits!An exciting opportunity to join my client’s team and make an impact on the future of data in finance. As a Senior Data Analyst, you will be instrumental in advancing AI/ML solutions, data governance practices, and financial data analysis. Collaborating with Data,...

  • Senior Data Architect

    4 weeks ago

    UK, UK, United Kingdom Marx Enterprise Transformation Architecture Full time

    Job Title: Senior Data ArchitectType: Remote, Full-timeAbout the RoleMarx Technology Consulting Ltd is looking for a Senior Data Architect to join our dynamic and innovative team. Based in London, we are a leading enterprise architecture consulting firm committed to helping clients harness the power of data for informed decision-making and strategic growth....

  • Senior Data Architect

    4 weeks ago

    UK, UK, United Kingdom Anson McCade Full time

    Data Architect 6 Months initially Outside IR35 Anson McCade are partnering with a leading digital transformation consultancies as they work with a major British institution as they seek to appoint a Senior Data Architect. The postholder will play a crucial role in designing and implementing data solutions across multiple cloud platforms. The Senior Data...

  • Data Engineer

    3 months ago

    UK, UK, United Kingdom Eames Consulting Full time

    We are delighted to be working with a global speciality Insurance firm that are looking to expand there Pricing Data engineering team with an experienced Data engineer.Responsibilities:Build and maintain data pipelines in a Spark-based platform to support the Pricing function.Develop solutions that enhance Global Pricing’s data-driven approach, leveraging...

  • Senior Data Engineer Python Spark AWS

    4 weeks ago

    London, UK, UK, United Kingdom Client Server Full time

    Senior Data Engineer (Python Spark AWS) Remote UK to £90kAre you a tech savvy Data Engineer with strong Python coding skills?You could be progressing your career in a senior, hands-on Data Engineer role as part of a friendly and supportive international team at a growing and hugely successful European car insurance tech company as they expand their UK...

  • Senior Software Engineer

    2 days ago

    UK, UK, United Kingdom Understanding Recruitment Full time

    Senior Software Engineer (Data Engineering)Join a dynamic team shaping the future of financial markets with cutting-edge trade surveillance technology. I am seeking a Senior Software Engineer with data engineering experience to build scalable, robust data pipelines in cloud environments and tackle challenges like data velocity, schema management, and high...

  • Senior Data Scientist

    3 weeks ago

    UK, UK, United Kingdom Sentient Search Full time

    Sentient Search are partnered with an innovative tech company based in Cambridge, England who combine cutting-edge machine learning techniques with real-world applications to deliver impactful results. Our client are looking for an experienced Senior Data Scientist to join our dynamic team and help lead the next phase of their growth.Please note this is an...

  • Senior Software Engineer

    5 days ago

    UK, UK, United Kingdom UMATR Full time

    Senior Software Engineer - Rust | FULLY RemoteSalary: £85k - £100k (PLUS bonus!)Location: Fully RemoteOur client is a global leader in AI and multi-cloud data management, accelerating the performance and reliability of AI and data-intensive workloads at scale. This is an opportunity to be a prominent innovator and shape the future of AI and data...

  • Sales and Solutions Engineering Manager

    3 months ago

    UK, UK, United Kingdom Vantage Data Centers Full time

    About Vantage Data CentersVantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another’s experience.Vantage Data Centers powers, cools, protects and connects the technology of the world’s well-known hyperscalers, cloud providers and large...

  • Senior Software Engineer

    4 weeks ago

    UK, UK, United Kingdom Venchr Full time

    Senior Software Engineer - Data-Driven Infrastructure Start-Up - Remote, UK - £80k Are you an accomplished software engineer with extensive experience handling data? Do you want the opportunity to work in an energetic start-up environment and shape the future of the built environment? Venchr are partnered with a leading innovator in the data infrastructure...

  • Senior Electronic Design Engineer

    4 weeks ago

    UK, UK, United Kingdom Aylin White Full time

    FREELANCE - OUTSIDE IR35 This engineering consultancy are looking for a Senior Electrical Design Engineer on a contract basis for their Data Centre projects.THE COMPANY- Specialising in mission critical projects- Great work life balanceRESPONSIBILITIES OF THE SENIOR ELECTRICAL DESIGN ENGINEERThe Senior Electrical Design Engineer’s day to day will involve...