Senior Engineer, Data Engineering

6 days ago

Bristol, United Kingdom S.H.I.F.T Full time

T Talent has partnered with an IT Consultancy looking for Data Engineers.

Their Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing data platforms and services that are high-quality, cost-efficient, and tailored to clients’ needs. They make sure they provide maximum value to data consumers, including analysts, scientists, and business stakeholders.

As a Senior Data Engineer, you may play one or more roles according to their clients' needs. The role is very hands-on and you'll support as a senior contributor for a project, focusing on both delivering engineering work as well as upskilling members of the client team. At other points, you might play more of a technical architect role and work with the larger team to identify growth opportunities within the account.

You’ll make sure that the wider context of a delivery is considered and maintain alignment between the operational and analytical aspects of the engineering solution.

Gathering and meeting the requirements of both clients and users on a data project
Owning the cloud infrastructure underpinning data systems through a DevOps approach
Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop
Good understanding of the possible architectures involved in modern data system design (e.g. Data Warehouse, Data Lakes and Data Meshes) and the different use cases for them
Ability to create data pipelines on a cloud environment and integrate error handling within these pipelines. With an understanding how to create reusable libraries to encourage uniformity of approach across multiple data pipelines.
Able to document and present an end-to-end diagram to explain a data processing system on a cloud environment, with some knowledge of how you would present diagrams (C4, UML etc.)
To provide guidance how one would implement a robust DevOps approach in a data project. Also would be able to talk about tools needed for DataOps in areas such as orchestration, data integration and data analytics.
Experience in improving resilience into a project by checking for software vulnerabilities and implement appropriate testing strategies (unit, integration, data quality etc.)
Knowledge of SOLID, DRY and TDD principles and how to practically implement these into a project.
Agile practices such as Scrum, XP, and/or Kanban
Designing and implementing efficient data transformation processes at scale, both in batch and streaming use cases
Owning the cloud infrastructure underpinning data systems through a DevOps approach
Agile practices such as Scrum, XP, and/or Kanban
To be able to demonstrate a commercial mindset when on projects to grow accounts organically with senior stakeholders

Working with Docker and virtual environments as part of the development and CI/CD process.
Experience in working with a team of engineers using a variety of techniques such as pair programming or mob programming.
Working with data scientists to productionise advanced data deliverables, such as machine learning models
Working with multidisciplinary digital and technology teams
An increasing number of their customers are specifying a minimum of SC (security check) clearance in order to work on their projects. Eligibility for SC requires 5 years' continuous UK residency and 5 year' employment history (or back to full-time education).

  • Senior Data Engineer

    6 hours ago

    Bristol, United Kingdom Babcock Full time

    **Job Title: Senior Data Engineer Location: Filton, Bristol, GB, BS16 1EJ Flexible Working: The roles can be based at either Bristol, Leicester or Devonport Compensation: Competitive Salary + Pension (up to 8% matched) + 25 days holiday Role Type: Full time / Permanent Job ID: SF41485** At Babcock we're looking to recruit a Senior Data Engineer to work with...

  • Senior Data Engineer

    2 weeks ago

    Bristol, Bristol, United Kingdom Ignite Digital Full time £60,000 - £90,000 per year

    Senior Data Engineer Renewable Energy / CleanTechHybrid | Bristol | Competitive Salary + BenefitsAre you a Senior Data Engineer looking to apply your skills in a company thats driving positive environmental impact? This is a fantastic opportunity to join a fast-growing renewable energy company dedicated to advancing the clean energy transition through smart...

  • Senior Data Engineer

    2 days ago

    Bristol, United Kingdom S.H.I.F.T Full time

    About the RoleSenior Data Engineer for a public sector IT consultancy. In this role, you will develop, operate, and maintain data platforms and services that are high‑quality, cost‑efficient, and tailored to client needs, providing maximum value to analysts, scientists, and business stakeholders. Key Responsibilities Support clients as a senior...

  • Senior Data Engineer

    6 days ago

    Bristol, United Kingdom S.H.I.F.T Full time

    Job description S.H.I.F.T Talent has partnered with an IT Consultancy looking for Data Engineers. Their Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing data platforms and services that are high-quality, cost-efficient, and tailored to clients’ needs. They develop, operate, and maintain these services....

  • Senior Data Engineer

    4 days ago

    Bristol, United Kingdom S.H.I.F.T Full time

    Job descriptionS.H.I.F.T Talent has partnered with an IT Consultancy looking for Data Engineers.Their Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing data platforms and services that are high-quality, cost-efficient, and tailored to clients’ needs. They develop, operate, and maintain these services....

  • Senior Data Engineer

    3 days ago

    Bristol, United Kingdom S.H.I.F.T Full time

    Job descriptionS.H.I.F.T Talent has partnered with an IT Consultancy looking for Data Engineers.Their Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing data platforms and services that are high-quality, cost-efficient, and tailored to clients' needs. They develop, operate, and maintain these services....

  • Senior Engineer, Data Engineering

    1 week ago

    Bristol, United Kingdom Assystem Full time

    Assystem is one of the UK’s leading engineering and digital services organisations, dedicated to accelerating the global energy transition. With 8,000 Switchers worldwide, we combine deep engineering heritage with advanced digital innovation to deliver major low-carbon infrastructure programmes. In the UK, our teams support landmark projects including...

  • Senior Data Engineer

    6 days ago

    Bristol, United Kingdom Method Resourcing Full time

    **_Senior Data Engineer | Architecture l Snowflake l Talend l PowerBI l Data Modelling l £650-675 PD l Outside IR35 l 4 weeks initially_** - Method Resourcing are partnering with a brilliant consultancy whose end client needs a Senior Data Engineer/Architect for the initial discovery phase of a project. After the first 4 weeks, there may be an opportunity...

  • Senior Data Engineer

    5 days ago

    Bristol, Bristol, United Kingdom S.H.I.F.T Full time

    Job descriptionS.H.I.F.T Talent has partnered with an IT Consultancy looking for Data Engineers.Their Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing data platforms and services that are high-quality, cost-efficient, and tailored to clients' needs. They develop, operate, and maintain these services....

  • Senior Data Engineer

    3 days ago

    Bristol, United Kingdom S.H.I.F.T Full time

    Job descriptionS.H.I.F.T Talent has partnered with an IT Consultancy looking for Data Engineers.Check out the role overview below If you are confident you have got the right skills and experience, apply today.Their Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing data platforms and services that are...