Data Pipeline Architect

4 hours ago

United Kingdom ISR Recruitment Full time

The Opportunity:

Consulting as a Data Pipeline Architect on a major central government project to provide the required services to develop robust data pipelines, analytics and visualisation tools that will support the integration of multiple infrastructure datasets across various sectors.


These services will contribute to the creation of solutions that align with the principles of digital twins, which are virtual models connected to their real-world counterparts by a two-way flow of real-time data where the primary challenge is to consolidate these sources into one cohesive framework.


N.B. Candidates will have or be willing to undergo a basic level of security clearance prior to starting the role.


Skills and Experience:

  • Architectural Design: proven experience in implementing robust and scalable software architectures that meet both functional and non-functional requirements.
  • Data Pipeline Architectures: proven experience in implementing large-scale data warehousing solutions and data streaming technologies (such as Apache Kafka).
  • Data Pipeline and Application Scalability: experience in designing hosting and runtime architectures to scale ETL data pipelines.
  • Security Expertise: strong background in application and data security, including overseeing penetration tests and implementing security remediations.
  • Identity and Access Management: hands-on experience with federated authentication solutions using open standards (OAuth 2.0, OIDC, SAML).
  • RBAC/ABAC: experience in implementing RBAC/ABAC access solutions in a national-scale service based on user profiles and data attributes.
  • Cloud Technologies: extensive experience with AWS cloud services and best practices for cost optimisation and performance.
  • Containerisation: proficient in using Kubernetes (AWS EKS preferred) for deploying and managing applications and ETL components in a containerised environment.
  • Stakeholder Management: excellent ability to engage with stakeholders, facilitate discussions and achieve consensus on technical solutions.
  • Technical Communication: strong verbal and written communication skills, with the ability to convey complex technical concepts to both technical and non-technical audiences.
  • Infrastructure as Code (IaC): experience in deploying cloud environments using tools like Terraform.
  • CI/CD Solutions: proven ability to design and implement continuous integration and continuous deployment pipelines using GitHub Actions.


Please call Edward here at ISR on 07436 071 872 to learn more about our client leading the way in developing the next-generation of digital-twin solutions through innovation and transformational technology?

  • Data Architect, Loyalty

    4 weeks ago

    United Kingdom Data Idols Full time €75,000 - €90,000

    Data Architect - Retail Location: Central London 2/3 days per week in the office Joining one of the best-known retail brands in the UK as a Data Solutions Architect, you will provide design and architecture guidance across the company. They are looking for someone to use their expertise to drive the design of solutions for the platform to support the...

  • Data Architect

    4 weeks ago

    United Kingdom James Adams Full time

    Data Architect – Birmingham (Hybrid Working or Fully Remote)) Salary: Up to £80,000 + £450 per month car allowance (£86k total package) + 10% bonus We are excited to be recruiting for an experienced Data Architect to join a leading IT services organisation. This is a permanent position based in Birmingham , offering a flexible hybrid working model...

  • Lead Data Engineer/Architect

    3 weeks ago

    United Kingdom Athsai Full time

    Lead AWS Data Engineer/Architect -Job Location -London Remote Eligibility for SC clearance is required Contract - 400 outside IR35 handled a team of Data Engineers AW S expert Lead Data Engineer/Architect - We are looking for a dedicated professional with substantial experience in big data technologies to join our team. Your collaborative...

  • Lead Data Engineer/Architect

    2 weeks ago

    United Kingdom Athsai Full time

    Lead AWS Data Engineer/Architect -Job Location -London Remote Eligibility for SC clearance is required Contract - 400 outside IR35 handled a team of Data Engineers AW S expert Lead Data Engineer/Architect - We are looking for a dedicated professional with substantial experience in big data technologies to join our team. Your collaborative...

  • Senior Data Architect

    24 hours ago

    United Kingdom Simon James IT Ltd Full time

    Data Architect - Engineering project - UKREMOTE - 3-6 Months – SC ClearedWe’re looking for Chief Archtiect and a Lead Architect for a project with a government department in the UK. Both roles are remote but may have some onsite meetings. Working on the design and delivery of multiple data models, to drive data archtiecture and oversee the delviry of the...

  • Senior Data Architect

    17 hours ago

    United Kingdom Simon James IT Ltd Full time

    Data Architect - Engineering project - UKREMOTE - 3-6 Months – SC ClearedWe’re looking for Chief Archtiect and a Lead Architect for a project with a government department in the UK. Both roles are remote but may have some onsite meetings. Working on the design and delivery of multiple data models, to drive data archtiecture and oversee the delviry of the...

  • Lead AWS Data Engineer/Architect

    3 weeks ago

    United Kingdom Athsai Full time

    Lead AWS Data Engineer/Architect -Job Location -London Remote Eligibility for SC clearance is required Contract - 400 outside IR35 handled a team of Data Engineers AW S expert Lead Data Engineer/Architect - We are looking for a dedicated professional with substantial experience in big data technologies to join our team. Your collaborative skills will...

  • Lead AWS Data Engineer/Architect

    2 weeks ago

    United Kingdom Athsai Full time

    Lead AWS Data Engineer/Architect -Job Location -London Remote Eligibility for SC clearance is required Contract - 400 outside IR35 handled a team of Data Engineers AW S expert Lead Data Engineer/Architect - We are looking for a dedicated professional with substantial experience in big data technologies to join our team. Your collaborative skills will...

  • Lead AWS Data Engineer/Architect

    2 weeks ago

    United Kingdom Athsai Full time

    Lead AWS Data Engineer/Architect -Job Location -London Remote Eligibility for SC clearance is required Contract - 400 outside IR35 handled a team of Data Engineers AWS expert Lead Data Engineer/Architect - We are looking for a dedicated professional with substantial experience in big data technologies to join our team. Your collaborative skills will be key...

  • Data Architect

    4 weeks ago

    United Kingdom ShortList Recruitment Limited Full time €75,000

    Data Architect £75,000 Remote ShortList Recruitment are working with a leading consultancy firm who are looking for a Data Architect to join their growing team, on a fully remote basis. This is a thought leading company with an amazing culture, who trust their team to work autonomously and flexibly. The successful candidate will be a SQL specialist with...

  • Data Architect

    4 weeks ago

    United Kingdom ShortList Recruitment Limited Full time €75,000

    Data Architect £75,000 Remote ShortList Recruitment are working with a leading consultancy firm who are looking for a Data Architect to join their growing team, on a fully remote basis. This is a thought leading company with an amazing culture, who trust their team to work autonomously and flexibly. The successful candidate will be a SQL specialist with...

  • Data Architect

    1 month ago

    United Kingdom ShortList Recruitment Limited Full time

    Data Architect£75,000RemoteShortList Recruitment are working with a leading consultancy firm who are looking for a Data Architect to join their growing team, on a fully remote basis. This is a thought leading company with an amazing culture, who trust their team to work autonomously and flexibly.The successful candidate will be a SQL specialist with a...

  • Data Architect

    4 weeks ago

    United Kingdom ShortList Recruitment Limited Full time

    Data Architect £75,000 Remote ShortList Recruitment are working with a leading consultancy firm who are looking for a Data Architect to join their growing team, on a fully remote basis. This is a thought leading company with an amazing culture, who trust their team to work autonomously and flexibly. The successful candidate will be a SQL specialist with...

  • Data Architect

    1 month ago

    United Kingdom ShortList Recruitment Limited Full time

    Data Architect£75,000RemoteShortList Recruitment are working with a leading consultancy firm who are looking for a Data Architect to join their growing team, on a fully remote basis. This is a thought leading company with an amazing culture, who trust their team to work autonomously and flexibly.The successful candidate will be a SQL specialist with a...

  • Data Architect

    4 weeks ago

    United Kingdom ShortList Recruitment Limited Full time €75,000

    Data Architect £75,000 Remote ShortList Recruitment are working with a leading consultancy firm who are looking for a Data Architect to join their growing team, on a fully remote basis. This is a thought leading company with an amazing culture, who trust their team to work autonomously and flexibly. The successful candidate will be a SQL specialist...

  • Data Architect

    4 weeks ago

    United Kingdom ShortList Recruitment Limited Full time €75,000

    Data Architect £75,000 Remote ShortList Recruitment are working with a leading consultancy firm who are looking for a Data Architect to join their growing team, on a fully remote basis. This is a thought leading company with an amazing culture, who trust their team to work autonomously and flexibly. The successful candidate will be a SQL specialist...

  • Data Platform Architect

    4 weeks ago

    United Kingdom eTeam Full time

    Job Description: The Data Platform Architect will be responsible for the end-to-end design, development, and management of scalable and secure data platforms. This role includes handling end-to-end platform solutions, from infrastructure design to data security and deployment. Key Responsibilities: • End-to-End Platform Solutions: o Design, implement,...

  • ICT Data and Information Systems Architect

    4 weeks ago

    United Kingdom Eden Smith Group Full time €90,000

    Data Platform Technical Architect London/Hybrid Salary up to £90,000 plus generous bonus An exciting opportunity has arisen to join a well-known organisation in the insurance space, within a Data Platform Technical Lead role. This represents the chance to embark on a greenfield project within a forward thinking company, who are looking to accelerate...

  • Data Platform Technical Architect

    4 weeks ago

    United Kingdom Eden Smith Group Full time €90,000

    Data Platform Technical Architect London/Hybrid Salary up to £90,000 plus generous bonus An exciting opportunity has arisen to join a well-known organisation in the insurance space, within a Data Platform Technical Lead role. This represents the chance to embark on a greenfield project within a forward thinking company, who are looking to accelerate...

  • Data Architect

    4 weeks ago

    United Kingdom Recruit with Purpose Full time €90,000

    Do you want to take the next step to become an Enterprise Data Architect? Do you want to own the vision and oversee overall data architecture for a brand-new ERP implementation? If so, this Lead Data Architect position at a Midlands based Housing Association could be just the thing for you! As Lead Data Architect, you will introduce a clearly defined...