Data Engineer – SC Cleared

2 days ago


Farringdon Greater London, United Kingdom SR2 Full time

Data Engineer – SC Cleared - AWS
Our client is establishing a new Data Team and requires a Data Engineer to design and implement the foundational data infrastructure. Current data is dispersed across multiple systems with inconsistent structures and limited automation. You will play a key role in creating scalable, secure data pipelines and models that enable reliable ingestion, transformation, and delivery across the organisation.
Due to the nature of the work, active SC clearance is required.
Key Responsibilities

Design, build, and maintain scalable data pipelines across AWS and Azure environments to ingest, transform, and store data from multiple sources.
Develop and manage data models, schemas, and metadata to support analytics, reporting, and operational requirements.
Work closely with Data Analysts, Data Scientists, and Business Analysts to ensure data is accessible, high-quality, and fit for purpose.
Implement data quality and validation routines, including monitoring, alerting, and automated checks.
Optimise data workflows for performance, cost-efficiency, and maintainability, using platforms such as Azure Data Factory, AWS Data Pipeline, Glue, Lambda, Databricks, and Apache Spark.
Support the integration of transformed data into visualisation and analytical platforms, including Power BI, ServiceNow, and Amazon QuickSight.
Ensure compliance with data governance, security, and privacy standards across all pipelines and processes.
Produce clear documentation of data architecture, pipelines, and operational processes to support knowledge transfer and maintainability.
Contribute to the development of a modern data platform capable of both batch and real-time processing



  • Farringdon, Greater London, United Kingdom SR2 Full time

    Data Analyst – SC Cleared - AWS We’re looking for a Data Analyst (SFIA Level 4) to join a high-profile government data transformation programme. The role will support an existing team, working across data modelling, analytics, and performance optimisation within the AWS Athena environment. This is not a data engineering or build role; it’s focused on...


  • Farringdon, Greater London, United Kingdom SR2 Full time

    Senior Data Engineer – SC Cleared We are seeking a hands-on Senior Data Engineer with deep expertise in building and managing streaming and batch data pipelines. The ideal candidate will have strong experience working with large-scale data systems operating on cloud-based platforms such as AWS, Databricks or Snowflake. This role also involves close...


  • Farringdon, Greater London, United Kingdom SR2 Full time

    DevOps Engineer – AWS – SC Cleared We are looking for two hands-on DevOps Engineers with strong AWS expertise to design and build platforms that enable data platforms and data-sharing systems at scale. This role is ideal for someone who thrives in a fast-paced environment and enjoys working at the intersection of cloud engineering, data, and...


  • Greater London, United Kingdom TRIAD GROUP PLC Full time

    SC Cleared Databricks Data Engineer contract C Job Title: SC Cleared Databricks Data Engineer Location: Client sites, remote, or hybrid, depending on project need. Contract Type: Contract About Us Triad Group Plc is an award-winning digital, data, and solutions consultancy with over 35 years’ experience primarily serving the UK public sector and central...


  • London, United Kingdom Blue Wolf Digital Full time

    Job DescriptionJob Title: SC Cleared Data EngineerLocation: London - regular travel to client sites will be required.Contract Type: PermanentSalary: All levels consideredOverview:I'm currently seeking SC Cleared Data Engineers, Software Engineers, Data Analysts or Data Scientists to join my rapidly growing client. This exciting opportunity will involve...


  • London Area, United Kingdom Blue Wolf Digital Full time

    Job Title: SC Cleared Data EngineerLocation: London - regular travel to client sites will be required.Contract Type: PermanentSalary: All levels consideredOverview:I'm currently seeking SC Cleared Data Engineers, Software Engineers, Data Analysts or Data Scientists to join my rapidly growing client. This exciting opportunity will involve working on critical...


  • London, Greater London, United Kingdom Axiom Software Solutions Limited Full time £96,000 per year

    Role: Data EngineerJob Type: ContractDay Rate: £400 per day (inside IR35)Duration: 6 Months + likely to be extendWork Location: ideally commutable to London, Bristol, or Manchester officePlease look for Security Cleared candidate.Name: Contact No: Email Id: Total Years of Experience Vendor Name Worked with Defra/Public sector : Yes/No If yes –...


  • London, Greater London, United Kingdom Axiom Software Solutions Limited Full time £40,000 - £80,000 per year

    Role: Data EngineerJob Type: ContractDuration: 6 Months + likely to be extendWork Location: ideally commutable to London, Bristol, or Manchester officePosition: 1Start date: July'24Please look for Security Cleared candidate.Name: Contact No: Email Id: Total Years of Experience Vendor Name Worked with Defra/Public sector : Yes/No If yes – Reason for...


  • London, Greater London, United Kingdom Morgan Hunt Full time £86,400 - £96,000 per year

    SC Cleared Data Professionals - Leading Government Organisation - Central LondonTitle:Urgent Requirement: SC Cleared Data Professionals (Engineer to Architect)Morgan Huntare proud to be partnering with a prestigiousleading UK government organisationbased in the heart ofLondon. We are supporting a critical digital transformation initiative and are seeking...


  • London, United Kingdom Axiom Software Solutions Limited Full time

    Overview Role: Data Engineer Job Type: Contract Day Rate: £400 per day (inside IR35) Duration: 6 Months + likely to extend Work Location: ideally commutable to London, Bristol, or Manchester office Please look for Security Cleared candidate. Candidate Information Name: Contact No: Email Id: Total Years of Experience Vendor Name Worked with Defra/Public...