Senior Data Engineer – SC Cleared
2 weeks ago
Senior Data Engineer – SC Cleared
We are seeking a hands-on Senior Data Engineer with deep expertise in building and managing streaming and batch data pipelines. The ideal candidate will have strong experience working with large-scale data systems operating on cloud-based platforms such as AWS, Databricks or Snowflake. This role also involves close collaboration with hyperscalers and data platform vendors to evaluate and document Proofs of Concept (PoCs) for modern data platforms, while effectively engaging with senior stakeholders across the organisation.
Key Responsibilities:
Design, develop, and maintain streaming and batch data pipelines using modern data engineering tools and frameworks.
Work with large volumes of structured and unstructured data, ensuring high performance and scalability.
Collaborate with cloud providers and data platform vendors (e.g., AWS, Microsoft Azure, Databricks, IBM, Snowflake) to conduct PoCs for data platform solutions.
Evaluate PoC outcomes and provide comprehensive documentation including architecture, performance benchmarks, and recommendations.
Engage with key stakeholders including Heads of Architecture, Enterprise Architects, Product Owners, and Security teams to align data platform initiatives with business and technical strategies.Required Experience & Skills:
Proven experience as a Data Engineer with a strong focus on streaming and batch processing.
Hands-on experience with cloud-based data plaforms such as AWS/ Databricks/ IBM/ Snowflake.
Strong programming skills in Python, Scala, or Java.
Experience with data modeling, ETL/ELT processes, and data warehousing.
Experience conducting and documenting PoCs with hyperscalers or data platform vendors.Preferred Qualifications:
Certifications in AWS, Azure, or Databricks.
Experience with Snowflake, IBM DataStage, or other enterprise data tools.
Knowledge of CI/CD pipelines and infrastructure as code (e.g., Terraform, CloudFormation).
Familiarity with data governance frameworks and compliance standards
-
Data Engineer – SC Cleared
2 days ago
Farringdon, Greater London, United Kingdom SR2 Full timeData Engineer – SC Cleared - AWS Our client is establishing a new Data Team and requires a Data Engineer to design and implement the foundational data infrastructure. Current data is dispersed across multiple systems with inconsistent structures and limited automation. You will play a key role in creating scalable, secure data pipelines and models that...
-
Data Analyst – SC Cleared
2 days ago
Farringdon, Greater London, United Kingdom SR2 Full timeData Analyst – SC Cleared - AWS We’re looking for a Data Analyst (SFIA Level 4) to join a high-profile government data transformation programme. The role will support an existing team, working across data modelling, analytics, and performance optimisation within the AWS Athena environment. This is not a data engineering or build role; it’s focused on...
-
DevOps Engineer – AWS – SC Cleared
2 weeks ago
Farringdon, Greater London, United Kingdom SR2 Full timeDevOps Engineer – AWS – SC Cleared We are looking for two hands-on DevOps Engineers with strong AWS expertise to design and build platforms that enable data platforms and data-sharing systems at scale. This role is ideal for someone who thrives in a fast-paced environment and enjoys working at the intersection of cloud engineering, data, and...
-
SC Cleared Data Professionals
1 week ago
London, Greater London, United Kingdom Morgan Hunt Full time £86,400 - £96,000 per yearSC Cleared Data Professionals - Leading Government Organisation - Central LondonTitle:Urgent Requirement: SC Cleared Data Professionals (Engineer to Architect)Morgan Huntare proud to be partnering with a prestigiousleading UK government organisationbased in the heart ofLondon. We are supporting a critical digital transformation initiative and are seeking...
-
SC Cleared Databricks Data Engineer
3 days ago
Greater London, United Kingdom TRIAD GROUP PLC Full timeSC Cleared Databricks Data Engineer contract C Job Title: SC Cleared Databricks Data Engineer Location: Client sites, remote, or hybrid, depending on project need. Contract Type: Contract About Us Triad Group Plc is an award-winning digital, data, and solutions consultancy with over 35 years’ experience primarily serving the UK public sector and central...
-
Senior Data Engineer
5 days ago
London - SE, UK, United Kingdom Data Careers Full time £85,000 - £100,000 per yearJob DescriptionSenior Data Engineer – SC ClearedRemote (UK-based)£85, ,000 + BenefitsFull-Time | Central Government ProjectsWe're looking for an experienced Senior Data Engineer to lead the design and delivery of secure, scalable, cloud-native data solutions across high-impact central government programmes. This is a fully remote role, but active SC...
-
SC Cleared Data Engineer/Scientist
2 weeks ago
London, United Kingdom Blue Wolf Digital Full timeJob DescriptionJob Title: SC Cleared Data EngineerLocation: London - regular travel to client sites will be required.Contract Type: PermanentSalary: All levels consideredOverview:I'm currently seeking SC Cleared Data Engineers, Software Engineers, Data Analysts or Data Scientists to join my rapidly growing client. This exciting opportunity will involve...
-
SC Cleared Data Engineer
1 week ago
London, Greater London, United Kingdom Axiom Software Solutions Limited Full time £96,000 per yearRole: Data EngineerJob Type: ContractDay Rate: £400 per day (inside IR35)Duration: 6 Months + likely to be extendWork Location: ideally commutable to London, Bristol, or Manchester officePlease look for Security Cleared candidate.Name: Contact No: Email Id: Total Years of Experience Vendor Name Worked with Defra/Public sector : Yes/No If yes –...
-
SC Cleared Data Engineer/Scientist
6 days ago
London Area, United Kingdom Blue Wolf Digital Full timeJob Title: SC Cleared Data EngineerLocation: London - regular travel to client sites will be required.Contract Type: PermanentSalary: All levels consideredOverview:I'm currently seeking SC Cleared Data Engineers, Software Engineers, Data Analysts or Data Scientists to join my rapidly growing client. This exciting opportunity will involve working on critical...
-
SC Cleared Data Engineer
5 days ago
London, Greater London, United Kingdom Axiom Software Solutions Limited Full time £40,000 - £80,000 per yearRole: Data EngineerJob Type: ContractDuration: 6 Months + likely to be extendWork Location: ideally commutable to London, Bristol, or Manchester officePosition: 1Start date: July'24Please look for Security Cleared candidate.Name: Contact No: Email Id: Total Years of Experience Vendor Name Worked with Defra/Public sector : Yes/No If yes – Reason for...