SC Data Engineer

2 weeks ago


London UK, UK, United Kingdom DataCareers Full time

Data Engineer

Permanent

Location: Remote working with some onsite working

Salary: Up to £75K

Skills: SQL, Power BI, ETL, SSIS, Data Factory, Azure


We are looking to recruit an SC Cleared Data Engineer for a leading software & solutions organisation. The Data Engineer will design, develop and maintain robust data infrastructure and ETL pipelines that support the data needs of projects, services and customers. To create insightful data visualisations and dashboards in PowerBI to enable data-driven decision-making. Collaborate with Data Consultants, Architects and other professionals to offer seamless and effective data solutions to customers.


Due to the nature of the work valid SC Clearance is essential.


Key Responsibilities:


  • Build data pipelines for data throughout the Azure Data Platform stages, integrating data management best practices at all stage transitions suitable for their use case, e.g., reporting, or archival of data from operational systems or unstructured data stores
  • Strong proficiency in SQL and SSIS for ETL processes.
  • Experience in Azure data platforms, including Azure Data Factory, Azure SQL Database, Fabric.
  • Experience in designing and building data warehouses.
  • Advanced skills in Power BI for data visualization and reporting.
  • Knowledge of data modeling, data warehousing concepts, and ETL best practices.
  • Design and implement data integrations between data platforms and operational systems both on premises and in the cloud
  • Develop data sets which are optimised for their given use case, e.g., self-service analytics, paginated reports or machine learning and advanced analytics
  • Migrate data from legacy reporting solutions on the azure data platforms to ensuring that data integrity and service levels are maintained


Essential Skills:


  • SQL including T-SQL (Queries, views, stored procedures, functions)
  • Microsoft BI experience / Data visualisation (SSAS, SSRS, Power BI)
  • Integration and ETL design and delivery Including (SSIS, Azure Data Factory)
  • Azure Data Services (including Data Factory, Databricks, Synapse Analytics, Data Lake)
  • Relational and multi-dimensional data modelling
  • Designing and delivering Testing including Regression, Unit, integration, and system for data solutions
  • Understanding of industry best practice and trends together with their application within a business context
  • Broad knowledge of the financial services industry and key regulatory requirements together with an understanding of business processes
  • Strong understanding of data management and data governance best practices
  • Experience in defining and delivering solutions to handle sensitive data including data obfuscation, cascade deletion of data, anonymisation



  • UK, UK, United Kingdom Focus on WD Full time

    Job Title: Azure & AWS Data Engineer Contract Length: 4 Months (Outside IR35) Location: Remote, with occasional on-site presence in London (approx. once a month) Client: Consultancy Firm based in London Job Description: We are seeking an experienced Azure & AWS Data Engineer to join our client, a dynamic consultancy based in London, on a 4-month contract....

  • Senior Data Engineer

    2 weeks ago


    UK, UK, United Kingdom Oliver Bernard Full time

    New SC Cleared Data Engineer Contract - RemoteI have a brand new contract role working for a government organisation on an initial 6-month engagement on a remote basis. To be considered, you must have Active SC Clearance AWS, Python, Spark, SQL £450-£500 Inside IR35 6-months initial engagement Remote for UK based candidates


  • London, UK, UK, United Kingdom iO Associates - UKEU Full time

    SC/DV Cleared Network Engineer £425-£525 a day (OUTSIDE IR35) Hybrid (Central London) 6 Months (Rolling Contract) iO Associates are looking for an SC/DV Cleared Network Engineer for a 6-month rolling contract role offering up to £525 a day (outside IR35). You will be working for a rapidly growing Network & Architecture consultancy who are very well...


  • London,, UK, United Kingdom RED Global Full time

    Job Title: AWS DevOps/Data EngineersLocation: London (Hybrid - Onsite)Start Date: Mid-January 2024Rate: £500–£700 per dayClearance: SC Clearance requiredWe are seeking experienced AWS DevOps/Data Engineers to join a dynamic team in London.Required Skills and Experience:Minimum 5 years of experience in AWS DevOps and/or Data Engineering.Strong...

  • Data Architect

    1 month ago


    UK, UK, United Kingdom SPG Resourcing Full time

    Job Title: Data ArchitectLocation: RemoteDay Rate: £550 (Outside)Security Clearance: Active SC clearance.About the RoleWe are seeking an experienced Data Architect to join our team within a large-scale organisation. The role will support the design, implementation, and governance of data architecture solutions that will drive organisational. This position...


  • London, UK, UK, United Kingdom DataCareers Full time

    Azure Solution Architect & Data Engineer2 Month Contract (Jan 2025 start)Location: Home / LondonRate: £600 - £650 per day (Inside IR35)Skills: Azure Databricks, Python, CI/CD Pipelines, SC ClearanceWe are looking to recruit an SC Cleared Azure Solution Architect & Data Engineer for a leading IT Consultancy. The role combines Solution Architecture & Data...

  • Data Scientist

    1 week ago


    UK, UK, United Kingdom Malikshaw Interim & Executive Full time

    We’re looking for a range of skilled data and research professionals to support our client in their next project. You will collaborate with subject matter experts, produce high-quality statistical outputs, and contribute to the development of data science capabilities within the organisation.Rate: HEO LevelLocation: Hybrid, Newport, Darlington &...

  • Data Engineer

    2 weeks ago


    London,, UK, United Kingdom Inara Full time

    Role: Data Engineer (Contract - Outside IR35)Location: London (Hybrid - 1 to 2 days max per week in office)Day Rate: Circa £600 per day (Outside IR35)Contract Length: 3 Months minimumImportant: Applicants must be UK residents with the right to work in the UK, as SC clearance may be required for this role in the near future.Are you ready to design,...

  • DevOps Engineer

    2 weeks ago


    UK, UK, United Kingdom Amber Labs Full time

    Senior DevOps Engineer - AWS (SC Cleared)Location: RemoteWork Pattern: Full time permanent or contractSecurity Clearance: Must hold active SC ClearanceThe Company:At Amber Labs, we are a cutting-edge UK and European technology consultancy that prioritises empowering autonomy, promoting experimentation, and facilitating rapid learning to provide exceptional...

  • Data Modeler

    2 months ago


    London,, UK, United Kingdom MarkJames Search Full time

    We are seeking an experienced Data Modeler to join our team. The ideal candidate will have expertise in both Logical and Physical Data Modelling and a strong understanding of Microsoft Dynamics and PostgreSQL. This role is critical to designing, optimizing, and maintaining data models to support high-performance querying and seamless integration between...

  • Data Engineer

    3 months ago


    UK, UK, United Kingdom Eames Consulting Full time

    We are delighted to be working with a global speciality Insurance firm that are looking to expand there Pricing Data engineering team with an experienced Data engineer.Responsibilities:Build and maintain data pipelines in a Spark-based platform to support the Pricing function.Develop solutions that enhance Global Pricing’s data-driven approach, leveraging...


  • UK, UK, United Kingdom Vantage Data Centers Full time

    About Vantage Data CentersVantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another’s experience.Vantage Data Centers powers, cools, protects and connects the technology of the world’s well-known hyperscalers, cloud providers and large...

  • Data Engineer

    2 weeks ago


    UK, UK, United Kingdom Apexon Full time

    Apexon is a digital-first technology services firm specializing in accelerating business transformation and delivering human-centric digital experiences. We have been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation.Apexon brings together distinct core competencies – in...

  • Head of Data Science

    2 weeks ago


    London,, UK, United Kingdom CodeVerse Full time

    Job Title: Chief Data Scientist - Hybrid (Central London)Salary: Up to £100K per annum (dependent on experience)Start Date: ASAPSC Security Clearance RequiredWe are seeking an experienced Chief/Senior Data Scientist to lead high-profile data science projects for a public sector client with a leading consultancy. This hybrid role (1-2 days per week in...

  • Data Engineer

    2 weeks ago


    London, UK, UK, United Kingdom Harnham Full time

    Data EngineerLondon1 day a month in officeUp to £70k depending on experienceTHE COMPANYThis is a global insurance company which was founded in the early 2000s and has been growing rapidly ever since. This company has around 15000 employees and is looking to continually expand. They are an extremely fast paced company who are constantly acquiring new...

  • Data Engineer

    1 month ago


    UK, UK, United Kingdom Next Phase Recruitment Full time

    Description‍The client is seeking software engineers with a strong background with Python programming and ideally a chemistry or material science background to develop domain-specific applications. Their goal is to revolutionize industrial research and development. They’re looking for motivated engineers who can help to build out tools that will...

  • Data Engineer

    2 weeks ago


    London,, UK, United Kingdom Synapri Full time

    Sector: Public Sector / Government / DefenceJob Title: Data EngineerType: ContractorLocation: London (Hybrid)Duration: End FY – 31/03/2025 (initial)Vetting: SC level security clearance is required The Data Engineer role’s primary focus will be on developing the PMO’s Excel-based toolkit to enhance the use of data in strategic decision making across the...

  • Graduate Data Engineer

    3 months ago


    UK, UK, United Kingdom Oho Group Ltd Full time

    Graduate Data Engineer - Fast Growing FinTech - ex Facebook / Google A very fast scaling FinTech in London founded by ex Facebook and Google Engineer are looking for a talented Data Engineer to join their team. In this role as a Data Engineer you’ll work with extremely high calibre engineers and hit the ground running from day one, starting off with where...

  • Algorithm Engineer

    4 weeks ago


    UK, UK, United Kingdom Murray Full time

    Murray McIntosh are currently seeking an Algorithm Development Engineer to work for a key client of ours on a permanent basis as detailed below:Candidates will need to be eligible to obtain SC clearance to be suitable for this position.Key Responsibilities: Design, implement, and optimise advanced algorithms for sensor fusion, target tracking, and object...

  • Data Engineer

    2 weeks ago


    London, UK, UK, United Kingdom BJSS Full time

    About UsWe’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day.In the last 30 years we won several awards,...