Senior Engineer, Data Engineering

1 week ago

London, Greater London, United Kingdom Careers at MI5, SIS and GCHQ Full time £59,479 - £66,100
Data Engineer

MI5 keeps the country safe from serious threats like terrorism and attempts by states to harm the UK, its people and way of life.

We carry out investigations by obtaining, analysing, and assessing intelligence, and then work with a range of partners including MI6 and GCHQ to disrupt these threats.


Flexible Working:
we offer a strong work-life balance, supporting full-time, part-time, and flexible hours. You'll be predominantly office-based, with working from home limited and subject to business need.

We're looking for experienced Data Engineers prepared to take on a more senior role within a multi-disciplinary product team.

As a Data Engineer and working closely with technical specialists such as Product Owners, Business Analysts, Delivery Managers, Software Engineers, Data Scientists and Machine Learning Engineers, you'll build and run secure data applications and data products.

You'll promote Agile technical practises, using Agile methodologies to deliver digital products that are core to MI5's operation, making use of modern approaches and cloud technologies such as AWS and Azure, as well as on-premises platforms and long-established technologies and frameworks.

You'll gain experience in a challenging environment as part of a forward-thinking team and strive to develop digital solutions.

Managing tasks, you'll be responsible for the design and implementation of numerous moderate-to-complex data flows, to connect operational systems, data for analytics, or business intelligence (BI) systems.

As a Data Engineer, you'll focus on creating professional and comprehensive digital experiences and share a collective responsibility in keeping the country safe, by staying one step ahead in an evolving digital world.

You'll set the standard for what good looks like, sharing digital and innovative ways of working with the team and across the skills community.

Importantly, you'll have a passion for sharing knowledge, whether it's a customer or colleague you'll help them to understand what great engineering looks like.

Promoting best practises, you'll participate in guilds, and encourage cross-organisation initiatives to help build our community of engineers, whilst mentoring and developing junior members of the team and influencing them with your vision.

Our tech stacks vary between products (such as OracleDB, MongoDB, Elastic Search and Hadoop for data storage and a mixture of commercial-off-the-shelf products and custom applications.

Whether it's building a platform to enable the analysis of data systems to track the progress of our investigations, developing robust and scalable capabilities for our Data Science teams, delivering compliance services to ensure we are operating legally, or tooling to improve our developer experience, the nature of our work presents unique and fascinating engineering challenges, the likes of which you will never have seen before.

As a Data Engineer you'll be part of a team which supports and delivers innovative digital products. You'll need to demonstrate a proficiency in developing data solutions and data integration design.

Crucially, you'll be comfortable using common data engineering technologies and you'll need to be familiar with the principles of a modern standards approach, such as continuous integration and delivery, test-driven development, and cloud services.

You'll have an awareness of design patterns and how to implement them appropriately with security in mind and demonstrate proficiency in the use of the Agile methodology.

You'll demonstrate leadership qualities, supporting others to upskill and build their career in an inclusive environment, while continuously looking for opportunities to develop and learn new engineering practises and approaches.

You'll have experience delivering moderate-to-complex data flows as part of a development team in collaboration with others.

You'll be confident using technologies such as:
Apache Kafka, Apache NiFi, SAS DI Studio, or other data integration platforms.

You can implement, deliver, and translate several data models, including unstructured data, document formats, relational models, and formats to support geo-enabled applications and graph database structures, using knowledge of various data formats including XML, JSON, flat file, Parquet etc.

You can also manage metadata across your development teams systems and beyond, with a practitioner knowledge of tracking data provenance and data lineage.

You'll work to agreed and recognised standards to build solutions using various traditional or big data languages such as: SQL, PL/SQL, SAS Macro Language, Python, Scala, Apache Spark, Java, JavaScript etc, using various tools including SAS, Hue (Hive/Impala), Kibana (Elastic Search).

Knowledge of data management on Cloud platforms is especially advantageous.

  • Senior Engineer, Data Engineering

    2 weeks ago

    London, Greater London, United Kingdom Data Idols Full time £85,000

    Job Description Senior Data Engineer Location: London (Hybrid) Data Idols are working with an exciting scale-up revolutionising delivery logistics and moving items across the UK with efficiency and ease all whilst cutting emissions. Trusted by millions of customers already they are expanding their data team to manage increased volumes of data and demand. As...

  • Senior Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Data Idols Full time

    Senior Data EngineerIncrease your chances of reaching the interview stage by reading the complete job description and applying promptly.Salary: up to £85,000Location: London (Hybrid)Data Idols are working with an exciting scale-up revolutionising delivery logistics and moving items across the UK with efficiency and ease all whilst cutting emissions. Trusted...

  • Senior Engineer, Data Engineering

    2 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time £85,000

    Senior Data Engineer Location: London (Hybrid) Data Idols are working with an exciting scale-up revolutionising delivery logistics and moving items across the UK with efficiency and ease all whilst cutting emissions. Trusted by millions of customers already they are expanding their data team to manage increased volumes of data and demand. As a Senior Data...

  • Senior Engineer, Data Engineering

    2 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time £70,000 - £85,000

    Senior Data Engineer Location: London, 3/2 days in the office per week Data Idols are currently working with a company that focus on the european marketplace for transport who are looking to make the future greener Within this role as a Senior Data Engineer, you will be monitoring, designing and implementing a datawarehouse, whilst working with different...

  • Senior Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time £85,000

    Senior Data Engineer Salary: up to £85,000 Location: London (Hybrid) Data Idols are working with an exciting scale-up revolutionising delivery logistics and moving items across the UK with efficiency and ease all whilst cutting emissions. Trusted by millions of customers already they are expanding their data team to manage increased volumes of data and...

  • Senior Engineer, Data Engineering

    2 weeks ago

    London, Greater London, United Kingdom ON Data Staffing Full time

    Our client, a Data & AI firm in London is actively seeking a Senior Data Engineer to play a pivotal role in delivering innovative big data solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks/Snowflake and exceptional communication skills to understand and address clients' diverse data...

  • Data Engineer

    1 week ago

    London, Greater London, United Kingdom Data Idols Full time

    Data Engineer Are you a mid-level Data Engineer skilled in Azure technologies, seeking an new 'feel-good' permanent opportunity? Data Idols are proud to be supporting a HealthTech client, who use remote-first technology focusing on engagingpatients across their healthcare journey while saving hospitals time, effort, and money This opportunity provides remote...

  • Lead Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Lead Data Engineer Location: LondonSalary: £100,000 + BenefitsExciting Opportunity in LondonDo you want to work in the media sector for a top company? We are currently seeking a skilled Lead Data Engineer ready for a new challenge and eager to grow in their career.About the CompanyThis innovative media company is data-driven and is seeking a Lead Data...

  • Senior Engineer, Data Engineering

    2 weeks ago

    London, Greater London, United Kingdom Open Data Science Conferenc Full time

    You have prior experience as a data engineer, software engineer, or data architect. You can work remotely and independently, taking ownership of your work. You have proven English language communication skills that enable you to collaborate in a remote-first company with a diverse international workforce. Experience with Java11+ for ingesting,...

  • NS - Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Abs Data Full time

    Job title: NS – Data Engineer Company: BAE Systems Job description : Location(s): [[mfield3]] BAE Systems Digital Intelligence is home to 4,500 digital, cyber and intelligence experts. We work collaboratively across 10 countries to collect, connect and understand complex data, so that governments, nation states, armed forces and commercial businesses...

  • Senior Engineer, Data Engineering

    2 weeks ago

    London, Greater London, United Kingdom Mentmore Full time £95,000

    Senior Data Engineer / Up to £95k + Benefits // Global Facilities Services Business Senior Data Engineer 1 Day per Week in London My client is seeking a highly skilled Senior Data Engineer to join their team. This role involves building out a robust data platform on Databricks, with a primary focus on facilitating seamless data migrations. As a Senior...

  • Senior Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Uniting People Ltd Full time £200,000

    Join to apply for the Senior Data Engineer (SAS) role at Uniting People Join to apply for the Senior Data Engineer (SAS) role at Uniting People Sign in to save Senior Data Engineer (SAS) at Uniting People . Job Title: Senior Data Engineer (SAS) Rewrite existing data pipelines (SAS, Info, pearl, shell scripts) to Python and DBT transformation-based...

  • Senior Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom JR United Kingdom Full time

    Role: Senior Data EngineerSkills: SQL, Data Engineer experience, Snowflake and DBT (Data build tools)£65,000 – Senior Data Engineer – Fully Remote (UK based)We are looking for a Senior Data Engineer who has experience with SQL, Data Engineer experience, Snowflake and DBT (Data build tools) on a permanent basis, based on your level of experience salaries...

  • Senior Data Engineer

    1 month ago

    London, Greater London, United Kingdom JR United Kingdom Full time

    Role: Senior Data EngineerSkills: SQL, Data Engineer experience, Snowflake and DBT (Data build tools)£65,000 – Senior Data Engineer – Fully Remote (UK based)We are looking for a Senior Data Engineer who has experience with SQL, Data Engineer experience, Snowflake and DBT (Data build tools) on a permanent basis, based on your level of experience salaries...

  • Senior Data Engineering

    1 week ago

    London, Greater London, United Kingdom Xcede Full time £85,000

    Job Description Senior Data Engineer (AWS) Up to £85,000 Salary + Bonus London office 2-3 days per week. A very successful AI scale up in the creative space are hiring for a Senior Data Engineer (AWS) to join their well established Data team, spearheading some of their key Data Engineering projects in AWS and mentoring junior team members.Your...

  • Senior Engineer, Data Engineering

    2 weeks ago

    London, Greater London, United Kingdom numi Full time

    Job Description Senior Data Engineer - London (hybrid) - £90-120,000 + bonusnumi have partnered with an absolute powerhouse in the global analytics, reporting and intelligence trade to hire a Senior AI Data EngineerThis is part of a HUGE new team build out that will be supporting a large number of greenfield projects. As their latest AI Data Engineer you'll...

  • Senior Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom JR United Kingdom Full time

    Senior Data EngineerUp to £90,000 + BonusFully Remote in UKOVERVIEWMajor FTSE100 retail giant hiring for x2 Senior Data Engineers, to lead small teams of Data Engineers on key projects, directly line managing them and providing technical leadership and guidance to the team. You will be joining a well-established Data function with huge customer data to work...

  • Senior Data Engineer

    2 months ago

    London, Greater London, United Kingdom JR United Kingdom Full time

    Senior Data EngineerUp to £90,000 + BonusFully Remote in UKOVERVIEWMajor FTSE100 retail giant hiring for x2 Senior Data Engineers, to lead small teams of Data Engineers on key projects, directly line managing them and providing technical leadership and guidance to the team. You will be joining a well-established Data function with huge customer data to work...

  • Senior Engineer, Data Engineering

    2 weeks ago

    London, Greater London, United Kingdom Validis Full time

    Role:Senior Data Engineer Business Area: Engineering/ Technology Reporting to: Head of Data Location: Hybrid/Remote Validis is a dynamic fintech company with a leading software platform, built for the extraction and standardisation of accounting data. We specialize in providing quality data for both audits and financial services, with the guarantee that our...

  • Senior Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Harnham Full time

    SENIOR DATA ENGINEERLONDON, CURRENTLY FLEXIBLE / REMOTE / HOMEWORKINGUP TO £85,000 As a Senior Data Engineer, you will be working on an AWS data platform for a successful AI company that has disrupted the market with its product line. You will be part of a high-performing engineering squad so will remain hands-on to further develop the platform and team...