Lead Data Engineer

2 weeks ago

Bristol, Bristol, United Kingdom Made Tech Limited Full time £100,000

Salary: Up to £100,000 depending on experience

Location: Hybrid working in either Swansea, Bristol, Manchester, London.

Support in applying

If you need this job description in another format, or other support in applying, please email

We believe we can use tech to make public services better. We also believe this can happen best when our own team represents the society that actually uses the services we work on. We're collectively continuing to grow a culture that is happy, healthy, safe and inspiring for people of all backgrounds and experiences, so we encourage people from underrepresented groups to apply for roles with us.

When you apply, we'll put you in touch with a talent partner who can help with any needs or adjustments we may need to make to help with your application. This includes alternative formats for documents, the time allotted for interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates.

As a lead data engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-led. You'll join our data team in its mission to get data knowledge and skills out of silos and embedded into delivery teams. You'll help implement efficient data pipelines and storage.You'll help build data platforms to enable predictive government services that make a positive impact on people in the UK.

Your role at Made Tech
  • Define, shape and perfect data strategies in central and local government
  • Help public sector teams understand the value of their data, and make the most of it
  • Establish yourself as a trusted advisor in data driven approaches using public cloud services like AWS, Azure and GCP
  • As employee growth is a huge focus here, we would expect you to contribute to our recruitment efforts and take on line management responsibilities

What skills and experience are we looking for?

We are looking for candidates with a range of skills and experience, please apply even if you don't meet all the criteria as if unsuccessful we can provide you with feedback.

  • Enthusiasm for learning and self-development
  • Proficiency in Git (inc. Github Actions) and able to explain the benefits of different branch strategies
  • Gathering and meeting the requirements of both clients and users on a data project
  • Strong experience in IaC and able to guide how one could deploy infrastructure into different environments
  • Owning the cloud infrastructure underpinning data systems through a DevOps approach
  • Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop
  • Good understanding of the possible architectures involved in modern data system design (e.g. Data Warehouse, Data Lakes and Data Meshes) and the different use cases for them
  • Ability to create data pipelines on a cloud environment and integrate error handling within these pipelines. With an understanding how to create reusable libraries to encourage uniformity of approach across multiple data pipelines.
  • Able to document and present an end-to-end diagram to explain a data processing system on a cloud environment, with some knowledge of how you would present diagrams (C4, UML etc.)
  • To provide guidance how one would implement a robust DevOps approach in a data project. Also would be able to talk about tools needed for DataOps in areas such as orchestration, data integration and data analytics.
  • Experience in improving resilience into a project by checking for software vulnerabilities and implement appropriate testing strategies (unit, integration, data quality etc.)
  • Knowledge of SOLID, DRY and TDD principles and how to practically implement these into a project.
  • Agile practices such as Scrum, XP, and/or Kanban
  • Designing and implementing efficient data transformation processes at scale, both in batch and streaming use cases
  • Owning the cloud infrastructure underpinning data systems through a DevOps approach
  • Agile practices such as Scrum, XP, and/or Kanban
  • People skills such as mentoring, supportive team player and performing line management duties
  • To be able to demonstrate a commercial mindset when on projects to grow accounts organically with senior stakeholders

Experience in the following things isn't essential, but it's highly desirable

  • Working at a technology consultancy
  • Working with Docker and virtual environments as part of the development and CI/CD process.
  • Working with senior stakeholders to gather requirements and keep them engaged with
  • Experience in working with a team of engineers using a variety of techniques such as pair programming or mob programming.
  • Working with data scientists to productionise advanced data deliverables, such as machine learning models
  • Working knowledge of statistics
  • Working with multidisciplinary digital and technology teams
  • Working within the public sector
  • Working with data scientists to productionise advanced data deliverables, such as machine learning models

Like many organisations, we use Slack to chat to each other. The Slack groups that have formed give an idea of the diversity within Made Tech. If you'd like to speak to someone from one of these groups about their experience as an employee, let your recruitment agent or Made Tech Talent Partner know.

The groups are:

  • disability
  • lgbtqiaplus-allies-and-activists
  • women-in-tech

We are always listening to our growing teams and evolving the benefits available to our people. As we scale, as do our benefits and we are scaling quickly. We've recently introduced a flexible benefit platform which includes a Smart Tech scheme, Cycle to work scheme, and an individual benefits allowance which you can invest in a Health care cash plan or Pension plan. We're also big on connection and have an optional social and wellbeing calendar of events for all employees to join should they choose to.

Here are some of our most popular benefits listed below:

Paid counselling - we offer paid counselling as well as financial and legal advice.

An increasing number of our customers are specifying a minimum of SC (security check) clearance in order to work on their projects. As a result, we're looking for all successful candidates for this role to have eligibility.Eligibility for SC requires 5 years' UK residency and 5 year' employment history (or back to full-time education). Please note that if at any point during the interview process it is apparent that you may not be eligible for SC, we won't be able to progress your application and we will contact you to let you know why.

#J-18808-Ljbffr

  • Engineering Data Architect

    2 weeks ago

    Bristol, Bristol, United Kingdom The Engineer Full time £56,000

    Bristol MBDA is a leading defence organisation. We are proud of the role we play in supporting the Armed Forces who protect our nations. We partner with governments to work together towards a common goal, defending our freedom. Salary : Circa £56,000 depending on experience What we can offer you: Company bonus of up to 21% of base salary Pension of...

  • Senior Engineer, Data Engineering

    2 weeks ago

    Bristol, Bristol, United Kingdom Abs Data Full time £65,000 - £85,000

    Senior Data Engineer Join Vaarst to work on technology that respects and supports the environment. Our actions and innovations play an active role in the energy transition making the world cleaner and greener.Location:Bristol, UK – Hybrid focuses on making the world a cleaner, greener and safer place by deploying technology for good. We're using...

  • Project Lead Mission Systems Engineer

    2 weeks ago

    Bristol, Bristol, United Kingdom The Engineer Full time

    Job Title: Project Lead Mission System Engineer Location: Bristol, Hybrid arrangements available Compensation: Competitive Salary + Benefits Role Type: Full time / Permanent Role ID: SF56326 At Babcock we're working to create a safe and secure world, together, and if you join us, you can play your part as a Project Lead Mission System Engineer at our...

  • Data Engineering Lead

    2 weeks ago

    Bristol, Bristol, United Kingdom Harnham Full time

    Data Engineering Lead**Bristol Remote**Up to £100,000An integral role where you'll be at the forefront of implementing an ambitious data transformation strategyTHE COMPANYWe've partnered with a leading UK Insurer with a high calibre data and analytics function. This team cover a range of disciplines including data warehousing, web development, API...

  • Data Engineering Lead

    2 weeks ago

    Bristol, Bristol, United Kingdom Unite Students Full time

    The Role We`re all about creating a Home for Success for our students, using technology and data to empower them to find their home, their tribe and have a great stay with us through their studies. We are seeking an experienced and highly skilled Data Engineering Lead to join our dynamic and innovative team. As the Data Engineering Lead, you will be...

  • Lead Data Engineer

    2 weeks ago

    Bristol, Bristol, United Kingdom UK Civil Service Full time

    Job SummaryJoin us at the Department for Levelling Up, Housing and Communities (DLUHC). Our mission is to have a positive impact on the places and communities we serve across the UK. If you're considering being part of our team, this is an exciting opportunity to contribute to meaningful projects.We are a team of 3,500 employees spread across 20 offices in...

  • Data Engineering Lead

    2 weeks ago

    Bristol, Bristol, United Kingdom eFinancialCareers Full time

    Essential Requirements Demonstrable experience as Engineering Lead in the Enterprise Data Lake domain Experience in implementing Event Driven Architecture and Data Streaming Experience in Delivering Operational Datastores in a variety of technologies and data platforms. Deep technical knowledge of EDL Technologies and Architecture Large scale delivery...

  • Senior/lead Data Engineer

    2 weeks ago

    Bristol, Bristol, United Kingdom Opus Recruitment Solutions Ltd Full time

    Lead Data Engineer | Bristol/Hybrid/Remote | Up to £90,000 DOEAWS | DynamoDB | Redshift | SQL | Python | Kafka | SnowflakeAre you wanting to take the next step in your career and develop into a Lead Data Engineer, developing the Data team due to a new approach to the business with data-lead decision making. You will be brushing shoulders and sharing valued...

  • Lead Data Engineer

    2 weeks ago

    Bristol, Bristol, United Kingdom Made Tech Full time £100,000

    Salary: Up to £100,000 depending on experienceYou can get further details about the nature of this opening, and what is expected from applicants, by reading the below.Location: Hybrid working in either Swansea, Bristol, Manchester, London.Are you a skilled Data Engineer who can deliver Data Platforms?Are you familiar of working on agile delivery-led...

  • Senior Safety Engineer

    2 weeks ago

    Bristol, Bristol, United Kingdom The Engineer Full time

    Senior Safety Engineer Location: Stoke Gifford, Bristol - Hybrid Working Compensation: Competitive Salary + Benefits Role Type: Full time / Permanent Role ID: SF55212 At Babcock we're working to create a safe and secure world, together, and if you join us, you can play your part as a Senior Safety Engineer. The role As a Senior Safety Engineer, you'll...

  • Advanced Planning Senior Engineer

    2 weeks ago

    Bristol, Bristol, United Kingdom The Engineer Full time £49,943

    Job Title: Advanced Planning Senior Engineer Location: Bristol + Plymouth + Clyde + Hybrid Working Arrangements Compensation: £49,943 + Benefits Role Type: Full time / Permanent Role ID: SF57328 At Babcock we're working to create a safe and secure world, together, and if you join us, you can play your part as an Advanced Planning Senior Engineer at our...

  • Chief Engineer

    2 weeks ago

    Bristol, Bristol, United Kingdom The Engineer Full time

    Job Title: Chief Engineer - Integrated Product Support Location: Bristol + hybrid Working Arrangement Compensation: Attractive Package Role Type: F ull time / Permanent At Babcock we're working to create a safe and secure world, together, and if you join us, you can play your part as a Chief Engineer - Integrated Product Support within our Missions...

  • Data Lead

    2 weeks ago

    Bristol, Bristol, United Kingdom Dojo 2022 Full time

    Creating a more diverse, equitable and inclusive Dojo Dojo's 150,000+ customers reflect the diversity of the UK High Street. Building teams with diverse backgrounds that are representative of the customer base which we serve is fundamental to creating innovative products at Dojo. Whoever you are, if you're passionate about your work, curious, relentless...

  • Tactical Strike Mission Planning Engineer

    2 weeks ago

    Bristol, Bristol, United Kingdom The Engineer Full time £2,500

    Tactical Strike Mission Planning Engineer Join the team in Tactical Strike Mission Planning delivering a key capability for the SPEAR3 weapon system. The SPEAR3 missile has multiple capabilities delivered from multiple platforms, with the current focus on UK capability. SPEAR3 is a complex weapon that delivers both tactical strike and electronic advantage....

  • Principal Aerodynamics Engineer

    2 weeks ago

    Bristol, Bristol, United Kingdom The Engineer Full time £55,000

    MBDA is a leading defence organisation. We are proud of the role we play in supporting the Armed Forces who protect our nations. We partner with governments to work together towards a common goal, defending our freedom. Salary : Up to £55,000 depending on experience What we can offer you: Company bonus of up to £2,500 (based on company performance and...

  • Data Engineering Automation Lead

    2 weeks ago

    Bristol, Bristol, United Kingdom Aviva Full time

    Data Engineering Automation Lead Salary circa £65,000 Aviva are currently looking for a vastly experienced Data Engineering Automation Lead to join the business on a permanent basis, who has expertise in automation using standard tooling to accelerate development and delivery. A bit about the job: As a Data Engineering Automation Lead, you will...

  • Data Engineering Automation Lead

    2 weeks ago

    Bristol, Bristol, United Kingdom Aviva Full time

    Data Engineering Automation LeadSalary circa £65,000Aviva are currently looking for a vastly experienced Data Engineering Automation Lead to join the business on a permanent basis, who has expertise in automation using standard tooling to accelerate development and delivery. A bit about the job: As a Data Engineering Automation Lead, you will be looking...

  • Data Engineer

    2 weeks ago

    Bristol, Bristol, United Kingdom ITECCO Full time

    Job Title: Data EngineerLocation: BristolSalary: £45,000 plus a great pension scheme and quarterly bonusMy client is currently recruiting for an experienced Data Engineer to join a leading hospitality company in Bristol on a full-time basis. Extensive experience in data engineering, database design and development, ETL development and database...

  • Lead Data Analyst

    2 weeks ago

    Bristol, Bristol, United Kingdom eFinancialCareers Full time

    My client, a leading financial services firm are looking for an experience Lead Data Analyst to join as part of their growing data team which acts as a critical capability across the business. The Bank's Data Factory provides critical data integration andengineering services to support the Bank's change programme of initiatives.Essential experience:...

  • Chapter Lead Data

    2 weeks ago

    Bristol, Bristol, United Kingdom TSB Banking Full time

    Role: Chapter Lead - DataFunction:CIOLocation: Hybrid working/Flexible across our key sitesAt TSB, we're transforming the service we provide our customers, and technology will be at the forefront of that change. It's an exciting transformation and we're investing in an enhanced in-house capability to deliver it - so, if you're a forward-looking and...