Senior Data Engineer

Join to apply for the Senior Data Engineer role at Made TechBase pay rangeSalary range is £60,000 - £75,000 depending on experienceLocation: Hybrid working in either Bristol, Manchester, or London.At Made Tech we want to positively impact the future of the country by using technology to improve society, for everyone. We want to empower the public sector to deliver and continuously improve digital services that are user‑centric, data‑driven and freed from legacy technology. A key component of this is developing modern data systems and platforms that drive informed decision‑making for our clients. You will also work closely with clients to help shape their data strategy.ResponsibilitiesOur Senior Data Engineers enable public sector organisations to embrace a data‑driven approach by providing data platforms and services that are high‑quality, cost‑efficient, and tailored to clients’ needs. They develop, operate, and maintain these services. They make sure they provide maximum value to data consumers, including analysts, scientists, and business stakeholders.As a Senior Data Engineer, you may play one or more roles according to our clients’ needs. The role is very hands‑on and you’ll support as a senior contributor for a project, focusing on both delivering engineering work as well as upskilling members of the client team. At other points, you might play more of a technical architect role and work with the larger MadeTech team to identify growth opportunities within the account.You’ll need to have a drive to deliver outcomes for users. You’ll make sure that the wider context of a delivery is considered and maintain alignment between the operational and analytical aspects of the engineering solution.Skills and experience we’re looking forEnthusiasm for learning and self‑developmentProficiency in Git (inc. Github Actions) and able to explain the benefits of different branch strategiesGathering and meeting the requirements of both clients and users on a data projectStrong experience in IaC and able to guide how one could deploy infrastructure into different environmentsOwning the cloud infrastructure underpinning data systems through a DevOps approachKnowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or HadoopGood understanding of the possible architectures involved in modern data system design (e.g. Data Warehouse, Data Lakes and Data Meshes) and the different use cases for themAbility to create data pipelines on a cloud environment and integrate error handling within these pipelines. With an understanding how to create reusable libraries to encourage uniformity of approach across multiple data pipelines.Able to document and present an end‑to‑end diagram to explain a data processing system on a cloud environment, with some knowledge of how you would present diagrams (C4, UML etc.)To provide guidance how one would implement a robust DevOps approach in a data project. Also would be able to talk about tools needed for DataOps in areas such as orchestration, data integration and data analytics.Experience in improving resilience into a project by checking for software vulnerabilities and implement appropriate testing strategies (unit, integration, data quality etc.)Knowledge of SOLID, DRY and TDD principles and how to practically implement these into a project.Agile practices such as Scrum, XP, and/or KanbanDesigning and implementing efficient data transformation processes at scale, both in batch and streaming use casesOwning the cloud infrastructure underpinning data systems through a DevOps approachAgile practices such as Scrum, XP, and/or KanbanPeople skills such as mentoring, supportive team player and performing line management dutiesTo be able to demonstrate a commercial mindset when on projects to grow accounts organically with senior stakeholdersDesirable experienceWorking at a technology consultancyWorking with Docker and virtual environments as part of the development and CI/CD process.Working with senior stakeholders to gather requirements and keep them engaged withExperience in working with a team of engineers using a variety of techniques such as pair programming or mob programming.Working with data scientists to productionise advanced data deliverables, such as machine learning modelsWorking knowledge of statisticsWorking with multidisciplinary digital and technology teamsWorking within the public sectorSupport in applyingIf you need this job description in another format, or other support in applying, please email talent@madetech.com.Life at Made TechWe’re committed to building a happy, inclusive and diverse workforce. You can get a sense of what it’s like working here from our blog, where we talk about mental health, communities of practice and neurodiversity (as well as our client work and best practice).Like many organisations, we use Slack to chat to each other. The Slack groups that have formed give an idea of the diversity within Made Tech. If you’d like to speak to someone from one of these groups about their experience as an employee, let your recruitment agent or Made Tech Talent Partner know.The groups are:disabilitylgbtqiaplus-allies-and-activistswomen-in-techBenefits✈️ 30 days Holiday - we offer 30 days of paid annual leave🕰️ Flexible Working Hours - we are flexible with what hours you work👶 Flexible Parental Leave - we offer flexible parental leave options👩 💻 Remote Working - we offer part time remote working for all our staff🤗 Paid counselling - we offer paid counselling as well as financial and legal advice.An increasing number of our customers are specifying a minimum of SC (security check) clearance in order to work on their projects. As a result, we’re looking for all successful candidates for this role to have eligibility. Eligibility for SC requires 5 years’ UK residency and 5 year' employment history (or back to full‑time education). Please note that if at any point during the interview process, it is apparent that you may not be eligible for SC, we won’t be able to progress your application.Seniority levelMid‑Senior levelEmployment typeFull‑timeJob functionInformation TechnologyIndustriesProfessional Services, Technology, Information and Media, and IT Services and IT ConsultingReferrals increase your chances of interviewing at Made Tech by 2xGet notified about new Data Engineer jobs in Manchester Area, United Kingdom. #J-18808-Ljbffr