Senior Data Engineer

1 month ago


Birmingham, Birmingham, United Kingdom Undisclosed Company Full time

Senior Data Engineer

Role purpose:

The Senior Data Engineer plays a pivotal role within the Data team of the Digital and Information function, assuming a leadership position in ensuring the availability, integrity, quality, and accuracy of data. With a wealth of experience, the Senior Data Engineer leads the design, development, and maintenance of data pipelines and workflows, driving the organisation's data processing capabilities and enabling the seamless delivery of BI reporting and analytics.

In addition to core responsibilities, the Senior Data Engineer takes a proactive role in advancing our Azure-based data platform, leveraging cutting-edge technologies like Azure Data Factory and Azure Databricks. This role presents exciting opportunities to spearhead digital transformation projects and innovate within the data landscape.

Operating within Agile principles and methodologies, the Senior Data Engineer collaborates closely with fellow data engineers and key stakeholders, assuming a leading role in shaping and managing the portfolio of reporting and data requirements. Leveraging their extensive expertise, the Senior Data Engineer contributes significantly to refining the overall data strategy, ensuring alignment with organisational objectives and driving continuous improvement initiatives.

Key Responsibilities:

  • Ownership and delivery of the design, development and maintenance of highly scalable and robust data pipelines and workflows utilising Azure Data Factory and Databricks.
  • Lead data transformation and integration efforts to augment data from diverse sources, ensuring data governance and regulatory compliance throughout the process.
  • Establish and enforce data quality standards through the implementation of rigorous data validation processes, ensuring the utmost accuracy, completeness, and consistency of the data ecosystem.
  • Serve as a key liaison between cross-functional teams, including data scientists, analysts, and business stakeholders, to comprehensively understand data requirements, conduct User Acceptance Testing (UAT), and deliver tailored solutions that align with business objectives.
  • Proactively monitor pipeline performance, swiftly identifying and resolving any potential issues to uphold seamless data processing operations and minimize downtime.
  • Drive comprehensive documentation of data pipelines, workflows, and procedures to foster knowledge sharing and ensure ongoing system maintainability and scalability.
  • Demonstrate proficiency in managing and resolving 2nd line data and reporting support requests through designated ticketing systems, mitigating disruptions to business operations with timely and effective resolutions.
  • Actively engage in daily stand-ups, weekly stakeholder meetings, and retrospectives, providing valuable insights and contributing to continuous improvement initiatives across the team and broader organization.

Technical / Professional Qualifications / Requirements:

  • Hands-on advanced experience in designing, developing, and managing data pipelines using Azure Data Factory.
  • Strong working knowledge of Databricks for data processing, analytics and Machine learning.
  • Advanced experience with data modelling techniques and data warehousing concepts.
  • Advanced proficiency in SQL for data querying and manipulation and good knowledge of Python.
  • Ability to work effectively in a fast-paced, dynamic environment and manage multiple priorities, following the Agile way of working
  • Ability to lead and analyse complex data problems and propose effective solutions.
  • Excellent communication skills with the ability to collaborate effectively with cross-functional teams.

Benefits Include:

25 days AL plus bank holidays
* 1 Wellbeing day
* Private Medical
* Pension - 8% matched pension
* Life Assurance x4 basic salary
* Income protection
* Dental plan - voluntary benefit


  • Data Engineer New

    1 month ago


    Birmingham, Birmingham, United Kingdom Experis UK Full time

    Data EngineerRole purpose:The Data Engineer position is an integral part of the Data team within the Digital and Information function. This role entails overseeing the availability, integrity, quality, and accuracy of data. The primary responsibilities include designing, developing, and maintaining data pipelines and workflows to support the organisation's...


  • Birmingham, Birmingham, United Kingdom Integrity Recruitment Solutions Limited Full time

    Experienced SQL Data Engineer – Prestigious ClientAn innovative client, making a significant impact within their sector, my client is going through a major business / systems transformation programme with a core focus of that being centred around their Data and BI / Reporting.The client is a reputable global brand and this role is integral to the success...


  • Birmingham, Birmingham, United Kingdom Maxim Recruitment Ltd Full time

    Our client, a major UK based contractor, is looking to hire an experienced Senior Planning Engineer to join the incredible planning team on their flagship HS2 project in Birmingham, UK.


  • Birmingham, Birmingham, United Kingdom PACC Full time

    Senior Structural Engineer Are you ready to apply Make sure you understand all the responsibilities and tasks associated with this role before proceeding.We are looking to recruit a full time Senior Structural Engineer to join our growing team. This is a busy and varied role providing support to the local and national Engineering teams on a wide range of...


  • Birmingham, Birmingham, United Kingdom Countryside Properties Full time

    Location BirminghamThe Vacancy SES Engineering Services are looking for an Electrical Senior Project Engineer to join our team in Birmingham to support on technically complex Mechanical and Electrical projects across the Midlands area. If you are an established Leader looking for an opportunity to challenge the norm, bring fresh new ideas and elevate...


  • Birmingham, Birmingham, United Kingdom BOA Group Full time

    The BOA Group is a Multi-Academy Trust of specialist academies located in Birmingham city centre, in the hub of the creative and digital industries. Though based in Birmingham, the academies recruit from across the wider Midlands region. We are a unique and outstanding creative educational hybrid, committed to the highest standards of excellence.Currently...


  • Birmingham, Birmingham, United Kingdom FIS Global Full time

    Position Type : Full time Type Of Hire : Experienced (relevant combo of work and education) Education Desired : Bachelor of Science Travel Percentage : 0%Are you curious, motivated, and forward-thinking? At FIS you'll have the opportunity to work on some of the most challenging and relevant issues in financial services and technology. Our talented people...


  • Birmingham, Birmingham, United Kingdom Kier Group PLC Full time

    We're looking for a Senior Highways Technology Engineer, to join our Transportation team based in either Birmingham or Salford. Could this be you? You'll be responsible for developing and leading various technology scheme designs, from conception through to completion of Preliminary Design. Schemes include the renewal and improvement of legacy highways...


  • Birmingham, Birmingham, United Kingdom Palmer McCarthy Recruitment Careers Full time

    This is a national home based role- requiring candidate to be based in England- (anywhere south of Newcastle)Part of a global group- our client is one of the fastest growing suppliers of security solutions in the UK. Due to exponential growth their Security Systems division needs to appoint a Senior Pre-Sales Engineer to support and advise the BD and Account...


  • Birmingham, Birmingham, United Kingdom Goldman Sachs Full time

    About Risk EngineeringGoldman Sachs Risk Division and Risk Engineering is known widely in the industry as the gold standard for developing cutting edge solutions that enables Goldman Sachs to manage risk exposures and risk decisions. Risk Engineering plays a critical function for the firm, driving how it takes and manages risk and the impact of the Risk...

  • Audit Semi Senior

    3 days ago


    Birmingham, Birmingham, United Kingdom MHA Full time

    Job Description Audit Semi Senior Location Birmingham B : Audit Semi Senior Our application form takes just a few minutes to complete and includes some diversity questions. MHA is a committed member of Access Accountancy and as such, we track our diversity stats and actively work to improve on these, year on year, looking at new ways to promote our roles to...

  • Senior Games Designer

    1 month ago


    Birmingham, Birmingham, United Kingdom Electronic Arts Full time

    When it comes to our F1 franchise, our passionate team brings players closer to the action than ever before. Each iteration innovates to bring players new experiences, letting them live their dream of lining up alongside their heroes from the worlds of F1 and F2TM. The F1 franchise is one of the highest-scoring of all time, according to Metacritic. With a...

  • Senior Planner

    3 weeks ago


    Birmingham, Birmingham, United Kingdom Hitachi Careers Full time

    Description Hitachi Energy has an exciting opportunity for a Senior Project Planner, you'll be involved in scheduling and cost control efforts for all project phases taking ownership and overseeing multiple projects of a value of between 2-25 Million USD. Set up, maintain and analyse actual and forecasted schedules, cost and risk, monitor, report and manage...


  • Birmingham, Birmingham, United Kingdom CAPPO Group Full time

    Job summary Do you have a strong background in e-drive and power electronics control systems? If so, you might be the perfect candidate for this exciting opportunity Key skills required for this role E- Drives, Control Systems, Matlab and Simulink Important E-Drive Controls , Matlab, Simulink Job descriptionE-Drive Controls EngineerAre you passionate...


  • Birmingham, Birmingham, United Kingdom Aston University Full time

    Location: Aston University Main CampusClosing Date: 23.59 hours BST on Friday 03 May 2024Interview Date: To be confirmedAn exciting opportunity has arisen in the Department of Civil Engineering for applicants in Water and Environmental Engineering. The successful candidate will make a significant contribution to teaching and research in Fluid Mechanics,...


  • Birmingham, Birmingham, United Kingdom British Telecom Full time

    This role is avalible on a hybrid working basis in either Birmingham, Manchester, London, Bristol locations. As a Senior Strategy and Market Insights Manager, you will play a pivotal role in driving the growth and success of Business Digital through strategy formulation and data-driven insights, identifying and articulating market opportunities for revenue...

  • Senior Town Planner

    4 weeks ago


    Birmingham, Birmingham, United Kingdom Carrington West Full time

    Job Title: Senior Town PlannerLocation: Fully remote/hybrid working (Office hubs in Manchester, Birmingham, or Milton Keynes)Company Overview: We are working with a private consultancy who are looking for a Senior Planner to join their growing team. They focus on strategic planning, residential and commercial planning and master-planning projects.Job...


  • Birmingham, Birmingham, United Kingdom Aston University Full time

    Closing Date: 28th May 2024 [23.59 GMT]Supervisors: Dr Sergei G. Sokolovski and Prof Sergei K. TuritsynProspective Start Date: 1 October 2024Applications are invited for a Postgraduate studentship, supported by HORIZON Europe Research and Innovation Actions to be undertaken within the Aston Institute of Photonic Technologies at Aston University. The...


  • Birmingham, Birmingham, United Kingdom IC Resources Full time

    Senior Power Electronics Controls Engineer A multinational company is looking to hire a Power Electronics Controls Engineerto join their team in Birmingham who will work on micro-grid and PV based power converter control systems and control algorithms.Responsibilities of the role As well as developing control algorithms for power electronics, your other...

  • Senior Data Manager

    1 month ago


    Birmingham, Birmingham, United Kingdom Hamstead Hall Academy Full time

    Location: Hamstead Hall Academy Contract: Permanent Start Date: ASAPWorking Pattern: Full time, all year round Hamstead Hall Academy is a successful, heavily oversubscribed 11 – 18 Academy in Birmingham with excellent, highly committed staff. Hamstead Hall Academy is a vibrant, dynamic, and interactive Academy for students of all abilities where...