Lead Data Engineer

4 weeks ago


Canary Wharf, United Kingdom Ikhoi Recruitment Full time

A rapidly growing Data Team for an energy contracts company are looking for a Lead Data Engineer to come and join their Data Team.

This role is hybrid you'll be working 2 days in their Canary Wharf office and rest WFH.

Employee Benefits

As if contributing to and supporting work that makes life better for millions wasn’t rewarding enough, we offer a full range of benefits too. Key benefits that may be available depending on the role include:

- 25 days' annual leave and bank holidays
- Recognition schemes allowing colleagues to say thanks
- Company contribution to your pension scheme
- Family friendly policies, including enhanced company maternity/paternity and shared parental benefits
- Employee assistance programme for free, confidential support for your professional or personal life, including financial management and family care
- Special leave such as study leave, sabbatical or public duties
- Three days paid leave a year for volunteering to support your local community
- Season ticket loan scheme to support your commute
- Access to "Work Perks" offering deals, discounts and cash back on your purchases
- Family savings on days out and English Heritage or gym discounts through our partners.

As part of the Technology Hub you will work very closely with the Development team and with the Operations Hub through project delivery, ensuring developers and data engineers within the direct Data & Software Engineering teams work collaboratively and effectivelywith Business Analysts, Project Managers and Testers from the wider business. The ability to work and influence internally with the business is key, as is an understanding of the wider external stakeholder environment.

Key Responsibilities
- Define and lead technical vision and strategy of appropriate data architecture, with security as a key consideration for all structured data
- Leading data engineering to design and implement complex and bespoke data solutions to support the high volume of data coming from settlement systems and other bespoke systems.
- Identify resource requirements, and recruit and manage a software engineering and data team appropriately.
- Provide mentoring and development to a highly skilled team of specialists
- Aligning the data architecture approach with the overall change strategy and also the overarching solutions architecture
- Support the implementation of our development practice of continuous delivery and promote cloud computing and open-source solutions where applicable
- Ensuring the operational support and monitoring are in place for the live running of systems
- Form part of the leadership team of the Technology Hub, defining and improving the ways of working to best support the whole business needs, also working closely with the Operations Hub
- Ensure the technical integrity of projects and those common technical elements are recognised so that work is not unnecessarily duplicated, and the technologies used are consistent target architecture
- Ensure the effective sourcing, modelling and storage of data that is reliable and ready to be used to develop business intelligence
- Define, embed, and drive master data management approaches, principles, and processes

Skills Knowledge and Expertise

Essential:

- Minimum 5 years’ experience in Software Engineering (Python), Data Architecture & Design frameworks
- Minimum 2 years’ experience in a leadership role in a technical area
- Experience in line managing and mentor a team of technical specialists whilst their day-to-day work may be dictated by wider project teams
- Knowledge of cloud platforms, such as Azure, IBM, AWS and Google
- Able to communicate complex technical issues simply to a lay stakeholder audience
- Understand the business needs/requirements, whilst making insightful recommendations
- Track record and strong understanding of KPI / Metric principles

Desirable:

- Passionate about software engineering best practices including agile, TDD, continuous delivery, microservices and iterative development
- Strong personal influencing and communication skills to challenge the business and achieve a compromise
- Highly analytical and robust critical thinker
- Strong decision-making and influencing skills as well as strong planning and organisational skills
- Results and output orientated
- Able to work closely with and build excellent relationships with key stakeholders.



  • Canary Wharf, United Kingdom Lorien Full time

    This major Cloud Engineering company are looking for Lead Cloud Native Data Engineers with experience of managing Cloud Data Engineering teams in the design, build and support of highly complex data migrations to the Public Cloud. These roles can be based remotely anywhere within the UK, but you will be required to attend monthly meetings in any of their...

  • Gcp Data Engineer

    2 months ago


    Canary Wharf, United Kingdom Lorien Full time

    Data Engineer - GCP Key skills required include - Strong data engineer experience - GCP experience - BigQuery - Dataproc for Spark - Dataflow for Apache Beam - Airflow on Composer: - Pub/Sub - Cloud Functions, Cloud Run - CloudSQL for Postgres - GCP operations suite for logging and monitoring - GCS - Usage in conjunction with other services, - BI tools...


  • Canary Wharf, United Kingdom Ethan James Full time

    Ethan James Group are working on behalf of a large well respeced Facilities Management provider to recruit an experienced Senior Electrical Engineer within the Data Centre sector who would like to further develop thier skills within BMS Controls and work on a split day shift in the Operations Control Centre. * Duties of the Data Centre Electrical BMS...


  • Canary Wharf, United Kingdom Ethan James Full time

    Ethan James Group are working on behalf of a large well respeced Facilities Management provider to recruit an experienced Senior Electrical Engineer within the Data Centre sector who would like to further develop thier skills within BMS Controls and work on a split day shift in the Operations Control Centre. * Duties of the Data Centre Electrical BMS...


  • Canary Wharf, United Kingdom Ethan James Full time

    Ethan James Group are working on behalf of a large well respeced Facilities Management provider to recruit an experienced Senior Electrical Engineer within the Data Centre sector who would like to further develop thier skills within BMS Controls and work on a split day shift in the Operations Control Centre. * Duties of the Data Centre Electrical BMS...


  • Canary Wharf, United Kingdom Ethan James Full time

    Ethan James Group are working on behalf of a large well respeced Facilities Management provider to recruit an experienced Senior Electrical Engineer within the Data Centre sector who would like to further develop thier skills within BMS Controls and work on a split day shift in the Operations Control Centre. * Duties of the Data Centre Electrical BMS...


  • Canary Wharf, United Kingdom Lorien Full time

    Senior Data Engineer - GCP Key skills required include - Strong data engineer experience - GCP experience - BigQuery - Dataproc for Spark - Dataflow for Apache Beam - Airflow on Composer: - Pub/Sub - Cloud Functions, Cloud Run - CloudSQL for Postgres - GCP operations suite for logging and monitoring - GCS - Usage in conjunction with other services, - BI...


  • Canary Wharf, United Kingdom Anonymous Full time

    Our client has an exciting opportunity for a Cabling Shift Engineer (Data Centres) – Optic Fibre to join their team in London, Docklands. You will join them on a full time, permanent basis, and in return, you will receive a competitive salary of £40,109 per annum + excellent benefits (shift allowance, travel allowance, bonus scheme, pension, life...


  • Canary Wharf, United Kingdom 360 Resourcing Solutions Full time

    Our client hasan exciting opportunity for an experienced and energetic **Cabling Engineer (Data Centres) - Optic Fibre** to join their high performing team in **London, Docklands.** You will join them on a **full time, permanent basis**, working Monday - Friday, 8am - 4pm and in return, you will receive a competitive salary of up to **£34,876 per annun +...


  • Canary Wharf, United Kingdom 360 Resourcing Solutions Full time

    Our client hasan exciting opportunity for an experienced and energetic **Cabling Engineer (Data Centres) - Optic Fibre** to join their high performing team in **London, Docklands.** You will join them on a **full time, permanent basis**, working Monday - Friday, 8am - 4pm and in return, you will receive a competitive salary of up to **£34,876 per annun +...


  • Canary Wharf, United Kingdom Anonymous Full time

    Our client has an exciting opportunity for a Cabling Shift Engineer (Data Centres) – Optic Fibre to join their team in London, Docklands. You will join them on a full time, permanent basis, and in return, you will receive a competitive salary of £40,109 per annum + excellent benefits (shift allowance, travel allowance, bonus scheme, pension, life...


  • Canary Wharf, United Kingdom Anonymous Full time

    Our client has an exciting opportunity for a Cabling Shift Engineer (Data Centres) – Optic Fibre to join their team in London, Docklands. You will join them on a full time, permanent basis, and in return, you will receive a competitive salary of £40,109 per annum + excellent benefits (shift allowance, travel allowance, bonus scheme, pension, life...


  • Canary Wharf, United Kingdom Ethan James Full time

    Ethan James Group are currently working on behalf of a large Facilities Management contractor to recruit an Electrical Day Shift Data Centre Engineer within a large presitgious critical data centre contract based in Canary Wharf, Dockalnds area in London. The ideal Electrical Data Centre Engineer will come from a Technical background ideally within Data...


  • Canary Wharf, United Kingdom Ethan James Full time

    Ethan James Group are currently working on behalf of a large Facilities Management contractor to recruit an Electrical Day Shift Data Centre Engineer within a large presitgious critical data centre contract based in Canary Wharf, Dockalnds area in London.The ideal Electrical Data Centre Engineer will come from a Technical background ideally within Data...


  • Canary Wharf, United Kingdom Genomics England Full time

    Company DescriptionGenomics England partners with the NHS to provide whole genome sequencing diagnostics. We also equip researchers to find the causes of disease and develop new treatments – with patients and participants at the heart of it all.Our mission is to continue refining, scaling, and evolving our ability to enable others to deliver genomic...


  • Canary Wharf, United Kingdom Genomics England Full time

    Company DescriptionGenomics England partners with the NHS to provide whole genome sequencing diagnostics. We also equip researchers to find the causes of disease and develop new treatments – with patients and participants at the heart of it all.Our mission is to continue refining, scaling, and evolving our ability to enable others to deliver genomic...


  • Canary Wharf, United Kingdom JPMorgan Chase & Co Full time

    **JOB DESCRIPTION** Data Management Strategy Lead, VP, Firmwide CDO** **Organization Description** The Chief Data & Analytics Office (CDAO) at JPMorgan Chase is responsible for accelerating the firm’s data and analytics journey. This includes ensuring the quality, integrity, and security of the company's data, as well as leveraging this data to generate...


  • Canary Wharf, United Kingdom The Medicines And Healthcare Products Regulatory Agency Full time

    The MHRA is transforming. Through enabling innovation, making the right judgements of the benefits and risks of medical products and forging the right partnerships in the UK and internationally, it aims to deliver world class regulation and improved outcomes for UK patients. We are currently looking for a Senior Data Engineer (Real World Data) to join our...


  • Canary Wharf, Greater London, United Kingdom The Medicines And Healthcare Products Regulatory Agency Full time

    The MHRA is transforming. Through enabling innovation, making the right judgements of the benefits and risks of medical products and forging the right partnerships in the UK and internationally, it aims to deliver world class regulation and improved outcomes for UK patients.We are currently looking for a Senior Data Engineer (Real World Data) to join our...


  • Canary Wharf, Greater London, United Kingdom The Medicines And Healthcare Products Regulatory Agency Full time

    The MHRA is transforming. Through enabling innovation, making the right judgements of the benefits and risks of medical products and forging the right partnerships in the UK and internationally, it aims to deliver world class regulation and improved outcomes for UK patients.We are currently looking for a Senior Data Engineer (Real World Data) to join our...