Lead Data Engineer

4 weeks ago

Potters Bar, United Kingdom Canada Life Limited Full time
Canada Life UK looks after the retirement, investment and protection needs of individuals, families and companies. We help to build better futures for our customers, our intermediaries and our employees by operating as a modern, agile and welcoming organisation.

Part of our parent company Great-West Lifeco, Canada Life UK has operated in the United Kingdom since 1903. We have hundreds of respected and supported employees committed to doing the right thing for our customers and colleagues.

Canada Life UK is transforming to create a more customer-focused business by providing our customers with expertise on financial and tax planning, offering home finance and annuities propositions, and providing collective fund solutions to third party customers.

Job Purpose
The Lead Data Engineer is a hands-on technical role responsible for designing, developing, and maintaining data pipelines within the IT department. The pipelines will be realised in a modern lake environment and the engineer will collaborate in cross-functional teams to gather requirements and develop the conceptual data models. This role plays a crucial part in driving data-driven decision-making across the organisation, ensuring data availability, quality, and accessibility for various business needs.

This is not a line management role, but you will play a key part in guiding and upskilling more junior data engineers and setting data standards and guidelines.

Duties/Responsibilities

Data Pipeline Development Design, model, develop and maintain data pipelines to ingest, store, process, and present data. Ensure data quality, accuracy, and consistency. Collaborate with data architects to ensure data pipelines align with the overall data architecture strategy. Data Transformation and Integration Perform data transformation tasks, including data cleansing, enrichment, and aggregation, to prepare data for analytics and reporting. Integrate data from structured and unstructured sources, ensuring compatibility and alignment with data models and business requirements. Automate data transformation processes to improve efficiency. Data Quality Assurance Implement and maintain data quality checks and validation processes to identify and resolve data anomalies and errors. Monitor data pipelines for data quality issues and implement data quality improvements. Collaborate with business stakeholders to define data quality requirements. Data Modelling and Schema Design Collaborate with data architects and data scientists to design and implement data models, schemas, and structures. Ensure that data models support business reporting and analytics needs while optimizing query performance. Maintain data dictionaries and metadata to document data structures and relationships. Performance Optimization Optimize data storage, retrieval, and query performance by implementing indexing, partitioning, and caching strategies. Monitor data processing performance and address bottlenecks as they arise. Stay updated with best practices in data processing performance tuning. Documentation and Knowledge Sharing Create and maintain documentation for data pipelines, data transformation processes, and data integration procedures. Foster a culture of knowledge sharing within the data engineering team and across the organization. Collaboration and Stakeholder Engagement Collaborate effectively with cross-functional teams, data stakeholders, and business units to understand data requirements and deliver data solutions that meet business needs. Communicate technical concepts and data solutions to non-technical stakeholders in a clear and understandable manner. Knowledge/Skills/Experience

Essential Extensive experience in data engineering, including designing and developing data pipelines for retrieval / ingestion / presentation / semantics in an Azure environment. Strong DataBricks, SQL, Python, Power BI Data acquisition from various data sources including Salesforce, API, XML, json, parquet, flat file systems and relational data. Effective communication and collaboration skills to work with cross-functional teams and gather data requirements. Skills in data modelling (both structured and unstructured data) working directly with the business & data scientists. Ability to optimise data solutions for performance, scalability, and efficiency. Desirable: Experience in a financial corporation Lake House / Delta Lake and Snowflake Experience with Spark clusters, both elastic permanent and transitory clusters Familiarity with data governance, data security, and compliance requirements. Power Automate. Benefits of working at Canada Life

We believe in recognising and rewarding our people, so we offer a competitive salary and benefits package that's regularly reviewed. As a Canada Life UK colleague, you'll receive a competitive salary and comprehensive reward package including a generous pension and bonus scheme, along with, income protection, private medical insurance and life assurance. We have a fantastic number of other benefits and support services as well as regular personal and professional development.

How we work at Canada Life

Our culture is unique and incredibly important to us. We care about doing the right thing for our people, customers and community and helping others to build better futures. Our blueprint behaviours shape and influence how we work, and are central to the relationships we have with others. Every day we are encouraged to be more curious, own the outcome, face into things together and find a way forward.

We want colleagues to have rewarding careers with us so we invest in the development of our people, technology and workplaces. That's why we offer a range of training, flexible working and opportunities to grow and develop.

Diversity and inclusion

Building an inclusive workplace with a diverse workforce where everyone can feel they belong and achieve their potential regardless of gender, ethnicity or any other characteristic is a key commitment for us. We are proud of the progress we're making in DEI, and we continue for it to be a significant focus.

"At Canada Life we believe in the power of great people from different backgrounds, experiences and perspectives coming together to build better futures. Emerging talent is crucial to our growth and creating an environment that continues to inspire us all." Nick Harding, Chief People Officer, Canada Life UK

We appreciate that everyone has different work and life responsibilities. We're happy to discuss flexible working arrangements, including part time, for any of our roles should this be a requirement for.

  • Data Engineer

    4 weeks ago

    Potters Bar, United Kingdom Canada Life Full time

    **Job Title: Data Engineer** **Location: Potters Bar** **Type: Permanent** Canada Life UK looks after the retirement, investment and protection needs of individuals, families and companies. We help to build better futures for our customers, our intermediaries and our employees by operating as a modern, agile and welcoming organisation. Part of our parent...

  • Data Engineer

    4 weeks ago

    Potters Bar, United Kingdom eFinancialCareers Full time

    Canada Life UK looks after the retirement, investment and protection needs of individuals, families and companies. We help to build better futures for our customers, our intermediaries and our employees by operating as a modern, agile and welcoming organisation. Part of our parent company Great-West Lifeco, Canada Life UK has operated in the United Kingdom...

  • Access Control Engineer

    4 weeks ago

    Potters Bar, United Kingdom Jobheron Full time

    A skilled Automated Access Control Engineer / Automated Gate Engineer is needed to join the team at this leading Electrical Installation Company based in Hertfordshire. Applicants MUST be able to clear an enhanced DBS check, be able to work independently using their own initiative and hold a full UK driving licence. They are specialists in providing...

  • Technical Lead

    3 weeks ago

    Potters Bar, United Kingdom JSM Construction Limited Full time

    Job DescriptionEHV Technical Lead Location: Potters Bar Coverage: All UK SitesPosition: Permanent (fulltime)Line of Reporting: Head of Projects & Frameworks Role Description:To manage the day-to-day operations on specifically assigned power projects and /or work streamsassociated with EHV/ICP Contracts. To oversee the effective deployment of Test Engineers,...

  • Group Data Protection Officer

    4 weeks ago

    Potters Bar, United Kingdom CareTech Group Full time

    **Group Data Protection Officer**: £60,000k per annum 37.5hrs per week 31 days annual leave inclusive of Bank Holidays **Main Duties and Responsibilities**: **Key Areas of Work** Support the Group’s SIRO by taking lead responsibility for the coordination and operational management of Information Governance projects. Review of Information Governance...

  • Access Control Engineer

    5 days ago

    Potters Bar, United Kingdom Jobheron Full time

    Salary: £35k - 45k per year + Company van, Pension, Sick p Reference: ACC71402JH A skilled, experienced Automated Access Control / Automated Gate Engineer is needed to join the team at this leading Electrical Installation Company based in Hertfordshire. Applicants MUST be able to clear an enhanced DBS check, be able to work independently using their own...

  • EHV Technical Lead

    2 weeks ago

    Potters Bar, Hertfordshire, United Kingdom JSM Construction Limited Full time

    Job Description EHV Technical Lead Location: Potters Bar Coverage: All UK Sites Position: Permanent (fulltime) Line of Reporting: Head of Projects & Frameworks Role Description: To manage the day-to-day operations on specifically assigned power projects and /or work streams associated with EHV/ICP Contracts. To oversee the effective deployment of...

  • Vacancy (P & S Blank)

    4 weeks ago

    Potters Bar, United Kingdom Canada Life Full time

    **Application closing date: 17th July 2023** Canada Life Group is the top-level European holding company for the Great-West Lifeco’s European insurance, reinsurance, and asset management companies, with business operations in the UK, Ireland, Germany, and the Isle of Man. European Technology sits within Canada Life Group and encompasses the technology...

  • Customer Analytics Manager

    4 weeks ago

    Potters Bar, United Kingdom eFinancialCareers Full time

    Canada Life UK looks after the retirement, investment and protection needs of individuals, families and companies. We help to build better futures for our customers, our intermediaries and our employees by operating as a modern, agile and welcoming organisation. Part of our parent company Great-West Lifeco, Canada Life UK has operated in the United Kingdom...

  • CRM Planning

    4 weeks ago

    Potters Bar, United Kingdom Canada Life Full time

    **Job Title: CRM Planning & Execution Manager** **Location: Potters Bar** **Type: Permanent** **Job Purpose** The role holder will manage the planning through to execution for customer and advisory communications. Reporting into the Head of Insight, Data and CRM, the role holder will look to plan and implement focused, strategic marketing campaigns through...

  • CRM Planning

    3 weeks ago

    Potters Bar, United Kingdom eFinancialCareers Full time

    Canada Life UK looks after the retirement, investment and protection needs of individuals, families and companies. We help to build better futures for our customers, our intermediaries and our employees by operating as a modern, agile and welcoming organisation. Part of our parent company Great-West Lifeco, Canada Life UK has operated in the United Kingdom...

  • Technical Lead

    3 weeks ago

    Potters Bar, South East, United Kingdom JSM CONSTRUCTION LIMITED Full time

    Job DescriptionScroll down for a complete overview of what this job will require Are you the right candidate for this opportunityEHV Technical Lead Location: Potters Bar Coverage: All UK SitesPosition: Permanent (fulltime)Line of Reporting: Head of Projects & Frameworks Role Description:To manage the day-to-day operations on specifically assigned power...

  • Graduate Trainee Construction Planner

    4 weeks ago

    Potters Bar, Hertfordshire, United Kingdom NSR Associates Full time

    SENIOR PLANNER - DATA CENTRE £70-95,000 Plus Car, Medical, Pension & Bonus Cash Rich Main Contractor with a strong foothold within the Data & Tech Sector across the UK & Europe. Client focused with an enviable record on Mega Watt Data Projects. Interested in a Major Project is this for you ? Major Data Centre - Potters Bar just off the M25 - North...

  • European Fund Administrator

    2 weeks ago

    Potters Bar, United Kingdom Flair for Recruitment Full time

    Do you have experience of working in an Investment Back Office? Are you a good communicator with a great customer service ethic? Our client, a leading provider of Group Insurance, is looking for a European Fund Administrator (Asset Servicing) to join their team. Your responsibilities: - Reporting into the Asset Servicing Supervisor, you will be responsible...

  • Senior Planner

    4 weeks ago

    Potters Bar, Hertfordshire, United Kingdom NSR Associates Full time

    SENIOR PLANNER - DATA CENTRE £70-95,000 Plus Car, Medical, Pension & Bonus Cash Rich Main Contractor with a strong foothold within the Data & Tech Sector across the UK & Europe. Client focused with an enviable record on Mega Watt Data Projects. Interested in a Major Project is this for you ? Major Data Centre - Potters Bar just off the M25 - North London ...

  • Project Manager

    4 weeks ago

    Potters Bar, United Kingdom SNC-Lavalin Full time

    Job Description AtkinsRéalis, Balfour Beatty and Egis Road Operations UK are part of a consortium, creating Connect Plus Services, a unique partnership with a collective strength in highways asset care from finance, through to design, build, maintenance as well as day to day operation. As part of our 30-year remit to manage and improve the...

  • Cloud Security Engineer Manager

    7 days ago

    Potters Bar, United Kingdom Canada Life Limited Full time

    Role Type and Location Full Time Permanent position. Hybrid role based in our Potters Bar, London, Bristol, Isle of Man or Dublin offices. About us Canada Life Group is the top-level European holding company for the Great-West Lifeco Group's European insurance, reinsurance, and asset management companies, with business operations in the UK, Ireland,...

  • Legal Counsel

    4 weeks ago

    Potters Bar, United Kingdom eFinancialCareers Full time

    Canada Life UK looks after the retirement, investment and protection needs of individuals, families and companies. We help to build better futures for our customers, our intermediaries and our employees by operating as a modern, agile and welcoming organisation. Part of our parent company Great-West Lifeco, Canada Life UK has operated in the United Kingdom...

  • Cloud Security Engineer Manager

    1 week ago

    Potters Bar, United Kingdom Canada Life Limited Full time

    Role Type and Location Full Time Permanent position. Hybrid role based in our Potters Bar, London, Bristol, Isle of Man or Dublin offices. About us Canada Life Group is the top-level European holding company for the Great-West Lifeco Group's European insurance, reinsurance, and asset management companies, with business operations in the UK, Ireland,...

  • Cloud Security Engineer Manager

    1 week ago

    Potters Bar, United Kingdom Canada Life Group Ltd Full time

    Role Type and Location Full Time Permanent position. Hybrid role based in our Potters Bar, London, Bristol, Isle of Man or Dublin offices. About us Canada Life Group is the top-level European holding company for the Great-West Lifeco Group's European insurance, reinsurance, and asset management companies, with business operations in the UK, Ireland,...