Lead Engineer/Data Engineer
4 weeks ago
Canada Life UK looks after the retirement, investment and protection needs of individuals, families and companies. We help to build better futures for our customers, our intermediaries and our employees by operating as a modern, agile and welcoming organisation.
Canada Life UK is transforming to create a more customer-focused business by providing our customers with expertise on financial and tax planning, offering home finance and annuities propositions, and providing collective fund solutions to third party customers.
The Lead Data Engineer is a hands-on technical role responsible for designing, developing, and maintaining data pipelines within the IT department. The pipelines will be realised in a modern lake environment and the engineer will collaborate in cross-functional teams to gather requirements and develop the conceptual data models. This role plays a crucial part in driving data-driven decision-making across the organisation, ensuring data availability, quality, and accessibility for various business needs.
This is not a line management role, but you will play a key part in guiding and upskilling more junior data engineers and setting data standards and guidelines.
Data Pipeline Development
Design, model, develop and maintain data pipelines to ingest, store, process, and present data.
Ensure data quality, accuracy, and consistency.
Collaborate with data architects to ensure data pipelines align with the overall data architecture strategy.
Data Transformation and Integration
Perform data transformation tasks, including data cleansing, enrichment, and aggregation, to prepare data for analytics and reporting.
Integrate data from structured and unstructured sources, ensuring compatibility and alignment with data models and business requirements.
Automate data transformation processes to improve efficiency.
Data Quality Assurance
Implement and maintain data quality checks and validation processes to identify and resolve data anomalies and errors.
Monitor data pipelines for data quality issues and implement data quality improvements.
Collaborate with business stakeholders to define data quality requirements.
Data Modelling and Schema Design
Collaborate with data architects and data scientists to design and implement data models, schemas, and structures.
Ensure that data models support business reporting and analytics needs while optimizing query performance.
Maintain data dictionaries and metadata to document data structures and relationships.
Performance Optimization
Optimize data storage, retrieval, and query performance by implementing indexing, partitioning, and caching strategies.
Monitor data processing performance and address bottlenecks as they arise.
Stay updated with best practices in data processing performance tuning.
Create and maintain documentation for data pipelines, data transformation processes, and data integration procedures.
Foster a culture of knowledge sharing within the data engineering team and across the organization.
Collaborate effectively with cross-functional teams, data stakeholders, and business units to understand data requirements and deliver data solutions that meet business needs.
Communicate technical concepts and data solutions to non-technical stakeholders in a clear and understandable manner.
Extensive experience in data engineering, including designing and developing data pipelines for retrieval / ingestion / presentation / semantics in an Azure environment.
Strong DataBricks, SQL, Python, Power BI
Data acquisition from various data sources including Salesforce, API, XML, json, parquet, flat file systems and relational data.
Effective communication and collaboration skills to work with cross-functional teams and gather data requirements.
Skills in data modelling (both structured and unstructured data) working directly with the business & data scientists.
Ability to optimise data solutions for performance, scalability, and efficiency.
Experience in a financial corporation
Experience with Spark clusters, both elastic permanent and transitory clusters
Familiarity with data governance, data security, and compliance requirements.
We believe in recognising and rewarding our people, so we offer a competitive salary and benefits package that's regularly reviewed. As a Canada Life UK colleague, you'll receive a competitive salary and comprehensive reward package including a generous pension and bonus scheme, along with, income protection, private medical insurance and life assurance. We have a fantastic number of other benefits and support services as well as regular personal and professional development.
We care about doing the right thing for our people, customers and community and helping others to build better futures. We want colleagues to have rewarding careers with us so we invest in the development of our people, technology and workplaces. That's why we offer a range of training, flexible working and opportunities to grow and develop.
Diversity and inclusion
Building an inclusive workplace with a diverse workforce where everyone can feel they belong and achieve their potential regardless of gender, ethnicity or any other characteristic is a key commitment for us. We're happy to discuss flexible working arrangements, including part time, for any of our roles should this be a requirement for.
We provide retirement, investment and protection solutions to 3.
-
Data Engineer
3 weeks ago
Potters Bar, United Kingdom eFinancialCareers Full timeCanada Life UK looks after the retirement, investment and protection needs of individuals, families and companies. We help to build better futures for our customers, our intermediaries and our employees by operating as a modern, agile and welcoming organisation. Part of our parent company Great-West Lifeco, Canada Life UK has operated in the United Kingdom...
-
Access Control Engineer
4 weeks ago
Potters Bar, United Kingdom Jobheron Full timeA skilled Automated Access Control Engineer / Automated Gate Engineer is needed to join the team at this leading Electrical Installation Company based in Hertfordshire. Applicants MUST be able to clear an enhanced DBS check, be able to work independently using their own initiative and hold a full UK driving licence. They are specialists in providing...
-
Gas Engineer
7 days ago
Potters Bar, United Kingdom Rubix Personnel Limited Full time**WANTED! Qualified Gas Engineers** **Potters Bar, Hertfordshire** Rubix M&E are trusted partners of leading; Blue-chip organisations, Energy & Heating suppliers, Housing Associations, Contractors and Private customers. Efficiency, customer service and safety are the core focuses. Ideally you will have; 2 years experience and domestic gas qualifications...
-
Data Engineer
3 days ago
Stevenage, Hertfordshire, United Kingdom Belcan Full timeLocation: Stevenage, Hertfordshire Contract details: 12 months (inside IR35), 37 hours per week Hybrid working model (3 days on site, 2 days remote) Hourly rate: £60 via an Umbrella company The Opportunity Belcan Workforce Solutions is seeking a talented and experienced data engineer to join our Space & Defence client’s team in Stevenage. As part of...
-
Data Engineer
2 days ago
Stevenage, Hertfordshire, United Kingdom Belcan Full timeLocation: Stevenage, Hertfordshire Contract details: 12 months (inside IR35), 37 hours per week Hybrid working model (3 days on site, 2 days remote) Hourly rate: £60 via an Umbrella company The Opportunity Belcan Workforce Solutions is seeking a talented and experienced data engineer to join our Space & Defence client’s team in Stevenage. As part of...
-
Aws Lead Engineer
5 days ago
Hertfordshire, United Kingdom Lorien Full time**AWS Lead Engineer - Contract** My client a top company are looking for an AWS Lead Engineer to join them on a 6-month initial contract based in their offices in Hertfordshire 2/3 days a week. **Please note this role will be paid via an umbrella company / PAYE**. Key Responsibilities: - Automation of end-to-end data flows:?Faster and reliable ingestion...
-
Senior Engineer, Data Engineering
2 weeks ago
Hertfordshire, United Kingdom Xcede Full timeSENIOR DATA ENGINEER (Hertfordshire HQ – circa x1 day a week in office) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also...
-
Senior Engineer, Data Engineering
3 days ago
Stevenage, Hertfordshire, United Kingdom Belcan Full timeStevenage, Hertfordshire Contract details: Hybrid working model (3 days on site, 2 days remote) Hourly rate: £60 via an Umbrella company Belcan Workforce Solutions is seeking a talented and experienced data engineer to join our Space & Defence client’s team in Stevenage. As part of the Space Systems projects, you will play a crucial role in managing...
-
Senior Engineer, Data Engineering
2 days ago
Stevenage, Hertfordshire, United Kingdom Belcan Full timeStevenage, Hertfordshire Contract details: Hybrid working model (3 days on site, 2 days remote) Hourly rate: £60 via an Umbrella company Belcan Workforce Solutions is seeking a talented and experienced data engineer to join our Space & Defence client’s team in Stevenage. As part of the Space Systems projects, you will play a crucial role in managing...
-
Access Control Engineer
2 days ago
Potters Bar, United Kingdom Jobheron Full timeSalary: £35k - 45k per year + Company van, Pension, Sick p Reference: ACC71402JH A skilled, experienced Automated Access Control / Automated Gate Engineer is needed to join the team at this leading Electrical Installation Company based in Hertfordshire. Applicants MUST be able to clear an enhanced DBS check, be able to work independently using their own...
-
Senior Data Engineer
2 weeks ago
Hertfordshire, United Kingdom Xcede Full timeSENIOR DATA ENGINEER(Hertfordshire HQ – circa x1 day a week in office)Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able...
-
Senior Data Engineer
2 weeks ago
Hertfordshire, United Kingdom Xcede Full timeSENIOR DATA ENGINEER (Hertfordshire HQ – circa x1 day a week in office) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also...
-
Senior Data Engineer
2 weeks ago
Hertfordshire, United Kingdom Xcede Full timeSENIOR DATA ENGINEER (Hertfordshire HQ – circa x1 day a week in office) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also...
-
Senior Data Engineer
2 weeks ago
Hertfordshire, United Kingdom Xcede Full timeSENIOR DATA ENGINEER(Hertfordshire HQ – circa x1 day a week in office)Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able...
-
Senior Data Engineer
2 weeks ago
Hertfordshire, United Kingdom Xcede Full timeSENIOR DATA ENGINEER (Hertfordshire HQ – circa x1 day a week in office) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also...
-
Senior Data Engineer
2 weeks ago
Hertfordshire, United Kingdom Xcede Full timeSENIOR DATA ENGINEER(Hertfordshire HQ – circa x1 day a week in office)Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able...
-
Senior Data Engineer
2 weeks ago
Hertfordshire, United Kingdom Xcede Full timeSENIOR DATA ENGINEER(Hertfordshire HQ – circa x1 day a week in office)Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able...
-
Senior Data Engineer
7 days ago
Hertfordshire, United Kingdom Xcede Full timeJob DescriptionSENIOR DATA ENGINEER(Hertfordshire HQ – circa x1 day a week in office)Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers...
-
Senior Engineer, Data Engineering
3 weeks ago
Borehamwood, Hertfordshire, United Kingdom Addition+ Full timeWe are currently recruiting for one of our trusted clients who are look for a Data Engineer. Join our client, a leading player in the pet health services and insurance industry, as they aim to secure the coveted position of the UK's #1 Pet Insurer. This pivotal moment includes a dynamic company rebrand, extensive departmental expansion, a sweeping...
-
Senior Engineer, Data Engineering
3 weeks ago
Borehamwood, Hertfordshire, United Kingdom Addition+ Full timeWe are currently recruiting for one of our trusted clients who are look for a Data Engineer. Join our client, a leading player in the pet health services and insurance industry, as they aim to secure the coveted position of the UK's #1 Pet Insurer. This pivotal moment includes a dynamic company rebrand, extensive departmental expansion, a sweeping...
