Senior Data Engineer

2 days ago

Manchester, United Kingdom Insight Investment Full time

Insight Investment is looking for an experienced Data Engineer to join our growing team building our strategic data platform as we look to adopt best-in-class data governance and democratize data around the business.


The successful candidate will play a pivotal role in shaping and executing our data strategy, leveraging our data assets to the full, elevating our decision-making, streamlining processes, and drive innovation within our organisation.


You will be part of the long-standing Data Platform team using Agile methods to deliver solutions on top of our cloud platform. Starting with Azure Databricks as a foundational component, we will look to integrate other technologies and grow capability to meet the demands of the business. You will work closely with a variety of business areas and be involved in all aspects of the Secure System Development Lifecycle (S-SDLC).


Role Responsibilities

  • Lead the design and implementation of a robust and scalable data platform using Azure Databricks and complementary tooling to meet the organisation's needs.
  • Contribute to and evolve the Insight Data Strategy, communicate outcomes at an executive through to team level Set the firm-wide standards and conventions for ingesting, governing, transforming, persisting, and democratising data.
  • Enable the adoption of advanced analytics & AI by configuring best-in-class tooling. Evolve the usage of infrastructure-as-code in collaboration with cloud engineering.
  • Align technical designs with internal data, privacy, security and compliance policies.
  • Stay abreast of industry trends and emerging technologies related to Databricks and big data processing, recommending relevant advancements for consideration.


Experience Required

  • Azure Databricks (Unity Catalog, Delta Lake, Delta Live Tables, Apache Spark, Structured Streaming) Python3 Terraform in Azure Integration with Collibra Integration with Snowflake Experience with CI/CD pipelines (GitHub Actions / TeamCity / Artifactory).
  • Demonstrate initiative and independence to solve problems.
  • Be able to communicate abstract or complex ideas or solutions effectively.
  • Stand by software engineering principles around quality and doing things the right way. Experience working in and with Agile teams performing iterative development.
  • Ability to collaborate with end users, stakeholders, teams, and team members.
  • Have a constant desire to improve knowledge and drive adoption of new tech or approaches within the teams.
  • Own mistakes and work with your colleagues to redress them, learn from them and make improvements for the long-term.


Insight is committed to being an inclusive employer and encourages applications from all suitably qualified applicants irrespective of background, circumstances, age, disability, gender identity, ethnicity, religion or belief, sexual orientation or other factors protected by federal, state and/or local laws. If you are a candidate with a disability, or are assisting a candidate with a disability, and require an accommodation to apply for one of our jobs, please email us at TalentAcquisition@InsightInvestment.com


About Insight Investment Insight Investment is a leading asset manager focused on designing investment solutions to meet its clients' needs. Founded in 2002, Insight's collaborative approach has delivered both investment performance and growth in assets under management. Insight manages assets across its core liability-driven investment, risk management, full-spectrum fixed income, currency and absolute return capabilities.


Insight is a global network of operations in the UK, Ireland, Germany, US, Japan and Australia. More information about Insight Investment can be found at: www.insightinvestment.com

  • Senior Data Analyst

    5 days ago

    Manchester, United Kingdom Data Idols Full time

    **Senior Data Analyst** Data Idols are working with a well-known retailer who is looking for a Senior Data Scientist to join an established data team and be part of making this organisation a fully data-driven company. This role offers very real career progression as you'll beworking with an industry-leading data team in the Manchester area. **The...

  • Senior Data Scientist

    3 weeks ago

    Manchester, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Job SummaryThis Senior Machine Learning Engineer role involves designing, developing and deploying ML models and pipelines, as well as maintaining and enhancing existing models.Key AccountabilitiesCollaborate with Data Scientists, ML Engineers and Data Engineers to design, develop and deploy ML models and pipelines.Develop processes to operationalise and...

  • Senior Data Engineer

    5 days ago

    Manchester, United Kingdom Adria Solutions Ltd Full time

    Senior Data Engineer - Fully Remote - Up to £85k On behalf of our leading client based in Manchester, we are recruiting for an exceptional Data Engineer. As Data Engineer, you will help support our clients as they build a new data platform that aims to empower Data Analysts to provide better insights toProduct Analysts, as well as empower Data Scientists to...

  • Data Engineer

    3 days ago

    Manchester, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **Data Engineer** **Up to £85,000 per annum** **Location** - Fully remote **URGENT** Data Engineer sought for a new and exciting telecommunications company with ambitious growth plans! **The Company** This company is a telecommunication start-up that wants to change the mobile industry by offering value, flexibility, and mutuality to their customers....

  • Senior Data Engineer

    1 month ago

    Manchester, United Kingdom Apply Recruitment Full time

    Senior Data Engineer required for an Enterprise Scale Business, paying up to £55K + Bonus + Excellent Benefits, with hybrid working in Manchester or Preston *This is hybrid working offering 2 to 3 days in your nearest office, with the others remotely.(It's still a new team finding the best approaches and solutions with users so being face to face is working...

  • Senior Engineer, Data Engineering

    3 weeks ago

    Manchester, United Kingdom Burns Sheehan Full time €75,000 - €85,000

    Senior Data Engineer £Azure, Databricks, SQL, PowerBI Manchester, fortnightly travel to office InsureTech influencing home insurance & mortgage services I am working with an insuretech business who have been a fore of the general insurance and mortgage industry for the best part of 20 years. Their mission is to revolutionise this space through...

  • Senior Engineer, Data Engineering

    4 weeks ago

    Manchester, United Kingdom Burns Sheehan Full time €75,000 - €85,000

    Senior Data Engineer £Azure, Databricks, SQL, PowerBI Manchester, fortnightly travel to office InsureTech influencing home insurance & mortgage services I am working with an insuretech business who have been a fore of the general insurance and mortgage industry for the best part of 20 years. Their mission is to revolutionise this space through...

  • Senior Data Engineer

    3 days ago

    Manchester, United Kingdom Harnham Full time

    **Senior Data Engineer** **Up to £70,000 per annum** **Location** - Leeds (attend the office once a week) Attention Data Engineers! We have a fantastic new opportunity for a Senior Data Engineer. **The Company** This company is an innovative firm that is looking to help students deal with the issue of information overload through the use of educational...

  • Senior Engineer, Data Engineering

    4 months ago

    Manchester, United Kingdom Harnham Full time €70,000 - €80,000

    Role: Senior Data Engineer Location: Remote (one day a month in Oxford) This global organisation leads a digital platform that supports the functions of buying and selling properties and are looking for a Senior Data Engineer to enter their team. The data team is relatively small (compared to the organisation) and they would love you to have...

  • Senior Data Engineer

    2 weeks ago

    Manchester, United Kingdom Xpertise Recruitment Full time

    Senior Data Engineer - Consultancy - Greater Manchester (Flexible, hybrid working is encouraged) Xpertise Recruitment is seeking a senior data engineer to join an established tech consultancy in Manchester.Why should you want to join?You will be representing an award winning consultancy that are well-respected in the industry for taking on the biggest...

  • Senior Data Engineer

    3 weeks ago

    Manchester, United Kingdom Xpertise Recruitment Full time

    Senior Data Engineer - Consultancy - Greater Manchester (Flexible, hybrid working is encouraged)Xpertise Recruitment is seeking a senior data engineer to join an established tech consultancy in Manchester.Why should you want to join?You will be representing an award winning consultancy that are well-respected in the industry for taking on the biggest...

  • Senior Data Scientist

    7 days ago

    Manchester, United Kingdom Data Idols Full time

    **Senior Data Scientist** Data Idols are working with a well-known e-commerce who is looking for a Senior Data Scientist to join an established data team and be part of making this organisation a fully data-driven company. This role offers very real career progression as you'll beworking with an industry-leading data team in the Manchester area. **The...

  • Senior Data Engineer

    12 hours ago

    Manchester, United Kingdom Harnham Full time

    Senior Data Engineer - DevOps We are working with a small software company that automate the legal and financial documentations.They currently have a small data team which they are looking to grow due to recent investment.The current Data Engineer is front end focused so they are looking for someone with strong DevOps experience to build out this function,...

  • Senior Data Analysts

    7 days ago

    Manchester, United Kingdom Aspire Data Recruitment Full time

    **Senior Data Analysts** **Manchester (office 2 days a week)** **£40,000 - £50,000 + bonus & benefits** **_The Role_** Support the business through the creation of actionable analysis and working with the wider teams to create solutions to improve efficiencies. - Supporting the business through the production of insight and recommendations to business...

  • Data Engineering Manager

    3 days ago

    Manchester, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **DATA ENGINEERING MANAGER** **LONDON 1x MONTH** **UP TO £75,000** **THE COMPANY** One of the largest global insurance companies is now looking to hire for a Data Engineering Manager to join the team! This company is extremely data-centric and has the plan to be the biggest insurance company in the UK! This role sits within a cross-functional team with...

  • Senior Data Engineer

    2 months ago

    Manchester, United Kingdom Harnham Full time

    Senior Data Engineer Location: Remote working (Once a month in Oxford) Salary: £80k competitive benefits package Role Overview: Our client is seeking a Senior Data Engineer to elevate their data infrastructure‘s reliability and scalability. Reporting to the Data & Analytics Director, you will drive the development of a larger data mesh setup while...

  • Senior Data Engineer

    3 days ago

    Manchester, United Kingdom Harnham Full time

    Senior Data Engineer - DevOps We are working with a small software company that automate the legal and financial documentations. They currently have a small data team which they are looking to grow due to recent investment. The current Data Engineer is front end focused so they are looking for someone with strong DevOps experience to build out this function,...

  • Senior Data Engineer

    3 days ago

    Manchester, United Kingdom Harnham Full time

    Senior Data Engineer - DevOps We are working with a small software company that automate the legal and financial documentations. They currently have a small data team which they are looking to grow due to recent investment. The current Data Engineer is front end focused so they are looking for someone with strong DevOps experience to build out this function,...

  • Senior Data Engineer

    1 day ago

    Manchester, United Kingdom Harnham Full time

    Senior Data Engineer - DevOps We are working with a small software company that automate the legal and financial documentations. They currently have a small data team which they are looking to grow due to recent investment. The current Data Engineer is front end focused so they are looking for someone with strong DevOps experience to build out this...

  • Senior Data Engineer

    2 days ago

    Manchester, United Kingdom Harnham Full time

    Senior Data Engineer - DevOps We are working with a small software company that automate the legal and financial documentations. They currently have a small data team which they are looking to grow due to recent investment. The current Data Engineer is front end focused so they are looking for someone with strong DevOps experience to build out this function,...