Data Engineer

3 weeks ago


Hampshire UK, South East England, United Kingdom Intec Select Full time

Data Analytics Engineer – Financial Services – SQL / Python / Power BI – Hampshire


Overview:

An Exciting opportunity has arisen with one of the UK’s largest Life Insurance brokers for a Data Analytics Engineer to join the growing team. Reporting to the Data Platform Manager, you will play a critical role in designing, building, and maintaining the infrastructure that allows the teams to analyse data efficiently and effectively. You will work closely with data scientists, analysts, and business stakeholders to ensure that the data pipelines are robust, scalable, and optimized for performance.


Role & Responsibilities:

  • Design, implement, and maintain scalable data pipelines to collect, process, and analyse large datasets from various sources
  • Develop and optimize data models that support analytical and reporting needs, ensuring data accuracy and consistency
  • Collaborating with key stakeholders to ensure the implementation of data products for insights and informed decisions, providing demos of the semantic model or building dashboards
  • Manage and optimize the data storage solutions, including relational and NoSQL databases
  • Designing and implementing performant data ingestion pipelines from multiple sources using Apache Spark - ideally in Azure Databricks
  • Work closely with data scientists, analysts, and business teams to understand their needs and deliver solutions that drive insights and decision-making
  • Identify and resolve performance bottlenecks in data processing and ensure the efficiency of ETL processes
  • Implement data validation and monitoring processes to ensure the integrity and quality of our data
  • Develop automation scripts and tools to improve the efficiency of data processing and analysis workflows


Essential Skills & Experience:

  • 3-5 years’ experience in a similar environment
  • Strong experience of Python and SQL
  • Excellent proficiency in writing SQL
  • Strong knowledge of Data Management principles in a Lakehouse Architecture
  • Hands on experience designing and delivering solutions using Azure services including Azure Data Factory, Azure Databricks, Azure Synapse, Azure Storage, Azure DevOps
  • Strong Power BI knowledge
  • Experience managing data solutions deployments using Azure DevOps (CI/CD)
  • Previous experience working with Data Scientists to produce ML pipelines into overall data platform solutions
  • Experience working in a heavily regulated industry desirable but not essential


Package:

  • £55K-65K basic salary
  • Hybrid working – 3 days in the office
  • Competitive Bonus
  • Excellent Benefits



  • Hampshire, UK, South East England, United Kingdom Stott and May Full time

    Data Centre Shift EngineerWe are seeking an experienced Data Centre Shift Engineer, This is a fantastic opportunity to work in a dynamic environment where you'll play a key role in maintaining the electrical and mechanical systems of DC facilities.CONTINENTAL SHIFT PATTERNKey Duties & Responsibilities:Perform small lighting installations, fault-finding,...


  • Oxfordshire, UK, South East England, United Kingdom Vector Resourcing Full time

    Our client is looking for a Head of Data Engineering to come on board and continue their development of their data platform product. They are looking for someone that can have a primary focus on the strategic running of the existing team but also someone that isn't so far removed from the technical aspects of the team that they can get hands on with the...


  • Oxfordshire, UK, South East England, United Kingdom Walsh Employment Full time

    Our client specialises in using advanced algorithms and AI to manage and maximise the value of energy storage. By optimising the timing of battery charging and discharging based on real-time market conditions, customers can participate more effectively in multiple energy markets, enhancing the efficiency and profitability of renewable energy resources. We...


  • West Berkshire, UK, South East England, United Kingdom Harnham Full time

    Senior Data EngineerBerkshireOnce a month in the officeUp to £80,000 depending on experience Harnham are partnering with a company who has been providing software solutions for nearly 20 years. They are a technology company who operates in the property, legal and financial services industries. They are looking for a Senior Data Engineer to help scale up the...

  • Data Engineer

    3 months ago


    Gloucestershire, UK, South West England, United Kingdom Hexegic Full time

    Are you passionate about advancing your career in data and software engineering? Here at Hexegic we are looking for driven and innovative data engineers to grow professionally, whilst collaborating with some of the industry’s brightest minds.Your role will be essential in helping customers build and maintain data pipelines and applications, using...


  • Hampshire, UK, South East England, United Kingdom iO Associates - UKEU Full time

    Experienced Azure Engineer£70,000 + bonus + 15% pensionHampshire, 3 days on site A well-known utilities organisation in Hampshire are undergoing a major cloud migration to Microsoft Azure, to improve the service offered to their growing client base.As the first permanent Azure Engineer to join the platform team, you will be working alongside the development...

  • Data Scientist

    1 week ago


    Oxfordshire, UK, South East England, United Kingdom Ivy Farm Technologies Full time

    Ivy Farm - Data Scientist (Statistics and Machine Learning)At Ivy Farm our mission is to create the world’s best guilt free and sustainable meat, it’s cultivated meat, just like real meat, only made differently - and we’re super excited by it.Were a humble community of 40+ technical and scientific crew; a team where you can make a true difference to...


  • Bristol, UK, South West England, United Kingdom Orion Group Full time

    Orion Technology is seeking a Data Commissioning Engineer to join our client's team working on the digitalisation of a Project. In this role, you'll play a key part in transforming current document-centric commissioning processes into a modern, data-driven approach. You'll leverage your expertise in data management and PLM tools (ideally Dassault...

  • Solicitor

    1 month ago


    Hampshire, UK, South East England, United Kingdom Thomas Ren Associates Ltd Full time

    We are looking for a corporate and or commercial solicitor to work for a rapidly expanding firm with National and International clients based in Hampshire. They are well-established, with a modern approach to the industry. Genuinely a nice place to work with a sophistication that would put many international practices to shame .They are flexible with their...


  • Oxfordshire, UK, South East England, United Kingdom Understanding Recruitment Full time

    MLOps Engineer | GreenTech | Oxford (2x per week)We are searching for an MLOps Engineer to join an innovative GreenTech company that maximises the value of large-scale flexible energy assets (eg, battery storage) on a sustainable basis. The role is based in Oxford (2x day per week in the office).You will build and maintain real-time data streaming from...


  • Oxfordshire, UK, South East England, United Kingdom FORT Full time

    About usWe strive to expand human potential and seek an enthusiastic and dedicated Director of Software Engineering to join our pioneering team in Oxford. We value relentless curiosity and the pursuit of excellence and invite you to help shape the future of scientific exploration and healthcare breakthroughs to drive scientific discovery and combat...

  • Veeam Consultant

    3 weeks ago


    Hampshire, UK, South East England, United Kingdom Chapman Tate Associates Full time

    Veeam Consultant – Initial 3 Month Contract – Outside IR35 – Hampshire Chapman Tate Associates is working with a leading provider of IT solutions who are seeking a skilled Veeam Consultant with security clearance on a specific project. The successful candidate will play a critical role in troubleshooting and resolving issues with Veeam installations,...


  • Oxfordshire, UK, South East England, United Kingdom be:technology Full time

    Role: Computer Vision EngineerSalary: £60-80kLocation: Oxfordshire (Remote/Hybrid)We are really excited to partner with a super cool start-up that has recently achieved Series A funding and is on a rapid growth trajectory. Our client, a leading AI-driven technology company, is revolutionising industries through advanced computer vision and data analytics...

  • Data Steward

    2 weeks ago


    Bristol, UK, South West England, United Kingdom Assystem Full time

    ⚡️ About AssystemAssystem is an international company with one mission: accelerate the energy transition around the world. Every day, our 7,500 Switchers located in 12 countries (Europe, Middle East, Pacific Asia & Africa) connect their six thousand billion neurons to tackle the task of the century: switching to low-carbon energy. We are a collective...


  • Buckinghamshire, UK, South East England, United Kingdom IC Resources Full time

    Senior Machine Learning EngineerBuckinghamshire, UK (Hybrid working, 2-3 days a week in the office)*Please note this position is to start in Q4, end of this year*IC Resources is seeking a Senior Machine Learning Engineer to join our client's team in Buckinghamshire, UK. The successful candidate will develop and implement advanced computer vision models...

  • Strategy Engineer

    2 weeks ago


    Oxfordshire, UK, South East England, United Kingdom Forsyth Barnes Full time

    Forsyth Barnes are delighted to be representing a motorsport team seeking a Senior Strategy Engineer.This role, based in Banbury, UK, reports to the Head of Performance Engineering and is focused on providing strategic support for FIA Formula 1 Championship races and test events. The primary responsibility is to manage the race strategy group, optimizing...


  • Surrey, UK, South East England, United Kingdom microTECH Global LTD Full time

    Contract Length: 6 monthsHybrid: 3 days onsite, 2 days WFHSkills & Qualifications:- A degree in Computer Science, Electronics, Natural Sciences, Mathematics, Engineering, or a related field (equivalent industrial experience may be considered).- Expertise in optimizing commercial game engines (such as Unity, Unreal, etc.)- Strong proficiency in modern C++-...

  • CAD Surveyor

    1 month ago


    Hampshire, South East England, United Kingdom HAMPSHIRE COUNTY COUNCIL Full time

    Our Geomatic Survey Team in Engineering Services is looking for an experienced CAD Surveyor to join the team. We are a forward-thinking in-house consultancy providing a range of services to the County Council and other authorities. This includes geomatic surveys, Geotech consultancy, engineering design, laboratory testing, site supervision and...


  • Kent, UK, South East England, United Kingdom Cubiq Recruitment Full time

    Head of Mechanical EngineeringSalary: £65,000Location: KentPermanent position This company is at the forefront of electrical safety equipment and distribute on a global scale, during this exciting time of expansion, the position of Head of Mechanical Engineering has become available.Role SummaryThe Head of the Mechanical Engineering Team will lead and...


  • Bristol, UK, South West England, United Kingdom BJSS Full time

    About UsWe’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day.In the last 30 years we won several awards,...