Data Engineer

4 months ago


London, UK, United Kingdom Hexegic Full time

Data Engineers are responsible for aiding UK Health in developing a cleaned, validated, and discoverable data foundation to enable new analytical workflows and applications.

They will need to work closely with UK Health subject matter experts to scope new data integrations, design a data model, and perform data cleansing and transformation within the data analytics platform.


Core activities

Establish new integrations into the data foundation.

  • The engineer will get to work with ontology experts and UK Health subject matter experts to map out a data model.
  • Data cleansing and transformation as defined with subject matter experts.
  • Configure links to other datasets in the data foundation.
  • Work with UK Health QA analysts and subject matter experts to test and validate the output datasets.
  • Set up schedules to regularly update the data in analytics platform.
  • Configure monitoring and data health on output datasets.
  • Liaise with UK Health business analysts to produce documentation on output datasets to aid understanding of pipelines and the data model.


Provide support to analytical users of the data foundation.

  • Once data is integrated into the data foundation, it is important that support is provided to UK Health analytical users to create new analytical workflows.
  • The engineer will supply advice to analytical users on how they can access and utilise the new datasets.


Qualities

  • Comfortable with Python - ideally experience with Apache Spark and Pyspark
  • Previous data analytics software experience
  • Able to scope new integrations and translate analytical user needs into technical requirement.


UK based – data analytics system can only be accessed in the UK.


  • SQL Support Engineer

    1 month ago


    London, UK, UK, United Kingdom Data Idols Full time

    SQL Support Engineer Salary: Up to £45k Location: Remote/Hybrid Data Idols are working with one of the largest entertainment organisations growing rapidly within their global operations.With innovation, creativity, and data at the company's heart, they are looking for a SQL Support Engineer to help them push technological boundaries. The Opportunity As...

  • Mechanical Engineer

    4 weeks ago


    London,, UK, United Kingdom Vantage Data Centers Full time

    About Vantage Data Centers Vantage Data Centers powers, cools, protects and connects the technology of the world’s well-known hyperscale’s, cloud providers and large enterprises. Developing and operating across markets in North America, Europe and APAC. Construction Department The Construction team is responsible for the entire process flow of...

  • Data Engineer

    7 days ago


    London,, UK, United Kingdom Fruition IT Full time

    Data EngineerLondon2 days a week on site£50,000 A dynamic innovation company is seeking a Data Engineer to join their Engineering team. This role will focus on designing, building, and operating technical implementations for various data products, including client-facing tools, internal research tools, and future innovations, potentially incorporating AI...

  • Data Engineer

    2 weeks ago


    London,, UK, United Kingdom Infinity Quest Full time

    Role: Data EngineerJob Type: Contract Duration: 6 Months + likely to be extendWork Location: Manchester, UK (Hybrid)Job Description:Develop, exploit, and maintain data products. Data Engineering teams are responsible for the delivery and operational stability of the data products built and provide ongoing support for those products. Data Engineers work...

  • Data Engineer

    1 month ago


    London,, UK, United Kingdom Prism Digital Full time

    Data Engineer | Snowflake, Python, SQL | FinTech CompanyI am seeking an experienced Data Engineer to join a prestigious FinTech company that delivers SaaS products offering real-time market feeds and pricing information, comparable with platforms like Bloomberg and Reuters. With around 800 employees globally and headquartered in London, the company is at the...

  • Data Engineer

    7 days ago


    London,, UK, United Kingdom Prism Digital Full time

    Data Engineer | Snowflake, Python, SQL | FinTech CompanySalary £65-70k + 10% BonusI am seeking an experienced Data Engineer to join a prestigious FinTech company that delivers SaaS products offering real-time market feeds and pricing information, comparable with platforms like Bloomberg and Reuters. With around 800 employees globally and headquartered in...

  • Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Mastek Full time

    Role: Data EngineerExperience: 8+ years Location - London (2 days travel to office)Permanent OpportunityCore Responsibilities:Design and implement ETL processes using PySpark and other data engineering tools.Develop, construct, test, and maintain architectures such as databases and large-scale data processing systems.Ensure data is cleaned, well-structured,...

  • Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Prism Digital Full time

    Lead Data Engineer | Microsoft & Azure Stack | Data AI ConsultancyLead position: 50% hands-on 50% consulting/working with strategy£100-120k + benefits packageI’m working with a fast-growing data consulting firm on the frontier of AI. They were established in 2020, have 10 employees and are growing fast. The Founder and leadership team come from an...

  • Data Engineer

    3 weeks ago


    London,, UK, United Kingdom Prism Digital Full time

    Lead Data Engineer | Microsoft & Azure Stack | Data AI ConsultancyLead position: 50% hands-on 50% consulting/customer engagement£90k-120k + benefits packageI’m working with a fast-growing data consulting firm on the frontier of AI. They were established in 2020, have 10 employees and are growing fast. The Founder and leadership team come from an...

  • Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Haystack Full time

    Position: Data EngineerLocation:Remote work with occasional (twice per month) office presence in London or Leicester.Role Overview:You will join a dynamic and expanding Data Engineering team with a primary focus on designing, building, enhancing, and optimising a cloud-based data warehouse.Candidate Profile:We are looking for someone who is honest,...

  • Data Engineer

    3 days ago


    London,, UK, United Kingdom Talent Finder Jobs Full time

    Data Engineer | Remote, London | Full Time | Up to £37,500 paUbiquity is a UK-based Academic Publishing Services and Technology company with a global team of 30. Our innovative, remote-friendly work culture emphasises collaboration and flexibility. We're seeking a skilled and motivated Data Engineer to join our Operations team.As a Data Engineer,...

  • Data Engineer

    3 weeks ago


    London,, UK, United Kingdom Formula Recruitment Full time

    Data Engineer - Marketplace and E-commerce platformTechnology: Python, SQL, Spark and AWSSalary: Up to £75,000 plus equity and benefitsLocation: Hybrid, London (3 days per week onsite)I am partnered with a rapidly growing marketplace and e-commerce start-up that is revolutionising how consumers shop, invest and operate online. Your role will involve...

  • Data Engineer

    1 month ago


    London,, UK, United Kingdom Movement8 Full time

    Azure Data Engineer - Contract - Inside IR35 This is an Azure Data Engineer position for a financial services end client helping them on delivering and implementing new data pipelines. You will need prior financial services experience as well as having strong Azure Data Factory and Databricks experience.Work Involved:Implementing and delivering data...

  • Data Engineer

    3 days ago


    London,, UK, United Kingdom Collabera Digital Full time

    We are looking for a Senior Azure Data Engineer to join an existing team building a new strategic big data platform for our client.Minimum 5 years of experience with Azure Data Factory, Databricks, Data Mesh.The new platform will be an Azure based data lake with APIs and events to allow consumption of data by analytics teams and will replace the existing...

  • Data Engineer

    1 month ago


    London,, UK, United Kingdom Airswift Full time

    Data EngineerLocation: London (Hybrid, 3 days a week)Contract: 4 months +, inside IR35Start: ASAPRate: £440 a day gross all inclusiveKey Skills: Data | Engineer | English | Python | Azure | ADF | Azure Data Factory | DBT | Data Bricks | Scala | PyScala | CI/CD | Agile | Banking |Key Responsibilities:Design and develop data engineering solutions utilizing...

  • Data Engineer

    3 weeks ago


    London,, UK, United Kingdom Click Recruitment Full time

    The ideal candidate will be responsible for developing high-quality applications. They will also be responsible for designing and implementing testable and scalable code.Here's some of the key work you'll be doing: Work with the Mulesoft API platform to facilitate new implementations of the societies API services. Design, implement, and maintain...

  • Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Eden Smith Group Full time

    Data EngineerLondon, remote, hybridUp to £70,000 per annum + BonusAn excellent opportunity has arisen for an experienced and engaging Data Engineer, to join a well-known organisation within the legal/tech sector.The successful applicant will join a well established team as a point of expertise for all data related projects. They will design, build and...

  • Data Engineer

    3 weeks ago


    London,, UK, United Kingdom SilverRock Bank Full time

    At SilverRock, we are building a new bank. Our vision is to “Pioneer fairer financial outcomes by empowering lenders to deliver and enabling savers to prosper” We are doing this by building a unique and highly scalable data driven multi-asset bank through a partnership of ecosystems, specialising in the delivery of forward flow partnerships and portfolio...

  • Data Engineer

    1 month ago


    London,, UK, United Kingdom Elysium Energy Talent Full time

    Data EngineerElysium Talent represent some of the most exciting and innovative Energy organisations, in the world. This role, based in London, is working for a leader in the Energy domain who are now looking for a Data Engineer to join their team due to growth.The Role The job holder will be responsible for expanding and optimising data and data pipeline...

  • Lead Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Dragonfly People Full time

    Lead Data EngineerData | Engineer | Lead | AWS | Python | SQL | Airflow | Snowflake | DBT | Fintech A Lead Data Engineer is required by a rapidly growing consumer Fin-Tech business who are based in London. The Lead Data Engineer will mentor and coach a team of Data Engineers, while driving automation and seeking opportunities to optimise data resources. You...