Data Engineering Lead

1 week ago

United Kingdom LexisNexis Intellectual Property Solutions Full time

About our Team

The Content Engineering teams at LexisNexis Intellectual Property (IP) are at the forefront of innovation, transforming the way patent data is processed, managed, and utilized. We are in the initial stages of building our DataOps team who will govern the Data Quality across the entire technology department.


Our teams are working closely with Databricks to migrate existing ETL solutions to a state-of-the-art Databricks, Python and PySpark tooling that will become our new Strategic Data Platform. The Data Platform ingests, processes, and enriches patent information from multiple global authorities using a medallion architecture.




About the Role

As the technical lead for the team building the strategic Data Platform at LexisNexis IP, you will be instrumental in executing our data strategy for the Data Platform. Your role will be pivotal in developing and implementing advanced solutions for data integration, quality control, and continuous delivery, driving our data operations to new heights.


Your expertise will be crucial in embedding best practices and state-of-the-art data engineering tools, ensuring that our workflows are both efficient and scalable.



Responsibilities

  • Architecting and leading the development of our patent data ingestion pipeline using Databricks, Python, and PySpark.
  • Mentoring and guiding a team of data engineers, fostering a collaborative environment that encourages growth and innovation. You will enable and lead technical discussions within the team and with stakeholders
  • Ensuring the pipeline is efficient, scalable, and robust, capable of handling terabytes of data with low latency. Eliminate inefficiencies and teach the techniques to the team.
  • Contributing to the overall data engineering strategy and drive the adoption of best practices in coding, architecture, and deployment.
  • Identifying and resolving technical challenges, ensuring the smooth operation of the data ingestion pipeline.
  • Automating the boring stuff, and make space for the team to tackle the most challenging up and coming problems.



Requirements

  • Demonstrate expertise in Python, and PySpark is essential for you to lead the skill up the team.
  • Demonstrate expertise in Databricks would be highly desirable and advantageous.
  • Demonstrate ability to design and implement scalable data architectures for both batch and streaming data processing.
  • Demonstrate proficiency in using cloud platforms such as AWS, Azure, or Google Cloud for data infrastructure management
  • Knowledge of data governance practices, including data quality management, metadata management, and data lineage
  • Proven experience in leading and mentoring technical data engineering teams.




Work in a way that works for you

We promote a healthy work/life balance across the organisation. We offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals.

  • Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive



Working for you

We know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:

  • Generous holiday allowance with the option to buy additional days
  • Health screening, eye care vouchers and private medical benefits
  • Wellbeing programs
  • Life assurance
  • Access to a competitive contributory pension scheme
  • Save As You Earn share option scheme
  • Travel Season ticket loan
  • Electric Vehicle Scheme
  • Optional Dental Insurance
  • Maternity, paternity and shared parental leave
  • Employee Assistance Programme
  • Access to emergency care for both the elderly and children
  • RECARES days, giving you time to support the charities and causes that matter to you
  • Access to employee resource groups with dedicated time to volunteer
  • Access to extensive learning and development resources
  • Access to employee discounts scheme via Perks at Work



About the Business

LexisNexis Legal & Professional® provides legal, regulatory, and business information and analytics that help customers increase their productivity, improve decision-making, achieve better outcomes, and advance the rule of law around the world. As a digital pioneer, the company was the first to bring legal and business information online with its Lexis® and Nexis® services.

  • Lead Data Engineer

    2 weeks ago

    United Kingdom identifi Global Resources Full time

    Lead Data Engineer Location: Remote (IT kit collection/return in Cardiff) Contract: 6 months, Inside IR35 Rate: NHS Band 7 (via Umbrella) The Role An exciting opportunity has arisen for a Lead Data Engineer to join an NHS organization, supporting the National Data Resource (NDR) programme. This role focuses on implementing data pipelines and...

  • Lead Data Engineer

    2 weeks ago

    United Kingdom identifi Global Resources Full time

    Lead Data Engineer Location: Remote (IT kit collection/return in Cardiff) Contract: 6 months, Inside IR35 Rate: NHS Band 7 (via Umbrella) The Role An exciting opportunity has arisen for a Lead Data Engineer to join an NHS organization, supporting the National Data Resource (NDR) programme. This role focuses on implementing data pipelines and...

  • Lead Data Engineer

    2 weeks ago

    United Kingdom identifi Global Resources Full time

    Lead Data EngineerLocation: Remote (IT kit collection/return in Cardiff)Contract: 6 months, Inside IR35Rate: NHS Band 7 (via Umbrella)The RoleAn exciting opportunity has arisen for a Lead Data Engineer to join an NHS organization, supporting the National Data Resource (NDR) programme. This role focuses on implementing data pipelines and platforms within the...

  • Lead Data Engineer

    2 weeks ago

    United Kingdom identifi Global Resources Full time

    Lead Data Engineer Location: Remote (IT kit collection/return in Cardiff) Contract: 6 months, Inside IR35 Rate: NHS Band 7 (via Umbrella) The Role An exciting opportunity has arisen for a Lead Data Engineer to join an NHS organization, supporting the National Data Resource (NDR) programme. This role focuses on implementing data pipelines...

  • Lead Data Engineer

    2 weeks ago

    United Kingdom identifi Global Resources Full time

    Lead Data EngineerLocation: Remote (IT kit collection/return in Cardiff)Contract: 6 months, Inside IR35Rate: NHS Band 7 (via Umbrella)The RoleAn exciting opportunity has arisen for a Lead Data Engineer to join an NHS organization, supporting the National Data Resource (NDR) programme. This role focuses on implementing data pipelines and platforms within the...

  • Data Engineering Lead

    3 weeks ago

    United Kingdom La Fosse Full time

    Data Engineer Lead (12-15m maternity cover) – £70k-£90k + 15% bonus & strong pension - remote La Fosse are partnering with a leading professional services body at a critical and exciting point in their data journey, currently looking for an experienced Azure Data Engineering Lead as part of a 12m maternity cover. Azure stack SQL ADF Synapse ...

  • Data Engineering Lead

    4 weeks ago

    United Kingdom La Fosse Full time

    Data Engineer Lead (12-15m maternity cover) – £70k-£90k + 15% bonus & strong pension - remote La Fosse are partnering with a leading professional services body at a critical and exciting point in their data journey, currently looking for an experienced Azure Data Engineering Lead as part of a 12m maternity cover. Azure stack SQL ADF Synapse...

  • Data Engineering Lead

    2 weeks ago

    United Kingdom La Fosse Full time

    Data Engineer Lead (12-15m maternity cover) – £70k-£90k + 15% bonus & strong pension - remote La Fosse are partnering with a leading professional services body at a critical and exciting point in their data journey, currently looking for an experienced Azure Data Engineering Lead as part of a 12m maternity cover. Azure stack SQL ADF Synapse ...

  • Data Engineering Lead

    4 weeks ago

    United Kingdom La Fosse Full time

    Data Engineer Lead (12-15m maternity cover) – £70k-£90k + 15% bonus & strong pension - remoteLa Fosse are partnering with a leading professional services body at a critical and exciting point in their data journey, currently looking for an experienced Azure Data Engineering Lead as part of a 12m maternity cover.Azure stackSQLADFSynapseExperience managing...

  • Data Engineering Lead

    4 weeks ago

    United Kingdom La Fosse Full time

    Data Engineer Lead (12-15m maternity cover) – £70k-£90k + 15% bonus & strong pension - remoteLa Fosse are partnering with a leading professional services body at a critical and exciting point in their data journey, currently looking for an experienced Azure Data Engineering Lead as part of a 12m maternity cover.Azure stackSQLADFSynapseExperience managing...

  • Data Engineering Lead

    2 weeks ago

    United Kingdom La Fosse Full time

    Data Engineer Lead (12-15m maternity cover) – £70k-£90k + 15% bonus & strong pension - remote La Fosse are partnering with a leading professional services body at a critical and exciting point in their data journey, currently looking for an experienced Azure Data Engineering Lead as part of a 12m maternity cover. Azure stack SQL ADF Synapse Experience...

  • Lead Engineer/Data Engineer

    1 month ago

    United Kingdom Durlston Partners Full time

    Data Engineering Lead – Digital Assets- London A premier global hedge fund with a dedicated digital assets division focused on building secure, efficient infrastructure for institutional-grade blockchain and crypto investments is looking to hire a Data Engineering Lead to join their core trading and technology team. As a Data Engineering Lead ,...

  • Lead Engineer/Data Engineer

    1 month ago

    United Kingdom Durlston Partners Full time

    Data Engineering Lead – Digital Assets- London A premier global hedge fund with a dedicated digital assets division focused on building secure, efficient infrastructure for institutional-grade blockchain and crypto investments is looking to hire a Data Engineering Lead to join their core trading and technology team. As a Data Engineering Lead ,...

  • Lead Data Engineer

    1 month ago

    United Kingdom Durlston Partners Full time

    Data Engineering Lead – Digital Assets- London About the Company A premier global hedge fund with a dedicated digital assets division focused on building secure, efficient infrastructure for institutional-grade blockchain and crypto investments is looking to hire a Data Engineering Lead to join their core trading and technology team. About the Role ...

  • Lead Data Engineer

    1 month ago

    United Kingdom Durlston Partners Full time

    Data Engineering Lead – Digital Assets- London About the Company A premier global hedge fund with a dedicated digital assets division focused on building secure, efficient infrastructure for institutional-grade blockchain and crypto investments is looking to hire a Data Engineering Lead to join their core trading and technology team. About the Role ...

  • Lead Engineer/Data Engineer

    2 weeks ago

    United Kingdom Dalton Full time

    Senior/Lead Data Engineer , Location: Hybrid London (2-3 days/week) About Dalton : Dalton is on a mission to make the world’s drug design more efficient. We are building the AI ecosystem for drug design and solving real-world problems that transform the efficiency of the pharmaceutical industry. Our mission is to harness cutting-edge technology and...

  • Lead Engineer/Data Engineer

    2 weeks ago

    United Kingdom Dalton Full time

    Senior/Lead Data Engineer , Location: Hybrid London (2-3 days/week) About Dalton : Dalton is on a mission to make the world’s drug design more efficient. We are building the AI ecosystem for drug design and solving real-world problems that transform the efficiency of the pharmaceutical industry. Our mission is to harness cutting-edge technology and...

  • Data Science Team Lead

    3 weeks ago

    United Kingdom La Fosse Full time

    Data Engineer Lead (12-15m maternity cover) – £70k-£90k + 15% bonus & strong pension - remote La Fosse are partnering with a leading professional services body at a critical and exciting point in their data journey, currently looking for an experienced Azure Data Engineering Lead as part of a 12m maternity cover. SQL Exceptionally busy company, a...

  • Data Science Team Lead

    2 weeks ago

    United Kingdom La Fosse Full time

    Data Engineer Lead (12-15m maternity cover) – £70k-£90k + 15% bonus & strong pension - remote La Fosse are partnering with a leading professional services body at a critical and exciting point in their data journey, currently looking for an experienced Azure Data Engineering Lead as part of a 12m maternity cover. SQL Exceptionally busy company, a...

  • Data Science Team Lead

    4 weeks ago

    United Kingdom La Fosse Full time

    Data Engineer Lead (12-15m maternity cover) – £70k-£90k + 15% bonus & strong pension - remote La Fosse are partnering with a leading professional services body at a critical and exciting point in their data journey, currently looking for an experienced Azure Data Engineering Lead as part of a 12m maternity cover. SQL Exceptionally busy company, a...