Data Engineer

3 weeks ago

London, Greater London, United Kingdom LA International Computer Consultants Ltd Full time
Our Global financial and commodities markets client based in London is looking for an experience DataOps Engineer. This is initially a 3-6 months contract with a possibility of extension.

This role is inside IR35.As a DataOps Engineer, you'll play a crucial role in ensuring the availability, quality, and reliability of data throughout its lifecycle.

You'll collaborate with development teams, and operational teams to design, develop, and maintain data pipelines. Your work will streamline data management processes, enhance automation, and ensure compliance with regulations.
Role Responsibilities
  • Create and manage toolkits/frameworks for regulatory data analysis, development, testing and implementation.
  • Analyse regulatory data requirements and understand regulatory problem statements.
  • Mapping data to regulatory frameworks and policies.
  • Design, develop, maintain, and optimise controls to monitor, report, and remediate regulatory data integrity (timeliness, completeness, accuracy) risks and issues - particularly reconciling, reporting and remediating data incompleteness.
  • Design, develop, maintain and optimise regulatory data delivery pipelines.
  • Automating regulatory data management processes such as extraction, transformation and load.
  • Contributing to the Enterprise Data Strategy and embedding it into the Regulatory Data deliverables.
  • Supporting the Enterprise Data Strategy DevOps team where required.
  • Ensure data security requirements are fully met.
  • Effective collaboration with upstream, horizontal, and downstream teams.
  • Senior stakeholder management.

Experience / CompetencesEssential
  • Proficiency in writing database queries using SQL and general understanding of relational databases, and in data pipeline design and development.
  • Experience with ETL processes, familiarity with the AWS ecosystem e.g. S3, Glue, DMS, CLI, etc., and experience with tools such as Qliksense, PowerBI, or equivalent.
  • Ability to setup database connections and manage related issues.
  • Familiarity with data analysis on trading platforms to understand order and trade lifecycle events.
  • Be able to work through, with completeness and accuracy, a technical checklist of data validation and feed the results back to the Data Lead
  • Be able to understand the reconciliation approach of order and order event count matching and use analysis techniques to identify differences and their cause.
  • Self-starter, strong problem solver and great attention to detail.
  • Excellent written and verbal communication.
  • Adaptable, resilient, and a forward thinker.
  • Knowledge of data security best practices.

Desired
  • DataOps / data pipeline output testing experience
  • Familiarity with GDPR, MAR, MiFID, and WORM regulations.
  • Willingness to learn new technologies.
  • Migration of datasets (schema evolution)

  • Data Engineering Delivery Lead

    2 weeks ago

    London, Greater London, United Kingdom NTT DATA Full time

    Lead Data Engineering Projects at a Global IT LeaderNTT DATA, a world-renowned IT service provider, is seeking a skilled and experienced Data Engineering Delivery Manager to join our dynamic team. As the 6th largest IT Service Provider globally, we are dedicated to driving business change and technology transformation across diverse industries.Your Role:In...

  • Data Engineering Delivery Lead

    14 hours ago

    London, Greater London, United Kingdom NTT DATA Full time

    Lead Data Engineering Projects at a Global IT LeaderNTT DATA, a world-renowned IT service provider, is seeking a skilled and experienced Data Engineering Delivery Manager to join our dynamic team. As the 6th largest IT Service Provider globally, we are dedicated to driving business change and technology transformation across diverse industries.Your Role:In...

  • Senior Data Engineering Project Manager

    2 days ago

    London, Greater London, United Kingdom NTT DATA Full time

    About the RoleWe are seeking an experienced Senior Data Engineering Project Manager to join our team at NTT DATA. As a key member of our Data Engineering service line, you will be responsible for overseeing Data Engineering projects and programmes across our Data transformation portfolio.Key ResponsibilitiesLead highly-skilled technical teams in a...

  • Technical Delivery Lead

    2 days ago

    London, Greater London, United Kingdom NTT DATA Full time

    About the RoleWe are seeking an experienced Senior Data Engineering Project Manager to join our team at NTT DATA. As a key member of our Data Engineering service line, you will be responsible for overseeing Data Engineering projects and programmes across our Data transformation portfolio.Key ResponsibilitiesLead highly-skilled technical teams in a...

  • Technical Delivery Lead

    16 hours ago

    London, Greater London, United Kingdom NTT DATA Full time

    About the RoleWe are seeking an experienced Senior Data Engineering Project Manager to join our team at NTT DATA. As a key member of our Data Engineering service line, you will be responsible for overseeing Data Engineering projects and programmes across our Data transformation portfolio.Key ResponsibilitiesLead highly-skilled technical teams in a...

  • Senior Data Engineering Project Manager

    14 hours ago

    London, Greater London, United Kingdom NTT DATA Full time

    About the RoleWe are seeking an experienced Senior Data Engineering Project Manager to join our team at NTT DATA. As a key member of our Data Engineering service line, you will be responsible for overseeing Data Engineering projects and programmes across our Data transformation portfolio.Key ResponsibilitiesLead highly-skilled technical teams in a...

  • Data Engineering Leader

    3 days ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Job Title: Director of Data EngineerCompany: Harnham - Data & Analytics RecruitmentJob Type: Full-timeLocation: RemoteJob Description:Overview:We are seeking an experienced Director of Data Engineer to lead our data engineering team and drive the development of our data platform. As a key member of our leadership team, you will be responsible for building...

  • Data Engineering Leader

    16 hours ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Job Title: Director of Data EngineerCompany: Harnham - Data & Analytics RecruitmentJob Type: Full-timeLocation: RemoteJob Description:Overview:We are seeking an experienced Director of Data Engineer to lead our data engineering team and drive the development of our data platform. As a key member of our leadership team, you will be responsible for building...

  • Lead Data Engineering Specialist

    3 days ago

    London, Greater London, United Kingdom ON Data Staffing Full time

    About the RoleWe are seeking a highly skilled Senior Data Solutions Architect to join our team at ON Data Staffing. As a key member of our data engineering team, you will play a pivotal role in delivering innovative big data solutions to our clients.Key ResponsibilitiesClient EngagementCollaborate directly with our clients to understand their business...

  • Lead Data Engineering Specialist

    14 hours ago

    London, Greater London, United Kingdom ON Data Staffing Full time

    About the RoleWe are seeking a highly skilled Senior Data Solutions Architect to join our team at ON Data Staffing. As a key member of our data engineering team, you will play a pivotal role in delivering innovative big data solutions to our clients.Key ResponsibilitiesClient EngagementCollaborate directly with our clients to understand their business...

  • Data Engineering Leader

    15 hours ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time £120,000

    About the RoleWe are partnering with a leading InsurTech company to find a seasoned Data Engineering Leader to join their team. This is an exciting opportunity to grow the data platform and build a high-performing team.Key ResponsibilitiesDevelop and implement a strategy to grow the data team and introduce new technologies to ensure the platform is built...

  • Data Engineering Leader

    1 day ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time £120,000

    About the RoleWe are partnering with a leading InsurTech company to find a seasoned Data Engineering Leader to join their team. This is an exciting opportunity to grow the data platform and build a high-performing team.Key ResponsibilitiesDevelop and implement a strategy to grow the data team and introduce new technologies to ensure the platform is built...

  • Data Engineering Leader

    20 hours ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Job SummaryHarnham - Data & Analytics Recruitment is partnering with a leading InsurTech company to find a highly skilled Head of Data Engineering to lead their data platform team.About the CompanyThe company is a fully digital InsurTech that aims to make insurance more accessible, affordable, and tailored to individual needs. With a strong focus on...

  • Data Engineering Leader

    3 days ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Job SummaryHarnham - Data & Analytics Recruitment is partnering with a leading InsurTech company to find a highly skilled Head of Data Engineering to lead their data platform team.About the CompanyThe company is a fully digital InsurTech that aims to make insurance more accessible, affordable, and tailored to individual needs. With a strong focus on...

  • Data Engineering Leader

    2 days ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Job Summary:This UK-based Insurance start-up is seeking a seasoned Data Engineering professional to lead their Data function. As the Head of Data Engineering, you will be responsible for managing the team and developing the Data strategy to drive business growth.About the Company:Harnham - Data & Analytics Recruitment is proud to partner with this innovative...

  • Quantitative Data Engineer

    1 day ago

    London, Greater London, United Kingdom White Swan Data Full time

    About This RoleThe successful candidate will join a team which develops innovative betting solutions. These solutions entail the development of sophisticated mathematical and statistical models, high-performance algorithms, efficient coding, automation of betting operations, data generation, acquisition, storage, and manipulation, as well as performance...

  • Quantitative Data Engineer

    18 hours ago

    London, Greater London, United Kingdom White Swan Data Full time

    About This RoleThe successful candidate will join a team which develops innovative betting solutions. These solutions entail the development of sophisticated mathematical and statistical models, high-performance algorithms, efficient coding, automation of betting operations, data generation, acquisition, storage, and manipulation, as well as performance...

  • Data Engineering Leader

    16 hours ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time £110,000 - £120,000

    Job DescriptionHead of Data EngineeringThis UK-based Insurance start-up is seeking a seasoned professional to lead their Data function. As the Head of Data Engineering, you will be responsible for managing the team and developing the Data strategy.The company specializes in the commercial insurance space, focusing on large insurance deals. They have recently...

  • Data Engineering Leader

    1 day ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time £110,000 - £120,000

    Job DescriptionHead of Data EngineeringThis UK-based Insurance start-up is seeking a seasoned professional to lead their Data function. As the Head of Data Engineering, you will be responsible for managing the team and developing the Data strategy.The company specializes in the commercial insurance space, focusing on large insurance deals. They have recently...

  • Head of Data Science and Engineering

    3 days ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Job Title: Director Of Data EngineerAbout the Role:We are partnering with a fully digital InsurTech company that aims to make insurance more available, cheaper, and fit-for-purpose. They are looking for a Head of Data Engineering to grow the current team and build the data platform.About the Company:The company was founded in the last decade and helps...