Current jobs related to Data Engineer - England - Haystack

  • Data Engineer

    3 weeks ago

    England, United Kingdom Damia Group Full time

    Data Engineer - INSIDE IR35 - 6-12 months+ We are looking for an SC Cleared Data Engineer to work on a major Oracle to PostgreSQL project working within an AWS cloud environment. All applicants must have been involved in an Oracle -> PostgreSQL migration before AND hold an active SC clearance. Skills needed PostgreSQL PL/pgSQL Oracle PL/SQL Code...

  • Data Engineer

    4 weeks ago

    England, United Kingdom Damia Group Full time

    Data Engineer - INSIDE IR35 - 6-12 months+ We are looking for an SC Cleared Data Engineer to work on a major Oracle to PostgreSQL project working within an AWS cloud environment. All applicants must have been involved in an Oracle -> PostgreSQL migration before AND hold an active SC clearance. Skills needed PostgreSQL PL/pgSQL Oracle PL/SQL Code...

  • Data Engineer

    4 weeks ago

    England, United Kingdom Damia Group Full time

    Data Engineer - INSIDE IR35 - 6-12 months+We are looking for an SC Cleared Data Engineer to work on a major Oracle to PostgreSQL project working within an AWS cloud environment.All applicants must have been involved in an Oracle -> PostgreSQL migration before AND hold an active SC clearance.Skills neededPostgreSQL PL/pgSQLOracle PL/SQLCode conversion of...

  • Data Engineer

    4 weeks ago

    England, United Kingdom Damia Group Full time

    Data Engineer - INSIDE IR35 - 6-12 months+We are looking for an SC Cleared Data Engineer to work on a major Oracle to PostgreSQL project working within an AWS cloud environment.All applicants must have been involved in an Oracle -> PostgreSQL migration before AND hold an active SC clearance.Skills neededPostgreSQL PL/pgSQLOracle PL/SQLCode conversion of...

  • Data Engineer

    4 weeks ago

    England,, UK, United Kingdom Damia Group Full time

    Data Engineer - INSIDE IR35 - 6-12 months+We are looking for an SC Cleared Data Engineer to work on a major Oracle to PostgreSQL project working within an AWS cloud environment.All applicants must have been involved in an Oracle -> PostgreSQL migration before AND hold an active SC clearance.Skills neededPostgreSQL PL/pgSQLOracle PL/SQLCode conversion of...

  • Data Engineer

    3 weeks ago

    England, United Kingdom Damia Group Full time

    Data Engineer - INSIDE IR35 - 6-12 months+ We are looking for an SC Cleared Data Engineer to work on a major Oracle to PostgreSQL project working within an AWS cloud environment. All applicants must have been involved in an Oracle -> PostgreSQL migration before AND hold an active SC clearance. Skills needed PostgreSQL PL/pgSQL Oracle PL/SQL Code...

  • Data Engineer

    5 days ago

    England, United Kingdom Undisclosed Company Full time

    Job Overview:We are looking for an experienced Senior Azure Data Engineer to join our growing data team. This is a fully remote position, offering the opportunity to work with cutting-edge technologies in the cloud computing space, specifically with a strong focus on Microsoft Azure services. The ideal candidate will have deep expertise in building and...

  • Data Engineer

    2 weeks ago

    England, United Kingdom Damia Group Full time

    Data Engineer - INSIDE IR35 - 6-12 months+For a complete understanding of this opportunity, and what will be required to be a successful applicant, read on.We are looking for an SC Cleared Data Engineer to work on a major Oracle to PostgreSQL project working within an AWS cloud environment.All applicants must have been involved in an Oracle -> PostgreSQL...

  • Senior Engineer, Data Engineering

    2 weeks ago

    England, United Kingdom iO Associates - UKEU Full time

    Senior Data Engineer - Full Remote - Outside IR35 - 6 Months + We are seeking a Senior Data Engineer to assist our client with an exciting project. This fully remote role is UK-based, allowing you to work from anywhere within the UK. You will be responsible for implementing a new data platform (Dataiku), a leading data science and machine learning platform....

  • Senior Engineer, Data Engineering

    2 weeks ago

    England, United Kingdom iO Associates - UKEU Full time

    Senior Data Engineer - Full Remote - Outside IR35 - 6 Months + We are seeking a Senior Data Engineer to assist our client with an exciting project. This fully remote role is UK-based, allowing you to work from anywhere within the UK. You will be responsible for implementing a new data platform (Dataiku), a leading data science and machine learning platform....

  • Data Engineer

    4 weeks ago

    England, United Kingdom Annapurna Full time

    Senior Data Engineer Location: Remote (United Kingdom) About The Company: We have partnered with a company that empowers underwriters to serve their insureds more effectively. They are using advanced data intelligence tools to rebuild the way that underwriters share and exchange risk. With a current focus on the small and medium-sized businesses that...

  • Senior Engineer, Data Engineering

    4 weeks ago

    England, United Kingdom KennedyPearce Consulting Full time €60,000 - €85,000

    Data Engineer Remote (once a month London) Data and AI Consultancy £We are partnered with a fast growing Data and AI specialist consultancy firm that are looking to expand their data engineering team. As a Data Engineer you will have extensive experience working with AWS cloud services, Terraform, SQL, and Python for automation and data processing. This...

  • Senior Engineer, Data Engineering

    4 weeks ago

    England, United Kingdom KennedyPearce Consulting Full time €60,000 - €85,000

    Data Engineer Remote (once a month London) Data and AI Consultancy £We are partnered with a fast growing Data and AI specialist consultancy firm that are looking to expand their data engineering team. As a Data Engineer you will have extensive experience working with AWS cloud services, Terraform, SQL, and Python for automation and data processing. This...

  • Data Engineer

    4 weeks ago

    England, United Kingdom Finatal Full time

    Job Title: Interim Data Engineer - Private Equity Regulatory Business Contract Duration: 3 Months (with potential for extension) Finatal is seeking an experienced Interim Data Engineer to join a leading private equity regulatory business. The successful candidate will play a critical role in designing, architecting, and building a data warehouse that...

  • Senior Data Engineer

    2 weeks ago

    England,, UK, United Kingdom iO Associates - UKEU Full time

    Senior Data Engineer - Full Remote - Outside IR35 - 6 Months +We are seeking a Senior Data Engineer to assist our client with an exciting project. This fully remote role is UK-based, allowing you to work from anywhere within the UK. You will be responsible for implementing a new data platform (Dataiku), a leading data science and machine learning...

  • Senior Data Engineer

    2 weeks ago

    England, United Kingdom iO Associates - UKEU Full time

    Senior Data Engineer - Full Remote - Outside IR35 - 6 Months +We are seeking a Senior Data Engineer to assist our client with an exciting project. This fully remote role is UK-based, allowing you to work from anywhere within the UK. You will be responsible for implementing a new data platform (Dataiku), a leading data science and machine learning...

  • Senior Data Engineer

    2 weeks ago

    England, United Kingdom iO Associates - UKEU Full time

    Senior Data Engineer - Full Remote - Outside IR35 - 6 Months + We are seeking a Senior Data Engineer to assist our client with an exciting project. This fully remote role is UK-based, allowing you to work from anywhere within the UK. You will be responsible for implementing a new data platform (Dataiku), a leading data science and machine learning platform....

  • Senior Data Engineer

    2 weeks ago

    England, United Kingdom iO Associates - UKEU Full time

    Senior Data Engineer - Full Remote - Outside IR35 - 6 Months +We are seeking a Senior Data Engineer to assist our client with an exciting project. This fully remote role is UK-based, allowing you to work from anywhere within the UK. You will be responsible for implementing a new data platform (Dataiku), a leading data science and machine learning...

  • Senior Data Engineer

    2 weeks ago

    England, United Kingdom iO Associates - UKEU Full time

    Senior Data Engineer - Full Remote - Outside IR35 - 6 Months + We are seeking a Senior Data Engineer to assist our client with an exciting project. This fully remote role is UK-based, allowing you to work from anywhere within the UK. You will be responsible for implementing a new data platform (Dataiku), a leading data science and machine learning platform....

  • Senior Data Engineer

    2 weeks ago

    England, United Kingdom iO Associates - UKEU Full time

    Senior Data Engineer - Full Remote - Outside IR35 - 6 Months + We are seeking a Senior Data Engineer to assist our client with an exciting project. This fully remote role is UK-based, allowing you to work from anywhere within the UK. You will be responsible for implementing a new data platform (Dataiku), a leading data science and machine learning platform....

Data Engineer

4 months ago

England, United Kingdom Haystack Full time

About the role


Contract duration: 3 - 6 months (potential to become rolling)

Rate: £600/day inside IR35


Our client is currently working on several end-client programmes, for several Government technical Consultancies to support various public body Government Data Engineering departments as part of their respective cloud migration strategies.


The Data Platform Engineer will be assigned to one (perhaps more depending on project timelines) of our client's data engineering projects based on data engineering and technical skills.


The successful candidate will fulfil the following responsibilities:


  • Requirements analysis and design of solutions for the data platform;
  • Integration and analysis of solutions;
  • Understanding of toolsets including AWS hosted databases (Postgres, S3 based data lake, AWS glue MySQL, Athena);
  • Integration services (AWS API gateway, lambda functions), nice to have MuleSoft or Axway;
  • ETL services (AWS Glue, Step functions);
  • Infrastructure a management tool such as Terraform and extensive use of SQLs, Python, and Node JS.


The data engineering services within our client's team fulfil hands-on data development to construct complete solution designs and complex application requirements across platforms and data sources including:


Data Architecture and Design:

  • Design and implement scalable and efficient data pipelines, databases, and data warehouses;
  • Collaborate with data visualisation and analysts’ teams to understand data requirements and translate them into technical specifications.


Data Processing:

  • Develop and maintain ETL (Extract, Transform, Load) processes for ingesting data from various sources into the data infrastructure;
  • Optimise data processing and storage for performance and cost-effectiveness.


Database Management:

  • Manage and maintain databases, ensuring data integrity, security, and availability;
  • Implement database schema changes and optimisations as needed.


Data Quality and Governance:

  • Implement data quality checks and ensure data accuracy and consistency;
  • Work with stakeholders to define and enforce data governance policies.


Infrastructure Management:

  • Set up and manage data infrastructure, including Kubernetes clusters, servers, and cloud-based resources using Terraform;
  • Monitor and optimise system performance, troubleshoot issues, and ensure system availability.


Collaboration:

  • Collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to meet data requirements;
  • Communicate effectively with stakeholders to gather requirements and provide updates on data engineering projects.


If the above role sounds like it may be of interest to you or someone you know, please feel free to submit an application to the job or reach out to this job's owner.