Data Engineer

4 weeks ago


England, UK, United Kingdom Haystack Full time

About the role


Contract duration: 3 - 6 months (potential to become rolling)

Rate: £600/day inside IR35


Our client is currently working on several end-client programmes, for several Government technical Consultancies to support various public body Government Data Engineering departments as part of their respective cloud migration strategies.


The Data Platform Engineer will be assigned to one (perhaps more depending on project timelines) of our client's data engineering projects based on data engineering and technical skills.


The successful candidate will fulfil the following responsibilities:


  • Requirements analysis and design of solutions for the data platform;
  • Integration and analysis of solutions;
  • Understanding of toolsets including AWS hosted databases (Postgres, S3 based data lake, AWS glue MySQL, Athena);
  • Integration services (AWS API gateway, lambda functions), nice to have MuleSoft or Axway;
  • ETL services (AWS Glue, Step functions);
  • Infrastructure a management tool such as Terraform and extensive use of SQLs, Python, and Node JS.


The data engineering services within our client's team fulfil hands-on data development to construct complete solution designs and complex application requirements across platforms and data sources including:


Data Architecture and Design:

  • Design and implement scalable and efficient data pipelines, databases, and data warehouses;
  • Collaborate with data visualisation and analysts’ teams to understand data requirements and translate them into technical specifications.


Data Processing:

  • Develop and maintain ETL (Extract, Transform, Load) processes for ingesting data from various sources into the data infrastructure;
  • Optimise data processing and storage for performance and cost-effectiveness.


Database Management:

  • Manage and maintain databases, ensuring data integrity, security, and availability;
  • Implement database schema changes and optimisations as needed.


Data Quality and Governance:

  • Implement data quality checks and ensure data accuracy and consistency;
  • Work with stakeholders to define and enforce data governance policies.


Infrastructure Management:

  • Set up and manage data infrastructure, including Kubernetes clusters, servers, and cloud-based resources using Terraform;
  • Monitor and optimise system performance, troubleshoot issues, and ensure system availability.


Collaboration:

  • Collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to meet data requirements;
  • Communicate effectively with stakeholders to gather requirements and provide updates on data engineering projects.


If the above role sounds like it may be of interest to you or someone you know, please feel free to submit an application to the job or reach out to this job's owner.


  • Data Engineer

    24 hours ago


    England,, UK, United Kingdom Adecco Full time

    Job Title: Data EngineerLocation: RemoteDuration: 6 monthsSalary: £104,000 per year Join our client's dynamic and innovative team as a Data Engineer! Are you ready to take the next step in your career as a Data Engineer? Do you have a passion for analytics and a knack for solving complex data challenges? If so, we have an exciting opportunity for you to...

  • Data Engineer

    4 weeks ago


    England,, UK, United Kingdom Templeton & Partners - Innovative & Inclusive Hiring Solutions Full time

    Templeton and Partners are currently on the look for an Data Engineer to join one of our clients within the Emerging Tech space on a 12month contract (PAYE), fully remote. You will be responsible for processing and managing our high-quality multimedia datasets for use by our researchers and engineers. The ideal candidate will have a strong background in data...

  • Data Engineer

    4 weeks ago


    England,, UK, United Kingdom Revoco Full time

    I have placed quite a few candidates with this organisation now, all have said glowing reviews about it, they're the leader in legal representation comparison and have rather interesting, unique data to work with. They are using modern Azure tools and have some very exciting initiatives!They are looking for an a mid -weight Data Engineer to join a well...

  • Data Engineer

    2 weeks ago


    England,, UK, United Kingdom Revoco Full time

    I have placed quite a few candidates with this organisation now, all have said glowing reviews about it, they're the leader in legal representation comparison and have rather interesting, unique data to work with. They are using modern Azure tools and have some very exciting initiatives!They are looking for an a mid -weight Data Engineer to join a well...


  • England,, UK, United Kingdom Tech Kinect Full time

    Job Title: Data Engineering Consultant (Azure Databricks)Job Description:We are seeking a talented Data Engineering Consultant to join our collaborative and inclusive team. In this role, you will be responsible for designing, implementing, and maintaining scalable and high-performing data solutions using the latest cloud technologies for our clients.Key...

  • Azure Data Engineer

    4 weeks ago


    England,, UK, United Kingdom Venturi Full time

    Hi Linkedin, Please can I ask, that if you do not have a minimum of 4 years of commercial experience, working with Azure exclusively, you do not apply for this position, as your application will not be considered.The salary can be flexible (to an extent)The key skills I am seeking are an essential requirement for the, and are as follows:Commercial Financial...

  • Azure Data Engineer

    2 weeks ago


    England,, UK, United Kingdom Venturi Full time

    Hi Linkedin, Please can I ask, that if you do not have a minimum of 4 years of commercial experience, working with Azure exclusively, you do not apply for this position, as your application will not be considered.The salary can be flexible (to an extent)The key skills I am seeking are an essential requirement for the, and are as follows:Commercial Financial...

  • Data Engineer

    4 weeks ago


    England,, UK, United Kingdom Service Care Solutions Full time

    Data Engineer - £95,000 - DV Clearance RequiredWe are currently looking for a passionate and experienced Data Engineer to come and join one of our biggest clients - A consultancy that specialises in FS, Public Sector, Media, Software and Data Warehousing. They are looking for someone to come in and be part of an ever-growing team.There are a number of...

  • Data Engineer

    2 weeks ago


    England,, UK, United Kingdom Service Care Solutions Full time

    Data Engineer - £95,000 - DV Clearance RequiredWe are currently looking for a passionate and experienced Data Engineer to come and join one of our biggest clients - A consultancy that specialises in FS, Public Sector, Media, Software and Data Warehousing. They are looking for someone to come in and be part of an ever-growing team.There are a number of...


  • England,, UK, United Kingdom Burns Sheehan Full time

    Senior Cloud Data EngineerLocation: Hybrid working with sites across the UK Eligibility: You must either possess or be eligible to apply for Security Clearance (SC)Salary range: £80,000 to £105,000 Technology: AWS/Azure, Python, CI/CD Burns Sheehan is working with an AI consultancy operating at the intersection of bleeding edge technology & defence as it...

  • Data Scientist

    4 weeks ago


    England,, UK, United Kingdom Ascent Full time

    This is a perfect opportunity for ambitious individuals to join a team of curious minds and support peers with a passion and the skills for creating value for businesses using data. About us Ascent is a design-led software, data and cloud business that specialises in advanced analytics and AI. We are an engineering business. We design, build and manage...

  • Data Analyst

    4 weeks ago


    England,, UK, United Kingdom OBSS Full time

    Would you like to perform rewarding work while contributing to the success on an established, growing company?We are looking for Data Analyst having the following qualifications to be employed in our company for the global projects.QUALIFICATIONSComputer engineering degree,Minimum 2 years experience with Business Intelligence, Data Modeling and Data...

  • Data Analyst

    2 weeks ago


    England,, UK, United Kingdom OBSS Full time

    Would you like to perform rewarding work while contributing to the success on an established, growing company?We are looking for Data Analyst having the following qualifications to be employed in our company for the global projects.QUALIFICATIONSComputer engineering degree,Minimum 2 years experience with Business Intelligence, Data Modeling and Data...

  • Data Architect

    4 weeks ago


    England,, UK, United Kingdom RX Global Full time

    About our TeamOur global platform (GBS) delivers on our "one company" vision by standardising business processes across the organisation. Using industry leading technologies and digital tooling, GBS provides a fully integrated toolset and enables the rapid deployment of innovation and standard methodologies across the global businessAbout the RoleWe are...

  • Senior Data Analyst

    3 days ago


    England,, UK, United Kingdom Synergize Consulting Full time

    A global Defence client with HQ’s around the U.K are looking to bring onboard either a Security cleared or willing to be security cleared Senior Data Analyst to join the team based either in Manchester, Bristol, Brough, Portsmouth, Barrow-in-Furness, Frimley or Weymouth.Although the base location for this opportunity will be mentioned above, the majority...

  • Finance Data Analyst

    4 weeks ago


    England,, UK, United Kingdom Cera Full time

    Position: Finance Data AnalystReporting to: Finance Data LeadContract type: Full Time, Permanent, Remote This is an exciting opportunity to join one of Europe's fastest-growing health tech scaleups!About Cera At Cera Care, our mission is to empower people to live longer, healthier, and better lives in their own homes. We don’t just care more, we care...

  • Head of Data Platform

    3 weeks ago


    England,, UK, United Kingdom Eames Consulting Full time

    Head of Data Platform/ Delivery (Contract)Snowflake, Kafka, AWS. 6 month contract, Rate up to £900 per day (Outside IR35)Hybrid work into Central LondonI am working with a leading insurance business as they undergo a group wide digital and data transformation programme. The business has been a leader in their space for several years and are now looking to...

  • Head of Data Platform

    2 weeks ago


    England,, UK, United Kingdom Eames Consulting Full time

    Head of Data Platform/ Delivery (Contract)Snowflake, Kafka, AWS. 6 month contract, Rate up to £900 per day (Outside IR35)Hybrid work into Central LondonI am working with a leading insurance business as they undergo a group wide digital and data transformation programme. The business has been a leader in their space for several years and are now looking to...


  • England,, UK, United Kingdom NTT DATA Business Solutions Full time

    Global Public Cloud Trainee Program | SAP Public Cloud Consulting Empowering you – to explore New Horizons! Are you analytical, tech-savvy, and interested in creating innovative solutions leveraging technology to meet changing business challenges? Then join our team as an SAP Public Cloud Consulting Trainee! NTT DATA Business Solutions’ Global Public...

  • Data & Reporting Lead

    3 weeks ago


    England,, UK, United Kingdom RX Global Full time

    About our TeamOur global platform (GBS) delivers on our "one company" vision by standardising business processes across the organisation. Using industry leading technologies and digital tooling, GBS provides a fully integrated toolset and enables the rapid deployment of innovation and standard methodologies across the global businessAbout the RoleWe are...