Data Engineer

2 days ago

Scotland, United Kingdom Talent Full time €450

• 6 month contract within the public sector

• Hybrid working – Occasional travel to Scotland

• £450 per day outside IR35

Data Engineer

Our public sector client is looking for a Data Engineer to join them in the process of creating a new Data Warehouse to enhance the data analytics capability and ensure robust data governance and data management.

You will be involved in the collaborative development of internal casework-profiling solutions using data extraction & processing techniques applied to semi-structured and unstructured documents and forms. You will also be expected to deliver robust and resilient data integration solutions and automation of data products and services to ensure that the Data Warehouse is fit-for-purpose.

Skills and Experience

Significant commercial experience with the following technology:

  • Python
  • PostgreSQL
  • REST APIs
  • Modern DevOps and CI/CD practices and tooling including Docker, GitLab CI, AWS CodePipeline, AWS CDK and AWS CloudFormation
  • Expertise in SQL, data transformation and analysis
  • Delivering high quality software collaboratively in high-performing, cross-functional development teams.
  • Experience implementing data ETLs, data streaming systems and data integration solutions
  • Experience working in the Agile delivery models - such as Scrum and/or Kanban frameworks.
  • Developing within Digital First or GDS quality standards
  • Data warehousing
  • Hybrid on-premises/cloud solutions
  • AWS Glue, Step Functions, Lambda functions, S3, RDS, Data Migration Service

Day to Day

Develop solutions to streamline the production of customer data products and reports

Assist in activities to migrate data processes from on-prem to AWS cloud

Contribute to the development and delivery of resilient solutions to integrate corporate data into the RoS data warehouse

Support the delivery of ongoing data engineering activities

Ensure technical resiliency of all data integration solutions and services

Support the delivery of ongoing data engineering activities

Enhance and support existing data product outputs for both internal and external customers.

Next Steps

If you are interested in finding out more about this role, please apply with your up to date CV and I will endeavour to get back to you.

  • Data Engineer

    24 hours ago

    Scotland, United Kingdom Talent Full time

    • 6 month contract within the public sector • Hybrid working – Occasional travel to Scotland • £450 per day outside IR35 Data Engineer Our public sector client is looking for a Data Engineer to join them in the process of creating a new Data Warehouse to enhance the data analytics capability and ensure robust data governance and data...

  • Data Engineer

    2 days ago

    Scotland, United Kingdom Talent Full time

    • 6 month contract within the public sector • Hybrid working – Occasional travel to Scotland • £450 per day outside IR35 Data Engineer Our public sector client is looking for a Data Engineer to join them in the process of creating a new Data Warehouse to enhance the data analytics capability and ensure robust data governance and data management. You...

  • Data Engineer

    1 day ago

    Scotland, United Kingdom Talent Full time

    • 6 month contract within the public sector • Hybrid working – Occasional travel to Scotland • £450 per day outside IR35 Data Engineer Our public sector client is looking for a Data Engineer to join them in the process of creating a new Data Warehouse to enhance the data analytics capability and ensure robust data governance and data management. You...

  • Data Engineer

    10 hours ago

    Scotland, United Kingdom Talent Full time

    • 6 month contract within the public sector • Hybrid working – Occasional travel to Scotland • £450 per day outside IR35 Data Engineer Our public sector client is looking for a Data Engineer to join them in the process of creating a new Data Warehouse to enhance the data analytics capability and ensure robust data governance and data...

  • Senior Engineer, Data Engineering

    2 days ago

    Scotland, United Kingdom Talent Full time €450

    6 month contract within the public sector • Hybrid working – Occasional travel to Scotland • £Data Engineer Our public sector client is looking for a Data Engineer to join them in the process of creating a new Data Warehouse to enhance the data analytics capability and ensure robust data governance and data management. You will be involved in...

  • Senior Engineer, Data Engineering

    1 day ago

    Scotland, United Kingdom Talent Full time €450

    6 month contract within the public sector • Hybrid working – Occasional travel to Scotland • £Data Engineer Our public sector client is looking for a Data Engineer to join them in the process of creating a new Data Warehouse to enhance the data analytics capability and ensure robust data governance and data management. You will be involved in...

  • Data Engineer

    23 hours ago

    Scotland, United Kingdom Venesky Brown Full time

    Venesky-Brown’s client, a public sector organisation in Edinburgh, is currently looking to recruit a Data Engineer for an initial 6 month contract with potential to extend on a rate of £484/day (Outside IR35). This role will be a hybrid of working at home and in the office. Responsibilities: - Ensure technical resiliency of all data integration...

  • Data Engineer

    2 days ago

    Scotland, United Kingdom Venesky Brown Full time

    Venesky-Brown’s client, a public sector organisation in Edinburgh, is currently looking to recruit a Data Engineer for an initial 6 month contract with potential to extend on a rate of £484/day (Outside IR35). This role will be a hybrid of working at home and in the office. Responsibilities: - Ensure technical resiliency of all data integration...

  • Data Engineer

    1 day ago

    Scotland, United Kingdom Venesky Brown Full time

    Venesky-Brown’s client, a public sector organisation in Edinburgh, is currently looking to recruit a Data Engineer for an initial 6 month contract with potential to extend on a rate of £484/day (Outside IR35). This role will be a hybrid of working at home and in the office. Responsibilities: - Ensure technical resiliency of all data integration...

  • Data Engineer

    2 days ago

    Scotland, United Kingdom Venesky Brown Full time

    Venesky-Brown’s client, a public sector organisation in Edinburgh, is currently looking to recruit a Data Engineer for an initial 6 month contract with potential to extend on a rate of £484/day (Outside IR35). This role will be a hybrid of working at home and in the office.Responsibilities:- Ensure technical resiliency of all data integration solutions...

  • Data Engineer

    1 day ago

    Scotland, United Kingdom Venesky Brown Full time

    Venesky-Brown’s client, a public sector organisation in Edinburgh, is currently looking to recruit a Data Engineer for an initial 6 month contract with potential to extend on a rate of £484/day (Outside IR35). This role will be a hybrid of working at home and in the office.Responsibilities:- Ensure technical resiliency of all data integration solutions...

  • Data Engineer

    10 hours ago

    Scotland, United Kingdom Venesky Brown Full time

    Venesky-Brown’s client, a public sector organisation in Edinburgh, is currently looking to recruit a Data Engineer for an initial 6 month contract with potential to extend on a rate of £484/day (Outside IR35). This role will be a hybrid of working at home and in the office. Responsibilities: - Ensure technical resiliency of all data integration solutions...

  • Senior Engineer, Data Engineering

    2 days ago

    Scotland, United Kingdom Venesky Brown Full time

    Venesky-Brown’s client, a public sector organisation in Edinburgh, is currently looking to recruit a Data Engineer for an initial 6 month contract with potential to extend on a rate of £484/day (Outside IR35). This role will be a hybrid of working at home and in the office.   Ensure technical resiliency of all data integration solutions and services...

  • Senior Engineer, Data Engineering

    1 day ago

    Scotland, United Kingdom Venesky Brown Full time

    Venesky-Brown’s client, a public sector organisation in Edinburgh, is currently looking to recruit a Data Engineer for an initial 6 month contract with potential to extend on a rate of £484/day (Outside IR35). This role will be a hybrid of working at home and in the office.   Ensure technical resiliency of all data integration solutions and services...

  • Senior Engineer, Data Engineering

    23 hours ago

    Scotland, United Kingdom Venesky Brown Full time

    Venesky-Brown’s client, a public sector organisation in Edinburgh, is currently looking to recruit a Data Engineer for an initial 6 month contract with potential to extend on a rate of £484/day (Outside IR35). This role will be a hybrid of working at home and in the office.   Ensure technical resiliency of all data integration solutions and services -...

  • Data Engineering Training

    2 days ago

    Edinburgh, Scotland, Scotland, United Kingdom CONNECTMETA.AI Full time

    About the Company: Oeson is a leading IT corporation globally recognized for its expertise in providing top-notch IT and Ed-tech services. Specializing in digital marketing, data science, data analytics, business analytics, cyber security, UI-UX design, web development, and app development, we are dedicated to innovation, excellence, and empowering talents...

  • Data Architect

    2 weeks ago

    Edinburgh, Scotland, Scotland, United Kingdom iXceed Solutions Full time

    About Us:Founded on the grounds of innovation – iXceed Solutions is an ISO certified, leader in Talent and Digital recruitment solutions, serving Fortune 100 companies globally.About the RoleWe are looking for an experienced Technical Data Engineer with expertise in Microsoft Fabric to join our innovative team. As a key player in our organization, you will...

  • Data Architect

    5 days ago

    Edinburgh, Scotland, Scotland, United Kingdom iXceed Solutions Full time

    About Us:Founded on the grounds of innovation – iXceed Solutions is an ISO certified, leader in Talent and Digital recruitment solutions, serving Fortune 100 companies globally.About the RoleWe are looking for an experienced Technical Data Architect with expertise in Microsoft Fabric to join our innovative team. As a key player in our organization, you...

  • Product Analyst

    2 weeks ago

    Edinburgh, Scotland, Scotland, United Kingdom Smart Data Foundry Full time

    About Smart Data FoundrySmart Data Foundry has a purpose to unlock the power of financial data as a force to improve people’s lives.What we doWe enable the research ecosystem to flourish through the provision of research ready real financial data.We create data-driven insights based on real financial data, that identify areas to inform policy change and...

  • Data Scientist

    1 month ago

    Scotland, United Kingdom Solos Consultants Ltd Full time

    Data Scientist - Generative AI SpecialistWe are seeking a highly skilled Data Scientist specializing in Generative AI to join our team at Solos Consultants Ltd. The selected candidate will leverage Azure OpenAI Studio to develop and integrate AI models that can process various pieces of text, rationalize the data, and produce a consolidated draft output.This...