Senior Data Engineer

13 hours ago

Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time
About the Role

We are seeking a highly skilled Senior Data Engineer to join our team at Methods Business and Digital Technology. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.

Key Responsibilities
  • Develop and manage data pipelines using Python, capable of supporting both streaming and batch data processing across structured, semi-structured, and unstructured data in on-premises and Azure environments.
  • Implement and manage data storage solutions leveraging both on-premises infrastructure and Azure, ensuring seamless data integration and accessibility across platforms.
  • Utilise Docker for containerisation and Kubernetes for orchestration, ensuring scalable and efficient deployment of applications across both cloud-based and on-premises environments.
  • Employ tools such as Apache Airflow to automate data flows and manage complex workflows within hybrid environments.
  • Manage security setups and access controls, incorporating tools like Keycloak to protect data integrity and comply with legal standards across all data platforms.
  • Oversee and enhance Elasticsearch setups for robust data searching and analytics capabilities in mixed infrastructure settings.
  • Administer and optimise PostgreSQL databases, ensuring high performance and availability across diverse deployment scenarios.
Requirements
  • Strong Python skills and experience with ETL/ELT workflows.
  • Expertise in hybrid cloud data architecture and containerisation and orchestration.
  • Proficiency in workflow automation tools and event streaming platforms.
  • Experience with data security and compliance.
  • Strong background in managing Elasticsearch and PostgreSQL in environments that span on-premises and cloud infrastructures.
About Us

Methods Business and Digital Technology is a leading provider of data-driven solutions. We are passionate about using data to drive decisions and technological innovation in a hybrid infrastructure environment. We value discussion and debate as part of our approach and strive for interactions that are engaging, informative, and fun in equal measure.

We are committed to delivering high-quality products and services to our customers and are seeking a talented Senior Data Engineer to join our team. If you are passionate about data engineering and have a strong background in designing, building, and maintaining sophisticated data infrastructure systems, we encourage you to apply.

  • Senior Systems IT Engineer

    3 days ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Senior ICT Support Engineer (Critical Systems)We are seeking a highly skilled Senior ICT Support Engineer to join our team at Data Careers Ltd. As a critical systems expert, you will play a pivotal role in maintaining and supporting vital ICT services, specialist applications, and equipment.Key Responsibilities:Deliver expert technical support across a range...

  • Senior Systems IT Engineer

    3 days ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Senior ICT Support Engineer (Critical Systems)We are seeking a highly skilled Senior ICT Support Engineer to join our team at Data Careers Ltd. As a critical systems expert, you will play a pivotal role in maintaining and supporting vital ICT services, specialist applications, and equipment.Key Responsibilities:Deliver expert technical support across a range...

  • Senior ICT Systems Engineer

    7 hours ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Senior ICT Systems EngineerWe are seeking a highly skilled Senior ICT Systems Engineer to join our team at Data Careers Ltd. As a critical member of our Specialist Technical Support Team, you will be responsible for delivering expert technical support across a range of critical systems, ensuring optimal performance and reliability.Key...

  • Senior ICT Systems Engineer

    10 hours ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Senior ICT Systems EngineerWe are seeking a highly skilled Senior ICT Systems Engineer to join our team at Data Careers Ltd. As a critical member of our Specialist Technical Support Team, you will be responsible for delivering expert technical support across a range of critical systems, ensuring optimal performance and reliability.Key...

  • Senior Data Infrastructure Engineer

    6 days ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data pipelines using...

  • Senior Data Infrastructure Engineer

    6 days ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data pipelines using...

  • Senior Data Engineer

    2 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer to join our team at Methods, a leading provider of data-driven solutions. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key...

  • Senior Data Engineer

    2 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer to join our team at Methods, a leading provider of data-driven solutions. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key...

  • Senior Data Infrastructure Engineer

    2 days ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data pipelines using...

  • Senior Data Infrastructure Engineer

    2 days ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data pipelines using...

  • Senior ICT Support Specialist

    7 days ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Job Title: Senior ICT Support EngineerWe are seeking a highly skilled Senior ICT Support Engineer to join our team at Data Careers Ltd. This role will involve providing expert technical support for critical systems and applications, ensuring optimal performance and reliability.Key Responsibilities:Deliver high-level technical support for critical systems,...

  • Senior ICT Support Specialist

    7 days ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Job Title: Senior ICT Support EngineerWe are seeking a highly skilled Senior ICT Support Engineer to join our team at Data Careers Ltd. This role will involve providing expert technical support for critical systems and applications, ensuring optimal performance and reliability.Key Responsibilities:Deliver high-level technical support for critical systems,...

  • Senior Data Infrastructure Engineer

    5 days ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data pipelines using...

  • Senior Data Infrastructure Engineer

    5 days ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data pipelines using...

  • Senior ICT Support Specialist

    7 days ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Job Title: Senior ICT Support EngineerWe are seeking a highly skilled Senior ICT Support Engineer to join our team at Data Careers Ltd. As a critical member of our Specialist Technical Support Team, you will be responsible for delivering expert technical support across a range of critical systems, ensuring optimal performance and reliability.Key...

  • Senior ICT Support Specialist

    7 days ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Job Title: Senior ICT Support EngineerWe are seeking a highly skilled Senior ICT Support Engineer to join our team at Data Careers Ltd. As a critical member of our Specialist Technical Support Team, you will be responsible for delivering expert technical support across a range of critical systems, ensuring optimal performance and reliability.Key...

  • Senior Data Architect

    4 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About Methods Business and Digital Technology We are a leading provider of data-driven solutions, dedicated to empowering businesses with informed decision-making capabilities. Our team of experts combines technical excellence with sector-specific knowledge to deliver end-to-end data services to our clients. We believe in a collaborative, creative, and...

  • Senior Cybersecurity Threat Analyst

    3 weeks ago

    Worcester, Worcestershire, United Kingdom Data Careers Full time

    About Data CareersData Careers is a leading technology driven public sector organisation seeking a highly skilled Senior Cybersecurity Threat Analyst to join our team.Job SummaryWe are looking for a seasoned cybersecurity professional to lead our threat hunting, vulnerability management, and incident response efforts. As a Senior Cybersecurity Threat...

  • Senior Cybersecurity Threat Analyst

    3 weeks ago

    Worcester, Worcestershire, United Kingdom Data Careers Full time

    About Data CareersData Careers is a leading technology driven public sector organisation seeking a highly skilled Senior Cybersecurity Threat Analyst to join our team.Job SummaryWe are looking for a seasoned cybersecurity professional to lead our threat hunting, vulnerability management, and incident response efforts. As a Senior Cybersecurity Threat...

  • Senior Data Engineer

    2 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer (Infrastructure) to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data...