Senior Data Infrastructure Engineer

1 day ago

Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time
About the Role

We are seeking a seasoned Senior Data Engineer to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.

Key Responsibilities
  • Develop and manage data pipelines using Python, capable of supporting both streaming and batch data processing across structured, semi-structured, and unstructured data in on-premises and Azure environments.
  • Implement and manage data storage solutions leveraging both on-premises infrastructure and Azure, ensuring seamless data integration and accessibility across platforms.
  • Utilise Docker for containerisation and Kubernetes for orchestration, ensuring scalable and efficient deployment of applications across both cloud-based and on-premises environments.
  • Employ tools such as Apache Airflow to automate data flows and manage complex workflows within hybrid environments.
  • Manage security setups and access controls, incorporating tools like Keycloak to protect data integrity and comply with legal standards across all data platforms.
  • Oversee and enhance Elasticsearch setups for robust data searching and analytics capabilities in mixed infrastructure settings.
  • Administer and optimise PostgreSQL databases, ensuring high performance and availability across diverse deployment scenarios.
Requirements
  • Strong Python skills and experience with ETL/ELT workflows, particularly in hybrid (on-premises and Azure) environments.
  • Expertise in hybrid cloud data architecture and containerisation and orchestration.
  • Proficiency in workflow automation tools and experience with event streaming platforms like Kafka.
  • Data security knowledge and experience with implementing security practices and tools across multiple platforms.
  • Search and database management skills, with a strong background in managing Elasticsearch and PostgreSQL in environments that span on-premises and cloud infrastructures.
About Us

Methods Business and Digital Technology is a leading provider of data-driven solutions. We are passionate about using data to drive decisions and technological innovation in a hybrid infrastructure environment.

We are committed to delivering timely, accurate, and actionable data insights from a robust, hybrid infrastructure. Our team is dedicated to cultivating a data-driven culture within the organisation, mentoring team members, and advancing our engineering practices.

We offer a range of benefits, including a competitive salary, comprehensive training and development opportunities, and a collaborative and dynamic work environment.

  • Senior Data Infrastructure Engineer

    5 days ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data pipelines using...

  • Senior Data Infrastructure Engineer

    5 days ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data pipelines using...

  • Senior Data Infrastructure Engineer

    4 days ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data pipelines using...

  • Senior Data Infrastructure Engineer

    4 days ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data pipelines using...

  • Senior Data Engineer

    2 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer to join our team at Methods, a leading provider of data-driven solutions. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key...

  • Senior Data Engineer

    2 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer to join our team at Methods, a leading provider of data-driven solutions. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key...

  • Senior Data Engineer

    2 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer (Infrastructure) to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data...

  • Senior Data Engineer

    2 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer (Infrastructure) to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data...

  • Senior Data Engineer

    1 week ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer (Infrastructure) to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data...

  • Senior Data Engineer

    1 week ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer (Infrastructure) to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data...

  • Senior Systems IT Engineer

    3 days ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Senior ICT Support Engineer (Critical Systems)We are seeking a highly skilled Senior ICT Support Engineer to join our team at Data Careers Ltd. As a critical systems expert, you will play a pivotal role in maintaining and supporting vital ICT services, specialist applications, and equipment.Key Responsibilities:Deliver expert technical support across a range...

  • Senior Systems IT Engineer

    3 days ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Senior ICT Support Engineer (Critical Systems)We are seeking a highly skilled Senior ICT Support Engineer to join our team at Data Careers Ltd. As a critical systems expert, you will play a pivotal role in maintaining and supporting vital ICT services, specialist applications, and equipment.Key Responsibilities:Deliver expert technical support across a range...

  • Senior ICT Support Specialist

    7 days ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Job Title: Senior ICT Support EngineerWe are seeking a highly skilled Senior ICT Support Engineer to join our team at Data Careers Ltd. This role will involve providing expert technical support for critical systems and applications, ensuring optimal performance and reliability.Key Responsibilities:Deliver high-level technical support for critical systems,...

  • Senior ICT Support Specialist

    7 days ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Job Title: Senior ICT Support EngineerWe are seeking a highly skilled Senior ICT Support Engineer to join our team at Data Careers Ltd. This role will involve providing expert technical support for critical systems and applications, ensuring optimal performance and reliability.Key Responsibilities:Deliver high-level technical support for critical systems,...

  • Senior ICT Support Specialist

    7 days ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Job Title: Senior ICT Support EngineerWe are seeking a highly skilled Senior ICT Support Engineer to join our team at Data Careers Ltd. As a critical member of our Specialist Technical Support Team, you will be responsible for delivering expert technical support across a range of critical systems, ensuring optimal performance and reliability.Key...

  • Senior ICT Support Specialist

    7 days ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Job Title: Senior ICT Support EngineerWe are seeking a highly skilled Senior ICT Support Engineer to join our team at Data Careers Ltd. As a critical member of our Specialist Technical Support Team, you will be responsible for delivering expert technical support across a range of critical systems, ensuring optimal performance and reliability.Key...

  • Senior Data Architect

    4 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About Methods Business and Digital Technology We are a leading provider of data-driven solutions, dedicated to empowering businesses with informed decision-making capabilities. Our team of experts combines technical excellence with sector-specific knowledge to deliver end-to-end data services to our clients. We believe in a collaborative, creative, and...

  • Cloud Infrastructure Engineer

    4 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Methods Business and Digital Technology. As a key member of our IT infrastructure team, you will be responsible for designing, implementing, and maintaining our Azure Stack Hub environment, as well as the physical networking and cabling that underpins our data...

  • Cloud Infrastructure Engineer

    2 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Methods Business and Digital Technology. As a key member of our IT infrastructure team, you will be responsible for designing, implementing, and maintaining our Azure Stack Hub environment, as well as the physical networking and cabling that underpins our data...

  • Senior Data Architect

    2 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About Methods Business and Digital TechnologyMethods Business and Digital Technology is a leading provider of data-driven solutions, dedicated to empowering businesses to make informed decisions. Our team of experts combines technical excellence with sector-specific insight to deliver end-to-end data services.Our ApproachWe take a collaborative, creative,...