Senior Data Engineer

3 weeks ago

Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

About the Role

We are seeking a seasoned Senior Data Engineer (Infrastructure) to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.

Key Responsibilities

  • Develop and manage data pipelines using Python, capable of supporting both streaming and batch data processing across structured, semi-structured, and unstructured data in on-premises and Azure environments.
  • Implement and manage data storage solutions leveraging both on-premises infrastructure and Azure, ensuring seamless data integration and accessibility across platforms.
  • Utilise Docker for containerisation and Kubernetes for orchestration, ensuring scalable and efficient deployment of applications across both cloud-based and on-premises environments.
  • Employ tools such as Apache Airflow to automate data flows and manage complex workflows within hybrid environments.
  • Manage security setups and access controls, incorporating tools like Keycloak to protect data integrity and comply with legal standards across all data platforms.
  • Oversee and enhance Elasticsearch setups for robust data searching and analytics capabilities in mixed infrastructure settings.
  • Administer and optimise PostgreSQL databases, ensuring high performance and availability across diverse deployment scenarios.

Requirements

  • Strong Python skills and experience with ETL/ELT workflows, particularly in hybrid (on-premises and Azure) environments.
  • Expertise in hybrid cloud data architecture and containerisation, with a solid understanding of Docker and Kubernetes.
  • Proficiency in workflow automation tools, such as Apache Airflow, and experience with event streaming platforms like Kafka.
  • Data security knowledge and experience with implementing security practices and tools, including Keycloak.
  • Search and database management skills, with a strong background in managing Elasticsearch and PostgreSQL in environments that span on-premises and cloud infrastructures.

About Us

Methods Business and Digital Technology is a leading provider of data-driven solutions, committed to helping organisations make informed decisions with data. We value collaboration, creativity, and user-centricity in our approach to data, ensuring that our outputs are transparent, robust, and transformative.

What We Offer

We offer a dynamic and supportive work environment, with opportunities for professional growth and development. Our team is passionate about using data to drive decisions and technological innovation, and we are committed to cultivating a data-driven culture within the organisation.

  • Senior ICT Systems Engineer

    2 months ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Senior ICT Systems EngineerWe are seeking a highly skilled Senior ICT Systems Engineer to join our team at Data Careers Ltd. As a critical member of our Specialist Technical Support Team, you will be responsible for delivering expert technical support across a range of critical systems, ensuring optimal performance and reliability.Key...

  • Senior ICT Systems Engineer

    2 months ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Senior ICT Systems EngineerWe are seeking a highly skilled Senior ICT Systems Engineer to join our team at Data Careers Ltd. As a critical member of our Specialist Technical Support Team, you will be responsible for delivering expert technical support across a range of critical systems, ensuring optimal performance and reliability.Key...

  • Senior ICT Systems Engineer

    1 month ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Senior ICT Systems EngineerWe are seeking a highly skilled Senior ICT Systems Engineer to join our team at Data Careers Ltd. As a critical member of our Specialist Technical Support Team, you will be responsible for delivering expert technical support across a range of critical systems, ensuring optimal performance and reliability.Key...

  • Senior ICT Systems Engineer

    1 month ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Senior ICT Systems EngineerWe are seeking a highly skilled Senior ICT Systems Engineer to join our team at Data Careers Ltd. As a critical member of our Specialist Technical Support Team, you will be responsible for delivering expert technical support across a range of critical systems, ensuring optimal performance and reliability.Key...

  • Senior ICT Systems Engineer

    4 weeks ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Senior ICT Systems EngineerWe are seeking a highly skilled Senior ICT Systems Engineer to join our team at Data Careers Ltd. As a critical member of our organization, you will be responsible for providing expert technical support for critical systems and applications that are essential to ensuring the safety and efficiency of our operations.Key...

  • Senior Data Engineer

    1 month ago

    Worcester, Worcestershire, United Kingdom Methods Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Methods. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data...

  • Senior Data Engineer

    1 month ago

    Worcester, Worcestershire, United Kingdom Methods Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Methods. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data...

  • Senior Data Infrastructure Engineer

    4 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer to join our team at Methods. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDesign, construct, and maintain efficient and reliable data pipelines using...

  • Senior Data Engineer

    3 weeks ago

    Worcester, Worcestershire, United Kingdom Hexegic Full time

    Job Summary:Hexegic is seeking a skilled Data Engineer to join our team. The ideal candidate will have expertise in building and maintaining data pipelines and applications using proprietary commercial software.Key Responsibilities:Developing data pipelines using Pandas, SQL, and PySpark.Creating front-end applications using Python.Integrating APIs for data...

  • Senior Data Infrastructure Engineer

    5 days ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    Job DescriptionAbout the Role: We are seeking a skilled Senior Data Engineer to join our team at Methods Business and Digital Technology. In this role, you will design, build, and maintain sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key Responsibilities:Develop and manage data pipelines using...

  • Senior Data Engineer

    4 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer (Infrastructure) to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data...

  • Senior Data Engineer

    4 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer (Infrastructure) to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data...

  • Senior Data Engineer

    1 month ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer (Infrastructure) to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data...

  • Senior Data Engineer

    1 month ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer (Infrastructure) to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data...

  • Senior Financial Accountant

    3 weeks ago

    Worcester, Worcestershire, United Kingdom Hays Senior Finance Full time

    Job DetailsJob Type: PermanentSalary: £45,000-£50,000 per annumLocation: Homebased (one day per month in Worcester)Hours: Mon-Fri (9-5)Your new companyHays Senior Finance are working with a large, reputable organisation as they look to recruit a new Financial Accountant on a permanent basis.This organisation provides engineering, procurement and...

  • Senior Data Engineer

    3 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data pipelines using...

  • Senior Finance Manager

    2 weeks ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Job Title: Senior Finance OfficerLocation: Worcester / Home BasedJob Type: Part-Time (max 30 hours per week)Salary: £56,073 Pro RataWe are seeking a qualified accountant to join our team at Data Careers Ltd. As a Senior Finance Officer, you will be responsible for leading a small team and providing professional, proactive, and effective support and advice...

  • Data Engineer

    4 weeks ago

    Worcester, Worcestershire, United Kingdom Hexegic Full time

    Job Title: Data and Software EngineerLocation: Gloucestershire/Herefordshire/HybridClearance: SC or aboveAbout the Role:Hexegic is seeking a skilled and innovative data/software engineer to join our expanding team. This role is crucial in helping customers build and maintain data pipelines and applications using proprietary commercial software, ensuring...

  • Data Engineer

    4 weeks ago

    Worcester, Worcestershire, United Kingdom Hexegic Full time

    Job Title: Data and Software EngineerLocation: Gloucestershire/Herefordshire/HybridClearance: SC or aboveAbout the Role:Hexegic is seeking a skilled and innovative data/software engineer to join our expanding team. This role is crucial in helping customers build and maintain data pipelines and applications using proprietary commercial software, ensuring...

  • Data Engineer

    1 month ago

    Worcester, Worcestershire, United Kingdom Hexegic Full time

    Job Title: Data and Software EngineerLocation: Gloucestershire/Herefordshire/HybridClearance: SC or aboveAbout the Role:Hexegic is seeking a skilled and innovative data/software engineer to join our expanding team. This role is crucial in helping customers build and maintain data pipelines and applications using proprietary commercial software, ensuring...