Senior Data Engineer

1 month ago

Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time
About the Role

We are seeking a seasoned Senior Data Engineer (Infrastructure) to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.

Key Responsibilities
  • Develop and manage data pipelines using Python, capable of supporting both streaming and batch data processing across structured, semi-structured, and unstructured data in on-premises and Azure environments.
  • Implement and manage data storage solutions leveraging both on-premises infrastructure and Azure, ensuring seamless data integration and accessibility across platforms.
  • Utilise Docker for containerisation and Kubernetes for orchestration, ensuring scalable and efficient deployment of applications across both cloud-based and on-premises environments.
  • Employ tools such as Apache Airflow to automate data flows and manage complex workflows within hybrid environments.
  • Manage security setups and access controls, incorporating tools like Keycloak to protect data integrity and comply with legal standards across all data platforms.
  • Oversee and enhance Elasticsearch setups for robust data searching and analytics capabilities in mixed infrastructure settings.
  • Administer and optimise PostgreSQL databases, ensuring high performance and availability across diverse deployment scenarios.
Requirements
  • Strong Python skills and expertise in developing and optimising ETL or ELT workflows, particularly in hybrid (on-premises and Azure) environments.
  • Experience with containerisation and orchestration, including Docker and Kubernetes.
  • Proficiency in workflow automation tools, such as Apache Airflow.
  • Experience in event streaming, including managing and deploying event streaming platforms like Kafka.
  • Data security knowledge and experience with implementing security practices and tools, including Keycloak.
  • Search and database management skills, including managing Elasticsearch and PostgreSQL in environments that span on-premises and cloud infrastructures.
About Us

Methods Business and Digital Technology exists to improve society by helping people make better decisions with data. We combine passionate people, sector-specific insight, and technical excellence to provide our customers an end-to-end data service.

We use a collaborative, creative, and user-centric approach to data to do good and solve difficult problems. Ensuring that our outputs are transparent, robust, and transformative. We value discussion and debate as part of our approach. We will question assumptions, ambition, and process – but do so with respect and humility.

We relish difficult problems, and overcome them with innovation, creativity, and technical freedom to help us design optimum solutions. Ethics, privacy, and quality are at the heart of our work, and we will not sacrifice these for outcomes.

We treat data with respect and use it only for the right purpose. Our people are positive, dedicated, and relentless. Data is a vast topic, but we strive for interactions that are engaging, informative, and fun in equal measure. But maintain a steely focus on outcomes and delivering quality products for our customers.

We are passionate about our people; we want our colleagues to develop the things they are good at and enjoy.

Methods was acquired by the Alten Group in early 2022.

  • Senior ICT Systems Engineer

    2 months ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Senior ICT Systems EngineerWe are seeking a highly skilled Senior ICT Systems Engineer to join our team at Data Careers Ltd. As a critical member of our Specialist Technical Support Team, you will be responsible for delivering expert technical support across a range of critical systems, ensuring optimal performance and reliability.Key...

  • Senior ICT Systems Engineer

    2 months ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Senior ICT Systems EngineerWe are seeking a highly skilled Senior ICT Systems Engineer to join our team at Data Careers Ltd. As a critical member of our Specialist Technical Support Team, you will be responsible for delivering expert technical support across a range of critical systems, ensuring optimal performance and reliability.Key...

  • Senior ICT Systems Engineer

    1 month ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Senior ICT Systems EngineerWe are seeking a highly skilled Senior ICT Systems Engineer to join our team at Data Careers Ltd. As a critical member of our Specialist Technical Support Team, you will be responsible for delivering expert technical support across a range of critical systems, ensuring optimal performance and reliability.Key...

  • Senior ICT Systems Engineer

    1 month ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Senior ICT Systems EngineerWe are seeking a highly skilled Senior ICT Systems Engineer to join our team at Data Careers Ltd. As a critical member of our Specialist Technical Support Team, you will be responsible for delivering expert technical support across a range of critical systems, ensuring optimal performance and reliability.Key...

  • Senior ICT Systems Engineer

    4 weeks ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Senior ICT Systems EngineerWe are seeking a highly skilled Senior ICT Systems Engineer to join our team at Data Careers Ltd. As a critical member of our organization, you will be responsible for providing expert technical support for critical systems and applications that are essential to ensuring the safety and efficiency of our operations.Key...

  • Senior Data Engineer

    1 month ago

    Worcester, Worcestershire, United Kingdom Methods Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Methods. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data...

  • Senior Data Engineer

    1 month ago

    Worcester, Worcestershire, United Kingdom Methods Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Methods. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data...

  • Senior Data Infrastructure Engineer

    4 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer to join our team at Methods. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDesign, construct, and maintain efficient and reliable data pipelines using...

  • Senior Data Engineer

    3 weeks ago

    Worcester, Worcestershire, United Kingdom Hexegic Full time

    Job Summary:Hexegic is seeking a skilled Data Engineer to join our team. The ideal candidate will have expertise in building and maintaining data pipelines and applications using proprietary commercial software.Key Responsibilities:Developing data pipelines using Pandas, SQL, and PySpark.Creating front-end applications using Python.Integrating APIs for data...

  • Senior Data Infrastructure Engineer

    5 days ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    Job DescriptionAbout the Role: We are seeking a skilled Senior Data Engineer to join our team at Methods Business and Digital Technology. In this role, you will design, build, and maintain sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key Responsibilities:Develop and manage data pipelines using...

  • Senior Data Engineer

    4 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer (Infrastructure) to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data...

  • Senior Data Engineer

    4 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer (Infrastructure) to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data...

  • Senior Financial Accountant

    3 weeks ago

    Worcester, Worcestershire, United Kingdom Hays Senior Finance Full time

    Job DetailsJob Type: PermanentSalary: £45,000-£50,000 per annumLocation: Homebased (one day per month in Worcester)Hours: Mon-Fri (9-5)Your new companyHays Senior Finance are working with a large, reputable organisation as they look to recruit a new Financial Accountant on a permanent basis.This organisation provides engineering, procurement and...

  • Senior Data Engineer

    3 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data pipelines using...

  • Senior Finance Manager

    2 weeks ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Job Title: Senior Finance OfficerLocation: Worcester / Home BasedJob Type: Part-Time (max 30 hours per week)Salary: £56,073 Pro RataWe are seeking a qualified accountant to join our team at Data Careers Ltd. As a Senior Finance Officer, you will be responsible for leading a small team and providing professional, proactive, and effective support and advice...

  • Senior Data Engineer

    3 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer (Infrastructure) to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data...

  • Data Engineer

    1 month ago

    Worcester, Worcestershire, United Kingdom Hexegic Full time

    Job Title: Data and Software EngineerLocation: Gloucestershire/Herefordshire/HybridClearance: SC or aboveAbout the Role:Hexegic is seeking a skilled and innovative data/software engineer to join our expanding team. This role is crucial in helping customers build and maintain data pipelines and applications using proprietary commercial software, ensuring...

  • Data Engineer

    4 weeks ago

    Worcester, Worcestershire, United Kingdom Hexegic Full time

    Job Title: Data and Software EngineerLocation: Gloucestershire/Herefordshire/HybridClearance: SC or aboveAbout the Role:Hexegic is seeking a skilled and innovative data/software engineer to join our expanding team. This role is crucial in helping customers build and maintain data pipelines and applications using proprietary commercial software, ensuring...

  • Data Engineer

    4 weeks ago

    Worcester, Worcestershire, United Kingdom Hexegic Full time

    Job Title: Data and Software EngineerLocation: Gloucestershire/Herefordshire/HybridClearance: SC or aboveAbout the Role:Hexegic is seeking a skilled and innovative data/software engineer to join our expanding team. This role is crucial in helping customers build and maintain data pipelines and applications using proprietary commercial software, ensuring...

  • Data Engineer

    1 month ago

    Worcester, Worcestershire, United Kingdom Hexegic Full time

    Job Title: Data and Software EngineerLocation: Gloucestershire/Herefordshire/HybridClearance: SC or aboveAbout the Role:Hexegic is seeking a skilled and innovative data/software engineer to join our expanding team. This role is crucial in helping customers build and maintain data pipelines and applications using proprietary commercial software, ensuring...