Senior Data Engineer

3 weeks ago

Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

Job Description:

We are seeking a seasoned Senior Data Engineer to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.

Key Responsibilities:

  • Develop and manage data pipelines using Python, capable of supporting both streaming and batch data processing across structured, semi-structured, and unstructured data in on-premises and Azure environments.
  • Implement and manage data storage solutions leveraging both on-premises infrastructure and Azure, ensuring seamless data integration and accessibility across platforms.
  • Utilise Docker for containerisation and Kubernetes for orchestration, ensuring scalable and efficient deployment of applications across both cloud-based and on-premises environments.
  • Employ tools such as Apache Airflow to automate data flows and manage complex workflows within hybrid environments.
  • Manage security setups and access controls, incorporating tools like Keycloak to protect data integrity and comply with legal standards across all data platforms.
  • Oversee and enhance Elasticsearch setups for robust data searching and analytics capabilities in mixed infrastructure settings.
  • Administer and optimise PostgreSQL databases, ensuring high performance and availability across diverse deployment scenarios.

Requirements:

  • Strong Python skills and experience with ETL/ELT workflows.
  • Expertise in hybrid cloud data architecture and containerisation.
  • Proficiency in workflow automation tools and event streaming platforms.
  • Data security knowledge and experience with implementing security practices and tools.
  • Search and database management skills.

About Us:

Methods Business and Digital Technology is a leading provider of data-driven solutions. We are passionate about using data to drive decisions and technological innovation in a hybrid infrastructure environment.

What We Offer:

We offer a competitive salary and benefits package, as well as opportunities for professional growth and development.

  • Senior ICT Systems Engineer

    2 months ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Senior ICT Systems EngineerWe are seeking a highly skilled Senior ICT Systems Engineer to join our team at Data Careers Ltd. As a critical member of our Specialist Technical Support Team, you will be responsible for delivering expert technical support across a range of critical systems, ensuring optimal performance and reliability.Key...

  • Senior ICT Systems Engineer

    2 months ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Senior ICT Systems EngineerWe are seeking a highly skilled Senior ICT Systems Engineer to join our team at Data Careers Ltd. As a critical member of our Specialist Technical Support Team, you will be responsible for delivering expert technical support across a range of critical systems, ensuring optimal performance and reliability.Key...

  • Senior ICT Systems Engineer

    1 month ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Senior ICT Systems EngineerWe are seeking a highly skilled Senior ICT Systems Engineer to join our team at Data Careers Ltd. As a critical member of our Specialist Technical Support Team, you will be responsible for delivering expert technical support across a range of critical systems, ensuring optimal performance and reliability.Key...

  • Senior ICT Systems Engineer

    4 weeks ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Senior ICT Systems EngineerWe are seeking a highly skilled Senior ICT Systems Engineer to join our team at Data Careers Ltd. As a critical member of our organization, you will be responsible for providing expert technical support for critical systems and applications that are essential to ensuring the safety and efficiency of our operations.Key...

  • Senior Data Engineer

    1 month ago

    Worcester, Worcestershire, United Kingdom Methods Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Methods. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data...

  • Senior Data Engineer

    1 month ago

    Worcester, Worcestershire, United Kingdom Methods Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Methods. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data...

  • Senior Data Infrastructure Engineer

    4 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer to join our team at Methods. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDesign, construct, and maintain efficient and reliable data pipelines using...

  • Senior Data Engineer

    4 weeks ago

    Worcester, Worcestershire, United Kingdom Hexegic Full time

    Job Summary:Hexegic is seeking a skilled Data Engineer to join our team. The ideal candidate will have expertise in building and maintaining data pipelines and applications using proprietary commercial software.Key Responsibilities:Developing data pipelines using Pandas, SQL, and PySpark.Creating front-end applications using Python.Integrating APIs for data...

  • Senior Data Infrastructure Engineer

    7 days ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    Job DescriptionAbout the Role: We are seeking a skilled Senior Data Engineer to join our team at Methods Business and Digital Technology. In this role, you will design, build, and maintain sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key Responsibilities:Develop and manage data pipelines using...

  • Senior Data Engineer

    4 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer (Infrastructure) to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data...

  • Senior Data Engineer

    4 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer (Infrastructure) to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data...

  • Senior Financial Accountant

    3 weeks ago

    Worcester, Worcestershire, United Kingdom Hays Senior Finance Full time

    Job DetailsJob Type: PermanentSalary: £45,000-£50,000 per annumLocation: Homebased (one day per month in Worcester)Hours: Mon-Fri (9-5)Your new companyHays Senior Finance are working with a large, reputable organisation as they look to recruit a new Financial Accountant on a permanent basis.This organisation provides engineering, procurement and...

  • Senior Data Engineer

    3 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data pipelines using...

  • Senior Finance Manager

    3 weeks ago

    Worcester, Worcestershire, United Kingdom Data Careers Ltd Full time

    Job Title: Senior Finance OfficerLocation: Worcester / Home BasedJob Type: Part-Time (max 30 hours per week)Salary: £56,073 Pro RataWe are seeking a qualified accountant to join our team at Data Careers Ltd. As a Senior Finance Officer, you will be responsible for leading a small team and providing professional, proactive, and effective support and advice...

  • Senior Data Engineer

    3 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer (Infrastructure) to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data...

  • Data Engineer

    1 month ago

    Worcester, Worcestershire, United Kingdom Hexegic Full time

    Job Title: Data and Software EngineerLocation: Gloucestershire/Herefordshire/HybridClearance: SC or aboveAbout the Role:Hexegic is seeking a skilled and innovative data/software engineer to join our expanding team. This role is crucial in helping customers build and maintain data pipelines and applications using proprietary commercial software, ensuring...

  • Data Engineer

    1 month ago

    Worcester, Worcestershire, United Kingdom Hexegic Full time

    Job Title: Data and Software EngineerLocation: Gloucestershire/Herefordshire/HybridClearance: SC or aboveAbout the Role:Hexegic is seeking a skilled and innovative data/software engineer to join our expanding team. This role is crucial in helping customers build and maintain data pipelines and applications using proprietary commercial software, ensuring...

  • Senior Data Engineer

    3 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About the RoleWe are seeking a seasoned Senior Data Engineer to join our team at Methods Business and Digital Technology. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data pipelines using...

  • Data Engineer

    2 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    Data Engineer Role OverviewAt Methods Business and Digital Technology, we are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will play a pivotal role in designing and building data pipelines that operate across both on-premises and Azure cloud environments.Key Responsibilities:Develop and manage data pipelines using Python,...

  • Data Engineer

    4 weeks ago

    Worcester, Worcestershire, United Kingdom Methods Business and Digital Technology Full time

    About UsMethods Business and Digital Technology is a leading provider of data-driven solutions, dedicated to empowering businesses to make informed decisions. Our team of experts is passionate about leveraging data to drive innovation and growth.Job DescriptionWe are seeking a talented Data Engineer to join our team. As a Data Engineer, you will play a...