Senior Data Engineer

2 weeks ago

Great Malvern, Worcestershire, United Kingdom Methods Full time
About the Role

We are seeking a highly skilled Senior Data Engineer to join our team at Methods. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.

Key Responsibilities
  • Develop and manage data pipelines using Python, capable of supporting both streaming and batch data processing across structured, semi-structured, and unstructured data in on-premises and Azure environments.
  • Implement and manage data storage solutions leveraging both on-premises infrastructure and Azure, ensuring seamless data integration and accessibility across platforms.
  • Utilise Docker for containerisation and Kubernetes for orchestration, ensuring scalable and efficient deployment of applications across both cloud-based and on-premises environments.
  • Employ tools such as Apache Airflow to automate data flows and manage complex workflows within hybrid environments.
  • Manage security setups and access controls, incorporating tools like Keycloak to protect data integrity and comply with legal standards across all data platforms.
  • Oversee and enhance Elasticsearch setups for robust data searching and analytics capabilities in mixed infrastructure settings.
  • Administer and optimise PostgreSQL databases, ensuring high performance and availability across diverse deployment scenarios.
Requirements
  • Strong Python skills and experience with ETL/ELT workflows.
  • Expertise in hybrid cloud data architecture and containerisation and orchestration.
  • Proficiency in workflow automation tools and event streaming platforms.
  • Data security knowledge and experience with implementing security practices and tools.
  • Search and database management skills and experience with managing Elasticsearch and PostgreSQL in environments that span on-premises and cloud infrastructures.
About Us

Methods is a leading provider of data-driven solutions, and we are passionate about using data to drive decisions and technological innovation. We offer a collaborative and supportive environment, with opportunities for professional growth and development.

What We Offer
  • Autonomy to develop and grow your skills and experience.
  • Opportunities to work on exciting projects that make a difference in society.
  • Strong, inspiring, and thought-provoking leadership.
  • A supportive and collaborative environment.
  • Development opportunities, including access to LinkedIn Learning and a management development programme.
  • Wellness initiatives, including a 24/7 confidential employee assistance programme.
  • Flexible working arrangements, including home working and part-time options.
  • Social benefits, including office parties, breakfast Tuesdays, and commitment to charitable causes.
  • Time off, including 25 days of annual leave per year, plus bank holidays, and the option to buy 5 extra days each year.
  • Volunteering opportunities, including 2 paid days per year to volunteer in our local communities or within a charity organisation.
  • Pension scheme, including a salary exchange scheme with 4% employer contribution and 5% employee contribution.
  • Discretionary company bonus, based on company and individual performance.
  • Life assurance, of 4 times base salary.
  • Private medical insurance, which is non-contributory (spouse and dependants included).
  • Worldwide travel insurance, which is non-contributory (spouse and dependants included).
  • Enhanced maternity and paternity pay.
  • Travel benefits, including a season ticket loan and cycle to work scheme.

  • Senior Data Engineer

    3 weeks ago

    Great Malvern, Worcestershire, United Kingdom Methods Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Methods. As a key member of our data infrastructure team, you will be responsible for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage...

  • Senior Data Engineer

    3 weeks ago

    Great Malvern, Worcestershire, United Kingdom Methods Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Methods. As a key member of our data infrastructure team, you will be responsible for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage...

  • Senior Data Scientist

    4 days ago

    Great Malvern, Worcestershire, United Kingdom Cubesmart Full time

    Senior Data ScientistCubeSmart is seeking a highly skilled Senior Data Scientist to join our team. As a key member of our Data Science team, you will play a critical role in driving advanced analytics, machine learning, and predictive modeling initiatives.Key Responsibilities:Develop and implement advanced analytics and machine learning models to solve...

  • Senior Data Scientist

    4 days ago

    Great Malvern, Worcestershire, United Kingdom Cubesmart Full time

    Senior Data ScientistCubeSmart is seeking a highly skilled Senior Data Scientist to join our team. As a key member of our Data Science team, you will play a critical role in driving advanced analytics, machine learning, and predictive modeling initiatives.Key Responsibilities:Develop and implement advanced analytics and machine learning models to solve...

  • Senior Data Scientist

    2 weeks ago

    Great Malvern, Worcestershire, United Kingdom Cubesmart Full time

    About the RoleCubeSmart is seeking a highly skilled Senior Data Scientist to join our award-winning team. As a key member of our Data Science team, you will play a critical role in driving advanced analytics, machine learning, and predictive modeling initiatives.Key ResponsibilitiesDevelop and implement advanced analytics and machine learning models to solve...

  • Senior Data Scientist

    2 weeks ago

    Great Malvern, Worcestershire, United Kingdom Cubesmart Full time

    About the RoleCubeSmart is seeking a highly skilled Senior Data Scientist to join our award-winning team. As a key member of our Data Science team, you will play a critical role in driving advanced analytics, machine learning, and predictive modeling initiatives.Key ResponsibilitiesDevelop and implement advanced analytics and machine learning models to solve...

  • Commissioning Engineer

    4 weeks ago

    Great Malvern, Worcestershire, United Kingdom Retrack Personnel Holdings Limited Full time

    Job Title: Commissioning EngineerWe are seeking a highly skilled Commissioning Engineer to join our team at Retrack Personnel Holdings Limited. As a Commissioning Engineer, you will be responsible for ensuring the smooth operation of our clients' automation systems, working closely with our clients to deliver turnkey projects within the automotive test...

  • Commissioning Engineer

    3 weeks ago

    Great Malvern, Worcestershire, United Kingdom Retrack Personnel Holdings Limited Full time

    Job Title: Commissioning EngineerWe are seeking a highly skilled Commissioning Engineer to join our team at Retrack Personnel Holdings Limited. As a Commissioning Engineer, you will be responsible for ensuring the smooth operation of our clients' automation systems, working closely with our clients to deliver turnkey projects within the automotive test...

  • Senior Systems Engineer

    1 month ago

    Great Malvern, Worcestershire, United Kingdom Rockfield Specialist Recruitment Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Systems Engineer to lead our team of engineers in the development of high-performance, cost-effective, and reliable systems and components. As a key member of our engineering team, you will be responsible for providing innovative solutions to complex engineering problems and contributing to...

  • Senior Systems Engineer

    1 month ago

    Great Malvern, Worcestershire, United Kingdom Rockfield Specialist Recruitment Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Systems Engineer to lead our team of engineers in the development of high-performance, cost-effective, and reliable systems and components. As a key member of our engineering team, you will be responsible for providing innovative solutions to complex engineering problems and contributing to...

  • Electrical Commissioning Engineer

    4 days ago

    Great Malvern, Worcestershire, United Kingdom Wright Staff Recruitment Ltd Full time

    Electrical Commissioning and Automation EngineerThis role is for engineers who enjoy the challenge of working on automation, Electro/Mechanical, and data acquisition systems for turnkey projects within the automotive test industry.Key Responsibilities:Checking on-site system electrical installations and fault finding as necessary on bespoke, one-off...

  • Electrical Commissioning Engineer

    3 days ago

    Great Malvern, Worcestershire, United Kingdom Wright Staff Recruitment Ltd Full time

    Electrical Commissioning and Automation EngineerThis role is for engineers who enjoy the challenge of working on automation, Electro/Mechanical, and data acquisition systems for turnkey projects within the automotive test industry.Key Responsibilities:Checking on-site system electrical installations and fault finding as necessary on bespoke, one-off...

  • Commissioning Engineer

    3 weeks ago

    Great Malvern, Worcestershire, United Kingdom CV Library Full time

    Job Title: Commissioning EngineerMy client is seeking a skilled Commissioning Engineer to join their team in Worcester. This role involves working on automation, electro-mechanical, and data acquisition systems for turnkey projects within the automotive test industry.Key Responsibilities:Conduct on-site system electrical installations and fault finding as...

  • Commissioning Engineer

    3 weeks ago

    Great Malvern, Worcestershire, United Kingdom CV Library Full time

    Job Title: Commissioning EngineerMy client is seeking a skilled Commissioning Engineer to join their team in Worcester. This role involves working on automation, electro-mechanical, and data acquisition systems for turnkey projects within the automotive test industry.Key Responsibilities:Conduct on-site system electrical installations and fault finding as...

  • Electrical Commissioning Engineer

    1 week ago

    Great Malvern, Worcestershire, United Kingdom Wright Staff Recruitment Ltd Full time

    Electrical Commissioning and Automation EngineerThis is a challenging role for engineers who enjoy working on automation, electro-mechanical, and data acquisition systems for turnkey projects within the automotive test industry.Key Responsibilities:Checking on-site system electrical installations and fault finding as necessary on bespoke, one-off...

  • Electrical Commissioning Engineer

    1 week ago

    Great Malvern, Worcestershire, United Kingdom Wright Staff Recruitment Ltd Full time

    Electrical Commissioning and Automation EngineerThis is a challenging role for engineers who enjoy working on automation, electro-mechanical, and data acquisition systems for turnkey projects within the automotive test industry.Key Responsibilities:Checking on-site system electrical installations and fault finding as necessary on bespoke, one-off...

  • Electrical Systems Engineer

    2 weeks ago

    Great Malvern, Worcestershire, United Kingdom Orion Electrotech Automation Full time

    Commissioning and Automation EngineerWe are seeking a highly skilled Commissioning and Automation Engineer to join our team at Orion Electrotech Automation. As a key member of our team, you will be responsible for the commissioning and automation of electro-mechanical systems in the automotive testing industry.Key Responsibilities:Inspect and troubleshoot...

  • Electrical Systems Engineer

    2 weeks ago

    Great Malvern, Worcestershire, United Kingdom Orion Electrotech Automation Full time

    Commissioning and Automation EngineerWe are seeking a highly skilled Commissioning and Automation Engineer to join our team at Orion Electrotech Automation. As a key member of our team, you will be responsible for the commissioning and automation of electro-mechanical systems in the automotive testing industry.Key Responsibilities:Inspect and troubleshoot...

  • Electrical Commissioning Engineer

    3 weeks ago

    Great Malvern, Worcestershire, United Kingdom Wright Staff Recruitment Ltd Full time

    Electrical Commissioning and Automation EngineerThis role is for engineers who enjoy the challenge of working on automation, Electro/Mechanical, and data acquisition systems for turnkey projects within the automotive test industry.Key Responsibilities:Checking on-site system electrical installations and fault finding as necessary on bespoke, one-off...

  • Electrical Commissioning Engineer

    3 weeks ago

    Great Malvern, Worcestershire, United Kingdom Wright Staff Recruitment Ltd Full time

    Electrical Commissioning and Automation EngineerThis role is for engineers who enjoy the challenge of working on automation, Electro/Mechanical, and data acquisition systems for turnkey projects within the automotive test industry.Key Responsibilities:Checking on-site system electrical installations and fault finding as necessary on bespoke, one-off...