Data Infrastructure Architect

2 days ago


Ebbw Vale, Blaenau Gwent, United Kingdom Methods Full time
Data Engineer Role

We are seeking a seasoned Senior Data Engineer to join our team at Methods. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments. The position involves deploying and managing scalable data operations that support advanced analytics and data-driven decision-making, crucial for our organisational growth and innovation.

As a Senior Data Engineer, you will be responsible for developing and managing data pipelines using Python, capable of supporting both streaming and batch data processing across structured, semi-structured, and unstructured data in on-premises and Azure environments. You will also implement and manage data storage solutions leveraging both on-premises infrastructure and Azure, ensuring seamless data integration and accessibility across platforms.

In this role, you will empower business leaders to make informed decisions by delivering timely, accurate, and actionable data insights from a robust, hybrid infrastructure. Your expertise will drive the seamless integration of on-premises and cloud-based data solutions, enhancing both the flexibility and scalability of our data operations. You will champion the adoption of modern data architectures and tooling, and play a pivotal role in cultivating a data-driven culture within the organisation, mentoring team members, and advancing our engineering practices.

Required Skills and Experience
  • Strong Python Skills: Expertise in Python for scripting and automating data processes across varied environments.
  • Experience with ETL/ELT: Demonstrable experience in developing and optimising ETL or ELT workflows, particularly in hybrid (on-premises and Azure) environments.
  • Expertise in Hybrid Cloud Data Architecture: Profound knowledge of integrating on-premises infrastructure with Azure cloud services.
  • Containerisation and Orchestration Expertise: Solid experience with Docker and Kubernetes in managing applications across both on-premises and cloud platforms.
  • Proficiency in Workflow Automation Tools: Practical experience Apache Airflow in hybrid data environments.
  • Experience in Event Streaming: Proven ability in managing and deploying event streaming platforms like Kafka.
  • Data Security Knowledge: Experience with implementing security practices and tools, including Keycloak, across multiple platforms.


  • Ebbw Vale, Blaenau Gwent, United Kingdom Methods Full time

    About Us Methods is a leading IT services consultancy, partnering with central government departments and agencies to transform the way the public sector operates in the UK. We have over 30 years of experience delivering business and technical solutions that are people-centred, safe, and designed for the future. Our human touch sets us apart from other...

  • Senior Data Architect

    4 weeks ago


    Ebbw Vale, Blaenau Gwent, United Kingdom Methods Full time

    About the RoleAt Methods, we're on a mission to empower business leaders with data-driven insights. As a Senior Data Engineer, you'll play a pivotal role in designing, building, and maintaining sophisticated data infrastructure systems that operate across on-premises and Azure cloud environments.Key ResponsibilitiesDevelop and manage data pipelines using...


  • Ebbw Vale, Blaenau Gwent, United Kingdom Methods Full time

    Methods is a leading IT Services Consultancy that partners with central government departments and agencies to transform the public sector in the UK. Our 30-year history and UK-based presence enable us to apply our skills in transformation, delivery, and collaboration to create end-to-end business and technical solutions that are people-centred, safe, and...


  • Ebbw Vale, Blaenau Gwent, United Kingdom Methods Full time

    Data Engineer Job DescriptionWe are looking for a skilled Senior Data Engineer to design, build, and maintain sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments. As a Senior Data Engineer, you will develop and manage data pipelines using Python, implement and manage data storage solutions leveraging...


  • Ebbw Vale, Blaenau Gwent, United Kingdom Methods Full time

    Senior Data Engineer PositionWe are seeking a seasoned Senior Data Engineer to join our team at Methods. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments. The position involves deploying and managing scalable...

  • Senior Data Engineer

    5 months ago


    Ebbw Vale, United Kingdom Methods Full time

    Methods AnalyticsMethods Analytics (MA) exists to improve society by helping people make better decisions with data. Combining passionate people, sector-specific insight, and technical excellence to provide our customers an end-to-end data service.We use a collaborative, creative and user centric approach to data to do good and solve difficult problems....


  • Ebbw Vale, United Kingdom Thales Full time

    Location: Ebbw Vale, United Kingdom Thales people architect identity management and data protection solutions at the heart of digital security. Business and governments rely on us to bring trust to the billons of digital interactions they have with people. Our technologies and services help banks exchange funds, people cross borders, energy become smarter...

  • Ff&e Designer

    5 months ago


    Ebbw Vale, United Kingdom Merthyr Area Full time

    Advanced Furniture Ltd - Established in 1979 is a leading manufacturer of quality Education and contract furniture. We are a progressive and ambitious large company based in Ebbw Vale in a 100000 square foot modern environmentally friendly factory. We pride ourselves on delivering quality products, high service levels and creative solutions to our...

  • Project Controller

    6 months ago


    Ebbw Vale, United Kingdom Thales Full time

    Location: Ebbw Vale, United Kingdom Thales people architect identity management and data protection solutions at the heart of digital security. Business and governments rely on us to bring trust to the billons of digital interactions they have with people. Our technologies and services help banks exchange funds, people cross borders, energy become smarter...


  • Ash Vale, United Kingdom BAE Full time

    Description Job Title Degree Apprentice Shared Services Data Analysis (CORDA) Guildford Location Guildford Salary We offer a competitive salary with annual increases throughout the apprenticeship and a range of employee benefits including, free higher education as well as access to the Company pension and Share Incentive plan. What you will be doing...


  • Ash Vale, United Kingdom BAE Full time

    Company OverviewBAE Systems Digital Intelligence is a leading digital defence and intelligence company with a rich history of innovation and collaboration. Our organisation is home to 4,800 talented professionals working across 16 countries to collect, connect and understand complex data.Role SummaryWe are seeking an experienced FPGA Developer to join our...


  • Barry, Vale of Glamorgan, United Kingdom M Group Services Full time

    Morrison Energy Services is currently looking to recruit a Senior Project Manager to work on our Electrical Transmission frameworks, nationwide, with initial project being based in South Wales. As a Senior Project Manager you will be part of our Electrical Transmission management team who are responsible for managing the civil and M&E delivery teams of the...


  • Ash Vale, United Kingdom BAE Full time

    Location(s): UK, Europe & Africa : UK : Guildford || UK, Europe & Africa : UK : Gloucester BAE Systems Digital Intelligence is home to 4,500 digital, cyber and intelligence experts. We work collaboratively across 10 countries to collect, connect and understand complex data, so that governments, nation states, armed forces and commercial businesses can unlock...


  • Barry, Vale of Glamorgan, United Kingdom Tarmac Trading Limited Full time

    Are you an Electrical Engineering Graduate looking for the first step of your career? Then please read on as we may just have the role for you! At Tarmac, who you are matters. We want to get to know you. If you share our values and are proud of a job well done, collaborative in working well with others and ambitious to make things better, then have a...