Data Engineer

2 weeks ago

Horsham, United Kingdom DiverseJobsMatter Full time

Are you passionate about designing impactful data-driven solutions and creating cutting-edge digital experiences?

We’re seeking a Principal Data and Digital Engineer to lead the delivery of transformative solutions for our clients. You will lead the delivery of tailored solutions to our clients where you will be responsible for the design, delivery and implementation solutions, spanning from end user interfaces and innovative user experience to data driven solutions.

Sitting in the consulting division, you will be one of the drivers of our new capability framework and will lead the implementation of data and digital solutions of varying size and complexity, across several technical domains, including Analytics and Visualisation, Data Engineering and pipelining, UI and UX, Digital Twins, Simulation and/or Asset and Data Management.

In addition to the relevant technical experience in the different domains identified, you will have a depth of experience in different software engineering languages and commercial off the shelf tools across cloud and on-prem settings where you will be expected to build impactful Technical Solutions, Concept Demonstrators and Minimum Value Propositions.

Job Responsibilities

  • Build, optimise, and maintain scalable data pipelines that handle high-volume, high-velocity data in complex SaaS environments.
  • Design efficient, scalable, and flexible data models in multiple technologies to meet business requirements.
  • Analyse and consolidate business requirements and use cases to meet technical and non-technical debt.
  • Design tailored and bespoke solutions to address and mitigate challenges faced by our clients.
  • Make key decisions on build vs buy for data and digital engineering solutions and platforms.
  • Work closely with the entire business far beyond just product or technology, including driving innovation through concept demonstrators and offerings and support the sales activities, from a pre-sales perspective.
  • Carry out horizon scanning to identify emerging technology and industry trends and assess their potential impact and opportunity to become our offerings to the market.
  • Ensure solution, hosting and service architectures are subject to robust cost and effort estimation, covering design, development, transition, operation, maintenance and exit costs.

Skills Required

Data Engineering

  • Fluency in one or more of the following languages: SQL, Scala, Python, R, PySpark, Elasticsearch.
  • Data Pipeline Development: Hands-on experience in building data pipelines in AWS, Azure and/or open-source frameworks like Spark, Beam, or Airflow.
  • Experience with real time data streaming frameworks, (e.g. Kafka, Pubsub etc.).
  • Data quality/validation experience: designing metrics and KPIs to verify and automated management of data quality – experience in Purview would be very welcome.
  • Build and optimise data models, ensuring data is structured, accessible, and performant for downstream analytics and machine learning models
  • Good working experience of AWS (e.g. S3, Kinesis, Glue, Redshift, Lambda and EMR) or Azure data services (e.g. ADF, Synapse, Fabric, Azure Functions)
  • Knowledge and experience of Palantir Foundry or Gotham is a major plus.
  • Working experience in Data Lakehouse environments such as Databricks, Snowflake and/or Microsoft Fabric is a major plus.

Digital and Software Engineering

  • Experience in developing software solutions in an agile fashion employing best practices (e.g. automated testing, version control, CI/CD, containerisation, etc.).
  • Experience in designing wireframes in Figma and development of web front ends in React and/or Angular.
  • Familiarity with user testing and research methodologies.
  • Strong understanding of HTML, CSS, JavaScript, and front-end frameworks.
  • Experience in Agile methodologies (Scrum / Kanban).
  • Experience in developing Infrastructure as a Code (e.g. Terraform) is an advantage.

Core

  • Working knowledge of 1 cloud vendor (AWS, Azure) – ideally with relevant engineering certification.
  • Strong problem-solving skills, attention to detail and passion for creating business value through data.
  • Strong communication skills, in particular the ability to translate technical concepts to non-technical stakeholders.
  • Value collaboration and have experience working effectively with remote teams.
  • Willingness to mentor others and support them in achieving their goals.
  • Comfortable working in a lean, agile environment, with the ability to adapt to changing priorities and technical domains with an enthusiastic and proactive attitude.

  • Data Engineer

    1 month ago

    Horsham, West Sussex, United Kingdom Data Privacy Full time

    Data Engineer - API Platform SpecialistRSPCA is seeking a skilled Data Engineer to join their IT department, focusing on the Mulesoft API Platform. This role involves developing API services, designing complex data engineering solutions, and maintaining data pipelines.Key Responsibilities:Implement new API services using the Mulesoft API platform.Design and...

  • Data Engineer

    2 weeks ago

    Horsham, United Kingdom DiverseJobsMatter Full time

    Job Description Are you passionate about designing impactful data-driven solutions and creating cutting-edge digital experiences? We’re seeking a Principal Data and Digital Engineer to lead the delivery of transformative solutions for our clients. You will lead the delivery of tailored solutions to our clients where you will be responsible for the design,...

  • Data Engineer

    3 weeks ago

    Horsham, United Kingdom DiverseJobsMatter Full time

    Are you passionate about designing impactful data-driven solutions and creating cutting-edge digital experiences?We’re seeking a Principal Data and Digital Engineer to lead the delivery of transformative solutions for our clients. You will lead the delivery of tailored solutions to our clients where you will be responsible for the design, delivery and...

  • Data Engineer

    3 weeks ago

    Horsham, United Kingdom DiverseJobsMatter Full time

    Are you passionate about designing impactful data-driven solutions and creating cutting-edge digital experiences?We’re seeking a Principal Data and Digital Engineer to lead the delivery of transformative solutions for our clients. You will lead the delivery of tailored solutions to our clients where you will be responsible for the design, delivery and...

  • Data Engineer

    3 weeks ago

    Horsham, UK, West Sussex, United Kingdom DiverseJobsMatter Full time

    Are you passionate about designing impactful data-driven solutions and creating cutting-edge digital experiences?We’re seeking a Principal Data and Digital Engineer to lead the delivery of transformative solutions for our clients. You will lead the delivery of tailored solutions to our clients where you will be responsible for the design, delivery and...

  • Principal Data and Digital Solutions Engineer

    2 weeks ago

    Horsham, West Sussex, United Kingdom Envitia Full time

    Role OverviewAt Envitia, we're seeking a talented Principal Data and Digital Solutions Engineer to lead the delivery of transformative solutions for our clients. This role involves designing, delivering, and implementing tailored solutions that span from end-user interfaces and innovative user experiences to data-driven solutions.Key ResponsibilitiesLead the...

  • Data and Planning Specialist

    4 weeks ago

    Horsham, West Sussex, United Kingdom Ceres Power Limited Full time

    Ceres Power Limited: A Leader in Clean Energy InnovationCeres Power Limited is a pioneering company in the field of clean energy innovation, pushing the boundaries of what is possible with technology. We are seeking a highly skilled Data and Planning Officer to join our team and contribute to our mission of delivering maximum value to the business through...

  • Senior Data Solutions Architect

    3 days ago

    Horsham, West Sussex, United Kingdom DiverseJobsMatter Full time

    Job Title: Principal Data and Digital EngineerDiverseJobsMatter is seeking a Principal Data and Digital Engineer to lead the delivery of transformative solutions for our clients.Key Responsibilities:Design and implement scalable data pipelines handling high-volume, high-velocity data in complex SaaS environments.Develop efficient data models in multiple...

  • Senior Test Planning and Data Analyst

    3 days ago

    Horsham, West Sussex, United Kingdom Terry Parris Associates Full time

    Test Planning and Data Analysis SpecialistWe are seeking a highly skilled Test Planning and Data Analysis Specialist to join our team at Terry Parris Associates.About the Role:The successful candidate will be responsible for meticulously planning and executing test plans to ensure the smooth operation of our department and improve the overall efficiency of...

  • Data Transformation Specialist

    2 weeks ago

    Horsham, West Sussex, United Kingdom Fortice Full time

    Transform Digital Outcomes in the UK Public SectorWe're seeking a skilled Technical Business Analyst to partner with clients, translating their goals into tailored digital solutions that are both innovative and actionable.Key Responsibilities:Elicit, analyse, and manage business requirements, developing high-impact deliverables such as Minimum Viable...

  • Senior Data Solutions Architect

    7 days ago

    Horsham, West Sussex, United Kingdom DiverseJobsMatter Full time

    About the RoleWe are seeking an experienced Senior Data Solutions Architect to join our team at DiverseJobsMatter. This is a full-time position, and we offer a competitive salary of $120,000 - $180,000 per year.Key Responsibilities:Design and implement scalable data pipelines in complex SaaS environments using AWS, Azure, or open-source frameworks like...

  • Business Data Analyst

    2 weeks ago

    Horsham, United Kingdom Fortice Full time

    Are you looking to drive impactful digital transformations across the UK public sector?We're seeking a talented Technical Business Analyst to join a leading consulting team, renowned for utilising cutting-edge technologies in data, AI, and machine learning to deliver strategic and technical solutions. In this unique role, you'll partner closely with clients,...

  • Business Data Analyst

    2 weeks ago

    Horsham, United Kingdom Fortice Full time

    Are you looking to drive impactful digital transformations across the UK public sector?We're seeking a talented Technical Business Analyst to join a leading consulting team, renowned for utilising cutting-edge technologies in data, AI, and machine learning to deliver strategic and technical solutions. In this unique role, you'll partner closely with clients,...

  • Business Data Analyst

    3 weeks ago

    Horsham, United Kingdom Fortice Full time

    Are you looking to drive impactful digital transformations across the UK public sector?We're seeking a talented Technical Business Analyst to join a leading consulting team, renowned for utilising cutting-edge technologies in data, AI, and machine learning to deliver strategic and technical solutions. In this unique role, you'll partner closely with clients,...

  • Test Engineer

    2 weeks ago

    Horsham, United Kingdom CV-Library Full time

    Job Title: Test Engineer   Location:Horsham Employment Type:Permanent Test Engineer  ​ Purpose of the role: The role will ensure auditable data is produced in line with company quality processes. Maintain and, where appropriate, modify test equipment in conjunction with the Test Capability Team. You will work closely with the Test...

  • Applications Engineer

    1 week ago

    Horsham, United Kingdom CV-Library Full time

    Primary responsibility will be providing strong, operations support to the organisation. Developing and implementing technology solutions in a business environment, specifically focused on system integration, EDI, ERP and software development using various technologies. Job Requirements (not limited to): Experience in developing technology solutions for...

  • Systems Engineer

    8 hours ago

    Horsham, United Kingdom CV-Library Full time

    Systems Engineer Location: Horsham Purpose of the role: ​ This position is part of the Systems Engineering Department, which focuses on supporting core technology development at the component and stack levels, showcasing system-level technology, advancing and leveraging system intellectual property (IP), and collaborating with partners to...

  • Electrical Project Engineer

    4 weeks ago

    Horsham, West Sussex, United Kingdom UKSE Group Full time

    About the Role:As an Electrical Project Engineer at UKSE Group, you will be responsible for delivering electrical engineering projects across various sectors, including utilities, healthcare, and hospitality. Your primary focus will be on specifying and purchasing equipment, particularly control systems and instrumentation, and ensuring their quality. You...

  • Electrical Engineer Specialist

    1 month ago

    Horsham, West Sussex, United Kingdom UKSE Group Full time

    We are seeking an Electrical Engineer Specialist to join our team at UKSE Group. The successful candidate will have a proven ability to coordinate and manage electrical projects, with a focus on day-to-day contact and coordination with clients, subcontractors, and suppliers.Key Responsibilities:Specifying and purchasing equipment, particularly control...

  • Crane Engineer

    2 months ago

    Horsham, United Kingdom CV-Library Full time

    Crane engineer required. Our client is a leading provider of installation, repairs and services on overhead crane, they are looking for an engineer to join their business in a field base role with the occasional need to do some work in their workshop based in Horsham. The role would involve covering the surrounding counties of Horsham with door to door pay....