Data Engineer

1 month ago

Horsham UK, West Sussex, United Kingdom DiverseJobsMatter Full time

Are you passionate about designing impactful data-driven solutions and creating cutting-edge digital experiences?

We’re seeking a Principal Data and Digital Engineer to lead the delivery of transformative solutions for our clients. You will lead the delivery of tailored solutions to our clients where you will be responsible for the design, delivery and implementation solutions, spanning from end user interfaces and innovative user experience to data driven solutions.

Sitting in the consulting division, you will be one of the drivers of our new capability framework and will lead the implementation of data and digital solutions of varying size and complexity, across several technical domains, including Analytics and Visualisation, Data Engineering and pipelining, UI and UX, Digital Twins, Simulation and/or Asset and Data Management.

In addition to the relevant technical experience in the different domains identified, you will have a depth of experience in different software engineering languages and commercial off the shelf tools across cloud and on-prem settings where you will be expected to build impactful Technical Solutions, Concept Demonstrators and Minimum Value Propositions.

Job Responsibilities

  • Build, optimise, and maintain scalable data pipelines that handle high-volume, high-velocity data in complex SaaS environments.
  • Design efficient, scalable, and flexible data models in multiple technologies to meet business requirements.
  • Analyse and consolidate business requirements and use cases to meet technical and non-technical debt.
  • Design tailored and bespoke solutions to address and mitigate challenges faced by our clients.
  • Make key decisions on build vs buy for data and digital engineering solutions and platforms.
  • Work closely with the entire business far beyond just product or technology, including driving innovation through concept demonstrators and offerings and support the sales activities, from a pre-sales perspective.
  • Carry out horizon scanning to identify emerging technology and industry trends and assess their potential impact and opportunity to become our offerings to the market.
  • Ensure solution, hosting and service architectures are subject to robust cost and effort estimation, covering design, development, transition, operation, maintenance and exit costs.

Skills Required

Data Engineering

  • Fluency in one or more of the following languages: SQL, Scala, Python, R, PySpark, Elasticsearch.
  • Data Pipeline Development: Hands-on experience in building data pipelines in AWS, Azure and/or open-source frameworks like Spark, Beam, or Airflow.
  • Experience with real time data streaming frameworks, (e.g. Kafka, Pubsub etc.).
  • Data quality/validation experience: designing metrics and KPIs to verify and automated management of data quality – experience in Purview would be very welcome.
  • Build and optimise data models, ensuring data is structured, accessible, and performant for downstream analytics and machine learning models
  • Good working experience of AWS (e.g. S3, Kinesis, Glue, Redshift, Lambda and EMR) or Azure data services (e.g. ADF, Synapse, Fabric, Azure Functions)
  • Knowledge and experience of Palantir Foundry or Gotham is a major plus.
  • Working experience in Data Lakehouse environments such as Databricks, Snowflake and/or Microsoft Fabric is a major plus.

Digital and Software Engineering

  • Experience in developing software solutions in an agile fashion employing best practices (e.g. automated testing, version control, CI/CD, containerisation, etc.).
  • Experience in designing wireframes in Figma and development of web front ends in React and/or Angular.
  • Familiarity with user testing and research methodologies.
  • Strong understanding of HTML, CSS, JavaScript, and front-end frameworks.
  • Experience in Agile methodologies (Scrum / Kanban).
  • Experience in developing Infrastructure as a Code (e.g. Terraform) is an advantage.

Core

  • Working knowledge of 1 cloud vendor (AWS, Azure) – ideally with relevant engineering certification.
  • Strong problem-solving skills, attention to detail and passion for creating business value through data.
  • Strong communication skills, in particular the ability to translate technical concepts to non-technical stakeholders.
  • Value collaboration and have experience working effectively with remote teams.
  • Willingness to mentor others and support them in achieving their goals.
  • Comfortable working in a lean, agile environment, with the ability to adapt to changing priorities and technical domains with an enthusiastic and proactive attitude.

  • Principal Data and Digital Solutions Engineer

    1 month ago

    Horsham, West Sussex, United Kingdom Envitia Full time

    Role OverviewAt Envitia, we're seeking a talented Principal Data and Digital Solutions Engineer to lead the delivery of transformative solutions for our clients. This role involves designing, delivering, and implementing tailored solutions that span from end-user interfaces and innovative user experiences to data-driven solutions.Key ResponsibilitiesLead the...

  • Data Product Specialist

    3 days ago

    Horsham, West Sussex, United Kingdom Terry Parris Associates Full time

    **About the Role**We are seeking a talented Senior Data Product Engineer to join our team at Terry Parris Associates.The successful candidate will be responsible for developing and maintaining advanced data products that enable our clients to decarbonize at scale and pace. Our technology includes cutting-edge power generation and alternative energy...

  • Data Solutions Engineer

    2 days ago

    Horsham, West Sussex, United Kingdom Fortice Full time

    Company Overview: Fortice is a leading consultancy in the digital and software services environment, seeking a Data Solutions Architect to drive transformative data strategies in the Defence and Government sectors.This role plays a key part in delivering data-driven solutions for clients using both internal and commercial products. Reporting to the Technical...

  • Senior Data Analyst Position

    3 days ago

    Horsham, West Sussex, United Kingdom Randstad Education Full time

    At Randstad Education, we're seeking a talented Senior Data Analyst to join our team.Job SummaryThe ideal candidate will possess strong problem-solving skills, proficiency in JavaScript and Python, and experience with data analysis and machine learning. The successful applicant will be responsible for data preprocessing, feature engineering, and model...

  • Senior Data Solutions Architect

    4 weeks ago

    Horsham, West Sussex, United Kingdom DiverseJobsMatter Full time

    Job Title: Principal Data and Digital EngineerDiverseJobsMatter is seeking a Principal Data and Digital Engineer to lead the delivery of transformative solutions for our clients.Key Responsibilities:Design and implement scalable data pipelines handling high-volume, high-velocity data in complex SaaS environments.Develop efficient data models in multiple...

  • Senior Test Planning and Data Analyst

    4 weeks ago

    Horsham, West Sussex, United Kingdom Terry Parris Associates Full time

    Test Planning and Data Analysis SpecialistWe are seeking a highly skilled Test Planning and Data Analysis Specialist to join our team at Terry Parris Associates.About the Role:The successful candidate will be responsible for meticulously planning and executing test plans to ensure the smooth operation of our department and improve the overall efficiency of...

  • Data Insights Manager

    1 hour ago

    Horsham, West Sussex, United Kingdom Michael Page Careers Full time

    About the OpportunityWe are seeking an experienced Data Insights Manager to join our team as FP&A Manager. This role will play a critical part in driving financial performance through data-driven insights and financial modelling.Key Responsibilities:Develop and maintain comprehensive financial models to inform business decisions.Lead the development of...

  • Financial Data Analyst

    16 hours ago

    Horsham, West Sussex, United Kingdom Michael Page Full time

    Drive Business Success with Data-Driven InsightsAs a key member of our team, you will play a crucial role in driving financial performance through data-driven insights and financial modelling. Our ideal candidate will have a strong background in FP&A, with experience in developing dashboards, analysing profit, and driving key decisions using BI and...

  • Junior /Mid Data Engineer

    3 weeks ago

    Burgess Hill, UK, West Sussex, United Kingdom iO Associates - UKEU Full time

    Junior/Mid Data Engineer - Exciting Opportunity in Burgess HillAre you passionate about data optimization and analytics? Join My client as a Data Engineer, where you'll design and maintain data pipelines, enhance data quality, and drive business insights. This role involves working with cross-functional teams to automate processes, support data science...

  • Data-Driven Decision Maker

    3 days ago

    Horsham, West Sussex, United Kingdom Michael Page - Client Branded Full time

    About the RoleWe are seeking a highly skilled Financial Strategist to join our team. This is a key role that will drive financial performance through data-driven insights and financial modelling.As a Financial Strategist, you will be responsible for developing dashboards, analysing profit, and driving key decisions using Business Intelligence and Alteryx...

  • Data Engineer

    3 weeks ago

    Birmingham, UK, West Midlands, United Kingdom Clearwater People Solutions Ltd Full time

    Job Title: Azure Data Engineer (Databricks & Data Lakehouse Specialist) Location: Fully Remote Employment Type: Permanent, Full-TimeAre you a data-driven professional with a passion for building and optimising cloud-based data solutions? Do you have a knack for designing seamless ETL processes and working with Azure’s cutting-edge data tools? Join us as an...

  • Senior Quality Assurance Engineer

    3 days ago

    Horsham, West Sussex, United Kingdom Terry Parris Associates Full time

    Senior Test Engineer Role SummaryWe are seeking an experienced Senior Test Engineer to join our team at Terry Parris Associates. The successful candidate will be responsible for developing and executing comprehensive test plans, collaborating with cross-functional teams, and analyzing test data to drive improvements.Key Accountabilities:* Develop and execute...

  • Systems Engineering Specialist

    6 days ago

    Horsham, West Sussex, United Kingdom Terry Parris Associates Full time

    Join Our Team - Senior Systems EngineerTerry Parris Associates is seeking a highly skilled Senior Systems Engineer to work in our Horsham office.We are offering a competitive salary range of $110,000 - $150,000 per annum, depending on experience, plus a comprehensive benefits package including life insurance, healthcare cash plan, 25 days annual leave, share...

  • Principal Systems Engineer

    6 days ago

    Horsham, West Sussex, United Kingdom Terry Parris Associates Full time

    Systems Engineer OpportunityBased in Horsham, we are seeking a talented Systems Engineer to join our team at Terry Parris Associates.We offer a competitive salary range of $100,000 - $140,000 per annum, depending on experience, plus a comprehensive benefits package including life insurance, healthcare cash plan, 25 days annual leave, share save scheme, and...

  • Data Engineer

    7 months ago

    Birmingham, UK, West Midlands, United Kingdom BJSS Full time

    About UsWe’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day.In the last 30 years we won several awards,...

  • Senior Systems Development Engineer

    5 days ago

    Horsham, West Sussex, United Kingdom Terry Parris Associates Full time

    Systems Engineer Position AvailableHorsham-based Terry Parris Associates is looking for a skilled Systems Engineer to work in our team.Our competitive salary range is $90,000 - $130,000 per annum, depending on experience, plus a comprehensive benefits package including life insurance, healthcare cash plan, 25 days annual leave, share save scheme, and pension...

  • Data Engineer

    3 hours ago

    Warwickshire, UK, West Midlands, United Kingdom WSS Associates Full time

    Our client an exceptional start-up are looking for a Data Engineer to join their team on a permanent basis. The role will require 3 days per week onsite. The role:The role of the Data Engineer is to deliver data products supporting a wide range of business demands. Working with the Data Architect, the data engineer will be responsible for the implementation...

  • Senior Data Engineer

    3 weeks ago

    Leeds, UK, West Yorkshire, United Kingdom Fruition IT Full time

    Job Title: Senior Data Engineer Location: Leeds, on-site 2x per week Salary: £65,000 Why Apply? Our client is looking for a talented Data Engineer to play a key role in their ongoing digital transformation. This full-time, permanent position offers the chance to develop the initial data strategy, design scalable pipelines, and create a data lake that will...

  • Cell Production Engineer

    3 days ago

    Horsham, West Sussex, United Kingdom Terry Parris Associates Careers Full time

    About the Role:This is an exciting opportunity for a Cell Manufacturing Engineer to join our team at Terry Parris Associates Careers. As a key member of our production team, you will be responsible for supporting and developing current cell manufacturing processes and equipment.The successful candidate will have a strong background in manufacturing...

  • Advanced Power Generation Engineer

    3 days ago

    Horsham, West Sussex, United Kingdom Terry Parris Associates Full time

    Key ResponsibilitiesAs a Senior Analytical Design Engineer at Terry Parris Associates, your primary focus will be on designing and developing energy systems that meet the needs of our clients.You will analyze complex data, identify areas for improvement, and implement innovative solutions to optimize system performance.Your contributions will directly impact...