Senior Data Engineer

hackajob is collaborating with Envitia to connect them with exceptional tech professionals for this role.Be Part of Something RealA close-knit team with big ideas.A passion for solving complex data challenges.A leading technology company specialising in data intelligence, AI and geospatial solutions.At Envitia, we are building something special.By using the power of data to tackle real-world challenges, our teams empower organisations to make smarter, data-driven decisions.We're thrilled to announce that Envitia has been named one of the Sunday Times Top 100 Medium-Sized Companies to Work For in 2025—a prestigious recognition that highlights our commitment to creating an outstanding workplace where innovation, collaboration, and personal growth thrive.Here's What You'll Get Stuck IntoInfluencing major digital and data transformation projects across the UK public sector.Building and utilising smart, AI-powered tools that support real decision making.Using tech to make a genuine difference in societyAfter growing 25% in 2024, we've got bold plans for 2025 and we're looking for brilliant, curious minds to help make them happen.About The TeamYou'll be joining a fresh team of Data Engineers and Consultants passionate about enabling digital success. Using cutting-edge data engineering and innovation tools, they build the platforms and capabilities that help organisations scale and innovate fast. This team is a powerhouse within our Consulting division, playing a hands-on role in shaping what modern, data-enabled organisations look like. If you're excited by the power to drive change, this is the team for you.The RoleAs a Senior / Principal Data Engineer, you will play a key leadership role in shaping and delivering advanced data-driven solutions for our clients. You will lead the delivery of tailored solutions to our clients, responsible for the design, delivery, and implementation of solutions spanning end-user interfaces and innovative user experience to data-driven solutions.Working within our Consulting division, you will be a key contributor to the development of our emerging capability framework. You will lead the end-to-end delivery of data and digital solutions of varying scale and complexity across multiple technical domains, including modern Data Engineering and pipelining, Analytics and Visualisation, Digital Twins, Simulation, and Asset/Data Management.You will bring deep hands-on expertise in contemporary data engineering practices, alongside strong proficiency in modern programming languages, cloud-native tooling, and commercial off-the-shelf technologies across both cloud and on-prem environments.Job ResponsibilitiesBuild, optimise, and maintain scalable data pipelines that handle high-volume, high-velocity data in complex SaaS environments.Design efficient, scalable, and flexible data models in multiple technologies to meet business requirements.Analyse and consolidate business requirements and use cases to meet technical and non-technical debt. Design tailored and bespoke solutions to address and mitigate challenges faced by our clients.Make key decisions on build vs buy for data and digital engineering solutions and platforms.Work closely with the entire business far beyond just product or technology, including driving innovation through concept demonstrators and offerings and support the sales activities, from a pre-sales perspective.Carry out horizon scanning to identify emerging technology and industry trends and assess their potential impact and opportunity to become Envitia offerings to the market.Required Skills & ExperienceData Engineering ExpertiseProficiency in one or more core data languages and technologies, such as SQL, Scala, Python, R, PySpark, and Elasticsearch.Proven experience designing, building, and maintaining robust data pipelines using AWS, Azure, and/or open-source frameworks including Spark, Beam, and Airflow.Hands-on experience with real-time data streaming technologies (e.g., Kafka, Pub/Sub).Strong background in data quality and validation practices, including defining metrics/KPIs and implementing automated quality controls.Ability to design, build, and optimise scalable data models that support analytics and machine learning workloads.Solid working knowledge of AWS data services (e.g., S3, Kinesis, Glue, Redshift, Lambda, EMR) or Azure equivalents (e.g., ADF, Synapse, Fabric, Azure Functions).Experience working within Data Lakehouse platforms such as Databricks, Snowflake, and/or Microsoft Fabric is an advantage.Core CompetenciesPractical understanding of at least one major cloud provider (AWS or Azure).Strong analytical and problem-solving skills with a keen eye for detail and a drive to deliver business value through data.Excellent communication skills, with the ability to convey technical concepts to non-technical audiences.Demonstrated ability to collaborate effectively within distributed or remote teams.A willingness to mentor and support colleagues in their professional development.Security Clearance RequirementsThe successful candidate must hold or be required to go through an SC security clearance.LocationThe role will require travel to our Horsham offices 2 days a month and travel to customer sites when required.