Senior Data Engineer

Collinson Haywards Heath, England, United KingdomSenior Data Engineer – CollinsonThe Data Engineering Team is responsible for maintaining and enhancing the data platform to deliver business value to both internal and external stakeholders.As a Data Engineer you’ll be a key member of this team which delivers functionality using the Agile delivery methodology. You will be responsible for designing, building, and maintaining data pipelines under the guidance of a Principal Software Engineer to the agreed development plan and approved specifications.You will have the opportunity to bring innovation to the team, using cutting‑edge data engineering frameworks and techniques.Key ResponsibilitiesDesign, develop, and maintain data pipelines for collecting, transforming, and loading data into various data storesWrite efficient and scalable code in languages such as PythonDevelop collaborative relationships with internal stakeholders to understand their data requirements and provide solutionsResolve day‑to‑day challenges or issues without the need for technical guidanceProvide competent, proactive, and professional technical support when requiredDeliver supporting documentation of a high qualityActively engage in and contribute to agile planning and design sessionsSupport agile process improvements that will improve productivity, effectiveness, and professionalism of the team, without impacting budgets and delivery plansContribute to the Code Peer Review community to improve the quality of code produced and ensure it adheres to our standardsParticipate in regular team meetings to ensure the correct tasks are being worked on and share key decisions required, risks identified and highlight any issues encounteredSupport, develop and improve our CI/CD pipelinesMaintain a good technical awareness and familiarity with new and forthcoming relevant technologiesKnowledge, skills and experienceRequired:University Degree in computer science, engineering, or related experienceAt least 5 years’ experience in a Data Engineering role or with similar technical systems and technologiesExperience with Scrum, Kanban, or another Agile application development methodologyExperience of working across multiple delivery organisations practising distributed developmentSpecific Technical SkillsIn-depth understanding of modern data architectures and data modelling practicesStrong programming skills in Python, PySparkExtensive experience with AWS Technologies (Aurora, Glue, Lambda, Step Functions, S3, API Gateway, SQS, SNS, Athena)Familiarity with CI/CD for data pipelines using Terraform, CodeBuild and FlywayUsage of Source Control tools (GitHub Enterprise)Personal SkillsThe ability to demonstrate through examples, the effective management of stakeholder relationshipsExcellent written and spoken EnglishPersonable, enthusiastic and a good communicator (ability to present, inform and guide others)Ability to bridge communications between technical and business focussed groupsPassionate about technology – willingness to learn about new and emerging technology within web, cloud, languages, frameworks, and methodologiesAbility to thrive in a fast moving and changing environmentAbility to show initiative and to work independentlyWillingness to take on a variety of roles and responsibilitiesCollinson is an equal opportunity employer and welcomes differences in all their forms including colour, race, ethnicity, gender identity, sexual orientation, neurodivergence, family status, age, individuals with disabilities and people from all backgrounds, cultures and experiences as we strongly believe this contributes to our on‑going success.We are focused on continually evolving our purpose driven, high performing culture, providing an environment where our people have the opportunity to achieve their full potential and do interesting and meaningful work. Our company values are: Take Action, Do the right thing, One team and Be insight led. These help guide everything we do internally in terms of how we think, act and interact, right through to how we deliver value to our customers and clients.In your application, please feel free to note which pronouns you use (e.g., she/her/hers, he/him/his, they/them/theirs, etc).If you need any extra support throughout the interview process, please email us at ukrecruitment@collinsongroup.com #J-18808-Ljbffr