Senior Data Engineer

We are recruiting for multiple Senior Data Engineers to join our team working with client business users, Technology Partners and Enterprise Architect, Data Scientists, to develop innovative, efficient solutions which address and add value to the businesschallenges posed. Your input will span the delivery lifecycle, taking a DataOps approach to solution delivery which will leverage your experience of replication/change data capture, data streaming and batch data processing paradigms.

We can offer great career progression opportunities, ability to be based anywhere across the UK, benefits which you can flex to meet your needs and, training and development opportunities.

You will be conversant in translating business requirements into well designed conceptual, logical and physical model data structures and integration pipeline processes as well as performing integrations ensuring a quality outcome is delivered. More specifically,through your data engineering role you will span data life-cycle management encompassing: data quality and enrichment, meta-data management, master data management, data ethics frameworks, analytic algorithms and statistical techniques, orchestration, logging,monitoring and alerting solutions.

**What you will be doing**:

- Liaise with Stakeholders, contributing towards and reviewing business requirements, ensuring utilisation of available technology functionality from the data streaming perspective
- Typically work independently on single or multiple projects or small components (workstreams) of larger projects that are multi-disciplined
- Design, prototype and implement data streaming patterns which transform existing batch pipelines into near-real time contexts
- Understand business processing within heavily regulated environments

**What you’ll bring**:

- Strong Data Engineering experience leveraging ETL/ELT Integration encompassing Data Quality, Data Cleansing and Migration processes
- Demonstrable Data Modelling - Relational and Non-relational
- Strong communication skills both within the technical team and also with client/business resources
- Demonstrable experience spanning various technologies which include Hadoop, Spark, Kafka/Streamsets/Kinesis, SQL and NoSQL databases, AWS and/or Azure cloud services, BI tools e.g. Tableau, MS Power BI etc
- Experience performing root cause investigative analysis on datasets and processes to address business queries and identify opportunities for improvement
- Strong analytical skills related to working with both structured and unstructured datasets
- Build processes supporting data transformation, data structures, metadata, dependency and workload management.

**it would be great if you had**:

- Regulatory processing experience
- Hadoop / SAS / Tableau / Python / Spark
- Experience in a Utilities, Financial Services/Banking environment (preferred)

If you are interested in this role but not sure if your skills and experience are exactly what we’re looking for, please do apply, we’d love to hear from you

**Full time permanent**
**Location** UK wide
**Security Clearance Level**PES4
**Internal Recruiter** Annecia
**Salary** £55,000 to £60,000
**Benefits** - 25 days annual leave with the option to buy additional days, life assurance, pension, and generous flexible benefits fund

**Loved reading about this job and want to know more about our company?**

Our Specialist Private Sector team are experienced in a range of different markets including Banking, Insurance, Retail, Travel, Transport and Utilities. We help our customers develop, deliver and operationalise their digital transformation strategies. Wework in true partnership with our customer, gaining a deep understanding of their business and technology issues.

Our capabilities and credentials across Private Sector markets enable the design, delivery and management of business transformation programmes. We help our clients respond to changing customer demands, keep ahead of the competition, and safeguard theirsystems from evolving business and technology risks.