Azure Data Engineer
3 days ago
£55,000 (+ bonus opportunity, up to 10%)
Full Time - Permanent
Hybrid Working - 1 day in office every 1 - 2 weeks (Derby)
The Client
The client has been at the heart of the UK rail network for three decades and owns around a quarter of the national passenger rail fleet.
They mobilise private finance to drive rail growth through tailored leasing solutions, industry leading innovations and essential network projects that deliver a safe, efficient and sustainable railway.
Their mission is to provide high-quality, digitally enabled rolling stock solutions that help deliver a safe, efficient and sustainable railway. We take an industry-leading approach, driven by innovative thinking and future planning.
About the team
The successful candidate will be joining the Fleet function, a small multi-disciplinary team that supports corporate and project governance, risk management and audits of Train Operating Companies, suppliers and internal processes. The team is part of the Operations Directorate reporting to the Chief Operating Officer
Responsibilities
This role will support the delivery and development of the client's Digital Portfolio. Taking advantage of the client's unified data platform and working with the team you would have overall responsibility for managing and maintaining existing data pipelines, monitoring of workloads, root cause analysis, data quality monitoring and escalation of technical issues to Product Owner
* Monitoring and recovery of Azure Data Factory and Databricks jobs
* Proactive monitoring of data quality
* Becoming a subject matter expert on understanding client's data sources, ingestion methods and data quality levels
* Assisting in developing and adhering to associated data governance policies and internal processes
* Working closely with the wider team to understand the business needs and improve data quality
* Develop and maintain digital services data quality KPIs
* Maintaining and monitoring of user facing dashboards and other internal Digital products
* Updating and patching of existing Digital software products
* Documenting root cause analysis outputs
* Skills, Knowledge and Expertise
Role Requirements
* Microsoft Azure Experience (essential)
* Knowledge of Azure data components such as Azure Data Factory, Azure SQL DB, Azure Data Lake, etc
* Strong Python and SQL skills for manipulating data
* Apache Spark and/or Databricks experience
* Experience using BI visualisation tools, such as Power BI
* Experience in managing end-to-end analytics pipelines (batch and streaming) suitable for data science workload consumption
* Experience in root-cause analysis and post-incident reporting in a production environment
Knowledge and Qualifications
* A relevant degree in Computer Science, Engineering, and/or relevant certificates including, Azure Data Engineer Associate are desirable
* Knowledge of railway industry rolling stock, organisation and players
* Data ingestion methods for real-time and batch ingestion
* PySpark
* Debugging Apache Spark workloads
* Experience using BI visualisation tools, such as Power BI
Key Skills
* Interpersonal skills
* Report writing, presentation and record keeping skills
* Excellent communication and stakeholder management
* A great place to work
* We are seeking the very best talent to join the team, and offer an excellent salary, along with bonus and benefits
This is a fantastic opportunity to join a great organisation with excellent people and a road map for the future to grow and develop the business. Some of our benefits are listed below:
* Excellent pension scheme
* Financial wellbeing support
* Flexible working
* Enhanced family friendly policies
* Adoption & Shared Parental Leave benefits
* Enhanced Armed Forces policies
* Ongoing support with professional and personal development
* Long service awards
* Life assurance
* Healthcare cash plan
* 25 days' annual leave + Bank Holidays + option to buy and sell up to 5 days' additional leave
* Additional days annual leave for long service
* Season ticket loan
* Cycle to work scheme
-
Data Engineering Expert
1 week ago
Derby, Derby, United Kingdom Expleo Full timeJob Description:Data Engineering Expert - Azure DeveloperWe are seeking an experienced Data Engineering Expert to join our team as an Azure Developer. The ideal candidate will have a strong background in designing, developing, and implementing data pipelines using Python and other Azure services.Key Responsibilities:Design, develop, and implement scalable...
-
Python Data Engineer
2 months ago
Derby, United Kingdom CV-Library Full timeOverview Expleo is a trusted partner for end-to-end, integrated engineering, quality services and management consulting for digital transformation. We help businesses harness unrelenting technological change to successfully deliver innovations that will help them gain a competitive advantage and improve the everyday lives of people around the globe. We...
-
Python Data Engineer
4 weeks ago
Derby, United Kingdom Expleo Engineering UK Limited Full timeOverviewExpleo is a trusted partner for end-to-end, integrated engineering, quality services and management consulting for digital transformation. We help businesses harness unrelenting technological change to successfully deliver innovations that will help them gain a competitive advantage and improve the everyday lives of people around the globe. We are...
-
Python Data Engineer
2 months ago
Derby, United Kingdom Expleo Full timeResponsibilities Design, develop, and implement Python and other Azure services. Build and manage data pipelines to extract, transform, and load data into Azure data warehouses. Develop and deploy machine learning models to predict customer behavior and optimize business processes. Work with other engineers and data scientists to build and maintain...
-
Azure Data Solutions Architect
1 week ago
Derby, Derby, United Kingdom Blue Tree Group Full timeAbout the RoleThis is an exciting opportunity for a talented Data Pipeline Specialist to join our Blue Tree Group team in Derby. The role involves proactively monitoring data quality, understanding data sources, and developing data governance policies.Key responsibilities include:Monitoring and recovering Azure Data Factory and Databricks jobsManaging...
-
Cloud Data Engineer
7 days ago
Derby, Derby, United Kingdom Blue Tree Group Full timeJob OverviewWe are seeking a skilled Cloud Data Engineer to join our team in Derby. The successful candidate will be responsible for designing and implementing efficient data pipelines, ensuring the reliability of data quality monitoring.The ideal candidate will have experience with Microsoft Azure, including Azure Data Factory and Databricks. Strong skills...
-
Azure Cloud Platform Engineer
4 weeks ago
Derby, United Kingdom CV-Library Full timeCloud Platform Engineer - £450-£500 per day - Outside IR35 - 3 Months initial contract - Remote. Our client, a global nuclear engineering organisation, is seeking a skilled Azure Cloud Platform Engineer to support the delivery of cloud hosting capabilities by developing and maintaining automation pipelines, scripts, and other artefacts...
-
Senior Data Engineer
4 weeks ago
Derby, Derby, United Kingdom Expleo Group Full timeExpleo Group is a trusted partner for end-to-end, integrated engineering, quality services, and management consulting for digital transformation. Our company helps businesses harness unrelenting technological change to successfully deliver innovations that will help them gain a competitive advantage and improve the everyday lives of people around the...
-
Data Architect
4 weeks ago
Derby, Derby, United Kingdom Expleo Engineering UK Limited Full timeJob OverviewExpleo Engineering UK Limited is a trusted partner for end-to-end, integrated engineering, quality services and management consulting for digital transformation. We help businesses harness unrelenting technological change to successfully deliver innovations that will help them gain a competitive advantage and improve the everyday lives of people...
-
Data Engineer
2 weeks ago
Derby, United Kingdom CV-Library Full timeData Engineer £50k + £6k Car Allowance Remote working 3x days a week Key Responsibilities: * Support project delivery by developing digital tools and processes. * Work with the project team to create and maintain data infrastructure for business intelligence (BI). * Ensure data quality by identifying methods for data extraction,...
-
Azure Infrastructure Specialist
1 week ago
Derby, Derby, United Kingdom Digital Waffle Full timeAs a Senior Azure DevOps Engineer at Digital Waffle, you will play a critical role in designing, implementing, and maintaining our cloud infrastructure and CI/CD pipelines. Your expertise will be essential in automating processes, optimizing performance, and ensuring the reliability and scalability of our applications.Salary: Up to £73,000 per annum (based...
-
Strategic Data Solutions Engineer
2 weeks ago
Derby, Derby, United Kingdom East Midlands Trains Full timeAs a leading transport provider, East Midlands Railway is committed to delivering exceptional services and experiences for its customers.We are currently seeking an experienced Commercial Data Solutions Engineer to join our team in Derby. This exciting opportunity will allow you to play a key role in shaping the future of our data strategy and driving...
-
Data Pipeline Specialist
7 days ago
Derby, Derby, United Kingdom Blue Tree Group Full timeTechnical RequirementsTo succeed in this role, you will need:Microsoft Azure experienceKnowledge of Azure Data Factory, Azure SQL DB, Azure Data Lake, etc.Strong skills in Python and SQL for data manipulationExperience with Apache Spark and DatabricksThe salary for this position is approximately £65,000 per annum, plus up to 10% bonus.
-
Data Engineer
2 months ago
Derby, United Kingdom Mace Full timeAt Mace, our purpose is to redefine the boundaries of ambition. We believe in creating places that are responsible, bringing transformative impact to our people, communities and societies across the globe. To learn more about our purpose, culture, and priorities, visit our Within our consult business, we harness our unique combination of leading-edge...
-
Commercial Data Engineer
6 months ago
Derby, United Kingdom East Midlands Trains Full timeWe are proud to be One Team at East Midlands Railway (EMR). We are passionate about keeping people safe, delighting our customers , doing the right thing and putting customers at the heart of our sustainable railway for the East Midlands. With over 2,600 employees, our people are the reason we are so successful and our Commercial team make a...
-
Microsoft Fabric Data Engineer
2 weeks ago
Derby, United Kingdom Mace Full timeAt Mace, our purpose is to redefine the boundaries of ambition. We believe in creating places that are responsible, bringing transformative impact to our people, communities and societies across the globe. To learn more about our purpose, culture, and priorities, visit our Within our consult business, we harness our unique combination of leading-edge...
-
Data Engineering Specialist
7 days ago
Derby, Derby, United Kingdom ENGINEERINGUK Full timeJob Title: Digital Transformation EngineerLocation: United KingdomWe are seeking a highly skilled Data Engineer to join our team at ENGINEERINGUK. As a Data Maintenance Engineer, you will be responsible for extracting data from source systems, managing credentials, and building integrations with error handling and business logic.The ideal candidate will have...
-
Data Engineer
1 month ago
Derby, Derby, United Kingdom ENGINEERINGUK Full timeJob DescriptionWe are seeking a highly skilled Data Engineer to join our team in a client-facing role. The successful candidate will be responsible for contributing to the development of digital tools, processes, and outputs that support the wider project team and enable effective delivery of projects for our clients.The ideal candidate will have a minimum...
-
Senior Virtualization Engineer
7 days ago
Derby, Derby, United Kingdom PKF Infuse Full timeAt PKF Infuse, we're seeking a highly skilled Senior Virtualization Engineer to join our team in Derby. As a key member of our IT infrastructure team, you'll be responsible for designing and implementing cutting-edge server virtualization solutions using the latest technologies.About the RoleThis is an exciting opportunity for a seasoned engineer with a...
-
Software Development Engineer
7 days ago
Derby, Derby, United Kingdom Rolls-Royce plc Full timeJob DescriptionWe are seeking a talented Software Development Engineer to join our Service Data Analytics Software team, supporting the submarines enterprise by leveraging in-service data to derive insights through data analytics and software implementation.You will have the opportunity to learn how Rolls-Royce Submarines supports the Royal Navy submarine...