Data Engineering Lead for Complex Data Environments
1 month ago
About Michael Page (UK)
Leading UK Logistics Company is seeking a Senior Data Engineer to play a pivotal role in leading the design, development, and maintenance of robust data pipelines and infrastructure within their Microsoft Azure environment.
Your expertise will ensure the availability, reliability, and scalability of their data platform, empowering the organisation with timely and accurate information to recognise the value of their data.
You will collaborate with the Data Science and Analytics teams to implement data models, create data integration pipelines, and optimise data workflows. This role requires a strong background in data engineering, with a solid understanding of data management principles and techniques.
You will support the development of junior data engineers, providing guidance and mentorship to help them build their skills.
This is a 12-month Fixed Term Contract/Fully remote position.
- Lead the support of the Strategic Data Platform (SDP), ensuring it is robust, reliable, and cost-effective in providing high-quality data.
- Design, develop, and uphold data integration processes, including the creation and execution of scalable and effective data pipelines for managing and transforming large datasets.
- Optimise data storage and retrieval processes to meet performance and scalability requirements.
- Ensure data quality and consistency by implementing data validation and cleansing techniques.
- Collaborate with stakeholders to define requirements and integrate new data sources.
- Monitor and troubleshoot data pipeline issues, identify and resolve bottlenecks, and implement performance optimisations.
- Collaborate with the Business Intelligence (BI) team to define and implement data models for analysis and reporting purposes.
- Maintain best practices, governance, and security in data projects.
- Stay up-to-date with the latest trends and technologies in the field of data engineering, and make recommendations for improvement.
- Provide guidance and mentorship to junior data engineers, supporting their development and skill-building;
- Lead the technical aspects of our data strategy, ensuring alignment with organisational goals and objectives.
Estimated Salary: £70,000 - £90,000 per annum
Experience, Skills, and Attributes:
- Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field (or equivalent experience).
- Strong programming skills in Python, Java, or Scala, with proficiency in database management systems and excellent SQL skills.
- Proven experience in designing and implementing data pipelines, ETL processes, data warehousing, and scaled data consumption patterns.
- Knowledge of data integration, data modelling concepts, and familiarity with cloud data platforms and storage technologies, ideally within Azure.
- Proficient in Azure data services (e.g., Synapse Analytics, SQL, Data Factory, Data Lake, Databricks, Cosmos DB) - Synapse and Databricks is essential.
- Experience in Agile development, branch-based source control/DevOps concepts, and gathering and analysing system requirements.
- Attention to detail and a commitment to delivering high-quality work.
- Azure Data Engineer Associate/DP-203 certification or equivalent practical experience preferred.
- Aptitude for learning new technologies and analytical methodologies, with experience in data visualisation tools (e.g., Power BI) and familiarity with machine learning/statistical analysis techniques being a plus.
-
Technical Lead
4 days ago
Birmingham, Birmingham, United Kingdom Michael Page Technology - Department for Transport Full timeAt Michael Page Technology - Department for Transport, we are seeking an exceptional Technical Lead - Cloud and Data to join our growing team of experts in digital transformation.About the RoleThis exciting opportunity offers a chance to lead the development of innovative cloud-based solutions that support our transport policies.You will work closely with...
-
Data Engineer Lead Position
2 weeks ago
Birmingham, Birmingham, United Kingdom Kainos Full timeData Engineering Opportunities at KainosWe are excited to offer a challenging role as a Data Engineer at Kainos. In this position, you will have the opportunity to work on complex data systems, collaborating with cross-functional teams to design and develop cutting-edge solutions.About Us:Kainos is a global company that values diversity, equity, and...
-
Data Engineering Lead for Complex Projects
2 weeks ago
Birmingham, Birmingham, United Kingdom Your Remote Tech Recruiter Full timeYour Remote Tech Recruiter has established a partnership with a Digital Consultancy supporting a leading global organisation's digital transformation initiatives.About the OrganisationThis global player operates across the US, UK, Europe and Asia, offering a wide range of digital services to various industries.The company boasts a supportive culture,...
-
Technical Data Governance Lead
2 weeks ago
Birmingham, Birmingham, United Kingdom Intec Select Full timeAbout the JobWe are seeking an experienced Technical Data Governance Lead to join our team at Intec Select. As a key member of our digital engineering department, you will play a critical role in ensuring the accuracy and integrity of our technical data.About the RoleThe successful candidate will be responsible for managing technical information within...
-
Data Scientist Lead
5 days ago
Birmingham, Birmingham, United Kingdom Society of Research Software Engineering Full time**Company Overview:**Society of Research Software Engineering is a leading institution in research software engineering, dedicated to advancing knowledge and innovation through collaborative research projects.We are seeking experienced professionals to fill two key roles: Senior Research Data Scientist and Senior Research Data Scientist & Manager. The ideal...
-
Senior Data Engineering Lead
2 weeks ago
Birmingham, Birmingham, United Kingdom CV-Library Full timeAbout the JobCandidates for this position should have expertise in SQL, data modelling, and performance optimisation, as well as experience working in an Agile environment.This Senior Data Engineer role offers an excellent opportunity to contribute to CV-Library's technical initiatives and drive process improvements.We expect the salary range for this...
-
Lead Data Engineer for Analytics
1 month ago
Birmingham, Birmingham, United Kingdom Annapurna Full timeAbout AnnapurnaAnnapurna is a leading provider of data intelligence solutions for the insurance industry. We empower underwriters to serve insureds more effectively by delivering actionable insights from granular policy data.Role OverviewWe seek an experienced Senior Data Engineer to design, implement, and maintain data pipelines and models that ensure...
-
Data Engineer Lead
1 week ago
Birmingham, Birmingham, United Kingdom Harnham Full timeJob OverviewWe are seeking a highly skilled Senior Data Engineer to join our team at Harnham. As a key member of our data engineering department, you will play a crucial role in modernising our existing data infrastructure.This is an exciting opportunity to work with a global organisation that leads a digital platform supporting property buying and selling....
-
Data Engineer Lead
1 week ago
Birmingham, Birmingham, United Kingdom Kainos Full timeAbout the RoleAs a Senior Data Engineer at Kainos, you will be responsible for designing and developing data processing and data persistence software components for solutions that handle large amounts of data.You will work in agile teams to provide strong development leadership and take responsibility for significant technical components of data systems....
-
Senior Data Engineer
1 day ago
Birmingham, Birmingham, United Kingdom Kainos Full timeAbout the RoleThis Senior Data Engineer position is a key part of our team's efforts to deliver large-scale data processing solutions using Big Data technologies. The successful candidate will work closely with Architects and Lead Engineers to ensure that software supports non-functional needs and collaborate with colleagues to resolve implementation...
-
Data Scientist Lead
2 weeks ago
Birmingham, Birmingham, United Kingdom Society of Research Software Engineering Full timeWe are pleased to announce the recruitment of a Senior Data Research Scientist for our Research Software Group.Come and work on innovative research projects at our world-class university. The successful candidate will be responsible for joining our existing team as a Senior Research Data Scientist, or providing line management for the team and coordinating...
-
Data Engineering Team Lead
2 weeks ago
Birmingham, Birmingham, United Kingdom CV-Library Full timeVIQU Energy Limited requires a highly skilled Senior Data Engineer to design, build, and maintain scalable data solutions. As a key member of the team, you will lead data integration processes, mentor junior engineers, and drive technical initiatives forward.Key ResponsibilitiesDesign and develop data warehouses and lakes to support business intelligence and...
-
Cloud Data Engineering Lead
2 weeks ago
Birmingham, Birmingham, United Kingdom Kainos Full timeAbout the RoleWe are seeking a highly experienced Principal Architect for Data & AI to join our team at Kainos. This is an outstanding opportunity to lead the delivery of advanced data and AI solutions across multiple customers.The ideal candidate will have a broad understanding of current and emerging data and AI technologies, with the ability to...
-
Water Environment Specialist
4 days ago
Birmingham, Birmingham, United Kingdom Perpetual Engineering Full timeCompany Overview: Perpetual Engineering is a leading organization that specializes in various sectors including water, environment, infrastructure, resource management, defence, energy, and international development. Our team of experts works collaboratively to find innovative solutions to complex problems.Salary: The estimated annual salary for this...
-
Data Platform Engineer
2 weeks ago
Birmingham, Birmingham, United Kingdom Harnham Full timeData Platform EngineerWe are seeking a talented Data Platform Engineer to join our team at Harnham. As a key member of our data team, you will be responsible for designing, building, and maintaining complex databases to support business growth and decision-making.Key Responsibilities:Design and develop databases to meet business requirements, ensuring...
-
Data Engineering Leader
1 week ago
Birmingham, Birmingham, United Kingdom 83zero Limited Full time £75,000 - £85,000Job TitleData Engineering Leader83zero Limited is a cutting-edge technology company that offers innovative solutions in customer experience. We are looking for a highly skilled Data Engineering Leader to take charge of our data architecture initiatives and drive business growth through data-driven insights.**About the Role:** As a Data Engineering Leader,...
-
Data Architect Lead
2 weeks ago
Birmingham, Birmingham, United Kingdom Aubay UK Full time**About the Role**We are seeking a highly experienced Data Architect Lead to join our team at Aubay UK. As part of a transformational journey, you will shape the data architecture landscape to meet evolving business needs.In this pivotal role, you will lead the design of large-scale data solutions, ensuring alignment with business objectives and regulatory...
-
Data Engineering Lead
1 month ago
Birmingham, Birmingham, United Kingdom 83zero Limited Full timeAbout our companyWe're a global IT consultancy that specialises in delivering data-driven solutions using Microsoft Azure.Our team is passionate about helping clients across multiple industries drive growth and development through the latest cloud platforms.Job SummaryWe're seeking an experienced Microsoft Azure Data Solution Architect to join our team. As a...
-
Senior Data Engineering Lead
2 weeks ago
Birmingham, Birmingham, United Kingdom Kainos Full timeData Engineering Leadership OpportunityEstimated salary: $140,000 - $170,000 per annum.Kainos is a high-growth IT services company providing digital technology solutions and agile software development to enterprise customers. We are seeking an experienced Lead Data Engineer to join our team.The role will involve leading the design and development of data...
-
Cloud Data Engineer
1 day ago
Birmingham, Birmingham, United Kingdom BJSS Full timeTransforming Businesses through Data InnovationWe are an award-winning tech consultancy that empowers organizations to harness the power of data. As a leader in innovative solutions, we've been finding better ways to solve complex technology problems since 1993. Our expertise spans multiple industries, and we're committed to delivering world-class...