Data Pipeline Architect

2 weeks ago


Birmingham, Birmingham, United Kingdom Clearwater People Solutions Ltd Full time
Data Engineering Position Summary

We are seeking an experienced Data Engineer to join our team at Clearwater People Solutions Ltd. In this role, you will design and develop data pipelines using Azure Databricks and Azure Data Factory, ensuring data quality and governance standards are met. With a focus on scalability and performance, you will work closely with data analysts and scientists to deliver actionable insights.

Key Responsibilities:
- Create and maintain ETL/ELT pipelines to ingest, cleanse, and transform data from multiple sources using Azure Databricks and Azure Data Factory.
- Develop and optimize the data lakehouse environment on Azure for analytics, supporting both structured and unstructured data.
- Ensure data quality and governance standards are met, implementing data validation techniques and security standards within cloud environments.

Requirements:
- Proficiency in Azure Databricks, Azure Data Factory, and Delta Lake.
- Experience with ETL/ELT workflows, Python, SQL, and Spark SQL.
- Direct experience with AWS to Azure data migrations, including data replication and re-platforming strategies.
- Strong understanding of data quality and governance principles.

  • Birmingham, Birmingham, United Kingdom Annapurna Full time

    Are you a skilled data engineer looking to lead the design and implementation of complex data pipelines? We are seeking a Senior Data Engineer Leader to join our team at Annapurna, where you will be responsible for building and maintaining our Data Warehouse.About the RoleDesign and Implement Data Pipelines: You will design and implement data pipelines that...


  • Birmingham, Birmingham, United Kingdom Annapurna Full time

    About AnnapurnaAnnapurna is a pioneering company that leverages data intelligence to transform the insurance industry. We partner with underwriters to deliver unparalleled insights into insurance pools, focusing on small and medium-sized businesses.Compensation PackageThe estimated annual salary for this role is $150,000 - $200,000, depending on...


  • Birmingham, Birmingham, United Kingdom RedRock Resourcing Full time

    About the RoleWe are seeking a highly skilled Senior Cloud Data Architect to join our team at RedRock Resourcing.This is a permanent opportunity with a competitive salary of £70,000 and flexible working arrangements in Birmingham.As a Senior Cloud Data Architect, you will play a key role in designing and developing data pipelines, integrating data from...


  • Birmingham, Birmingham, United Kingdom Succession Wealth Full time

    Job DescriptionRole Overview:Succession Wealth, a leading Financial Advisory firm, is seeking a highly skilled Data and Systems Architect to join our team. As a key member of our IT department, you will play a crucial role in designing and implementing an enterprise-wide data architecture that aligns with our business needs and objectives.About the Role:This...


  • Birmingham, Birmingham, United Kingdom Succession Wealth Full time

    Job Title: Data Systems ArchitectCompany: Succession WealthJob Type: ContractLocation: Remote/Hybrid UK officesContract Duration: 6 months with potential extensionDay rate: £450 - £500 (DOE)About the Role:Succession Wealth, a leading Financial Advisory firm, is seeking a Data Systems Architect to support the CTO in ensuring the best fit architectural...


  • Birmingham, Birmingham, United Kingdom Change-IT Consulting Ltd Full time

    Job OverviewAn exciting opportunity has arisen for a Senior Azure Data Architect to join Change-IT Consulting Ltd in Birmingham, West Midlands. This is a fantastic chance to work with a fast-growing team and contribute to the company's continued growth and expansion.The successful candidate will have extensive experience in data engineering and cloud-based...


  • Birmingham, Birmingham, United Kingdom itecopeople Full time

    Contract Data Solutions Architect – D365 CE OpportunityWe are seeking an experienced Data Solutions Architect with expertise in Dynamics 365 CE for a high-profile contract opportunity.This 6–12 month interim role offers you the chance to play a pivotal part in the data architecture strategy and execution for a critical D365 CE implementation...


  • Birmingham, Birmingham, United Kingdom Opencast Full time

    Opencast is seeking an experienced Senior Data Solutions Architect to join their team. As a key member of our data engineering team, you will play a vital role in designing and developing innovative data solutions for our clients. Salary:We offer a highly competitive salary of £60,000 - £78,000 per annum, depending on experience. About the Role:You will be...


  • Birmingham, Birmingham, United Kingdom Annapurna Full time

    Join us at Annapurna as a Data Pipeline Architect and play a key role in shaping our data infrastructure. As a seasoned data engineer, you'll design and implement complex data pipelines that ensure data quality and integrity.About the RoleDesign and Implement Data Pipelines: You will design and implement data pipelines that ensure data quality and...

  • Data Architect

    2 weeks ago


    Birmingham, Birmingham, United Kingdom Cyber Crime Full time

    Data Consultant OpportunityKerv, a £112m revenue technology consultancy leader, is seeking a technical lead to join our Data practice. With a data consultancy / Azure background and experience in leading client projects, you will be responsible for identifying through workshops, elaborating user stories, and refining to an engineer-friendly technical...


  • Birmingham, Birmingham, United Kingdom BJSS Full time

    About UsWe're a forward-thinking tech consultancy, renowned for our innovative approach to solving complex technology problems. With a strong focus on sustainable solutions, we've been delivering cutting-edge technology to leading organisations since 1993.Our team of creative problem solvers has won numerous awards, including a prestigious Queen's Award for...

  • Cloud Data Architect

    2 weeks ago


    Birmingham, Birmingham, United Kingdom 83zero Limited Full time

    About 83zero LimitedWe are a leading global IT consultancy with a strong presence in the digital and data transformation space.Our team is dedicated to helping clients across multiple industries drive growth and development through the latest cloud platforms, including Microsoft Azure.Job DescriptionWe are seeking an experienced Microsoft Azure Data Solution...


  • Birmingham, Birmingham, United Kingdom ENGINEERINGUK Full time

    EngineeringUK is seeking an exceptional Chief Data Architect to play a pivotal role in transforming the coverage and interoperability of our workforce analytics. As a key member of the People Analytics team, you will lead the implementation and prioritization of critical HR data and analytics products. This role requires strong analytical skills, experience...

  • Data Architect

    6 days ago


    Birmingham, Birmingham, United Kingdom Distributed Full time

    We are a Distributed company, and this role involves designing and architecting Elasticsearch solutions for large-scale data processing. This is an exciting opportunity to work with a leading telecoms organisation, enhancing efficiency and speed while processing 90TB of data daily.Design and architect Elasticsearch solutions tailored to the client's...


  • Birmingham, Birmingham, United Kingdom Dabster Full time

    About the RoleWe are seeking a highly skilled Senior Data Model Architect to join our team at Dabster. As a key member of our technology department, you will be responsible for designing and implementing data models that drive business value and support our growth.With a strong background in software engineering, data modeling, and business intelligence, you...


  • Birmingham, Birmingham, United Kingdom Sidetrade Full time

    Company OverviewSidetrade is a fast-growing international software company that is transforming the Order-to-Cash process for global enterprises. Its AI-powered SaaS platform digitizes the financial customer journey, empowering CFOs to secure and accelerate cash flow generation.We are seeking a passionate and knowledgeable Data Engineer with a multifaceted...

  • Data Architect Lead

    3 weeks ago


    Birmingham, Birmingham, United Kingdom Bjss Full time

    Company OverviewBjss is an award-winning innovative tech consultancy that has been solving complex technology problems for leading organisations since 1993. Our team of creative problem solvers operates from multiple locations across the world, bringing together diverse experts with a collaborative and open culture.About the RoleWe work with clients across...


  • Birmingham, Birmingham, United Kingdom Goldman Sachs Full time

    Wealth Client Onboarding ExpertGoldman Sachs is a dynamic organization that empowers individuals to turn data into action. As a Wealth Management Architect, you will be part of a team that builds scalable software and systems to drive business growth.About the RoleOur team is responsible for delivering cutting-edge data platforms and services. We are seeking...

  • Data Governance Lead

    2 weeks ago


    Birmingham, Birmingham, United Kingdom Succession Wealth Full time

    About the RoleWe are seeking a highly skilled Data and Systems Architect to join our team at Succession Wealth, a leading Financial Advisory firm.As a key member of our IT department, you will play a crucial role in designing and implementing an enterprise-wide data architecture that aligns with our business needs and objectives.This 6-month contract...


  • Birmingham, Birmingham, United Kingdom PeoplePlus Full time

    Company OverviewPeoplePlus is a leading provider of funded training courses and employment support services. With a strong commitment to innovation and quality, the company has established itself as a trusted partner in delivering high-quality services to learners.Salary and BenefitsThe estimated salary for this role is £65,000 - £80,000 per annum,...