Senior Data Pipelines Specialist

4 days ago


Manchester, United Kingdom Smart DCC Full time
About the Role

We are seeking a Senior Data Pipelines Specialist to join our Data and Analytics team at Smart DCC in Manchester. In this critical role, you will harness your engineering prowess to enhance data process efficiencies, ensuring data is seamlessly, reliably, and efficiently managed across our analytics platforms.

This is a permanent position with a competitive salary of £75,000 plus benefits. Our ideal candidate will have a solid background in software engineering principles, fluency in programming languages such as Python or Scala, and an adeptness with DevOps tools.

As a Senior Data Pipelines Specialist, you will play a crucial role in constructing and maintaining sophisticated data pipelines that support the organization's data science and analytics ambitions. This includes automating data pipelines, implementing scalable solutions, ensuring data availability and integrity through effective governance, and continuously monitoring, troubleshooting, and optimizing data systems for superior performance.

What You'll Be Doing:

  • Detailed ETL Expertise: Design and implement complex ETL processes to efficiently extract, transform, and load data from disparate sources into target data stores.
  • Streaming Data Processing: Develop real-time data processing pipelines using technologies like Apache Kafka or cloud-native streaming platforms.
  • Batch Processing Optimization: Optimize batch processing workflows using distributed computing frameworks such as Apache Spark or Apache Flink.


  • Manchester, United Kingdom CV-Library Full time

    We're looking for a talented Senior Data Pipeline Developer to join our team at CV-Library.The successful candidate will be responsible for building and maintaining modern, cloud-based data pipelines that deliver high-quality data to our stakeholders. This includes developing and managing data pipelines, databases, and data delivery systems, as well as...


  • Manchester, United Kingdom Qodea Full time

    Senior Big Data EngineerWe're looking for an experienced Senior Big Data Engineer to join our team, offering a $130,000 salary and the opportunity to work on cutting-edge projects using Google Cloud Platform. As a Senior Engineer, you'll lead the design and implementation of large-scale data processing systems.Main Responsibilities:Design, build, and...

  • Senior Data Scientist

    23 hours ago


    Manchester, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Job SummaryThis Senior Machine Learning Engineer role involves designing, developing and deploying ML models and pipelines, as well as maintaining and enhancing existing models.Key AccountabilitiesCollaborate with Data Scientists, ML Engineers and Data Engineers to design, develop and deploy ML models and pipelines.Develop processes to operationalise and...


  • Manchester, United Kingdom Qodea Full time

    **Responsibilities**Design, build, and maintain data pipelines to support data ingestion, ETL, and storage.Build and maintain automated data pipelines to monitor data quality and troubleshoot issues.Implement and maintain databases and data storage solutions.Ensure data quality, accuracy, and completeness.Collaborate with data scientists and analysts to...


  • Manchester, United Kingdom Playtech Full time

    Job Title: Senior Data SpecialistPlaytech is looking for a skilled Senior Data Specialist to join our BI Unit.In this role, you'll design and implement large-scale data processing systems, ensuring data quality and optimizing data processing performance.You'll work closely with data engineers to develop robust data architectures, handle large amounts of...


  • Manchester, United Kingdom Smart DCC Full time

    At Smart DCC, we are looking for a skilled Big Data Pipeline Architect to lead the development of our data pipeline infrastructure. This role comes with a competitive salary of £90,000 plus benefits.The ideal candidate will have expertise in designing and implementing scalable data pipelines that support Smart DCC's data science and analytics ambitions....


  • Manchester, United Kingdom CV-Library Full time

    **Job Summary:** Pipeline Management SpecialistWe are looking for a highly skilled Pipeline Management Specialist to join our team at Kintec Global Recruitment.The successful candidate will be responsible for:Sourcing and evaluating potential suppliers for long-lead itemsProviding technical input into the design and development of the hydrogen pipeline...


  • Manchester, United Kingdom Atmos International Full time

    About the RoleThe Atmos International team is seeking a highly skilled Senior Pipeline Engineer to join their fast-growing technology company.As a Senior Pipeline Engineer, you will be responsible for the whole life cycle of projects, from initial design stages to installation, commissioning, and ongoing support.This exciting opportunity will suit an...

  • MLOps Engineer

    1 month ago


    Manchester, United Kingdom Guidant Global Full time £540 - £690

    About the RoleWe're seeking an MLOps Engineer to work with our client in Manchester, implementing and maintaining AI/ML tooling and processes.Key Responsibilities• Design scalable ML pipelines for data processing, model training, and deployment• Develop AI-powered solutions for predictive maintenance and connected car applications• Optimise and deploy...


  • Manchester, United Kingdom Harnham Full time

    About the OpportunityWe are seeking a highly skilled Data Engineer to join our team in London. As a key member of our data engineering team, you will play a crucial role in designing, building, and implementing robust ETL pipelines and warehousing solutions.The ideal candidate will have experience working with cloud platforms, designing and implementing...


  • Manchester, United Kingdom Moody's Investors Service Full time

    About the RoleWe are looking for a highly motivated Senior Big Data Cloud Program Specialist to lead the design and implementation of enterprise-grade big data cloud programs. As a key member of our team, you will be responsible for developing and maintaining complex data pipelines and ensuring seamless integration with our existing infrastructure.Key...


  • Greater Manchester, United Kingdom Kitman Labs Full time

    Are you passionate about working with large datasets and developing innovative solutions? Do you have a strong background in software engineering and experience with cloud computing platforms?We're looking for a talented Kitman Labs Data Pipeline Developer to join our team of experts in human performance analytics. In this role, you'll design, build, and...

  • Senior Data Architect

    4 weeks ago


    Manchester, United Kingdom Apply Recruitment Full time £55,000

    Senior Data Engineer OpportunityWe are seeking a highly skilled Senior Data Engineer to join our team at Apply Recruitment. This role will involve working with complex ETL data pipelines, Azure focused environment using tools such as Azure Data Factory and Synapse.About the RoleWork closely with stakeholders to design and implement data architectures.Develop...


  • Manchester, United Kingdom SPG Resourcing Full time

    About the RoleWe are advocates of working on high-impact projects, leveraging expertise to help clients unlock insights, drive decisions, and deliver measurable business value.As a Senior Data Engineer, you'll combine software engineering discipline with a deep understanding of data systems. Your pivotal role will involve deploying production-safe data...


  • Manchester, United Kingdom PSD Technology Contracts Ltd. Full time

    Job Description:Data Infrastructure Specialist sought by a leading professional services organisation to play a pivotal role in designing, implementing, and maintaining their data infrastructure. Leading a small team, you will work closely with business stakeholders to ensure the availability, reliability and performance of data pipelines, enabling...


  • Manchester, United Kingdom iO Associates Full time

    Senior Lead Data Engineer salary: £80,000. A seasoned data engineering professional to lead, innovate, and make an impact in our forward-thinking organisation. This hands-on leadership role involves guiding a talented team of engineers, driving technical excellence, and shaping the future of data solutions.We're looking for an experienced Senior Lead Data...

  • Senior Data Engineer

    3 weeks ago


    Manchester, United Kingdom Apply Recruitment Full time

    Senior Data Engineer required for an Enterprise Scale Business, paying up to £55K + Bonus + Excellent Benefits, with hybrid working in Manchester or Preston *This is hybrid working offering 2 to 3 days in your nearest office, with the others remotely.(It's still a new team finding the best approaches and solutions with users so being face to face is working...


  • manchester, United Kingdom 83zero Limited Full time

    About the RoleThis is an exciting opportunity to join a global leader in digital services as a Senior Oracle Cloud Architect and Data Specialist. The role will involve leading large-scale Oracle PaaS solutions with a focus on architectural design, implementation, and pre-sales support.ResponsibilitiesOperate as a lead architect for the adoption, design, and...


  • Manchester, United Kingdom Apply Recruitment Full time €55,000

    Senior Data Engineer required for an Enterprise Scale Business, paying up to £55K + Bonus + Excellent Benefits, with hybrid working in Manchester or Preston *This is hybrid working offering 2 to 3 days in your nearest office, with the others remotely. (As Senior Data Engineer you will join a relatively new team as a result of continued investment and...


  • Manchester, United Kingdom Apply Recruitment Full time €55,000

    Senior Data Engineer required for an Enterprise Scale Business, paying up to £55K + Bonus + Excellent Benefits, with hybrid working in Manchester or Preston *This is hybrid working offering 2 to 3 days in your nearest office, with the others remotely. (As Senior Data Engineer you will join a relatively new team as a result of continued investment and...