Data Pipeline Architect

1 day ago


London, Greater London, United Kingdom DataCareers Full time £65,000 - £75,000

Data Engineer Vacancy

We are seeking an experienced Data Engineer to join our team at DataCareers. The successful candidate will be responsible for designing and building scalable data pipelines to process and transform raw data into structured data products.

This is a key role in the development of our organisation's analytics platform, and we require a professional with expertise in AWS, Python, and SQL to work on customer site in Bristol 2 days a week.

About the Role

  • Design and build scalable data pipelines using AWS services.
  • Collaborate with stakeholders to understand data requirements and develop solutions that align with business needs.
  • Work with Python and SQL to clean, process, and analyse data.
  • Integrate data sources into cloud platforms, leveraging AWS tools and services.

Key Skills and Experience

  • Proficiency in Python and SQL for data processing and transformation.
  • Experience designing and building scalable data pipelines.
  • Expertise in AWS, with experience in services such as S3, Redshift, Lambda, or similar.

Benefits: £65,000 - £75,000 per annum + benefits

About You

You will be a highly skilled data professional with a passion for data transformation and analytics. A strong technical foundation and the ability to work independently and collaboratively in a dynamic environment are essential.



  • London, Greater London, United Kingdom Northern Data Group Full time

    About the TeamNorthern Data Group is a leading provider of High-Performance Computing (HPC) solutions. Our team is dedicated to delivering innovative data-driven solutions to our clients.Main Responsibilities:Design, build, and maintain data pipelines and infrastructure to support data analysis and reporting.Collaborate with business stakeholders to...


  • London, Greater London, United Kingdom Harnham Full time £90,000 - £100,000

    About UsHarnham is a leading recruitment agency specialising in technology and data jobs. We have an exciting opportunity for a Data Pipeline Architect to join our growing team.Your Role:You will be responsible for building new data pipelines using Python and SQL.You will work closely with our Data and Analytics team to develop and maintain our cloud...


  • London, Greater London, United Kingdom Our Future Health Limited Full time

    We are seeking a Data Pipeline Architect to join our team at Our Future Health Limited. As a skilled professional, you will be responsible for designing and implementing scalable data pipelines that support our mission of enabling cutting-edge health research.The ideal candidate will have a strong background in data engineering, with experience in Python...


  • London, Greater London, United Kingdom Data Idols Full time £85,000 - £95,000

    About the Role: Lead Data Pipeline DeveloperWe are seeking an experienced lead developer to join our data team as a Lead Data Pipeline Developer. In this role, you will be responsible for designing, developing, and maintaining complex data pipelines that deliver business-critical insights. The ideal candidate will have experience in data warehousing, data...


  • London, Greater London, United Kingdom Hyre AI Limited Full time

    In pursuit of a more sustainable tomorrow, we're recruiting a Cloud-Native Data Pipeline Architect to help shape the future of ESG management solutions. This critical role involves designing, implementing, and maintaining robust data pipelines that efficiently collect, process, and store data from multiple sources.Applicants should hold 3+ years of...


  • London, Greater London, United Kingdom Xcede Full time

    OverviewWe are seeking an experienced Data Engineer to join our team at Xcede. As a Data Engineer, you will play a key role in optimising our data architecture and building reliable and scalable data pipelines for the application of advanced analytics and machine learning.About the Role:The successful candidate will be responsible for designing, building and...


  • London, Greater London, United Kingdom Abound Full time

    Your New RoleWe are seeking an experienced Data Engineer to join our team at Abound, a leading player in consumer lending. The successful candidate will be responsible for designing, building, and maintaining ETL pipelines to support our data-driven business decisions.The role involves working closely with data scientists, analysts, and other stakeholders to...


  • London, Greater London, United Kingdom Harnham Full time £70,000 - £80,000

    We're excited to announce an opportunity for a highly skilled Data Engineer to join our team at Harnham. As a Senior Python Software Engineer, you will play a key role in designing and developing our AWS platform and data pipelines, leveraging your expertise in Python, ML, and CI/CD.About the RoleThis challenging position demands a technical expert who can...

  • Data Architect

    2 days ago


    London, Greater London, United Kingdom Xcede Full time

    Job Title: Data Architect Salary Estimate: £80,000-£90,000 per annumWe are seeking a highly skilled Data Architect to join our team in London. The successful candidate will be responsible for designing and implementing scalable data pipelines, ensuring the quality and security of data processes, and collaborating with cross-functional teams to deliver...


  • London, Greater London, United Kingdom Data Science Festival Full time

    We are recruiting a Highly Skilled Data Pipeline Specialist to join our team at the Data Science Festival. This role involves designing and developing data pipelines using Azure cloud platform, maintaining and improving existing data solutions, and collaborating with wider data teams to ensure delivery of high-quality data insights.About YouThe ideal...

  • Data Model Engineer

    4 weeks ago


    London, Greater London, United Kingdom Houseful Full time

    About UsAt Houseful, we're redefining the digital property landscape and empowering people to make better home decisions. Our mission is to connect everyone to their home and provide personalised insights for moving, managing, or financing.We're a dynamic team that thrives on innovation and collaboration. We're passionate about creating a welcoming, fair,...


  • London, Greater London, United Kingdom Data Idols Full time £80,000 - £100,000

    Data Solutions ArchitectAt Data Idols, we're seeking a skilled Data Solutions Architect to join our team. As a key member of our data architecture team, you will be responsible for designing and implementing data solutions that drive business decisions.The OpportunityYou will collaborate with our partners to develop future roadmaps for data tools and...


  • London, Greater London, United Kingdom Curveanalytics Full time

    About CurveanalyticsWe are a forward-thinking insights and analytics consultancy that utilizes digital consumer data and advanced technology to help businesses unlock consumer opportunities.Our software, machine learning, and AI are key to delivering impact, focused on:Natural Language Processing, GPT & other LLMs: uncovering trends, themes, and other...


  • London, Greater London, United Kingdom LEK Full time

    Data Pipeline Development - Global Data Solutions ArchitectL.E.K. Consulting is seeking a Data Engineer to join our global data solutions team in London. In this role, you will be responsible for designing and developing scalable data pipelines to extract, transform, and load data from various sources.The ideal candidate will have a strong background in data...


  • London, Greater London, United Kingdom Data Idols Full time £80,000 - £100,000

    Data Solutions Architect OpportunityAt Data Idols, we are seeking a highly skilled Data Solutions Architect to provide design and architecture guidance across the company. This role requires expertise in driving the design of solutions that support the business in making data-driven decisions.The OpportunityAs a Data Solutions Architect, you will collaborate...


  • London, Greater London, United Kingdom Harnham Full time £75,000 - £95,000

    Role OverviewWe are seeking a highly skilled Data Engineer to join our client's expanding Data and Analytics team in London. As a key member of the team, you will be responsible for building and maintaining a new AWS serverless data platform, streamlining real-time data using Kafka, and improving best coding practices within the business.About the TeamThe...


  • London, Greater London, United Kingdom Northern Data Group Full time

    Job OverviewNorthern Data Group is seeking a Senior Data Engineer to join our team and play a crucial role in designing, building, and maintaining our data infrastructure.Estimated Salary: $120,000 - $180,000 per yearKey Responsibilities:Data Pipeline Development: Develop and maintain end-to-end data pipelines, ensuring performance, scalability, and...


  • London, Greater London, United Kingdom Data Science Festival Full time

    Data Science Festival: Enterprise Data ArchitectWe are working with one of the largest entertainment organisations growing rapidly within their global operations. With innovation, creativity, and data at the heart of the company, we are looking for an Enterprise Data Architect to join the team.As an Enterprise Data Architect, you will be responsible for...


  • London, Greater London, United Kingdom Mastek Full time

    Responsibilities:Analyze existing data pipelines, workflows, and blending processes in Alteryx and manual operationsUnderstand data sourcing from Azure Synapse and Azure Data Stores to target systemsIdentify inefficiencies, risks, and improvement opportunities in the current systemCreate and maintain a prioritized product backlog to guide transition...


  • London, Greater London, United Kingdom Core Consultants Full time

    Data Platform ArchitectCore Consultants is seeking a Data Platform Architect to develop and maintain our internal data ingestion platform. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data pipelines that consume data from Kafka streams, leveraging Airflow for pipeline orchestration.The ideal...