Data Pipeline Architect

5 days ago

London, Greater London, United Kingdom Curveanalytics Full time
About Curveanalytics

We are a forward-thinking insights and analytics consultancy that utilizes digital consumer data and advanced technology to help businesses unlock consumer opportunities.

Our software, machine learning, and AI are key to delivering impact, focused on:

  • Natural Language Processing, GPT & other LLMs: uncovering trends, themes, and other patterns from large text-based data sets, and deploying state-of-the-art AI to automate and empower consumer-facing businesses and their insights & analytics functions.
  • Marketing Data Science & Personalisation: leveraging first-party consumer data to understand each client's consumer base, building personalization and other machine learning models to better engage with and excite consumers.
  • Analytics Engineering & Data Architecture: data engineering across various tools to integrate leading technologies into optimized and efficient data models and ecosystems, feeding into best-in-class analytics dashboards and front-end platforms.
  • Software Engineering: full-stack expertise to build, maintain, and support internal and externally facing Software & Data as a Service solutions, in AWS, that accelerate delivery and unlock deeper insights for our clients.
About the Role

You will play a vital role in designing, building, and productionizing innovative data pipelines, in the cloud, from scratch. You'll work on a mix of small analytics proof of concepts and larger projects, both of which push the boundaries of what we can do with data; identifying and utilizing novel data sources and APIs, and enriching them with leading analytics, data science, and AI methods.

Main Responsibilities
  • Develop innovative data solutions.
  • Create and deploy automated code pipelines, from data acquisition through cleaning and preparing data for modeling, through to visualization.
  • Assist in productionizing machine learning models.
  • Collaborate with a skilled program team – project lead, data scientists, and analysts – and interface with client technology counterparts.
  • Identify ways to enhance data reliability, processing efficiency, and quality of our data output.
  • Produce detailed documentation and promote code quality.
  • Analyze rich data sources such as social, search, surveys, reviews, clickstream, sales, connected devices, and beyond.
  • Identify and explore opportunities to acquire new data sources that deliver innovative perspectives to our clients.
Key Requirements
  • Bachelor's degree or higher in an applicable field such as Computer Science, Statistics, Maths, or similar Science or Engineering discipline.
  • Strong Python and other programming skills (Java and/or Scala desirable).
  • Strong SQL background.
  • Some exposure to big data technologies (Hadoop, Spark, Presto, etc.).

The estimated salary for this role is $140,000 - $200,000 per year, depending on experience.

  • Data Pipeline Architect

    5 days ago

    London, Greater London, United Kingdom Northern Data Group Full time

    About the TeamNorthern Data Group is a leading provider of High-Performance Computing (HPC) solutions. Our team is dedicated to delivering innovative data-driven solutions to our clients.Main Responsibilities:Design, build, and maintain data pipelines and infrastructure to support data analysis and reporting.Collaborate with business stakeholders to...

  • Data Pipeline Architect

    5 days ago

    London, Greater London, United Kingdom Harnham Full time £90,000 - £100,000

    About UsHarnham is a leading recruitment agency specialising in technology and data jobs. We have an exciting opportunity for a Data Pipeline Architect to join our growing team.Your Role:You will be responsible for building new data pipelines using Python and SQL.You will work closely with our Data and Analytics team to develop and maintain our cloud...

  • Data Pipeline Architect

    4 weeks ago

    London, Greater London, United Kingdom Our Future Health Limited Full time

    We are seeking a Data Pipeline Architect to join our team at Our Future Health Limited. As a skilled professional, you will be responsible for designing and implementing scalable data pipelines that support our mission of enabling cutting-edge health research.The ideal candidate will have a strong background in data engineering, with experience in Python...

  • Lead Data Pipeline Developer

    5 days ago

    London, Greater London, United Kingdom Data Idols Full time £85,000 - £95,000

    About the Role: Lead Data Pipeline DeveloperWe are seeking an experienced lead developer to join our data team as a Lead Data Pipeline Developer. In this role, you will be responsible for designing, developing, and maintaining complex data pipelines that deliver business-critical insights. The ideal candidate will have experience in data warehousing, data...

  • Cloud-Native Data Pipeline Architect

    4 weeks ago

    London, Greater London, United Kingdom Hyre AI Limited Full time

    In pursuit of a more sustainable tomorrow, we're recruiting a Cloud-Native Data Pipeline Architect to help shape the future of ESG management solutions. This critical role involves designing, implementing, and maintaining robust data pipelines that efficiently collect, process, and store data from multiple sources.Applicants should hold 3+ years of...

  • Data Pipeline Architect

    2 days ago

    London, Greater London, United Kingdom Principle Full time

    Job OverviewWe are seeking a skilled Data Engineer to join our team at Principle. As a high-impact Data Engineer, you will design robust data pipelines and collaborate with cross-functional teams to drive critical insights.Salary and BenefitsThe salary for this role is estimated to be £75,000 - £84,000 per year, paid on a weekly basis. This position also...

  • Data Pipeline Architect

    5 days ago

    London, Greater London, United Kingdom Xcede Full time

    OverviewWe are seeking an experienced Data Engineer to join our team at Xcede. As a Data Engineer, you will play a key role in optimising our data architecture and building reliable and scalable data pipelines for the application of advanced analytics and machine learning.About the Role:The successful candidate will be responsible for designing, building and...

  • Data Pipeline Optimization Expert

    2 days ago

    London, Greater London, United Kingdom Northern Data Group Full time

    OverviewNorthern Data Group is a cutting-edge company that's changing the face of High-Performance Computing. With a strong focus on innovation and sustainability, we're shaping the future of data centers worldwide.Job SummaryWe're seeking a highly skilled Senior Data Engineer to join our team. As a key member of our Data Team, you will play a crucial role...

  • Data Pipeline Architect

    4 days ago

    London, Greater London, United Kingdom DataCareers Full time £65,000 - £75,000

    Data Engineer VacancyWe are seeking an experienced Data Engineer to join our team at DataCareers. The successful candidate will be responsible for designing and building scalable data pipelines to process and transform raw data into structured data products.This is a key role in the development of our organisation's analytics platform, and we require a...

  • Data Pipeline Architect

    5 hours ago

    London, Greater London, United Kingdom Accelero Full time £65,000

    Accelero is a dynamic and innovative company that holds the largest repository of education data in Europe. We are seeking an experienced AWS Data Engineer to join our team and contribute to the development of cutting-edge data pipelines and platforms.">In this role, you will be responsible for developing ETL/ELT workflows to integrate data from multiple...

  • Data Pipeline Architect

    4 weeks ago

    London, Greater London, United Kingdom Abound Full time

    Your New RoleWe are seeking an experienced Data Engineer to join our team at Abound, a leading player in consumer lending. The successful candidate will be responsible for designing, building, and maintaining ETL pipelines to support our data-driven business decisions.The role involves working closely with data scientists, analysts, and other stakeholders to...

  • Data Pipeline Architect

    3 weeks ago

    London, Greater London, United Kingdom Harnham Full time £70,000 - £80,000

    We're excited to announce an opportunity for a highly skilled Data Engineer to join our team at Harnham. As a Senior Python Software Engineer, you will play a key role in designing and developing our AWS platform and data pipelines, leveraging your expertise in Python, ML, and CI/CD.About the RoleThis challenging position demands a technical expert who can...

  • Data Engineer

    3 days ago

    London, Greater London, United Kingdom Data Science Festival Full time

    Company OverviewThe Data Science Festival is one of the best-known retail brands in the UK, looking for a skilled Staff Data Engineer to support the delivery of data transformation during an exciting time within the company. As a Staff Data Engineer, you will collaborate with the wider data teams to build and maintain data pipelines.

  • Data Pipeline Architect

    10 hours ago

    London, Greater London, United Kingdom Harnham Full time

    The RoleYou will be responsible for the direction and development of our internal data platform, liaising with stakeholders across the business and helping to impact future decisions. Your expertise in product testing using CI/CD will be invaluable in ensuring the high quality of our data pipeline.

  • Data Architect

    5 days ago

    London, Greater London, United Kingdom Xcede Full time

    Job Title: Data Architect Salary Estimate: £80,000-£90,000 per annumWe are seeking a highly skilled Data Architect to join our team in London. The successful candidate will be responsible for designing and implementing scalable data pipelines, ensuring the quality and security of data processes, and collaborating with cross-functional teams to deliver...

  • Highly Skilled Data Pipeline Specialist

    4 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time

    We are recruiting a Highly Skilled Data Pipeline Specialist to join our team at the Data Science Festival. This role involves designing and developing data pipelines using Azure cloud platform, maintaining and improving existing data solutions, and collaborating with wider data teams to ensure delivery of high-quality data insights.About YouThe ideal...

  • Data Solutions Architect

    2 months ago

    London, Greater London, United Kingdom Data Idols Full time £80,000 - £100,000

    Data Solutions ArchitectAt Data Idols, we're seeking a skilled Data Solutions Architect to join our team. As a key member of our data architecture team, you will be responsible for designing and implementing data solutions that drive business decisions.The OpportunityYou will collaborate with our partners to develop future roadmaps for data tools and...

  • Enterprise Data Pipeline Developer

    5 days ago

    London, Greater London, United Kingdom LEK Full time

    Data Pipeline Development - Global Data Solutions ArchitectL.E.K. Consulting is seeking a Data Engineer to join our global data solutions team in London. In this role, you will be responsible for designing and developing scalable data pipelines to extract, transform, and load data from various sources.The ideal candidate will have a strong background in data...

  • Senior Data Platform Architect

    4 weeks ago

    London, Greater London, United Kingdom Data Idols Full time £80,000 - £100,000

    Data Solutions Architect OpportunityAt Data Idols, we are seeking a highly skilled Data Solutions Architect to provide design and architecture guidance across the company. This role requires expertise in driving the design of solutions that support the business in making data-driven decisions.The OpportunityAs a Data Solutions Architect, you will collaborate...

  • Data Infrastructure Architect

    4 weeks ago

    London, Greater London, United Kingdom Northern Data Group Full time

    Job OverviewNorthern Data Group is seeking a Senior Data Engineer to join our team and play a crucial role in designing, building, and maintaining our data infrastructure.Estimated Salary: $120,000 - $180,000 per yearKey Responsibilities:Data Pipeline Development: Develop and maintain end-to-end data pipelines, ensuring performance, scalability, and...