Senior Big Data Specialist

3 days ago


London, Greater London, United Kingdom Harnham Full time £35,000 - £40,000

About Harnham

Harnham is a software firm based in London that specializes in creating marketing strategies for its clients by collecting and analyzing their data.

Job Overview

We are currently seeking a Data Engineer to join our product engineering organization. The successful candidate will be responsible for building a new data lake using Google Cloud Platform (GCP) and developing real-time streaming features using big data tools such as Apache Spark.

Key Responsibilities

  • Work collaboratively with the data science team to design and implement a data lake architecture.
  • Develop and maintain data pipelines using Python, ensuring high-quality code and adhering to best practices.
  • Design and implement real-time streaming features using big data tools such as Apache Spark.

Requirements

  • Extensive experience working with big data tools such as Apache Spark.
  • Strong background in Python programming, with experience in maintaining GCP databases.
  • Good knowledge of SQL and ability to work with large datasets.

What We Offer

  • A competitive salary of £35,000-40,000 per annum, depending on experience.
  • A generous holiday plan and career development opportunities.
  • Flexible working arrangements to support work-life balance.

How to Apply

If you are a motivated and experienced data engineer looking for a new challenge, please submit your CV via the apply link on this page.



  • London, Greater London, United Kingdom MRJ Recruitment Full time £70,000 - £80,000

    Unlock New Opportunities in Big Data">Are you a seasoned big data expert looking for a new challenge? Do you want to make a real impact in the healthcare industry?We are MRJ Recruitment, a leading recruitment agency specialising in tech talent. We are excited to partner with our HealthTech SaaS brand to find exceptional professionals like yourself for the...


  • London, Greater London, United Kingdom InterEx Group Full time

    Job Title: Senior Big Data Infrastructure SpecialistWe are looking for an experienced and skilled Senior Big Data Infrastructure Specialist to join our team at InterEx Group. As a Senior Big Data Infrastructure Specialist, you will be responsible for designing and implementing robust Big Data solutions that meet the needs of our clients.Job Description:We...

  • Big Data Specialist

    10 hours ago


    London, Greater London, United Kingdom CV-Library Full time

    **Job Description**We are looking for a Big Data Specialist to join our team at CV-Library. As a Data Engineer, you will be responsible for developing and implementing big data solutions using SQL Server.**Key Responsibilities:*** Build advanced automation of end-user developed applications and data engineering pipelines*Develop solutions for streaming data...


  • London, Greater London, United Kingdom JPMorganChase Full time

    We are looking for a skilled Senior Big Data Developer to join our team at JPMorgan Chase. In this role, you will be responsible for designing and developing big data solutions using cloud-based technologies such as AWS.The estimated salary for this position is $150,000 - $200,000 per year, depending on experience. As a Senior Big Data Developer, you will...


  • London, Greater London, United Kingdom Data Science Festival Full time

    **Job Overview**Data Science Festival is seeking an experienced Big Data Engineering Lead to join their team in London – hybrid. This is a fantastic opportunity for a skilled professional to drive data transformation and deliver value throughout the company.This hands-off role requires someone with extensive experience in managing teams, stakeholder...


  • London, Greater London, United Kingdom Pearson Full time

    About the Job: We are seeking a Senior Big Data Professional to join our team at Pearson. The successful candidate will have a strong background in big data technologies, experience working with complex data transformation projects, and excellent communication skills. The ideal candidate will be responsible for designing, developing, and maintaining complex...

  • Senior Data Engineer

    22 hours ago


    London, Greater London, United Kingdom Entain Full time

    At Entain, we're committed to transforming the gaming sector by creating exciting and trusted experiences for our customers. As a Senior Data Engineer - Big Data Analytics, you'll be responsible for leading the design, development, and deployment of big data analytics solutions to drive business growth and improvement.ResponsibilitiesBig Data Analytics:...


  • London, Greater London, United Kingdom Mastek Full time

    Key ResponsibilitiesThe Lead Big Data Specialist will be responsible for leading cross-functional teams to understand and address data requirements, developing and maintaining documentation for data processes and architecture, and providing technical leadership and mentorship to junior data engineers.They will also troubleshoot and resolve any issues related...


  • London, Greater London, United Kingdom Harnham Full time £55,000 - £65,000

    Senior Big Data Developer RoleAnnual salary: £60,000-£70,000We are seeking an experienced Senior Big Data Developer to join our team at Harnham. As a key member of our product engineering organisation, you will be responsible for building a new data lake in AWS and implementing real-time streaming features using Apache Spark.About the roleDesign and...


  • London, Greater London, United Kingdom ATTB - The Big Jobsite Full time

    ATTB - The Big Jobsite is seeking a talented Data Engineer Specialist to join our data team in London. This is a permanent role with an estimated salary of £50,000 - £75,000 plus a 20% bonus, and you will work from home.The ideal candidate will have expertise in the Microsoft Power platform stack, including POWER BI and POWER BI DAX. As a Data Engineer...


  • London, Greater London, United Kingdom Data Science Festival Full time

    Data Architect SpecialistData Science Festival is looking for a highly skilled Data Architect Specialist to lead the development of our data warehouse. This role involves designing and improving the data infrastructure, ensuring seamless integration with other departments.The successful candidate will have proven experience in data warehouse implementation,...


  • London, Greater London, United Kingdom Curveanalytics Full time

    Come work with us at Curveanalytics and take advantage of this exciting opportunity to develop industry-first data science and analytics capabilities.We're seeking a highly skilled Senior Big Data Engineer to design, build and productionise innovative data pipelines in the cloud, from scratch.This is a unique chance to shape the future of our company's data...


  • London, Greater London, United Kingdom Databricks Inc. Full time

    Job DescriptionWe are seeking a Senior Big Data Analytics Consultant to join our team at Databricks Inc. As a key member of our sales engineering group, you will be responsible for building successful relationships with clients throughout your assigned territory, providing technical and business value to Databricks customers in collaboration with Account...

  • Big Data Engineer

    1 day ago


    London, Greater London, United Kingdom Xcede Full time

    Job Summary: Xcede is seeking a Big Data Engineer to join our team in London. The successful candidate will be responsible for designing and implementing scalable big data architectures, ensuring the quality and security of data processes, and collaborating with cross-functional teams to deliver projects.Key Responsibilities: Design, build, and maintain...


  • London, Greater London, United Kingdom Data Science Festival Full time

    Data Science Festival is a leading entertainment organisation with a global presence, renowned for its innovative approach to data-driven decision making.Key ResponsibilitiesAs a Senior Data Warehouse Engineer, you will play a pivotal role in designing and implementing the company's data warehouse strategy.This involves working closely with the Data...


  • London, Greater London, United Kingdom Databricks Full time

    Job DescriptionWe are seeking a highly motivated Big Data and AI Transformation Specialist to join our team at Databricks. As a key member of our sales team, you will play a critical role in driving business growth and success within the Communication, Media, and Entertainment (CME) sector.Key ResponsibilitiesProvide industry insights and develop unique use...

  • Senior Data Engineer

    22 hours ago


    London, Greater London, United Kingdom Computappoint Full time £70,000

    About the RoleThis Senior Data Engineer position requires expertise in Big Data (Hadoop/Hive/Spark) and Cloud technologies, as well as prior programming experience with Python or Java. The successful candidate will work on the deployment, optimization, and maintenance of Starburst installations, managing and deploying Trino/Starburst, configuring servers,...

  • Big Data Technologist

    10 hours ago


    London, Greater London, United Kingdom Curo Resourcing Ltd. Full time

    Key ResponsibilitiesAs a Data DevOps Engineer, you will be responsible for the detailed development and implementation of scalable clustered Big Data solutions. You will work closely with the team to design and implement automated dynamic scaling and self-healing systems.You will also provide technical thought-leadership and advise on technologies and...


  • London, Greater London, United Kingdom Source Technology Full time

    Senior Big Data Engineer for Commodities Trading FirmAbout Source TechnologyWe're a leading Commodities trading firm that's committed to staying ahead of the curve in terms of technology. As a Senior Big Data Engineer, you'll play a key role in designing and implementing cutting-edge big data infrastructure that enables advanced AI/ML capabilities.Salary...

  • Big Data Expert

    3 weeks ago


    London, Greater London, United Kingdom WorksHub Full time

    This job at WorksHub is an exciting opportunity for a Big Data expert to leverage their skills in data science, machine learning, and business analytics.Key ResponsibilitiesWe are seeking a professional with hands-on experience in coding languages such as Python, R, and Scala.The ideal candidate will have proficiency in database technologies including SQL,...