Big Data Engineering Role

3 days ago


London, Greater London, United Kingdom Hexegic Full time
About the Company

Hexegic is a prominent technical consultancy providing agile multi-disciplinary teams to top organisations. We offer stimulating projects for ambitious individuals seeking to establish a fulfilling career.

The Job

As a skilled Data Engineer, you will play a critical role in ensuring our customers have access to precise and timely data via our data analytics platform. Your responsibilities will include responding promptly to data health issues, reading code to identify resolutions and implementing necessary modifications. This position requires proficiency in big data technologies like Python, Pyspark and Java.

Main Responsibilities
  1. Maintain schedule builds for effective pipeline execution.
  2. Establish and maintain health checks across multiple data pipelines.
  3. Identify, troubleshoot and resolve data pipeline issues.
  4. Read and modify code to ensure optimal performance.
  5. Familiarise yourself with data pipelines and related documentation.
  6. Adhere to standard operating procedures for contacting relevant teams when data inaccuracies arise.
  7. Communicate pipeline outages to end-users.
Necessary Skills
  1. Expertise in coding languages Python, Pyspark and Java.
  2. Knowledge of Spark fundamentals and interest in learning job tuning.
  3. Able to operate pipeline development tools.
  4. Background in supporting data integration systems.
Benefits Offered

£50,000 to £60,000 salary
25 days annual leave
Personal development program: £5,000 per employee per year



  • London, Greater London, United Kingdom Data Science Festival Full time

    **Job Overview**Data Science Festival is seeking an experienced Big Data Engineering Lead to join their team in London – hybrid. This is a fantastic opportunity for a skilled professional to drive data transformation and deliver value throughout the company.This hands-off role requires someone with extensive experience in managing teams, stakeholder...

  • Big Data Engineer

    6 days ago


    London, Greater London, United Kingdom Xcede Full time

    Job Summary: Xcede is seeking a Big Data Engineer to join our team in London. The successful candidate will be responsible for designing and implementing scalable big data architectures, ensuring the quality and security of data processes, and collaborating with cross-functional teams to deliver projects.Key Responsibilities: Design, build, and maintain...


  • London, Greater London, United Kingdom Source Technology Full time

    Job Details:Job Title: Engineering Lead for Big DataWe are seeking an experienced Engineering Lead for Big Data to lead our team in delivering next-generation big data infrastructure and enabling advanced AI/ML capabilities. The successful candidate will have a strong background in data engineering, Azure data services, and leading high-performing teams.Key...


  • London, Greater London, United Kingdom Thoughtworks Inc. Full time

    About the Opportunity:We are looking for an experienced Big Data Engineer Lead to lead our big data initiatives and drive innovation in data engineering.About You:You have a proven track record of successfully leading big data projects and teams.You have extensive experience with big data tools, frameworks, and technologies, including distributed storage and...


  • London, Greater London, United Kingdom CV-Library Full time

    CV-Library is seeking a Big Data Engineering Manager to lead our data engineering efforts. The ideal candidate will have extensive experience in designing and implementing large-scale data systems, managing a team of engineers, and collaborating with stakeholders to drive business outcomes.RequirementsProven track record in leading data engineering...


  • London, Greater London, United Kingdom Harnham Full time £55,000 - £65,000

    Senior Big Data Developer RoleAnnual salary: £60,000-£70,000We are seeking an experienced Senior Big Data Developer to join our team at Harnham. As a key member of our product engineering organisation, you will be responsible for building a new data lake in AWS and implementing real-time streaming features using Apache Spark.About the roleDesign and...


  • London, Greater London, United Kingdom Athsai Full time

    Athsai is looking for a highly skilled Lead Big Data Engineer to oversee the design, development, and deployment of large-scale data engineering projects. This is an excellent opportunity for a qualified professional to showcase their technical expertise and leadership skills.You will work closely with cross-functional teams to deliver complex data...


  • London, Greater London, United Kingdom InterEx Group Full time

    Are you a highly motivated and tech-passionate individual looking for a new challenge? Do you have experience in designing and implementing big data solutions? If so, we would like to hear from you!Job OverviewWe are InterEx Group, a leading provider of big data solutions, and we are currently seeking a Big Data Solutions Engineer to join our team. The...


  • London, Greater London, United Kingdom Entain Full time

    At Entain, we're committed to transforming the gaming sector by creating exciting and trusted experiences for our customers. As a Senior Data Engineer - Big Data Analytics, you'll be responsible for leading the design, development, and deployment of big data analytics solutions to drive business growth and improvement.ResponsibilitiesBig Data Analytics:...


  • London, Greater London, United Kingdom Bazaarvoice Full time

    Bazaarvoice is seeking a highly skilled Big Data Engineer Specialist to join our team. In this role, you'll be responsible for designing, building, and supporting large-scale, distributed data systems that drive our organization's data infrastructure forward and power our products and services.The ideal candidate will have 7+ years of experience designing...

  • Big Data Specialist

    5 days ago


    London, Greater London, United Kingdom CV-Library Full time

    **Job Description**We are looking for a Big Data Specialist to join our team at CV-Library. As a Data Engineer, you will be responsible for developing and implementing big data solutions using SQL Server.**Key Responsibilities:*** Build advanced automation of end-user developed applications and data engineering pipelines*Develop solutions for streaming data...


  • London, Greater London, United Kingdom Quantexa Full time

    Key ResponsibilitiesAs a lead data engineer at Quantexa, your key responsibilities will include:• Leading a team of junior data engineers within an agile framework• Writing defensive, fault-tolerant, and efficient code for production-level data processing systems• Configuring and deploying Quantexa's software using tools such as Spark, Hadoop, Scala,...


  • London, Greater London, United Kingdom Jas Gujral Full time

    Data Analyst Position with Big Data AnalyticsJas Gujral is seeking a skilled Data Analyst to join their team in the Financial Services Sector. The successful candidate will have the opportunity to drive innovations using Big Data and work closely with analytics teams to review and enhance data categorization.The role involves gaining a deep understanding of...


  • London, Greater London, United Kingdom InterEx Group Full time

    About the RoleWe are seeking an experienced Data Engineering Lead to join our team in Madrid. As a key member of our data engineering team, you will be responsible for designing and implementing big data solutions using cloud-based technologies.The ideal candidate will have over 5 years of experience in big data implementation projects, with a focus on...


  • London, Greater London, United Kingdom Source Technology Full time

    About the RoleWe are seeking a Big Data Infrastructure Specialist to join our team at Source Technology. As a key member of our Data Engineering Team, you will be responsible for designing, implementing, and maintaining big data infrastructure that supports critical business and data science projects.The ideal candidate will have a strong background in big...


  • London, Greater London, United Kingdom JPMorganChase Full time

    We are looking for a skilled Senior Big Data Developer to join our team at JPMorgan Chase. In this role, you will be responsible for designing and developing big data solutions using cloud-based technologies such as AWS.The estimated salary for this position is $150,000 - $200,000 per year, depending on experience. As a Senior Big Data Developer, you will...


  • London, Greater London, United Kingdom Curo Resourcing Ltd. Full time

    Key ResponsibilitiesAs a Data DevOps Engineer, you will be responsible for the detailed development and implementation of scalable clustered Big Data solutions. You will work closely with the team to design and implement automated dynamic scaling and self-healing systems.You will also provide technical thought-leadership and advise on technologies and...


  • London, Greater London, United Kingdom CV-Library Full time

    Data Warehouse Development Role">The company is seeking an experienced Data Engineer to join their team and take on a key role in the development of their data warehouse. This is a fantastic opportunity for someone with a strong background in data engineering and a passion for delivering high-quality solutions.">About the Role:">Design and develop the data...


  • London, Greater London, United Kingdom ATTB - The Big Jobsite Full time

    ATTB - The Big Jobsite is seeking a talented Data Engineer Specialist to join our data team in London. This is a permanent role with an estimated salary of £50,000 - £75,000 plus a 20% bonus, and you will work from home.The ideal candidate will have expertise in the Microsoft Power platform stack, including POWER BI and POWER BI DAX. As a Data Engineer...

  • Big Data Architect

    3 days ago


    London, Greater London, United Kingdom Source Technology Full time

    At Source Technology, we are seeking an experienced Big Data Architect to play a key role in transforming how data is managed and utilised, supporting a multi-year program designed to deliver next-generation big data infrastructure and enable advanced AI/ML capabilities.We are looking for a Senior Data Engineer with a strong background in trading and...