Big Data Infrastructure Developer

4 weeks ago


London, Greater London, United Kingdom Investigo Full time

About the Job:

We are seeking a talented individual to fill the role of Big Data Infrastructure Developer with our client in the Financial Services sector. The successful candidate will have extensive experience in building or architecting data pipelines in Spark and setting up Kafka environments.

About the Role:

This is an exciting opportunity to work with a leading consulting client in the Financial Services sector. You will be responsible for designing and implementing data pipelines using Spark and setting up their new Kafka environment.

Key Responsibilities:

  • Design and implement data pipelines to move data from legacy systems to a new data warehouse
  • Set up the new Kafka environment
  • Collaborate with cross-functional teams to ensure smooth project execution

Requirements:

  • Strong understanding of Spark and Kafka technologies
  • Experience in data warehousing concepts
  • Excellent problem-solving skills

Salary: £650-850 per annum, depending on experience.



  • London, Greater London, United Kingdom Source Technology Full time

    About the RoleWe are seeking a Big Data Infrastructure Specialist to join our team at Source Technology. As a key member of our Data Engineering Team, you will be responsible for designing, implementing, and maintaining big data infrastructure that supports critical business and data science projects.The ideal candidate will have a strong background in big...


  • London, Greater London, United Kingdom S&P Global Full time

    About the Team:S&P Global Market Intelligence is a division of S&P Global, a leading provider of data and analytics solutions for the financial industry. We understand the importance of accurate, deep, and insightful information and are committed to delivering unrivaled insights and leading data and technology solutions.The Job Description: As a Senior...


  • London, Greater London, United Kingdom Xcede Recruitment Solutions Full time

    Job Title: Big Data Pipeline DeveloperXcede Recruitment Solutions is hiring a skilled Big Data Pipeline Developer to create efficient and scalable data pipelines for a leading AI Scale Up in Medical Technology/Digital Health.About the Job:Develop and maintain big data pipelines using Python, Java, or other programming languages.Create data visualisation...


  • London, Greater London, United Kingdom Computappoint Full time £70,000

    About the JobComputappoint Limited is seeking a talented Data Engineer to join their AI and Data practice. As a key member of the team, you will be responsible for designing, implementing, and maintaining large-scale data infrastructure using Starburst and other technologies.Responsibilities Include:Developing and deploying data pipelines using...

  • Big Data Developer

    2 weeks ago


    London, Greater London, United Kingdom WeAreTechWomen Full time

    About the Opportunity:WeAreTechWomen is looking for a Big Data Developer to join our Financial Risk Analytics team. As a developer, you will play a key role in building state-of-the-art financial analytics software using a Spark platform.The successful candidate will have a strong background in software development and experience working with distributed...

  • Big Data Architect

    4 weeks ago


    London, Greater London, United Kingdom Source Technology Full time

    At Source Technology, we are seeking an experienced Big Data Architect to play a key role in transforming how data is managed and utilised, supporting a multi-year program designed to deliver next-generation big data infrastructure and enable advanced AI/ML capabilities.We are looking for a Senior Data Engineer with a strong background in trading and...


  • London, Greater London, United Kingdom MBR Partners Full time

    Job DescriptionWe are seeking an experienced AWS Data Architect to lead our Cloud Native Big Data Analytics infrastructure layer design and implementation. This role involves designing and supporting the backbone for AI/ML workflows, enabling both real-time and batch processing for training and inference purposes. The typical data throughput to support is in...


  • London, Greater London, United Kingdom LinuxRecruit Full time

    LinuxRecruit is seeking an experienced AWS Big Data Infrastructure Lead to oversee the deployment and management of our core technical infrastructure. Based in the UK, this fully remote position offers a competitive salary of £100,000 - £130,000 per annum.You'll be responsible for constructing ETL pipelines using Glue and Spark, while leveraging Power BI...


  • London, Greater London, United Kingdom Source Technology Full time

    Job Details:Job Title: Engineering Lead for Big DataWe are seeking an experienced Engineering Lead for Big Data to lead our team in delivering next-generation big data infrastructure and enabling advanced AI/ML capabilities. The successful candidate will have a strong background in data engineering, Azure data services, and leading high-performing teams.Key...

  • Big Data Engineer

    4 weeks ago


    London, Greater London, United Kingdom Xcede Full time

    Job Summary: Xcede is seeking a Big Data Engineer to join our team in London. The successful candidate will be responsible for designing and implementing scalable big data architectures, ensuring the quality and security of data processes, and collaborating with cross-functional teams to deliver projects.Key Responsibilities: Design, build, and maintain...


  • London, Greater London, United Kingdom Northern Data Group Full time

    About the RoleWe are excited to announce a new opportunity for a Senior Data Infrastructure Developer to join our team at Northern Data Group. In this role, you will play a critical part in designing, building, and maintaining our data infrastructure.Main Responsibilities:Develop and maintain end-to-end data pipelines, focusing on performance, scalability,...


  • London, Greater London, United Kingdom Alphasights Full time

    Are you passionate about solving complex data challenges? Do you enjoy collaborating with talented colleagues in a fast-paced environment?About the Role:We're seeking a highly skilled Senior Big Data Engineer to expand our Engineering team in London. As a Senior Big Data Engineer, you will be responsible for designing, developing, and deploying scalable data...


  • London, Greater London, United Kingdom Apple Inc. Full time

    Shape the Future of Big Data Systems with AppleWe are seeking a seasoned expert in big data systems to join our team at Apple Inc. As a Big Data Systems Expert, you will be responsible for designing, building, and maintaining scalable big-data systems that power our AI and ML solutions.Your expertise will be invaluable in improving the performance,...


  • London, Greater London, United Kingdom Data Idols Full time £80,000 - £90,000

    The Perfect CandidateAs a Senior Data Platform Engineer, you'll have:Expertise in Azure Data Lake Storage, Azure Compute, and Azure Databricks.A strong understanding of DevOps practices, using tools like Azure DevOps, Jenkins, or GitHub Actions.Solid knowledge of security best practices on Azure, including identity and access management, network security,...


  • London, Greater London, United Kingdom Middleware Talents Ltd Full time

    About the Role:We are seeking an experienced Big Data and Azure Expert to join our team in London. As a key member of our architecture team, you will be responsible for designing and implementing large-scale cloud infrastructure solutions using Microsoft Azure. Your expertise in big data, database, and data warehouse architecture is highly valued. You will...


  • London, Greater London, United Kingdom DATAHEAD Full time

    About the RoleThis Senior Data Infrastructure Developer position is responsible for designing and implementing scalable data pipelines to support business growth. The ideal candidate will have expertise in big data technologies and cloud platforms.Key Responsibilities:Design and develop robust data pipelines and ETL processesCollaborate with data scientists...

  • Senior Data Architect

    2 weeks ago


    London, Greater London, United Kingdom BGL Group Full time

    Job Summary:We are seeking a Senior Data Architect - Big Data to lead the development of our cloud-based data infrastructure. The successful candidate will be responsible for designing and implementing scalable data pipelines and architectures that support business growth.Key Responsibilities:Lead the design and implementation of big data architectures that...


  • London, Greater London, United Kingdom JPMorganChase Full time

    We are looking for a skilled Senior Big Data Developer to join our team at JPMorgan Chase. In this role, you will be responsible for designing and developing big data solutions using cloud-based technologies such as AWS.The estimated salary for this position is $150,000 - $200,000 per year, depending on experience. As a Senior Big Data Developer, you will...


  • London, Greater London, United Kingdom Coatue Management L.L.C. Full time

    About the Role:We are looking for a Big Data Solutions Architect to join our team at Coatue Management L.L.C. in London.Responsibilities:Guide customers in building big data solutions on Databricks that span a large variety of use cases.Work with and support Solution Architects, requiring hands-on production experience with cloud infrastructure and big data...

  • Big Data Engineer

    2 weeks ago


    London, Greater London, United Kingdom ADLIB Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at ADLIB. The ideal candidate will have experience with Databricks and SQL, as well as strong communication skills.About the Role:Lead the migration of data from legacy DB to Databricks.Design, implement, and optimize data pipelines using Databricks, PySpark, and...