Big Data Specialist

3 weeks ago

London, United Kingdom Vallum Associates Full time

Role: Big Data Architect (GCP)

Location : 2/3 days Onsite in London

Full Time opportunity




Job Description

You will be responsible for translating client requirements into design, architecting, and implementing GCP Cloud-based big data solutions for clients. Your role will be focused on delivering high-quality solutions by independently driving design discussions related to Data Ingestion, Transformation & Consumption, Data Storage and Computation Frameworks, Performance Optimizations, Infrastructure, Automation & Cloud Computing, and Data Governance & Security. The role requires a hands-on technologist with expertise in Big Data solution architecture and with a strong programming background in Java / Scala / Python.


Your Impact:

  • Provide technical leadership and hands-on implementation role in the areas of data engineering including data ingestion, data access, modeling, data processing, visualization, design, and implementation.
  • Lead a team to deliver high quality big data technologies-based solutions on GCP Cloud. Manage functional & nonfunctional scope and quality.
  • Help establish standard data practices like governance and address other non-functional issues like data security, privacy, and quality.
  • Manage and provide technical leadership to a data program implementation based on the requirement using agile technologies.
  • Participate in workshops with clients and align client stakeholders to optimal solutions.
  • Consulting, Soft Skills, Thought Leadership, Mentorship etc.
  • People management, contributing to hiring and capability building.


Qualifications

Your Skills & Experience:

  • Overall 8+ years of IT experience with 3+ years in Data related technologies, and expertise of 1+ years in data-related GCP Cloud services and delivered at least 1 project as an architect.
  • Mandatory to have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end Big Data solutions on GCP Cloud.
  • Expert in programming languages like Java/ Scala and good to have Python
  • Expert in at least one distributed data processing framework: Spark (Core, Streaming, SQL), Storm or Flink, etc.
  • Expert in Hadoop eco-system with GCP cloud distribution and worked at least on one or more big data ingestion tools (Sqoop, Flume, NiFI, etc), distributed messaging and ingestion frameworks (Kafka, Pulsar, Pub/Sub, etc) and good to know traditional tools like Informatica, Talend, etc
  • Should have worked on any NoSQL solutions like Mongo DB, Cassandra, HBase, etc, or Cloud-based NoSQL offerings like DynamoDB, Big Table, etc.
  • Good Exposure in development with CI / CD pipelines. Knowledge of containerization, orchestration, and Kubernetes engine would be an added advantage.


Set Yourself Apart With:

  • Certification on GCP cloud platform or big data technologies.
  • Strong analytical and problem-solving skills.
  • Excellent understanding of data technologies landscape/ecosystem.

  • Big Data Engineering Lead

    1 day ago

    London, Greater London, United Kingdom Data Science Festival Full time

    **Job Overview**Data Science Festival is seeking an experienced Big Data Engineering Lead to join their team in London – hybrid. This is a fantastic opportunity for a skilled professional to drive data transformation and deliver value throughout the company.This hands-off role requires someone with extensive experience in managing teams, stakeholder...

  • Senior Big Data Infrastructure Specialist

    4 days ago

    London, Greater London, United Kingdom InterEx Group Full time

    Job Title: Senior Big Data Infrastructure SpecialistWe are looking for an experienced and skilled Senior Big Data Infrastructure Specialist to join our team at InterEx Group. As a Senior Big Data Infrastructure Specialist, you will be responsible for designing and implementing robust Big Data solutions that meet the needs of our clients.Job Description:We...

  • Big Data Specialist

    3 weeks ago

    London, Greater London, United Kingdom WorksHub Full time

    Data Engineer, Prime Video Core Analytics and ToolingWe are seeking a Data Engineer with expertise in big data technologies to join our team at WorksHub.Key Responsibilities:Design and implement big data pipelines using Hadoop, Hive, and Spark.Develop and maintain scalable data processing systems using EMR.Collaborate with the team to ensure data quality and...

  • Big Data Specialist

    3 weeks ago

    London, United Kingdom Vallum Associates Full time

    Job Description Role: Big Data Architect (GCP) Location : 2/3 days Onsite in London Full Time opportunity Job Description You will be responsible for translating client requirements into design, architecting, and implementing GCP Cloud-based big data solutions for clients. Your role will be focused on delivering high-quality solutions by...

  • Big Data Specialist

    3 weeks ago

    london, United Kingdom Vallum Associates Full time

    Role: Big Data Architect (GCP) Location : 2/3 days Onsite in London Full Time opportunity Job Description You will be responsible for translating client requirements into design, architecting, and implementing GCP Cloud-based big data solutions for clients. Your role will be focused on delivering high-quality solutions by independently driving design...

  • Big Data Specialist

    3 weeks ago

    London,, UK, United Kingdom Vallum Associates Full time

    Role: Big Data Architect (GCP)Location : 2/3 days Onsite in London Full Time opportunity Job DescriptionYou will be responsible for translating client requirements into design, architecting, and implementing GCP Cloud-based big data solutions for clients. Your role will be focused on delivering high-quality solutions by independently driving design...

  • Big Data Specialist

    3 weeks ago

    London, United Kingdom Vallum Associates Full time

    Role: Big Data Architect (GCP)Location : 2/3 days Onsite in London Full Time opportunity Job DescriptionYou will be responsible for translating client requirements into design, architecting, and implementing GCP Cloud-based big data solutions for clients. Your role will be focused on delivering high-quality solutions by independently driving design...

  • Data Engineer Specialist

    7 hours ago

    London, Greater London, United Kingdom ATTB - The Big Jobsite Full time

    ATTB - The Big Jobsite is seeking a talented Data Engineer Specialist to join our data team in London. This is a permanent role with an estimated salary of £50,000 - £75,000 plus a 20% bonus, and you will work from home.The ideal candidate will have expertise in the Microsoft Power platform stack, including POWER BI and POWER BI DAX. As a Data Engineer...

  • Data Engineer

    4 weeks ago

    London, United Kingdom Stealth IT Consulting Limited Full time

    Job Title: Data Engineer - Big Data Technologies SpecialistAbout the Role:We are seeking a highly skilled Data Engineer to join our team at Stealth IT Consulting Limited. As a Data Engineer, you will be responsible for developing applications on Big Data technologies, including API development, and working with Python programming, database management, and...

  • Big Data Engineering Specialist

    2 weeks ago

    London, Greater London, United Kingdom Vallum Associates Full time

    At Vallum Associates, we are seeking a highly skilled Big Data Architect to join our team. This is an excellent opportunity for an experienced IT professional to lead our data technologies initiatives and drive the implementation of end-to-end big data solutions on GCP Cloud.About You: To be successful in this role, you will need at least 8 years of...

  • Big Data and AI Transformation Specialist

    4 days ago

    London, Greater London, United Kingdom Databricks Full time

    Job DescriptionWe are seeking a highly motivated Big Data and AI Transformation Specialist to join our team at Databricks. As a key member of our sales team, you will play a critical role in driving business growth and success within the Communication, Media, and Entertainment (CME) sector.Key ResponsibilitiesProvide industry insights and develop unique use...

  • Big Data Engineer

    1 month ago

    London, Greater London, United Kingdom WorksHub Full time

    Data Engineer Position at WorksHubWe are seeking a skilled Data Engineer to join our team at WorksHub.The ideal candidate will have experience in big data technologies such as Hadoop, Hive, and Spark, as well as a strong background in programming languages such as Python, Java, and Scala.Key ResponsibilitiesDesign and develop scalable data pipelines using...

  • Big Data Architect

    1 month ago

    London, United Kingdom CV-Library Full time

    Overall 8+ years of IT experience with 3+ years in Data related technologies, and expertise of 1+ years in data-related GCP Cloud services and delivered at least 1 project as an architect. * Mandatory to have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end Big Data solutions on GCP Cloud. * Expert in programming...

  • Big Data Architect

    3 weeks ago

    London,, UK, United Kingdom Vallum Associates Full time

    Overall 8+ years of IT experience with 3+ years in Data related technologies, and expertise of 1+ years in data-related GCP Cloud services and delivered at least 1 project as an architect.Mandatory to have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end Big Data solutions on GCP Cloud.Expert in programming languages...

  • Big Data Architect

    4 weeks ago

    London, United Kingdom Vallum Associates Full time

    Overall 8+ years of IT experience with 3+ years in Data related technologies, and expertise of 1+ years in data-related GCP Cloud services and delivered at least 1 project as an architect.Mandatory to have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end Big Data solutions on GCP Cloud.Expert in programming languages...

  • Big Data Architect

    3 weeks ago

    London, United Kingdom Vallum Associates Full time

    Overall 8+ years of IT experience with 3+ years in Data related technologies, and expertise of 1+ years in data-related GCP Cloud services and delivered at least 1 project as an architect.Mandatory to have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end Big Data solutions on GCP Cloud.Expert in programming languages...

  • Solutions Architect

    3 weeks ago

    London, Greater London, United Kingdom Databricks Inc. Full time

    At Databricks, we strive to empower customers to make informed decisions by harnessing the power of data and AI. As a Solutions Architect, you will play a crucial role in demonstrating the capabilities of our Data Intelligence Platform to drive business growth.The impact you will have:Develop and maintain strong relationships with clients across your...

  • Big Data Architect

    2 weeks ago

    London, United Kingdom InterEx Group Full time

    For this role, you will be responsible for providing the framework that appropriately replicates the Big Data needs of a company utilizing data. Essential requirements: More than 3 years of presales experience in the design of Big Data and Data analytics solutions according to customer requirements Previous experience with the preparation of high-quality...

  • Big Data Architect

    3 weeks ago

    London, United Kingdom Vallum Associates Full time

    Job Description Overall 8+ years of IT experience with 3+ years in Data related technologies, and expertise of 1+ years in data-related GCP Cloud services and delivered at least 1 project as an architect. Mandatory to have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end Big Data solutions on GCP Cloud. Expert in...

  • Big Data Architect

    3 weeks ago

    london, United Kingdom InterEx Group Full time

    For this role, you will be responsible for providing the framework that appropriately replicates the Big Data needs of a company utilizing data. Essential requirements: More than 3 years of presales experience in the design of Big Data and Data analytics solutions according to customer requirements Previous experience with the preparation of high-quality...