Big Data Solutions Expert

1 month ago


Belfast, United Kingdom HAYS Specialist Recruitment Full time
Job Title: Big Data Specialist

We are currently working with a global financial institution to recruit a Big Data specialist to join their dynamic Data Strategy team, dedicated to meeting the evolving business, analytical, and regulatory needs of their clients.

Key Responsibilities:
  • Onboard new users and clients to the organisation's Big Data platform.
  • Collaborate with cross-functional teams to identify and prioritize data requirements, data quality issues, and performance bottlenecks.
  • Set up build pipelines to automate the build and deployment process.
  • Conduct code reviews, detect suboptimal queries, and address performance issues.
  • Guide teams to follow industry-standard best practices.
  • Design and develop scalable and fault-tolerant big data solutions on the Cloudera platform.
  • Monitor and optimize the risk data platform for performance, scalability, and cost-effectiveness.
Requirements:
  • 5+ years of experience in big data technologies, with at least 3 years of experience in Apache Spark and Cloudera.
  • Strong knowledge of big data technologies, including Hadoop, Hive, HBase, Kafka, and YARN.
  • Excellent programming skills in Python and/or Scala.
  • Strong analytical, problem-solving, and communication skills.
  • Bachelor's or master's degree in computer science, Information Systems, or a related field.
  • The ability to work independently and collaboratively in a fast-paced, agile environment.

This role will be hybrid with 3 days working from the office in Belfast. Although the role is initially for a 12-month period, there is a high possibility of extension. If you're interested in this role, please forward an up-to-date copy of your CV or contact us for a confidential discussion about your career.



  • Belfast, United Kingdom Hays Technology Full time

    We are currently working with a global financial institution to recruit a Big Data engineer to join their dynamic Data Strategy team, dedicated to meeting the evolving business, analytical, and regulatory needs of their clients.Key ResponsibilitiesIntegrate diverse data sources, enabling industry-leading analytics, client reporting, regulatory compliance,...


  • Belfast, United Kingdom Data Intellect Full time

    Job DescriptionWe are seeking a highly skilled Data Scientist and Engineer to join our team at Data Intellect. As a key member of our data science and engineering team, you will be responsible for designing, developing, and implementing data-driven solutions for our clients.Key Responsibilities:Design and develop bespoke data science and engineering...

  • Data Engineer

    4 weeks ago


    Belfast, United Kingdom Data Intellect Full time

    Job DescriptionWhat you’ll be doing:Build and enhance bespoke Data Science and Engineering solutions for our clientsEnhance and grow your data science and engineering knowledge among subject matter experts in our learning and development ecosystem Deliver high quality, best practice software solutions Use a range of architectures, tools and...


  • Belfast, United Kingdom WorksHub Full time

    As a Data Scientist with Big Data Expertise at WorksHub, you will leverage your skills in Unix/Linux scripting to drive data-driven decision making.Key Responsibilities:Design and build production data pipelines from ingestion to consumption within a hybrid big data environmentDevelop and model using Big Data tools like Scala, Spark, Impala & HiveRequired...


  • Belfast, United Kingdom Data Intellect Full time

    Job Title: Databricks Practice LeadJob Summary:Data Intellect is seeking a highly skilled Databricks Practice Lead to drive the growth, innovation, and successful delivery of cloud-based data solutions for our clients. As a key member of our team, you will collaborate with internal teams and clients to design, implement, and optimize big data and machine...

  • Java Contractor

    1 month ago


    Belfast, United Kingdom Data Intellect Full time

    Job DescriptionAs a Senior Java Developer, you will be primarily working within the back-end development team and will gain exposure to the full software stack. You will use modern development tools and concepts to deliver high quality, best practice software solutions.Please note, this role is Belfast based.What you will be doing: Design, build and enhance...


  • Belfast, United Kingdom Rapid7 Full time

    About the TeamThe Rapid7 Data Platform is a unified, integrated platform that provides customers with enhanced visibility into their attack surface, operational efficiency, risk management, and decision-making capabilities.Our teams are responsible for consolidating data from all Rapid7 products, transforming it for optimized retrieval, and ensuring...


  • Belfast, United Kingdom Rapid7 Full time

    About the Team The Rapid7 Data Platform is a unified, integrated platform powered by Rapid7’s product suite providing our customers enhanced visibility into their attack surface, operational efficiency, risk management, and decision-making capabilities.  Our teams are responsible for consolidating data from all Rapid7 products, transforming it for...

  • Data Engineer

    3 weeks ago


    Belfast, United Kingdom aPriori Full time

    Data Engineer Job DescriptionWe are seeking a skilled Data Engineer to build and maintain scalable data products and ensure the reliability of data architecture. The ideal candidate will have a solid background in data engineering, software development, and data management.Key ResponsibilitiesDesign, implement, and maintain data products and data platform...


  • Belfast, United Kingdom aPriori Full time

    Estimate Salary: £90,000 - £120,000 per annumWe are seeking an experienced Data Engineering Lead to oversee the development and maintenance of scalable data products and ensure the reliability of our data architecture. With a strong background in data engineering, software development, and data management, you will lead a team of data engineers in...

  • Data Engineer

    19 hours ago


    Belfast, United Kingdom Data Intellect Full time

    Job OverviewWe are seeking a highly skilled Data Engineer to join our team at Data Intellect. As a Data Engineer, you will be responsible for designing, developing, and implementing data-driven solutions that transform our clients' businesses.Key ResponsibilitiesDesign and Develop Data-Driven SolutionsCollaborate with Cross-Functional TeamsImplement and...


  • Belfast, United Kingdom VANRATH Full time

    An exciting opportunity for a Senior Software Engineer to join this growing company. My client works in the Research sector, working in Tech for Good. You will get the opportunity to work on cutting edge software, for this award wining company. The company are seeking an experienced Software Engineer who is able to take large sets of data from multiple...

  • Kdb+ Contractor

    5 months ago


    Belfast, United Kingdom Data Intellect Full time

    **Company Description** Every question matters, every pathway, direction, thought process and conversation. Because every challenge makes us stronger, more knowledgeable, more determined and more valuable to our clients. We’re not big on egos and we’re not for the faint hearted. We stand for camaraderie, collaboration and change. - Welcome to _**_Data...

  • Data Engineer

    3 weeks ago


    Belfast, United Kingdom Rapid7 Full time

    About the Role The Rapid7 Data Platform is a unified, integrated platform that powers our customers' decision-making capabilities. We're seeking a Data and Performance Engineer who will collaborate with our product teams to optimize data pipelines for performance and efficiency. This role is crucial to the platform's success as it focuses on building a...

  • Project/Data Analyst

    1 month ago


    Belfast, United Kingdom Hays Full time

    Big data engineer, Day Rate Contract, Belfast (hybrid), up to £640 p/d We are currently working with a global financial institution to recruit a Big Data engineer join their dynamic Data Strategy team, dedicated to meeting the evolving business, analytical, and regulatory needs of their clients. This role will integrate diverse data sources, enabling...

  • Project/Data Analyst

    2 months ago


    Belfast, United Kingdom Hays Full time

    Big data engineer, Day Rate Contract, Belfast (hybrid), up to £640 p/d We are currently working with a global financial institution to recruit a Big Data engineer join their dynamic Data Strategy team, dedicated to meeting the evolving business, analytical, and regulatory needs of their clients. This role will integrate diverse data sources, enabling...


  • Belfast, United Kingdom Anson McCade Full time

    Principal Data Engineer • Belfast based – Hybrid - flexible working • Package : £5,900 car allowance (can be taken as cash) + 15 % bonus + 11% pension One of the UK’s leading digital solution provider’s is searching for a Data Engineer to join their practice in Belfast and work on developing cutting-edge greenfield solutions for their...


  • Belfast, United Kingdom Lorien Full time

    Cloud Solutions Expert Lorien is seeking a Cloud Solutions Expert to contribute to the full span of projects, architecting AWS applications that meet and exceed client needs. The ideal candidate will oversee projects from requirements gathering to delivery, ensuring seamless execution and client satisfaction. Key Responsibilities: Oversee projects from...

  • Senior Java Developer

    1 month ago


    Belfast, United Kingdom Data Intellect Full time

    Job Title: Senior Java DeveloperAt Data Intellect, we are seeking a highly skilled Senior Java Developer to join our team. As a key member of our back-end development team, you will be responsible for designing, building, and enhancing bespoke Java solutions for our clients.Key Responsibilities:Design and develop high-quality, best practice Java...


  • Belfast, United Kingdom Lorien Full time

    Key Responsibilities: As a Cloud Solutions Expert at Lorien, you will oversee projects from requirements gathering and presales phases through to delivery, ensuring seamless execution and client satisfaction throughout. You will design and build cloud-based infrastructure and applications using AWS, adhering to both customer requirements and industry best...