Data Reliability Engineer

2 weeks ago


Belfast, United Kingdom caia - Jobboard Full time

Data Reliability Engineer

Caia - Jobboard is seeking a skilled Data Reliability Engineer to join our team. As a Data Reliability Engineer, you will be responsible for ensuring the reliability, scalability, and efficiency of our data infrastructure on Google Cloud Platform (GCP).

Key Responsibilities:

  1. Automate data tasks on GCP using tools such as Terraform and KCC.
  2. Design, build, secure, and maintain data infrastructure, including data pipelines, databases, data warehouses, and data processing platforms on GCP.
  3. Measure and monitor the quality of data on GCP data platforms.
  4. Implement robust monitoring and alerting systems to proactively identify and resolve issues in data systems.
  5. Develop automation scripts and tools to streamline data operations and make them scalable to accommodate growing data volumes and user traffic.
  6. Optimize data systems to ensure efficient data processing, reduce latency, and improve overall system performance.
  7. Collaborate with data and infrastructure teams to forecast data growth and plan for future capacity requirements.
  8. Ensure data security and compliance with data protection regulations.

Requirements:

  1. Bachelor's or Master's degree in Computer Science, Software Engineering, Data Science, or related field, or equivalent practical experience.
  2. Experience as a Data Site Reliability Engineer or a similar role, with a focus on data infrastructure management.
  3. Proficiency in data technologies, such as relational databases, data warehousing, big data platforms (e.g., Hadoop, Spark), data streaming (e.g., AWS, GCP, Azure).
  4. Ideally some programming skills in languages like Python, Java, or Scala, with experience in automation and scripting.
  5. Experience with data governance, data security, and compliance best practices.
  6. Understanding of software development methodologies and best practices, including version control (e.g., Git).
  7. Ideally a background in cloud computing and data-intensive applications and services, with a focus on Google Cloud Platform.
  8. 3+ years of experience in data engineering or data science.
  9. Experience with data quality assurance and testing.
  10. Ideally knowledge of GCP data services (BigQuery; Data Fusion; Google Cloud Storage).
  11. Understanding of logging and monitoring using tools such as Cloud Logging, ELK Stack, AppDynamics, New Relic, Splunk, etc.
  12. Proven ability to learn new technologies, including open source and cloud-native offerings.
  13. Knowledge of AI and ML tools is a plus.
  14. Google Associate Cloud Engineer or Data Engineer certification is a plus.


  • Belfast, United Kingdom caia - Jobboard Full time

    Data Reliability EngineerJob Summary:We are seeking a highly skilled Data Reliability Engineer to join our team. As a Data Reliability Engineer, you will be responsible for ensuring the reliability, scalability, and efficiency of our data infrastructure on Google Cloud Platform.Key Responsibilities:Automate data tasks on GCP using tools such as Terraform and...


  • Belfast, United Kingdom CME Group Full time

    Job Title: Data Reliability EngineerCompany: CME GroupJob Summary:We are seeking a highly skilled Data Reliability Engineer to join our team at CME Group. As a Data Reliability Engineer, you will be responsible for ensuring the reliability, scalability, and efficiency of our data infrastructure on Google Cloud Platform (GCP). You will work closely with data...


  • Belfast, United Kingdom CME Group Full time

    Job Title: Data Reliability EngineerCompany: CME GroupJob Summary:We are seeking a highly skilled Data Reliability Engineer to join our team at CME Group. As a Data Reliability Engineer, you will be responsible for ensuring the reliability, scalability, and efficiency of our data infrastructure on Google Cloud Platform (GCP). You will work closely with data...


  • Belfast, United Kingdom College of Charleston Full time

    Data Reliability EngineerAbout the Role:We are seeking a highly skilled Data Reliability Engineer to join our team at CME Group. As a Data Reliability Engineer, you will play a crucial role in ensuring the reliability, scalability, and efficiency of our data infrastructure on Google Cloud Platform (GCP).Key Responsibilities:Automate data tasks on GCPWork...


  • Belfast, United Kingdom College of Charleston Full time

    Job Title: Data Reliability EngineerJob Summary: We are seeking a highly skilled Data Reliability Engineer to join our team at the College of Charleston. As a Data Reliability Engineer, you will be responsible for ensuring the reliability, scalability, and efficiency of our data infrastructure on the Google Cloud Platform (GCP).Key Responsibilities:Automate...


  • Belfast, United Kingdom College of Charleston Full time

    Data Reliability EngineerAbout the Role:We are seeking a highly skilled Data Reliability Engineer to join our team at CME Group. As a Data Reliability Engineer, you will play a crucial role in ensuring the reliability, scalability, and efficiency of our data infrastructure on Google Cloud Platform (GCP).Key Responsibilities:Automate data tasks on GCPWork...


  • Belfast, United Kingdom CME Group Full time

    Data Reliability EngineerCME Group is seeking a highly skilled Data Reliability Engineer to join our team. As a key member of our data engineering team, you will be responsible for ensuring the reliability, scalability, and efficiency of our data infrastructure on Google Cloud Platform.Key Responsibilities:Automate data tasks on GCP to improve efficiency and...


  • Belfast, United Kingdom CME Group Full time

    Data Reliability EngineerCME Group is seeking a highly skilled Data Reliability Engineer to join our team. As a key member of our data engineering team, you will be responsible for ensuring the reliability, scalability, and efficiency of our data infrastructure on Google Cloud Platform.Key Responsibilities:Automate data tasks on GCP to improve efficiency and...


  • Belfast, United Kingdom CME Group Full time

    Job Title: Data Reliability EngineerCompany: CME GroupJob Summary:We are seeking a highly skilled Data Reliability Engineer to join our team at CME Group. As a Data Reliability Engineer, you will be responsible for ensuring the reliability, scalability, and efficiency of our data infrastructure on Google Cloud Platform (GCP). You will work closely with data...


  • Belfast, United Kingdom CME Group Full time

    Job Title: Data Reliability EngineerCompany: CME GroupJob Summary:We are seeking a highly skilled Data Reliability Engineer to join our team at CME Group. As a Data Reliability Engineer, you will be responsible for ensuring the reliability, scalability, and efficiency of our data infrastructure on Google Cloud Platform (GCP). You will work closely with data...


  • Belfast, United Kingdom CME Group Full time

    Data Reliability EngineerCME Group is seeking a highly skilled Data Reliability Engineer to join our team. As a key member of our data infrastructure team, you will be responsible for ensuring the reliability, scalability, and efficiency of our data systems.Key Responsibilities:Automate data tasks on GCP to improve efficiency and reduce errorsCollaborate...


  • Belfast, United Kingdom CME Group Full time

    Data Reliability EngineerCME Group is seeking a highly skilled Data Reliability Engineer to join our team. As a key member of our data infrastructure team, you will be responsible for ensuring the reliability, scalability, and efficiency of our data systems.Key Responsibilities:Automate data tasks on GCP to improve efficiency and reduce errorsCollaborate...


  • Belfast, United Kingdom CME Group Full time

    About the Role:CME Group is seeking a highly skilled Data Reliability Engineer to join our team. As a Data Reliability Engineer, you will play a crucial role in ensuring the reliability, scalability, and efficiency of our data infrastructure on Google Cloud Platform (GCP).Key Responsibilities:Automate data tasks on GCPCollaborate with data domain owners,...


  • Belfast, United Kingdom CME Group Full time

    About the Role:CME Group is seeking a highly skilled Data Reliability Engineer to join our team. As a Data Reliability Engineer, you will play a crucial role in ensuring the reliability, scalability, and efficiency of our data infrastructure on Google Cloud Platform (GCP).Key Responsibilities:Automate data tasks on GCPCollaborate with data domain owners,...


  • Belfast, United Kingdom CME Group Full time

    Data Reliability EngineerCME Group is seeking a highly skilled Data Reliability Engineer to join our team. As a key member of our data infrastructure team, you will be responsible for ensuring the reliability, scalability, and efficiency of our data systems.Key Responsibilities:Automate data tasks on GCP to improve efficiency and reduce errors.Collaborate...


  • Belfast, United Kingdom CME Group Full time

    Data Reliability EngineerCME Group is seeking a highly skilled Data Reliability Engineer to join our team. As a key member of our data infrastructure team, you will be responsible for ensuring the reliability, scalability, and efficiency of our data systems.Key Responsibilities:Automate data tasks on GCP to improve efficiency and reduce errors.Collaborate...


  • Belfast, United Kingdom College of Charleston Full time

    Data System Reliability EngineerA crucial role in CME's Cloud data transformation, the data SRE will be aligned to data product pods ensuring our data infrastructure is reliable, scalable, and efficient as the GCP data footprint expands rapidly.Key Responsibilities:Automate data tasks on GCPWork with data domain owners, data scientists and other stakeholders...


  • Belfast, United Kingdom CME Group Full time

    About the Role:CME Group is seeking a highly skilled Data Reliability Engineer to join our team. As a key member of our Cloud data transformation, you will be aligned to data product pods to ensure that our data infrastructure is reliable, scalable, and efficient as the GCP data footprint expands rapidly.Key Responsibilities:Automate data tasks on...


  • Belfast, United Kingdom CME Group Full time

    About the Role:CME Group is seeking a highly skilled Data Reliability Engineer to join our team. As a key member of our Cloud data transformation, you will be aligned to data product pods to ensure that our data infrastructure is reliable, scalable, and efficient as the GCP data footprint expands rapidly.Key Responsibilities:Automate data tasks on...

  • Data Engineer

    1 week ago


    Belfast, United Kingdom Data Intellect Full time

    Job DescriptionWhat you’ll be doing:Build and enhance bespoke Data Science and Engineering solutions for our clientsEnhance and grow your data science and engineering knowledge among subject matter experts in our learning and development ecosystem Deliver high quality, best practice software solutions Use a range of architectures, tools and...