Data Manager for Machine Learning Datasets

5 days ago


Reading, Reading, United Kingdom ECMWF Full time
About the Role

We are seeking a highly skilled Data Manager to join our team at ECMWF. As a Data Manager, you will play a key role in the management of training datasets for machine learning models, including the AIFS. You will be responsible for managing machine learning datasets for ECMWF activities, such as operational configurations, Destination Earth applications, and ECMWF's Member and Co-operating State undertakings.

You will work closely with users inside and outside of ECMWF, understanding the requirements for new datasets, and life-cycle management and curation of datasets between HPC systems across Europe. This is an exciting opportunity to work with a world-leading organisation in weather and environmental forecasting.

Key Responsibilities:

  • Manage and support the data handling requirements of ML applications.
  • Taking the responsibility for relevant elements in terms of creating, storing and serving of datasets to be used for machine learning applications, in close collaboration with ECMWF ML experts and with experts in ECMWF's Member and Cooperating States.
  • Collaborate with research and technical teams at ECMWF on ML developments, including the gathering of future requirements, producing projections of usage and performing resource capacity planning.
  • Act as Data Governance (DGov) facilitator for matters related to machine-learing, working collaboratively with ECMWF's existing DGov Facilitators and building expertise in the data format standards involved.
  • Act as Data Curator for ML datasets, with emphasis on the maintenance of catalogues and ensuring data accuracy and completeness.

Requirements:

  • Excellent interpersonal and communication skills are vital, to communicate with a wide range of technically skilled colleagues at ECMWF and in partner organisations, also to non-technical staff.
  • Dedication and enthusiasm to work as part of a team, taking initiative to work collaboratively with other team members and project partners.
  • Ability to at times work independently, but to know when it is important to seek advice.
  • Excellent analytical and problem-solving skills with a proactive continuous improvement approach.
  • Ability to work with precision and care and having a good awareness of the need to test thoroughly and document changes appropriately.
  • Ability and willingness to collaborate with internal and external experts on related aspects of governance and exchange of data for machine learning applications.
  • Active listener who seeks and respects the views of others.
  • Highly organised with the capacity to work on a diverse range of tasks to tight deadlines.
  • Flexibility, with a willingness to adapt plans if partner organisations work at different paces, and if priorities shift over time.
  • Candidates must be able to work and communicate effectively in English.

Education and Experience:

  • An advanced university degree (EQF Level 7 or above) or equivalent professional experience is required.
  • Experience curating large datasets (terabytes to petabytes) required.
  • Programming skills in Python and/or scripting languages in a UNIX/Linux environment required.
  • Experience handling scientific data formats in High Performance Computing environments is desirable.
  • Experience of working collaboratively on software development projects is desirable.

Knowledge and Skills:

  • Experience working in a scientific environment.
  • Experience working in a High Performance Computing environment.
  • Familiarity with big-data analytics, cloud technologies and machine learning fundamentals.
  • An understanding of numerical weather prediction or meteorological applications.
  • Knowledge of standardised data formats for international exchange.

What We Offer:

  • A competitive salary and benefits package.
  • The opportunity to work with a world-leading organisation in weather and environmental forecasting.
  • A dynamic and supportive work environment.
  • The chance to work on exciting and challenging projects.

How to Apply:

Applicants are invited to complete the online application form by clicking on the apply button.

ECMWF is an equal opportunities employer and welcomes applications from all qualified candidates.

For more information about ECMWF and the role, please visit our website at https://www.ecmwf.int/en/about/jobs.



  • Reading, Reading, United Kingdom ECMWF Full time

    Job OverviewECMWF is seeking a highly skilled Data Manager to play a leading role in the management of training datasets for machine learning models. The successful candidate will be responsible for managing machine learning datasets for ECMWF activities, including operational configurations, Destination Earth applications, and ECMWF's Member and Cooperating...


  • Reading, Reading, United Kingdom ECMWF Full time

    Job DescriptionECMWF is seeking a highly skilled Data Manager to play a leading role in the management of training datasets for machine learning models, including the AIFS system. The successful candidate will be responsible for managing machine learning datasets for ECMWF activities, such as operational configurations, Destination Earth applications, and...


  • Reading, Reading, United Kingdom Persistent Systems Full time

    About the RoleWe are seeking a highly skilled Data Scientist and Machine Learning Engineer to join our team at Persistent Systems. As a key member of our Digital Engineering and Enterprise Modernization team, you will play a crucial role in helping our clients transform their industries.Key ResponsibilitiesDesign, implement, and manage data science and...


  • Reading, Reading, United Kingdom Persistent Systems Full time

    About the RoleWe are seeking a highly skilled Data Scientist and Machine Learning Engineer to join our team at Persistent Systems. As a key member of our Digital Engineering and Enterprise Modernization team, you will play a crucial role in helping our clients transform their industries.Key ResponsibilitiesDesign, implement, and manage data science and...


  • Reading, Reading, United Kingdom Persistent Systems Full time

    About the RoleWe are seeking a highly skilled Data Scientist and Machine Learning Engineer to join our team at Persistent Systems. As a key member of our Digital Engineering and Enterprise Modernization team, you will play a crucial role in helping our clients transform their industries.Key ResponsibilitiesDesign, implement, and manage data science and...


  • Reading, Reading, United Kingdom Persistent Systems Full time

    About the RoleWe are seeking a highly skilled Data Scientist and Machine Learning Engineer to join our team at Persistent Systems. As a key member of our Digital Engineering and Enterprise Modernization team, you will play a crucial role in helping our clients transform their industries.Key ResponsibilitiesDesign, implement, and manage data science and...


  • Reading, Reading, United Kingdom IQVIA Full time

    Job Description:As a Senior Software Engineer - Data Science at {company}, you will be responsible for designing and developing cutting-edge data science solutions. Your primary focus will be on building and maintaining large-scale datasets, implementing machine learning algorithms, and collaborating with cross-functional teams to drive business growth.Key...

  • Data Scientist

    4 weeks ago


    Reading, Reading, United Kingdom Nokia Full time

    Job Title: Big Data ScientistThe Data Scientist plays a crucial role in driving business decisions with data-driven insights. This position involves handling large datasets, applying advanced analytics techniques, and communicating findings to stakeholders.Key Responsibilities:Design and implement data pipelines to extract insights from complex data...

  • Data Scientist

    4 weeks ago


    Reading, Reading, United Kingdom Nokia Full time

    Job Title: Big Data ScientistThe Data Scientist plays a crucial role in driving business decisions with data-driven insights. This position involves handling large datasets, applying advanced analytics techniques, and communicating findings to stakeholders.Key Responsibilities:Design and implement data pipelines to extract insights from complex data...


  • Reading, Reading, United Kingdom MarketCast UK Ltd Full time

    Unlock the Power of Data ScienceMarketCast UK Ltd is seeking a highly skilled Data Scientist to join our team in Reading. As a Data Scientist, you will play a critical role in analyzing large datasets, creating bespoke client reports, and building new algorithms to deliver services to clients.Key Responsibilities:Analyze extremely large datasets to identify...


  • Reading, Reading, United Kingdom MarketCast UK Ltd Full time

    Unlock the Power of Data ScienceMarketCast UK Ltd is seeking a highly skilled Data Scientist to join our team in Reading. As a Data Scientist, you will play a critical role in analyzing large datasets, creating bespoke client reports, and building new algorithms to deliver services to clients.Key Responsibilities:Analyze extremely large datasets to identify...


  • Reading, Reading, United Kingdom Mind Foundry Full time

    About the RoleMind Foundry is looking for a senior machine learning engineer to join our Defence and Security team. This role involves working on client sites 3-4 days a week, likely in London or Reading.About Mind FoundryOur company was established to ensure that AI is used to transform the world for the better. We design intelligent tools that are easy to...


  • Reading, Reading, United Kingdom SureCare Franchising Full time

    About the RoleWe are seeking a highly skilled Software Engineer with expertise in machine learning and data analysis to join our team. As a software engineer, you will be responsible for designing, developing, and deploying software applications using machine learning and data analysis techniques.Main Responsibilities:Design and develop software applications...

  • Data Scientist

    4 weeks ago


    Reading, Reading, United Kingdom MarketCast UK Ltd Full time

    Data Scientist IHybrid RoleAt MarketCast UK Ltd, we're seeking a talented Data Scientist to join our team. As a Data Scientist, you'll play a crucial role in helping us drive business growth through data-driven insights.Key Responsibilities:Develop and maintain machine learning pipelines and processes to extract meaningful insights from large...

  • Data Scientist

    4 weeks ago


    Reading, Reading, United Kingdom MarketCast UK Ltd Full time

    Data Scientist IHybrid RoleAt MarketCast UK Ltd, we're seeking a talented Data Scientist to join our team. As a Data Scientist, you'll play a crucial role in helping us drive business growth through data-driven insights.Key Responsibilities:Develop and maintain machine learning pipelines and processes to extract meaningful insights from large...


  • Reading, Reading, United Kingdom Signature Senior Lifestyle Limited Full time

    Job Title: Software Engineer in Python with experience in machine learning and data analysis.About the Role:We are seeking an experienced software developer to join our team as a software engineer in Python with expertise in machine learning and data analysis. The ideal candidate will have a strong background in Python programming and experience in working...


  • Reading, Reading, United Kingdom AWE Plc Full time

    Job Title: Machine Learning Research ScientistWe are seeking a highly skilled Machine Learning Research Scientist to join our team at AWE Plc.Location: Our office is located in a convenient location, with free onsite parking available.Due to the nature of the work, some flexibility in working hours may be required.Package: The successful candidate will...


  • Reading, Reading, United Kingdom AWE Plc Full time

    Job Title: Machine Learning Research ScientistWe are seeking a highly skilled Machine Learning Research Scientist to join our team at AWE Plc.Location: Our office is located in a convenient location, with free onsite parking available.Due to the nature of the work, some flexibility in working hours may be required.Package: The successful candidate will...


  • Reading, Reading, United Kingdom Samsung Full time

    Job Title: Software Development ProfessionalAbout the Role:We are seeking a highly skilled Software Development Professional to join our team. As an experienced developer, you will be responsible for designing, developing, and maintaining software applications using machine learning and data analysis techniques.Key Responsibilities:Design and develop...


  • Reading, Reading, United Kingdom Mind Foundry Full time

    Defence and Security Machine Learning EngineerAbout the RoleMind Foundry is seeking a highly skilled Defence and Security Machine Learning Engineer to join our team. As a key member of our Engineering and Machine Learning department, you will be responsible for designing and developing AI/ML solutions for our Defence and Security clients.Key...