Senior Manager, Quality Operations, AGI Data Services

2 weeks ago


Cambridge, Cambridgeshire, United Kingdom Amazon Data Services UK Limited Full time
Amazon's AGI Data Services organization is hiring a Senior Manager of Quality Operations for its Data Quality business unit. The purpose of the role is to manage our worldwide network of Quality Auditors and Quality Specialists and oversee the human verification of the data that the organization creates and annotates. Come be part of an initiative that is critical to building and improving the just-launched Amazon Nova foundational models

Today, AGI Data Services produces tens of millions of units of human-created data that is used to train and fine-tune large language models. These data must be evaluated based on whether they were generated following the conventions defined by the workflow, on dimensions such as complexity, correctness, helpfulness and harmfulness. Filtering out high quality data from low quality is of paramount importance, as it maximizes our chances of improving performance of the model under test.

To achieve this objective, the Data Quality organization is responsible for auditing individual units of data, as well as building an automated system using a large language model to predict and filter high quality units of data from low. The Senior Manager of Quality Operations will manage our network of Quality Auditors and Quality Specialists in eight countries that sit with the experts who create this data, reviewing their work to find defects, suggesting process improvements that lead to generating higher quality data while balancing the need to generate the data quickly and cost-competitively. Our quality assessments must be highly accurate in order to avoid sending poor quality data to our customers, necessitating constant measurement and improvement of the accuracy of our quality assessments. This role partners with the entire AGI Data Services network to advocate for changes to the overall operations processes that improve quality; and with the rest of the Data Quality organization to provide requirements and ground truth for the improvement of our automated quality checks.

BASIC QUALIFICATIONS

* Bachelor's Degree from an accredited university or equivalent qualification.
* 5+ years of previous supervisory experience in a production, distribution or manufacturing environment.
* 5+ years of previous people management experience, as well as proven ability to drive employee engagement and development plans.
* Background in Quality Assurance Management with the proven ability to show improvement in a continually developing environment.
* Experience in fast-paced environments, driving process improvement across different teams, while motivating others to meet challenges.
* Relevant experience working with high-level stakeholders in a complex, ambiguous environment.
* Proficient verbal and written communications skills both in English.

PREFERRED QUALIFICATIONS

* Degree in a science or logistics-based discipline, with a strong bias towards analytics and data.
* Experience in Machine Learning Data operations disciplines, including data creation, collection and annotation.
* Experience in remote team management and team development.
* Experience with Lean and Six Sigma methodologies and techniques.


  • Cambridge, Cambridgeshire, United Kingdom Evi Technologies Limited Full time

    The Amazon General Intelligence Data Services (AGI-DS) organization is engaged in data processing to support generative, large language AI models. The Alexa service is always getting smarter, both for features, and for natural language understanding and accuracy. Because Alexa's brains are in the AWS cloud, she continually learns and adds more functionality,...


  • Cambridge, Cambridgeshire, United Kingdom Amazon Full time

    Senior Data Associate with Italian, AGI-Data ServicesJob ID: 2920035 | Evi Technologies Limited - C67AI is the most transformational technology of our time, capable of tackling some of humanity's most challenging problems. Amazon is investing in generative AI and the responsible development and deployment of large language models (LLMs) across all of our...


  • Cambridge, Cambridgeshire, United Kingdom Amazon Full time

    Senior Data Associate with Italian, AGI-Data ServicesJob ID: 2920035 | Evi Technologies Limited - C67AI is the most transformational technology of our time, capable of tackling some of humanity's most challenging problems. Amazon is investing in generative AI and the responsible development and deployment of large language models (LLMs) across all of our...


  • Cambridge, Cambridgeshire, United Kingdom Amazon Full time

    Senior Data Associate with German, AGI-Data ServicesJob ID: 2914587 | Evi Technologies Limited - C67AI is the most transformational technology of our time, capable of tackling some of humanity's most challenging problems. Amazon is investing in generative AI and the responsible development and deployment of large language models (LLMs) across all of our...


  • Cambridge, Cambridgeshire, United Kingdom ENGINEERINGUK Full time

    Senior Data Associate with Italian, AGI-Data ServicesSector: LegalRole: Senior ExecutiveContract Type: PermanentHours: Full TimeDESCRIPTIONAI is the most transformational technology of our time, capable of tackling some of humanity's most challenging problems. Amazon is investing in generative AI and the responsible development and deployment of large...


  • Cambridge, Cambridgeshire, United Kingdom ENGINEERINGUK Full time

    You will need to login before you can apply for a job.Senior Data Associate with German, AGI-Data ServicesSector: LegalRole: Senior ExecutiveContract Type: PermanentHours: Full TimeDESCRIPTIONAI is the most transformational technology of our time, capable of tackling some of humanity's most challenging problems. Amazon is investing in generative AI and the...


  • Cambridge, Cambridgeshire, United Kingdom ENGINEERINGUK Full time

    You will need to login before you can apply for a job.Senior Data Associate with German, AGI-Data ServicesSector: LegalRole: Senior ExecutiveContract Type: PermanentHours: Full TimeDESCRIPTIONAI is the most transformational technology of our time, capable of tackling some of humanity's most challenging problems. Amazon is investing in generative AI and the...


  • Cambridge, Cambridgeshire, United Kingdom Amazon Full time

    Senior Data Associate with German, AGI-Data ServicesJob ID: 2914587 | Evi Technologies Limited - C67AI is the most transformational technology of our time, capable of tackling some of humanity's most challenging problems. Amazon is investing in generative AI and the responsible development and deployment of large language models (LLMs) across all of our...


  • Cambridge, Cambridgeshire, United Kingdom ENGINEERINGUK Full time

    Senior Data Associate with French, AGI-Data ServicesDESCRIPTIONAI is the most transformational technology of our time, capable of tackling some of humanity's most challenging problems. Amazon is investing in generative AI and the responsible development and deployment of large language models (LLMs) across all of our businesses. Come build the future of...


  • Cambridge, Cambridgeshire, United Kingdom Amazon Full time

    Senior Data Associate with German, AGI-Data ServicesJob ID: 2914587 | Evi Technologies Limited - C67AI is the most transformational technology of our time, capable of tackling some of humanity's most challenging problems. Amazon is investing in generative AI and the responsible development and deployment of large language models (LLMs) across all of our...


  • Cambridge, Cambridgeshire, United Kingdom Evi Technologies Limited Full time

    The AGI team is looking for experienced Technical Program Manager to help us expand our engineering operations that follow expansion of our customer base. This is a high visibility role that will require working with several engineering teams to help streamline operations and deliver greater experiences to our customers at a high velocity. You will be a...


  • Cambridge, Cambridgeshire, United Kingdom ENGINEERINGUK Full time

    You will need to login before you can apply for a job.Sector: Science and PharmaceuticalRole: Senior ExecutiveContract Type: PermanentHours: Full TimeDESCRIPTIONThe Artificial General Intelligence team (AGI) has an exciting position for a Senior Applied Scientist with a strong background in Machine Learning and Large Language Models to play a critical role...


  • Cambridge, Cambridgeshire, United Kingdom Evi Technologies Limited - C67 Full time

    AI is the most transformational technology of our time, capable of tackling some of humanity's most challenging problems. Amazon is investing in generative AI and the responsible development and deployment of large language models (LLMs) across all of our businesses. Come build the future of human-technology interaction with us.We are looking for those...


  • Cambridge, Cambridgeshire, United Kingdom Evi Technologies Limited - C67 Full time

    AI is the most transformational technology of our time, capable of tackling some of humanity's most challenging problems. Amazon is investing in generative AI and the responsible development and deployment of large language models (LLMs) across all of our businesses. Come build the future of human-technology interaction with us.We are looking for those...


  • Cambridge, Cambridgeshire, United Kingdom Evi Technologies Limited Full time

    AI is the most transformational technology of our time, capable of tackling some of humanity's most challenging problems. Amazon is investing in generative AI and the responsible development and deployment of large language models (LLMs) across all of our businesses. Come build the future of human-technology interaction with us. We are hiring Senior Data...


  • Cambridge, Cambridgeshire, United Kingdom Amazon Full time

    Job ID: 2868138 | Evi Technologies LimitedAI is the most transformational technology of our time, capable of tackling some of humanity's most challenging problems. Amazon is investing in generative AI and the responsible development and deployment of large language models (LLMs) across all of our businesses. Come build the future of human-technology...


  • Cambridge, Cambridgeshire, United Kingdom ENGINEERINGUK Full time

    DESCRIPTIONAI is the most transformational technology of our time, capable of tackling some of humanity's most challenging problems. Amazon is investing in generative AI and the responsible development and deployment of large language models (LLMs) across all of our businesses. Come build the future of human-technology interaction with us. We are hiring...


  • Cambridge, Cambridgeshire, United Kingdom ENGINEERINGUK Full time

    You will need to login before you can apply for a job.DESCRIPTIONAI is the most transformational technology of our time, capable of tackling some of humanity's most challenging problems. Amazon is investing in generative AI and the responsible development and deployment of large language models (LLMs) across all of our businesses. Come build the future of...


  • Cambridge, Cambridgeshire, United Kingdom Evi Technologies Limited Full time

    The Amazon General Intelligence Data Services (AGI-DS) organization is engaged in data processing to support generative, large language AI models. The Alexa service is always getting smarter, both for features, and for natural language understanding and accuracy. Because Alexa's brains are in the AWS cloud, she continually learns and adds more functionality,...


  • Cambridge, Cambridgeshire, United Kingdom Amazon Full time

    Senior Operations Manager, Artificial General Intelligence Data ServicesJob ID: 2941449 | Evi Technologies LimitedAI is the most transformational technology of our time, capable of tackling some of humanity's most challenging problems. Amazon is investing in generative AI and the responsible development and deployment of large language models (LLMs) across...