Business Test Analyst

4 days ago

City Of London, United Kingdom Lorien Full time

Lorien City Of London, England, United Kingdom Business Test Analyst - AI Products (Contract) Are you passionate about building the future of AI quality? Do you thrive in hands‑on roles where you can shape frameworks from the ground up and make a real impact? We’re looking for an experienced Business Test Analyst experienced in evaluating AI products to join our team on a contract basis and lay the foundations for robust, reliable, and user‑focused AI services across our business. What You’ll Do Design and implement a comprehensive AI testing and evaluation framework for all AI solutions, including LLM‑based tools, RAG systems, and third‑party platforms. Define and document quality standards for semantic accuracy, factual consistency, bias, tone, and relevance. Develop reusable testing templates, data sets, and evaluation methods that can be scaled and maintained by internal teams. Run hands‑on testing of AI prototypes and production tools to assess technical performance and business value. Collaborate with business users to guide practical testing and feedback processes. Deliver training and upskilling materials to empower internal staff to sustain the framework after your contract ends. Support vendor evaluations and POC assessments with robust test protocols. Establish baseline metrics and dashboards to measure ongoing AI quality and relevance. Work closely with engineering and product leads to embed testing into delivery workflows. Champion responsible AI practices to ensure fairness, transparency, and user trust. What You’ll Bring Strong hands‑on experience in testing and evaluation of AI or software systems, ideally with NLP or LLM‑based applications. Understanding of prompt evaluation, semantic search, and LLM behaviour (accuracy, hallucination, bias, tone, etc.). Familiarity with tools like Trulens, HumanLoop, PromptLayer, or similar; experience designing QA approaches for GenAI environments. Knowledge of modern AI architectures (RAG pipelines, embeddings, API integrations such as OpenAI, Azure OpenAI, Anthropic). Experience designing and implementing structured test regimes in fast‑evolving contexts. Excellent communication and facilitation skills, engaging both technical and business audiences. Proven ability to create sustainable frameworks, documentation, and training materials. Who You Are A builder who loves creating practical, scalable solutions. Hands‑on and analytical, balancing experimentation with process. Collaborative and empathetic, bridging technical and non‑technical teams. User‑focused, driven by delivering real value. Committed to responsible AI, fairness, and transparency. Ready to shape the future of AI quality with us? Apply now and help us ensure our AI‑enabled services are accurate, consistent, and trusted by all. Seniority level Associate Employment type Contract Job function Information Technology Industries Staffing and Recruiting Referrals increase your chances of interviewing at Lorien by 2x #J-18808-Ljbffr

  • Testing business analyst

    4 weeks ago

    City of London, Greater London, United Kingdom Lorien Full time

    Business Test Analyst - AI Products (Contract) Location: Hybrid working - Blackfriars 3 days per week Contract: 6 months, Outside IR35 Are you passionate about building the future of AI quality? We’re looking for an experienced Business Test Analyst experienced in evaluations AI Products to join our team on a contract basis and lay the foundations...

  • Testing business analyst

    4 weeks ago

    City of London, Greater London, United Kingdom Lorien Full time

    Business Test Analyst - AI Products (Contract) Location: Hybrid working - Blackfriars 3 days per week Contract: 6 months, Outside IR35 Are you passionate about building the future of AI quality? We’re looking for an experienced Business Test Analyst experienced in evaluations AI Products to join our team on a contract basis and lay the foundations...

  • Business Test Analyst

    6 days ago

    City Of London, England, United Kingdom Lorien Full time £60,000 - £120,000 per year

    Business Test Analyst - AI Products (Contract)Location:Hybrid working - Blackfriars 3 days per weekContract:6 months, Outside IR35Are you passionate about building the future of AI quality? Do you thrive in hands-on roles where you can shape frameworks from the ground up and make a real impact? We're looking for an experienced Business Test Analyst...

  • Test Analyst

    3 weeks ago

    london (city of london), United Kingdom RED Global Full time

    Test Analyst – Data Analytics (Contract, Inside IR35) Location: London (3 days onsite) | Duration: 6 months Seeking an experienced Test Analyst to support Data Analytics delivery across data pipelines, datasets, reports, and dashboards. Key Skills (Essential): ETL testing, data validation across source → warehouse/platform Testing BI outputs (e.g.,...

  • Test Analyst

    3 weeks ago

    City of London, United Kingdom La Fosse Full time

    Test Analyst - Hybrid (London) - Contract - £450-£475 outside IR35 Please note: This is a contract role and requires candidates to be available to work on-site in our London office.La Fosse has partnered with a well-established education organisation to recruit a Test Analyst.This role will play a key part in ensuring the quality and accuracy of critical...

  • Test Analyst

    3 weeks ago

    City of London, Greater London, United Kingdom RED Global Full time

    Test Analyst – Data Analytics (Contract, Inside IR35) Location: London (3 days onsite) | Duration: 6 months Seeking an experienced Test Analyst to support Data Analytics delivery across data pipelines, datasets, reports, and dashboards. Key Skills (Essential): ETL testing, data validation across source → warehouse/platform Testing BI outputs (e.g.,...

  • Test Analyst

    2 weeks ago

    City Of London, England, United Kingdom Deloitte Full time £40,000 - £80,000 per year

    Role:Test AnalystStart:5 th January 2026Duration:9 months (inside IR th October 2026 end dateLocation:Remote. Monday to Friday, 9am – 5pmJoin the growing Deloitte Managed Solutions team within IT Solutions working with a variety of clients to provide for their workflow and technology needs.The technology solutions that Deloitte can provide to clients are...

  • Business Test Analyst

    4 weeks ago

    City of London, United Kingdom Lorien Full time

    Business Test Analyst - AI Products (Contract)Location: Hybrid working - Blackfriars 3 days per weekContract: 6 months, Outside IR35Are you passionate about building the future of AI quality? Do you thrive in hands-on roles where you can shape frameworks from the ground up and make a real impact? We’re looking for an experienced Business Test Analyst...

  • Business Test Analyst

    2 weeks ago

    London Area, United Kingdom techbyte talent Full time £60,000 - £90,000 per year

    Senior Testing/Business Analyst – D365 Finance ImplementationContractLondon 2-3 days week in the central London officeOur client, a global consultancy is seeking aSenior Testing/Business Analystto support theirMicrosoft Dynamics 365 Finance implementation.The Role:You'll lead testing activities across D365 Finance & Operations modules, integrations, and...

  • Business Analyst

    4 weeks ago

    City of London, United Kingdom techbyte talent Full time

    Senior Testing/Business Analyst – D365 Finance ImplementationContractLondon 2-3 days week in the central London officeOur client, a global consultancy is seeking a Business Analyst with experience in Testing to support their Microsoft Dynamics 365 Finance implementation. The Role: You'll lead testing activities across D365 Finance & Operations modules,...