Research Associate in Flaky Tests

Job Description

Job Title: Research Associate in Flaky Tests

Posting Start Date: 15/12/2025

Job Id: 2035

School/Department: Computer Science

Work Arrangement: Part Time (Hybrid)

Contract Type: Fixed-term

Salary per annum (£): £38, pro rata)

Closing Date: 04/01/2026

The University of Sheffield is a remarkable place to work. Our people are at the heart of everything we do. Their diverse backgrounds, abilities and beliefs make Sheffield a world-class university.

We offer a fantastic range of benefits including a highly competitive annual leave entitlement (with the ability to purchase more), a generous pensions scheme, flexible working opportunities, a commitment to your development and wellbeing, a wide range of retail discounts, and much more.

Overview

The appointee will work on the EPSRC-funded Test FLARE project, which investigates flaky software tests - defined as tests that pass and fail non-deterministically without changes to the underlying code. The primary function of this role is the design, implementation, and maintenance of software tools intended to detect, reproduce, and mitigate flaky tests within real-world software environments.

In addition to engineering duties, the role involves conducting supporting research into the root causes of non-determinism in software testing. This includes performing empirical studies on large-scale codebases to validate the effectiveness of the developed tools and contributing to the technical understanding of test stability.

Candidates are expected to possess a degree in Software Engineering or Computer Science. Specifically, applicants must demonstrate experience in writing tools to address flaky tests and have encountered them in practice, including the implementation of mitigation strategies. Proficiency in developing general analysis tools, such as static or dynamic analysis and instrumentation, is also required. A technical understanding of software-testing frameworks and continuous integration (CI) pipelines is necessary to bridge the gap between theoretical research and practical software solutions.

Main duties and responsibilities

• Design, implement and maintain software tools intended to detect, reproduce and mitigate flaky tests within real-world software environments.
• Conduct supporting research into the root causes of non-determinism in software testing.
• Perform empirical studies on large-scale codebases to validate the effectiveness of the developed tools.
• Contribute to the technical understanding of test stability.
• Carry out other duties, commensurate with the grade and remit of the post

Person Specification

Our diverse community of staff and students recognises the unique abilities, backgrounds, and beliefs of all. We foster a culture where everyone feels they belong and is respected. Even if your past experience doesn't match perfectly with this role's criteria, your contribution is valuable, and we encourage you to apply. Please ensure that you reference the application criteria in the application statement when you apply.

Criteria

Essential or desirable

Stage(s) assessed at

A bachelor's or master's degree in Computer Science/Software Engineering or a related discipline

Essential

Application

Obtained or are working towards a PhD in software testing.

Essential

Application

Experience of flaky tests in software development practice, including detecting, mitigating and fixing.

Essential

Application/interview

Experience in writing software tools in Python, Ruby and/or Java, aimed at addressing the problem of flaky tests.

Essential

Application/interview

Strong technical understanding of software testing techniques and methods.

Essential

Application/interview

In-depth technical understanding of software testing frameworks and continuous integration (CI) pipelines.

Essential

Application/interview

Ability to work effectively in a team and engage in effective collaborative research.

Essential

Application/interview

Ability to develop creative approaches to problem-solving.

Essential

Application/Interview

Further Information

Grade

Grade 7

Salary

£38,784 pro rata (equivalent to full-time salary), with an actual salary of £16,623 per annum based on 15 hours a week.

Work arrangement

Part-time

Duration

February 2026 until January 2027

Line manager

Professor of Software Engineering (project lead)

Direct reports

None

Our website

For informal enquiries about this job contact Prof Phil McMinn, project lead, at

Next steps in the recruitment process

It is anticipated that the selection process will take place in the week commencing 2nd February. This will consist of an interview with a short presentation. We plan to let candidates know if they have progressed to the selection stage in the week commencing 19th January 2026. If you need any support, equipment or adjustments to enable you to participate in any element of the recruitment process you can contact COM-

Our vision and strategic plan

We are the University of Sheffield. This is our vision: ().

What we offer

• A minimum of 41days annual leave including bank holiday and closure days (pro rata) with the ability to purchase more.
• Flexible working opportunities, including hybrid working for some roles.
• Generous pension scheme.
• A wide range of discounts and rewards on shopping, eating out and travel.
• A variety of staff networks, providing opportunities for social interaction, peer support and personal development (for example, Race Equality, LGBT+, Women's and Parent's networks).
• Recognition Awards to reward staff who go above and beyond in their role.
• A commitment to your development access to learning and mentoring schemes.
• A range of generous family-friendly policies
• paid time off for parenting and caring emergencies
• support for those going through the menopause
• paid time off and support for fertility treatment
• and more

We are a Disability Confident Employer. If you have a disability and meet the essential criteria for this job you will be invited to take part in the next stage of the selection process.

We are a research university with a global reputation for excellence. Our ideas and expertise change the world for the better, making a real difference to society. We know that when people come together with different views, approaches and insights it can lead to richer, more creative and innovative teaching and research and the highest levels of student experience. Our University Vision ) outlines our commitment to building a diverse community of staff and students that recognises and values the abilities, backgrounds, beliefs and ways of living for everyone.