Article published In:
Information Design JournalVol. 11:2/3 (2003) ► pp.160–170
The ‘magic number 5’
Is it enough for web-testing?
Common practice holds that 80% of usability findings are discovered after five participants. Recent findings from web testing indicate that a much larger number of participants is required to get results and that independent teams testing the same web-based product do replicate results. Other findings suggest that results improve when testing teams work closely with developers in planning the test. This paper presents an insider view of the CUE-2 evaluation that may stimulate further debate regarding the results, plus two cases in which different teams uncovered the same usability issues, working independently but closely with the sponsor.
Keywords: usability testing, web usability, number of users, reliability
Cited by
Cited by 12 other publications
Alhadreti, Obead & Pam Mayhew
2018. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, ► pp. 1 ff. 
Baskoro, Kezia & Ari Widyanti
2018. 2018 International Conference on Information Technology Systems and Innovation (ICITSI), ► pp.
148
ff.
Chowdhury, Aparajita, Aino Ahtinen, Chia-Hsin Wu, Kasia Väänänen, Davide Taidi & Roel Pieters
2023. 2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), ► pp. 2344 ff.
Clarke, Martina A, Jeffery L Belden & Min Soon Kim
2016. How Does Learnability of Primary Care Resident Physicians Increase After Seven Months of Using an Electronic Health Record? A Longitudinal Study. JMIR Human Factors 3:1 ► pp. e9 ff.
Clarke, Martina A., Jeffery L. Belden & Min Soon Kim
2014. Determining differences in user performance between expert and novice primary care doctors when using an electronic health record (EHR). Journal of Evaluation in Clinical Practice 20:6 ► pp. 1153 ff.
Golightly, David, Mirabelle D’ Cruz, Harshada Patel, Micharl Pettitt, Sarah Sharples, Alex stedmon & John Wilson
2010. Novel Interaction Styles, Complex Working Contexts and the Role of Usability. In Usability of Complex Information Systems, ► pp. 281 ff.
Ishaq, Kashif, Fadhilah Rosdi, Nor Azan Mat Zin & Adnan Abid
2021. 2021 International Conference on Innovative Computing (ICIC), ► pp. 1 ff.
M.S. Kim, Shapiro, J.S., Genes, N., Aguilar, M.V., Mohrer, D., Baumlin, K. & Belden, J.L.
2012. A Pilot Study on Usability Analysis of Emergency Department Information System by Nurses. Applied Clinical Informatics 03:01 ► pp. 135 ff.
Kools, Marieke, Robert A. C. Ruiter, Margaretha W. J. van de Wiel & Gerjo Kok
2007. Testing the usability of access structures in a health education brochure. British Journal of Health Psychology 12:4 ► pp. 525 ff.
Melton, Brittany, Zillich, Alan, Saleem, Jason, Russ, Alissa, Tisdale, James & Brian Overholser
2016. Iterative Development and Evaluation of a Pharmacogenomic-Guided Clinical Decision Support System for Warfarin Dosing. Applied Clinical Informatics 07:04 ► pp. 1088 ff.
Sauro, Jeff & James R. Lewis
2016. What sample sizes do we need? Part 2: formative studies. In Quantifying the User Experience, ► pp. 143 ff.
van den Berg, Liselot N., Cynthia Hallensleben, Niels H. Chavannes & Anke Versluis
2022. Developing a Smartphone Application That Promotes Responsible Short-Acting Beta2-Agonist Use in People with Asthma: A Participatory Design. International Journal of Environmental Research and Public Health 19:14 ► pp. 8496 ff.
This list is based on CrossRef data as of 30 march 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.