Dogmas in the assessment of usability evaluation methods

Research output: Contribution to journalJournal articleResearchpeer-review

86 Citations (Scopus)

Abstract

Usability evaluation methods (UEMs) are widely recognised as an essential part of systems development. Assessments of the performance of UEMs, however, have been criticised for low validity and limited reliability. The present study extends this critique by describing seven dogmas in recent work on UEMs. The dogmas include using inadequate procedures and measures for assessment, focusing on win-lose outcomes, holding simplistic models of how usability evaluators work, concentrating on evaluation rather than on design and working from the assumption that usability problems are real. We discuss research approaches that may help move beyond the dogmas. In particular, we emphasise detailed studies of evaluation processes, assessments of the impact of UEMs on design carried out in real-world systems development and analyses of how UEMs may be combined
Original languageEnglish
JournalBehavior and Information Technology
Volume29
Issue number1
Pages (from-to)97-111
Number of pages15
ISSN0144-929X
DOIs
Publication statusPublished - 2010

Cite this