TY - JOUR
T1 - Feedback beyond accuracy
T2 - Using eye-tracking to detect comprehensibility and interest during reading
AU - van der Sluis, Frans
AU - van den Broek, Egon L.
N1 - Funding Information:
The authors thank the anonymous reviewers, who provided valuable, detailed comments and suggestions on an earlier version of this paper. This enabled us to improve the paper substantially. Furthermore, the Dutch Organisation for Scientific Research (NWO) is gratefully acknowledged for funding the IPPSI‐KIEM project Adaptive Text‐Mining (ATM) (project number: 628.005.006), under which this work was conducted. 1
Publisher Copyright:
© 2022 The Authors. Journal of the Association for Information Science and Technology published by Wiley Periodicals LLC on behalf of Association for Information Science and Technology.
PY - 2023
Y1 - 2023
N2 - Knowing what information a user wants is a paramount challenge to information science and technology. Implicit feedback is key to solving this challenge, as it allows information systems to learn about a user's needs and preferences. The available feedback, however, tends to be limited and its interpretation shows to be difficult. To tackle this challenge, we present a user study that explores whether tracking the eyes can unpack part of the complexity inherent to relevance and relevance decisions. The eye behavior of 30 participants reading 18 news articles was compared with their subjectively appraised comprehensibility and interest at a discourse level. Using linear regression models, the eye-tracking signal explained 49.93% (comprehensibility) and 30.41% (interest) of variance (p <.001). We conclude that eye behavior provides implicit feedback beyond accuracy that enables new forms of adaptation and interaction support for personalized information systems.
AB - Knowing what information a user wants is a paramount challenge to information science and technology. Implicit feedback is key to solving this challenge, as it allows information systems to learn about a user's needs and preferences. The available feedback, however, tends to be limited and its interpretation shows to be difficult. To tackle this challenge, we present a user study that explores whether tracking the eyes can unpack part of the complexity inherent to relevance and relevance decisions. The eye behavior of 30 participants reading 18 news articles was compared with their subjectively appraised comprehensibility and interest at a discourse level. Using linear regression models, the eye-tracking signal explained 49.93% (comprehensibility) and 30.41% (interest) of variance (p <.001). We conclude that eye behavior provides implicit feedback beyond accuracy that enables new forms of adaptation and interaction support for personalized information systems.
UR - http://www.scopus.com/inward/record.url?scp=85130508015&partnerID=8YFLogxK
U2 - 10.1002/asi.24657
DO - 10.1002/asi.24657
M3 - Journal article
C2 - 37056352
AN - SCOPUS:85130508015
VL - 74
SP - 3
EP - 16
JO - American Society for Information Science and Technology. Journal
JF - American Society for Information Science and Technology. Journal
SN - 2330-1635
IS - 1
ER -