Naturalistic Digital Behavior Predicts Cognitive Abilities

Tung Vuong*, Giulio Jacucci, Tuukka Ruotsalo

*Corresponding author af dette arbejde

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningpeer review

7 Downloads (Pure)

Abstract

Individuals are known to differ in cognitive abilities, affecting their behavior and information processing in digital environments. However, we have a limited understanding of which behaviors are affected, how, and whether some features extracted from digital behavior can predict cognitive abilities. Consequently, researchers may miss opportunities to design and support individuals with personalized experiences and detect those who may benefit from additional interventions. To characterize digital behaviors, we collected 24/7 screen recordings, input behavior, and operating system data from the laptops of 20 adults for two weeks. We use cognitive test results from the same individuals to characterize their cognitive abilities: psychomotor speed, processing speed, selective attention, working memory, and fluid intelligence. Our results from regression analysis, path modeling, and machine learning experiments show that cognitive abilities are associated with differences in digital behavior and that naturalistic behavioral data can predict the cognitive abilities of individuals with small error rates. Our findings suggest naturalistic interaction data as a novel source for modeling cognitive differences.

OriginalsprogEngelsk
Artikelnummer36
TidsskriftACM Transactions on Computer-Human Interaction
Vol/bind31
Udgave nummer3
ISSN1073-0516
DOI
StatusUdgivet - 2024

Bibliografisk note

Funding Information:
This research was funded by the project COADAPT (Human and Work Station Adaptation Supportto aging citizens, grant agreement No. 826266) and was partially supported by the Academy of Finland (Flagship programme: Finnish Center for Artificial Intelligence FCAI and decision numbers: 359853, 352915, 350323, 357270), and the Horizon 2020 FET program of the European Union (grantCHIST-ERA-20-BCI-001). We would like to thank Chen He, Duc Le, and Linh Mac for their assistancein pilot studies

Publisher Copyright:
© 2024 Copyright held by the owner/author(s).

Citationsformater