Abstract
Eye tracking in combination with artificial intelligence is a developing area of research with a wide range of applications, as evidenced by the increasing number of studies being conducted in this field. Such studies hold promising results in terms of prognosis and diagnosis, as they provide insight into how doctors interpret images and the factors that influence their decision-making processes. In this study, we investigated whether potential diagnostic errors made by physicians can be recognized through eye movements and artificial intelligence. To achieve this, we engaged four radiologists with varying levels of diagnostic experience to analyze 400 X-rays chest images with a wide range of anomalies, concurrently capturing their eye movements using an eye tracker. For each of the resulting 1546 readings, we computed numerical features extracted using radiologists’ gaze saccade data. Subsequently, we applied three machine learning algorithms such as random forest, support vector machines, k-nearest neighbor classifier, and also a neural network to map reading gaze features with radiological errors resulting in the error prediction accuracy of 0.7. Our experiments demonstrate the existence of a connection between diagnostic errors and gaze, indicating that eye-tracking data can serve as a valuable source of information for human error analysis.
Original language | English |
---|---|
Title of host publication | Medical Imaging 2024 : Image Perception, Observer Performance, and Technology Assessment |
Editors | Claudia R. Mello-Thoms, Claudia R. Mello-Thoms, Yan Chen |
Number of pages | 4 |
Publisher | SPIE |
Publication date | 2024 |
Article number | 129290A |
ISBN (Electronic) | 9781510671621 |
DOIs | |
Publication status | Published - 2024 |
Event | Medical Imaging 2024: Image Perception, Observer Performance, and Technology Assessment - San Diego, United States Duration: 20 Feb 2024 → 22 Feb 2024 |
Conference
Conference | Medical Imaging 2024: Image Perception, Observer Performance, and Technology Assessment |
---|---|
Country/Territory | United States |
City | San Diego |
Period | 20/02/2024 → 22/02/2024 |
Sponsor | The Society of Photo-Optical Instrumentation Engineers (SPIE) |
Series | Progress in Biomedical Optics and Imaging - Proceedings of SPIE |
---|---|
Volume | 12929 |
ISSN | 1605-7422 |
Bibliographical note
Publisher Copyright:© 2024 SPIE.
Keywords
- artificial intelligence
- eye tracking
- x-rays images