TY - JOUR
T1 - Deep Learning to Discriminate Arteritic from Nonarteritic Ischemic Optic Neuropathy on Color Images
AU - Gungor, Ayse
AU - Najjar, Raymond P.
AU - Hamann, Steffen
AU - Tang, Zhiqun
AU - Lagrèze, Wolf A.
AU - Sadun, Riccardo
AU - Sathianvichitr, Kanchalika
AU - Dinkin, Marc J.
AU - Oliveira, Cristiano
AU - Li, Anfei
AU - Sadun, Federico
AU - Carey, Andrew R.
AU - Bouthour, Walid
AU - Lin, Mung Yan
AU - Loo, Jing Liang
AU - Miller, Neil R.
AU - Newman, Nancy J.
AU - Biousse, Valérie
AU - Milea, Dan
AU - for the BONSAI Group
N1 - Publisher Copyright:
Copyright © 2024 American Medical Association.
PY - 2024
Y1 - 2024
N2 - Importance: Prompt and accurate diagnosis of arteritic anterior ischemic optic neuropathy (AAION) from giant cell arteritis and other systemic vasculitis can contribute to preventing irreversible vision loss from these conditions. Its clinical distinction from nonarteritic anterior ischemic optic neuropathy (NAION) can be challenging, especially when systemic symptoms are lacking or laboratory markers of the disease are not reliable. Objective: To develop, train, and test a deep learning system (DLS) to discriminate AAION from NAION on color fundus images during the acute phase. Design, Setting, and Participants: This was an international study including color fundus images of 961 eyes of 802 patients with confirmed AAION and NAION. Training was performed using images from 21 expert neuro-ophthalmology centers in 16 countries, while external testing was performed in a cohort from 5 expert neuro-ophthalmology centers in the US and Europe. Data for training and external testing were collected from August 2018 to January 2023. A mix of deidentified images of 2 fields of view (optic disc centered and macula centered) were used. For training and internal validation, images were from 16 fundus camera models with fields of 30° to 55°. For external testing, images were from 5 fundus cameras with fields of 30° to 50°. Data were analyzed from January 2023 to January 2024. Main Outcomes and Measures: The performance of the DLS was measured using area under the receiver operating characteristic curve (AUC), sensitivity, specificity, and accuracy. Results: In the training and validation sets, 374 (54.9%) of patients were female, 301 (44.2%) were male, and 6 (0.9%) were of unknown sex; the median (range) age was 66 (23-96) years. When tested on the external dataset including 121 patients (35 [28.9%] female, 44 [36.4%] male, and 42 [34.7%] of unknown sex; median [range] age, 69 [37-89] years), the DLS achieved an AUC of 0.97 (95% CI, 0.95-0.99), a sensitivity of 91.1% (95% CI, 85.2-96.9), a specificity of 93.4% (95% CI, 91.1-98.2), and an accuracy of 92.6% (95% CI, 90.5-96.6). The accuracy of the 2 experts for classification of the same dataset was 74.3% (95% CI, 66.7-81.9) and 81.6% (95% CI, 74.8-88.4), respectively. Conclusions and Relevance: A DLS showing disease-specific averaged class-activation maps had greater than 90% accuracy at discriminating between acute AAION from NAION on color fundus images, at the eye level, without any clinical or biomarker information. A DLS that identifies AAION could improve clinical decision-making, potentially reducing the risk of misdiagnosis and improving patient outcomes..
AB - Importance: Prompt and accurate diagnosis of arteritic anterior ischemic optic neuropathy (AAION) from giant cell arteritis and other systemic vasculitis can contribute to preventing irreversible vision loss from these conditions. Its clinical distinction from nonarteritic anterior ischemic optic neuropathy (NAION) can be challenging, especially when systemic symptoms are lacking or laboratory markers of the disease are not reliable. Objective: To develop, train, and test a deep learning system (DLS) to discriminate AAION from NAION on color fundus images during the acute phase. Design, Setting, and Participants: This was an international study including color fundus images of 961 eyes of 802 patients with confirmed AAION and NAION. Training was performed using images from 21 expert neuro-ophthalmology centers in 16 countries, while external testing was performed in a cohort from 5 expert neuro-ophthalmology centers in the US and Europe. Data for training and external testing were collected from August 2018 to January 2023. A mix of deidentified images of 2 fields of view (optic disc centered and macula centered) were used. For training and internal validation, images were from 16 fundus camera models with fields of 30° to 55°. For external testing, images were from 5 fundus cameras with fields of 30° to 50°. Data were analyzed from January 2023 to January 2024. Main Outcomes and Measures: The performance of the DLS was measured using area under the receiver operating characteristic curve (AUC), sensitivity, specificity, and accuracy. Results: In the training and validation sets, 374 (54.9%) of patients were female, 301 (44.2%) were male, and 6 (0.9%) were of unknown sex; the median (range) age was 66 (23-96) years. When tested on the external dataset including 121 patients (35 [28.9%] female, 44 [36.4%] male, and 42 [34.7%] of unknown sex; median [range] age, 69 [37-89] years), the DLS achieved an AUC of 0.97 (95% CI, 0.95-0.99), a sensitivity of 91.1% (95% CI, 85.2-96.9), a specificity of 93.4% (95% CI, 91.1-98.2), and an accuracy of 92.6% (95% CI, 90.5-96.6). The accuracy of the 2 experts for classification of the same dataset was 74.3% (95% CI, 66.7-81.9) and 81.6% (95% CI, 74.8-88.4), respectively. Conclusions and Relevance: A DLS showing disease-specific averaged class-activation maps had greater than 90% accuracy at discriminating between acute AAION from NAION on color fundus images, at the eye level, without any clinical or biomarker information. A DLS that identifies AAION could improve clinical decision-making, potentially reducing the risk of misdiagnosis and improving patient outcomes..
U2 - 10.1001/jamaophthalmol.2024.4269
DO - 10.1001/jamaophthalmol.2024.4269
M3 - Journal article
C2 - 39418057
AN - SCOPUS:85209239706
VL - 142
JO - JAMA Ophthalmology
JF - JAMA Ophthalmology
SN - 2168-6165
IS - 11
ER -