| J Neuromonit Neurophysiol > Volume 6(1); 2026 > Article |
|
FDA, U.S. Food and Drug Administration; AI, artificial intelligence; US, ultrasonography; TIRADS, Thyroid Imaging Reporting and Data System; RSS, risk stratification system; ACR TI-RADS, American College of Radiology Thyroid Imaging Reporting and Data System; ATA, American Thyroid Association; EU-TIRADS, European Thyroid Imaging Reporting and Data System; FNA, fine-needle aspiration; PACS, picture archiving and communication system; 3D, three dimensional.
| Study | AI tool | Study population/design | Comparator | Main performance findings | Clinical implication |
|---|---|---|---|---|---|
| Han et al. (2021) [12] | S-Detect | 454 thyroid nodules; comparison using K-TIRADS classification and dichotomous output | Experienced radiologist | TIRADS-based classification: sensitivity 97.6%, specificity 21.6%, accuracy 49.6%. Dichotomous prediction: sensitivity 81.4%, specificity 81.9%. | TIRADS-based feature assignment showed high sensitivity but low specificity; dichotomous prediction provided a more balanced sensitivity–specificity profile. |
| Kim et al. (2019) [13] | S-Detect | 218 thyroid nodules; real-world performance evaluation | Radiologist alone vs. AI-assisted interpretation | Dichotomous prediction: sensitivity 81.4%, specificity 68.2%, accuracy 73.4%. With AI assistance, radiologist sensitivity increased from 84.9% to 93.0%, while specificity decreased from 96.2% to 67.4%. | AI assistance may reduce missed malignancies but may increase false-positive assessment, unnecessary FNA, or follow-up. |
| Chung et al. (2020) [14] | S-Detect | 165 thyroid nodules; prospective non-inferiority study by reader experience level | Resident, fellow, and attending radiologist | CAD accuracy was 88.5%, similar to resident and fellow performance but lower than attending radiologist performance. All readers showed slight, non-significant improvement with AI assistance. | AI may be more useful for standardizing interpretation among less experienced operators than for replacing expert radiologists. |
| Reverter et al. (2019) [15] | AmCAD-UT | 300 thyroid nodules; diagnostic performance evaluation | Thyroid US expert | Sensitivity 87.0% for both AI and expert. Specificity was lower for AI than expert, 68.8% vs. 91.2%. AUC was also lower, 0.72 vs. 0.88. | AI matched expert sensitivity but showed lower specificity and overall discriminative performance. |
| Lu et al. (2019) [16] | AmCAD-UT | 234 intermediate-risk nodules, TIRADS categories 3 and 4 | Radiologists alone vs. AI-assisted interpretation | AUC was 0.916 for AmCAD-UT, 0.653 for radiologists alone, and 0.930 with AI-assisted radiologist interpretation. | AI assistance may improve classification of intermediate-risk thyroid nodules. |
| Wu et al. (2020) [17] | AmCAD-UT | Multi-reader multi-case study; 19 physicians and 265 nodules | Unaided vs. AI-assisted interpretation | Mean AUC increased from 0.728 without AI to 0.792 with AI assistance. Interobserver variability was reduced. | AI may improve reader consistency and reduce interobserver variation. |
| FDA submission data (2021) [19] | Koios DS | Thyroid engine validation on 500 nodules; separate multi-reader multi-case study with 15 readers and 650 nodules | Physicians alone vs. Koios-assisted interpretation | AI Adapter and descriptor predictors achieved an AUC of 79.8% using ACR TI-RADS guidelines. Reader study showed mean AUC improvement of 0.083, 95% CI: 0.066–0.099, with Koios DS assistance. | Performance data are promising, but independent external validation remains limited compared with S-Detect and AmCAD-UT. |
AI, artificial intelligence; K-TIRADS, Korean Thyroid Imaging Reporting and Data System; TIRADS, Thyroid Imaging Reporting and Data System; FNA, fine-needle aspiration; CAD, computer-aided diagnosis; US, ultrasonography; AUC, area under the receiver operating characteristic curve; FDA, U.S. Food and Drug Administration; ACR TI-RADS, American College of Radiology Thyroid Imaging Reporting and Data System; CI, confidence interval.
Ji Won Kim
https://orcid.org/0000-0003-1587-9671