Are AI Neuroimaging Models Ready for Clinical Use? A Systematic Methodological Review

Abstract

Background/Objectives: Artificial intelligence (AI) has rapidly expanded across medical imaging with proposed applications in diagnosis, prognostication, and surgical planning. Concerns remain regarding methodological robustness and clinical readiness for many published models. This systematic review aimed to conduct a methodological audit of AI imaging studies relevant to contemporary neurosurgical practice-including intracranial, cerebrovascular, spinal, and connectomics-based applications-published in 2025. Methods: Following PRISMA guidelines and PROSPERO registration (CRD420261284068), PubMed was searched for studies published in 2025 evaluating machine learning or deep learning applications in MRI- or CT-based imaging. Three reviewers independently extracted data on validation strategy, data leakage risk, human comparator use, calibration reporting, and CLAIM/TRIPOD-AI adherence. Risk of bias was assessed using PROBAST+AI. Results: Of 1776 screened records, 91 studies met the inclusion criteria. China led contributions (54.9%), oncology was the most common domain (37.4%), and MRI was the predominant modality (67.0%). External validation was reported in 75.8% of studies, and 66.0% used multicenter cohorts. Data leakage risk was low in 93.4%. However, only 18.7% included human comparators, calibration was reported in 30.8%, and none achieved full CLAIM/TRIPOD-AI compliance. Conclusions: AI imaging studies published in 2025 demonstrate encouraging progress in multicenter design and external validation. However, persistent gaps in human benchmarking, calibration, and reporting suggest further methodological development is needed.