Fully automated detection and identification of CSF shunt valves using YOLOv8 and a class-based reference image assignment as a safety mechanism

Abstract

Abstract The study aimed to develop and evaluate an algorithm based on the YOLOv8x framework to automatically detect and identify cerebrospinal fluid (CSF) shunt valves. This approach seeks to streamline the diagnostic process identifying shunt valve types and pressure levels. A retrospective cohort of 2701 anonymized radiographs comprising six types of CSF shunt valves was used. Data augmentation techniques such as flipping, scaling, and mosaic augmentation were applied during training to enhance robustness. The dataset was split into 80% training and 20% testing subsets as part of a 5-fold cross-validation. Validation was conducted on a separate test set of 295 images using metrics such as mean Average Precision (mAP) at intersection over union thresholds of 50% (mAP50) as well as precision, recall, and F1-scores as metrics. Additionally, a class-based reference image assignment system was used to link the detected valves with the corresponding manufacturer images. These paired images were then independently reviewed by two radiologists to assess the accuracy of the algorithm’s classifications. The algorithm achieved a weighted mAP50 of 0.884 and a weighted average F1-score of 94.8%. High F1-scores were observed for Codman Certas (99.6%) and Codman Hakim (99.6%), with lower scores for less common valves like proGAV (30.8%). Radiologists were able to identify both correct and incorrect classifications made by the algorithm with 100% accuracy, due to the integrated safety mechanism. This safety mechanism relies on the fully automated linking of detected valves with the corresponding manufacturer images. In Conclusion the automated system demonstrated high efficiency in detecting and classifying CSF shunt valves, significantly simplifying the diagnostic workflow. Moreover, the integration of a robust safety mechanism ensures that potential misclassifications are identified and corrected.