Benchmarking imputation strategies for missing time-series data in critical care using real-world-inspired scenarios

Abstract

Abstract Handling missing data remains a central challenge in Intensive Care Units (ICU) time-series analysis, where gaps frequently arise from non-random mechanisms such as sensor disconnections and workflow-driven interruptions. In this study, we benchmarked multiple imputation strategies on monitoring data from MIMIC-IV and designed masking scenarios that reflect ICU missingness patterns observed in the database, thereby approximating real-world conditions and clarifying how conclusions depend on both the chosen imputation method and the missingness scenario. We compared commonly used simple statistical approaches (mean, LOCF, interpolation), classical machine learning techniques (MICE, MissForest), and several deep learning architectures (Transformers, RNNs, GANs, VAEs). Transformer and GAN models achieved the best overall performance, whereas linear interpolation remained a strong baseline. Crucially, results were scenario-dependent: MCAR produced optimistic error estimates and compressed differences between methods, whereas structured gaps revealed clearer performance separations. Our findings suggest that, while deep learning methods improve overall imputation accuracy, linear interpolation is often nearly as effective and offers a lighter, more interpretable approach. This work introduces a practical framework for evaluating time-series imputation strategies under realistic constraints, with a focus on clinical relevance. Further analysis of downstream impact under clinically realistic scenarios and using tailored imputation strategies by variable type remains needed.