A hybrid BiLSTM and rule-based system for integrated diabetes prediction and personalized guidance

Abstract

Diabetes is a common chronic disease that needs early diagnosis and proper management to avoid severe complications. While current Artificial Intelligence (AI) tools generate predictive information, they often lack an integrated element for post-diagnosis support in order to fill in this critical gap in patient self-management. This research proposes and validates a hybrid System which aims to bridge this gap. The methodology is based on a novel, fused dataset (PIMA and Type 2 Diabetes) that was carefully preprocessed following a leakage-safe protocol in order to increase generalizability. The system architecture is a combination of two different critical components: Strong Bidirectional Long Short term Memory (BiLSTM) model for prediction and rule based engine for creating personalized lifestyle recommendations. In order to validate the efficacy of the BiLSTM model, seven traditional machine learning (ML) models and standard deep learning (DL) models have been comparatively tested, in which BiLSTM model has demonstrated a better generalization and prediction performance. Rigorous 10-fold cross validation was used to validate the system, which came up with an accuracy of 84.02%, precision of 87.89%, and recall of 80.50%. This research concludes that by successfully combining the high-performance predictive engine and real-time guidance module, it is possible to develop a holistic clinically relevant tool to close the loop between diagnosis and proactive self-management.