LDIE-FDNet: Lightweight dynamic image enhancement-enabled real-time fatigue driving detection network

Abstract

Aiming at the imbalance between accuracy and real-time of existing fatigue driving detection models, and the accuracy is lower in low illumination, an LDIE-FDNet (Lightweight Dynamic Image Enhancement-Enabled Real-time Fatigue Driving Detection Network) is designed. Enhance the image by MSR-LIENET (Multi-Scale Retinex-Based Low-Light Image Enhancement Network); Through GSConv_C3k2 module, lightweight design, efficient capture of remote context information, reduction of parameters and calculation, and variable convolution kernel design and feature segmentation and mosaic are adopted to enhance feature extraction ability; Through DHFAR-Net (Dynamic Hierarchical Feature Aggregation and Reconstruction Network), combined with DySample and SDI (Semantic and Detail Infusion), the semantic information and detail information are enhanced. Through multi-level feature fusion, the model can better capture the information of various targets, reduce the situation of missing detection and false detection, thus improving the overall detection effect, and does not need high-resolution boot features as input. It has lower reasoning delay, memory occupation, floating-point operation times, and parameter number; Through the PIoU (Powerfull-IoU) loss function, IoU is calculated pixel by pixel, which can better optimize the positioning of rotating rectangular frames and deal with high aspect ratio targets, reduce the overlap of background areas and improve the detection effect. Finally, a fatigue driving detection model including maximum closing time (MCT) and maximum yawn duration (MYD) is proposed. Experiments show that mAP increases by 0.6% to 99.2, Params reduce by 24%, GFLOPs increase by 14.3% and FPS increases by 23.1% on the YawDD data set. On the DMS data set, mAP increased by 0.7% to 92.9, Params reduce by 24%, GFLOPs increased by 14.3%, and FPS increased by 20.5%. The proposed method enhances both accuracy and efficiency in fatigue detection while effectively balancing precision with real-time performance.