Enhancing fake news detection with transformer-based deep learning: A multidisciplinary approach

Abstract

The widespread dissemination of fake news presents a critical challenge to the integrity of digital information and erodes public trust. This urgent problem necessitates the development of sophisticated and reliable automated detection mechanisms. This study addresses this gap by proposing a robust fake news detection framework centred on a transformer-based architecture. Our primary contribution is the application of the Bidirectional Encoder Representations from Transformers (BERT) model, uniquely enhanced with a progressive training methodology that allows the model to incrementally learn and refine its understanding of the linguistic nuances that differentiate factual reporting from fabricated content. The framework was rigorously trained and evaluated on the large-scale WELFake dataset, comprising 72,134 articles. Our findings demonstrate the model’s exceptional performance, achieving an accuracy of 95.3%, an F1-score of 0.953, precision of 0.952, and recall of 0.954. Comparative analysis confirms that our approach significantly outperforms traditional machine learning classifiers and other standard transformer-based implementations, highlighting its superior ability to capture complex contextual dependencies. These results underscore the efficacy of our enhanced BERT framework as a powerful and scalable solution in the ongoing fight against digital misinformation.