Enhancing Bangla Fake News Detection Using Bidirectional Gated Recurrent Units and Deep Learning Techniques

Utsha Roy, Mst. Sazia Tahosin, Md. Mahedi Hassan, Taminul Islam, Fahim Imtiaz, Md Rezwane Sadik, Yassine Maleh, Rejwan Bin Sulaiman, Md. Simul Hasan TalukderarXiv 2024 · DOI · arXiv

Abstract

Misinformation in low-resource languages like Bangla presents a significant challenge due to linguistic complexity and a lack of specialized tools. This study proposes a deep learning framework utilizing Bidirectional Gated Recurrent Units (Bi-GRU) to detect fake news. Using a dataset of approximately 50,000 articles, the proposed model achieved a state-of-the-art accuracy of 99.16%, significantly outperforming traditional machine learning and standard sequential models.

Introduction

While fake news detection is a mature field for high-resource languages like English, Bangla—spoken by over 200 million people—remains underserved in the AI community. The language's rich idiomatic expressions and diverse dialects make traditional keyword-based detection ineffective. This research addresses the gap by developing a robust pipeline specifically tuned for the unique syntax and context of Bangladeshi news media.

Methodology

The research implemented a comprehensive pipeline to process and classify news articles. The workflow involves data preprocessing, visualization, text cleaning, and model training.

The end-to-end pipeline for Bangla fake news detection, from data collection to performance analysis.

Model Architecture

The core of the proposed system is a Bidirectional Gated Recurrent Unit (Bi-GRU). Unlike standard GRUs, the bidirectional variant processes text in both forward and backward directions, capturing context from both the preceding and succeeding words. This is particularly effective for Bangla, where sentence veracity often depends on holistic context.

The proposed Bi-GRU model architecture featuring embedding, bidirectional GRU, and dense layers.

The architecture includes an embedding layer to convert tokens into dense vectors, followed by the Bi-GRU layer to capture temporal dependencies. Global Average Pooling is used to reduce dimensionality, while Dense and Dropout layers provide the final classification and regularization to prevent overfitting.

Data and Preprocessing

The study utilized a dataset sourced from Kaggle consisting of approximately 50,000 news items, including Authentic-48K.csv and Fake-1K.csv. To address the significant class imbalance, the researchers employed resampling techniques. Preprocessing was a critical step, involving the removal of line breaks, tabs, and specific Bengali punctuation, alongside using a specialized "Stopwords Bengali (BN)" library to filter linguistic noise.

Results and Discussion

The Bi-GRU model demonstrated exceptional performance, setting a new benchmark for Bangla NLP. The results were remarkably high across all primary metrics:

  • Accuracy: 99.16%
  • Precision: 99.40%
  • Recall: 99.74%
  • F1-Score: 99.57%

Comparatively, standard LSTM models achieved 97.49% accuracy, while 1D CNNs reached 99.06%. The results suggest that Bi-GRU's computational efficiency and bidirectional context-handling are ideal for this specific linguistic task, surpassing previous efforts that typically reached the 91-96% range.

Conclusion

This study confirms that deep learning, specifically Bi-GRU architectures, can effectively combat misinformation in low-resource languages. Future work will focus on expanding the dataset with "pseudo-events" to ensure robustness against evolving misinformation tactics and developing real-time automation tools, such as browser extensions, to protect citizens from digital misinformation.

Summary updated

Abstract

The rise of fake news has made the need for effective detection methods, including in languages other than English, increasingly important. The study aims to address the challenges of Bangla which is considered a less important language. To this end, a complete dataset containing about 50,000 news items is proposed. Several deep learning models have been tested on this dataset, including the bidirectional gated recurrent unit (GRU), the long short-term memory (LSTM), the 1D convolutional neural network (CNN), and hybrid architectures. For this research, we assessed the efficacy of the model utilizing a range of useful measures, including recall, precision, F1 score, and accuracy. This was done by employing a big application. We carry out comprehensive trials to show the effectiveness of these models in identifying bogus news in Bangla, with the Bidirectional GRU model having a stunning accuracy of 99.16%. Our analysis highlights the importance of dataset balance and the need for continual improvement efforts to a substantial degree. This study makes a major contribution to the creation of Bangla fake news detecting systems with limited resources, thereby setting the stage for future improvements in the detection process.
BibTeX
@misc{roy2024enhancing,
  author = {Utsha Roy and Mst. Sazia Tahosin and Md. Mahedi Hassan and Taminul Islam and Fahim Imtiaz and Md Rezwane Sadik and Yassine Maleh and Rejwan Bin Sulaiman and Md. Simul Hasan Talukder},
  title = {{Enhancing Bangla Fake News Detection Using Bidirectional Gated Recurrent Units and Deep Learning Techniques}},
  year = {2024},
  eprint = {2404.01345},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2404.01345},
}
Figure