FSDNet-An efficient fire detection network for complex scenarios based on YOLOv3 and DenseNet

Zhu Li, Jiahui Xiong, Wenxian Wu, Hongyu YuarXiv 2023 · DOI · arXiv

TL;DR

FSDNet is a novel fire and smoke detection network that fuses the architectural strengths of YOLOv3 and DenseNet to achieve high accuracy in complex, real-world scenarios. By introducing a new large-scale dataset (MS-FS) and optimizing feature extraction through dense connections and spatial pyramid pooling, the authors outperform mainstream models like YOLOv4 and SqueezeNet in both precision and reliability.

What Problem Does This Paper Address?

Traditional fire detection relies on physical sensors (heat, smoke, light), which often suffer from significant lag—the fire must reach the sensor to be detected. Vision-based systems offer a faster alternative, but they face a "wild west" of environmental challenges: varying lighting, amorphous flame shapes, and "fire-like" distractors (sunset glows, indoor lights, or moving red objects).

The authors identify two major bottlenecks in current computer vision approaches:

  1. Architectural Limitations: Standard backbones often struggle with "gradient disappearance" or fail to capture the multi-scale nature of flames and smoke.
  2. Data Scarcity: Publicly available fire datasets are often too small, lack scenario diversity, or have poor annotation quality, leading to models that don't generalize well to real-world "complex scenarios."

Methods

FSDNet (Fire Smoke Detection Network) is built on three primary modules:

  • Dense-Connected Feature Extraction: Instead of the standard Darknet53 backbone used in YOLOv3, FSDNet utilizes a DenseNet-inspired structure. By connecting every layer to every subsequent layer, the model maximizes "feature reuse" and ensures a smoother gradient flow, which is particularly effective for detecting objects without fixed shapes, like fire.
  • Spatial Pyramid Pooling (SPP): To handle the massive variance in fire size (from a matchstick to a forest fire), the authors integrated an SPP module. This fuses local and global features by using multiple pooling kernel sizes ($5\times5, 9\times9, 13\times13$), allowing the network to "see" the fire at different scales simultaneously.
  • Training Optimizations: The team employed Mosaic data augmentation (mixing four training images into one to enrich backgrounds) and the CIoU (Complete Intersection over Union) loss function. Unlike standard IoU, CIoU accounts for the overlap area, center point distance, and aspect ratio, leading to much more stable bounding box regression.

Datasets

The authors evaluated FSDNet on two established benchmarks and one massive new contribution:

  • DS1 & DS2: Standard fire video and image datasets used to test classification accuracy and false alarm rates.
  • MS-FS (Multi-scene Fire And Smoke): A new dataset created for this paper. It contains 11,938 images collected via web crawling, covering hundreds of scenarios (city roads, high-rises, forests) and lighting conditions. Crucially, it includes "interference items" specifically designed to trick AI, such as sunsets and red car lights.

Key Insights and Ideas

  • Dense Connections for Amorphous Objects: The most interesting takeaway is that DenseNet’s architecture is uniquely suited for fire. Because flames don't have a rigid geometry (unlike cars or faces), the ability to pass low-level texture features directly to deeper layers helps the model distinguish "true" fire from "fire-colored" objects.
  • The "Small Object" Solution: By combining SPP with multi-scale detection branches (inspired by Feature Pyramid Networks), FSDNet maintains high reliability even when the fire occupies a tiny fraction of the frame.
  • Robustness over Raw Speed: While many papers chase pure inference speed, FSDNet prioritizes the reduction of False Positives (FP) and False Negatives (FN). In fire safety, a false alarm is annoying, but a missed detection is catastrophic.

Key Results

FSDNet demonstrated superior performance across the board:

  • Benchmark Accuracy: Achieved 99.82% accuracy on DS1 and 91.15% on DS2, significantly outperforming lightweight models like MobileNet and SqueezeNet.
  • Mean Average Precision (mAP): On the new MS-FS dataset, FSDNet reached an mAP of 86.80%. This is 1.2% higher than YOLOv4 and 8.5% higher than the original YOLOv3.
  • False Alarm Suppression: On DS1, FSDNet achieved a remarkably low False Positive Rate of 0.07%, compared to 5.88% for the next best traditional method.

Limitations and Future Work

While FSDNet excels at flame detection, the results in Table 4 show that its smoke detection precision (0.801) is slightly lower than YOLOv4 (0.858). Smoke is notoriously difficult to detect due to its transparency and similarity to fog or steam.

The authors suggest that future work will focus on further refining the network for early-stage smoke detection and deploying the system into community-level monitoring frameworks. There is also a hint that the dynamic, temporal nature of fire (how it flickers over time) could be better exploited by incorporating video-based temporal features in future iterations.

Summary updated

Abstract

Fire is one of the common disasters in daily life. To achieve fast and accurate detection of fires, this paper proposes a detection network called FSDNet (Fire Smoke Detection Network), which consists of a feature extraction module, a fire classification module, and a fire detection module. Firstly, a dense connection structure is introduced in the basic feature extraction module to enhance the feature extraction ability of the backbone network and alleviate the gradient disappearance problem. Secondly, a spatial pyramid pooling structure is introduced in the fire detection module, and the Mosaic data augmentation method and CIoU loss function are used in the training process to comprehensively improve the flame feature extraction ability. Finally, in view of the shortcomings of public fire datasets, a fire dataset called MS-FS (Multi-scene Fire And Smoke) containing 11938 fire images was created through data collection, screening, and object annotation. To prove the effectiveness of the proposed method, the accuracy of the method was evaluated on two benchmark fire datasets and MS-FS. The experimental results show that the accuracy of FSDNet on the two benchmark datasets is 99.82% and 91.15%, respectively, and the average precision on MS-FS is 86.80%, which is better than the mainstream fire detection methods.
BibTeX
@misc{li2023fsdnet,
  author = {Zhu Li and Jiahui Xiong and Wenxian Wu and Hongyu Yu},
  title = {{FSDNet-An efficient fire detection network for complex scenarios based on YOLOv3 and DenseNet}},
  year = {2023},
  eprint = {2304.07584},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2304.07584},
}
Figure