KutralNet: A Portable Deep Learning Model for Fire Recognition

Angel Ayala, Bruno J. T. Fernandes, Francisco Cruz, David Macêdo, Adriano L. I. Oliveira, Cleber Zanchettin

Fire detection has traditionally relied on specialized hardware like smoke and thermal sensors. While computer vision offers a more flexible and easily embeddable alternative, deploying deep learning (DL) models on portable devices—like drones, mobile phones, or Raspberry Pis—is notoriously difficult due to the high computational cost.

In their paper presented at IJCNN 2020, Ayala et al. introduce KutralNet (named after the Mapuche word for fire), a lightweight deep learning architecture designed specifically for efficient fire recognition on hardware-restricted systems.

TL;DR

KutralNet is a novel, five-layer deep learning architecture that achieves competitive fire recognition accuracy while requiring significantly fewer parameters and floating-point operations (FLOPs) than state-of-the-art models. By combining inverted residual blocks with octave convolutions, the authors created a "Mobile Octave" variant that slashes computational costs by over 90% compared to traditional approaches.

What Problem Does This Paper Address?

The primary challenge in image-based fire detection is the resource-accuracy trade-off. Standard deep learning models (like ResNet50) are highly accurate but require massive memory and processing power, leading to high energy consumption and slow inference times on mobile devices.

Existing "lightweight" models often struggle with generalization or still demand too many FLOPs for real-time performance on low-power hardware. The authors sought to bridge this gap by designing a model that is "portable" by design, focusing on reducing both the model size (parameters) and the complexity of the operations (FLOPs).

Methods

The authors propose a baseline architecture called KutralNet and then iterate on it using modern efficiency techniques:

  1. KutralNet (Baseline): A 5-layer CNN inspired by FireNet and ResNet, optimized for 84x84 RGB images. It uses LeakyReLU activations and batch normalization to prevent overfitting.
  2. KutralNet Mobile: Replaces standard convolution blocks with Inverted Residual Blocks (from MobileNetV2). These use depth-wise separable convolutions to simplify signal processing.
  3. KutralNet Octave: Implements Octave Convolutions, which split the image signal into high and low spatial frequencies. This reduces spatial redundancy, as the low-frequency component can be processed at a lower resolution.
  4. KutralNet Mobile Octave (Hybrid): The most advanced variant, combining the inverted residual structure with octave convolutions to maximize efficiency.

Datasets

The models were evaluated on two primary benchmarks:

  • FireNet: A dataset containing 2,425 training images and 871 test images.
  • FiSmo: A larger dataset of 6,063 images.
  • Augmented Sets (FiSmoA/BA): The authors introduced augmented versions of FiSmo by adding 485 purely black images labeled as "no-fire." This was a critical test to ensure the models weren't simply identifying fire based on image brightness, but were actually learning structural features of flames and smoke.

Key Insights and Ideas

  • Frequency Splitting is Key: The success of the Octave variants suggests that fire recognition relies heavily on global features (low frequency) and specific edge details (high frequency). Separating these allows the model to ignore redundant spatial data.
  • FLOPs vs. Parameters: The authors highlight that a model with fewer parameters isn't always faster. While KutralNet Mobile Octave has slightly more parameters than the baseline, its FLOP count is nearly 70% lower, making it much better suited for real-time execution.
  • Robustness to "Black Screen" Errors: Many DL models misclassify dark or black images as fire. By training with the augmented "black image" datasets, KutralNet demonstrated significantly better generalization and lower false-positive rates in low-light simulations.

Key Results

The quantitative improvements are substantial:

  • Efficiency: The baseline KutralNet uses 71% fewer parameters than FireNet.
  • Computational Savings: The KutralNet Mobile Octave variant requires only 24.59M FLOPs, compared to 76.85M for the baseline and a staggering 4.13G for ResNet50.
  • Performance: Despite the massive reduction in complexity, KutralNet Mobile Octave achieved a Mean Test Accuracy of 79.49% and an AUROC of 0.90, outperforming the baseline and other lightweight models like FireNet (64.27% accuracy) in cross-dataset testing.
Model Parameters FLOPs Test Acc (Mean)
ResNet50 31.91M 4.13G 70.26%
FireNet 646.82K - 64.27%
KutralNet (Baseline) 138.91K 76.85M 76.01%
KutralNet Mobile Octave 185.25K 24.59M 79.49%

Limitations and Future Work

While KutralNet excels at recognition (is there a fire in this image?), it does not currently perform localization (where is the fire?). The authors acknowledge this and suggest that future work will involve:

  • Bounding Box Detection: Moving from simple classification to object detection to pinpoint fire locations.
  • Video Integration: Adapting the model to process temporal data from video streams rather than static images.
  • Hardware Deployment: Further testing on physical mobile vehicle systems for autonomous fire monitoring.

Summary updated

Abstract

Most of the automatic fire alarm systems detect the fire presence through sensors like thermal, smoke, or flame. One of the new approaches to the problem is the use of images to perform the detection. The image approach is promising since it does not need specific sensors and can be easily embedded in different devices. However, besides the high performance, the computational cost of the used deep learning methods is a challenge to their deployment in portable devices. In this work, we propose a new deep learning architecture that requires fewer floating-point operations (flops) for fire recognition. Additionally, we propose a portable approach for fire recognition and the use of modern techniques such as inverted residual block, convolutions like depth-wise, and octave, to reduce the model's computational cost. The experiments show that our model keeps high accuracy while substantially reducing the number of parameters and flops. One of our models presents 71% fewer parameters than FireNet, while still presenting competitive accuracy and AUROC performance. The proposed methods are evaluated on FireNet and FiSmo datasets. The obtained results are promising for the implementation of the model in a mobile device, considering the reduced number of flops and parameters acquired.
BibTeX
@inproceedings{ayala2020kutralnet,
  author = {Angel Ayala and Bruno J. T. Fernandes and Francisco Cruz and David Macêdo and Adriano L. I. Oliveira and Cleber Zanchettin},
  title = {{KutralNet: A Portable Deep Learning Model for Fire Recognition}},
  booktitle = {IJCNN},
  year = {2020},
  url = {https://openreview.net/forum?id=D7HR6IznWey},
}

Loading related content...

Figure