Decision threshold associated with multiple measurements. Application to the synthesis of the environment monitoring results

A. Vivier, G. Manificat, J-l. Picolo, Sylvain Fleury, Marcel Mokili, Xin GuoRadioprotection 2012 · DOI

Abstract

When sample activity is measured multiple times, each measurement is associated with an individual decision threshold ($L_c$) and limit of detection ($L_D$). These individual results can often be contradictory, with some measurements falling below the decision threshold while others exceed it. This paper establishes a rigorous statistical framework for building a collective decision threshold and detection limit that accounts for all individual results. By treating multiple measurements as a single "accumulated" dataset, researchers can significantly lower decision thresholds and improve the reliability of radioactivity detection. This approach has significant applications in gamma spectrometry and environmental monitoring, where signals are often near background noise levels.

Introduction

In fields like environmental monitoring and radiation protection, scientists frequently deal with signals that are very close to background noise. To decide if a substance is actually present, they use two statistical hurdles: the Decision Threshold ($L_c$), which determines if a signal is real or just a background fluctuation, and the Limit of Detection ($L_D$), the minimum amount that can be reliably detected.

A common problem arises when a sample is measured multiple times—for instance, measuring different gamma-ray peaks from the same isotope or taking periodic rainwater samples. Often, individual results fall below the threshold and are reported as "non-detects" or "< LD." Standard practice might lead a scientist to conclude nothing was found. However, this paper argues that this approach wastes valuable information and that the aggregate of multiple "non-significant" results can provide a statistically significant "yes."

Methodology: The Power of Accumulation

The authors define "accumulation" as the process of synthesizing multiple results into a single value, typically through a sum or a weighted average. They introduce two fundamental rules for this process:

  1. Preserve Raw Data: Never discard "non-significant" individual results before accumulation. One must preserve the raw net amounts, even if they are negative (which can occur due to background subtraction).
  2. Algebra of Standard Deviation: Decision thresholds follow the "algebra of standard deviation." When results are averaged or summed, the new combined threshold is calculated using the sum of the squares of the individual thresholds.

Case Study: Individual vs. Accumulated Results

The paper demonstrates the impact of these rules using datasets from the IRSN (French Institute for Radiological Protection and Nuclear Safety). Consider a set of ten measurements where the true activity is low.

Table 1: Individual measurement results (meas. 1-10) showing inconsistent significance against individual decision thresholds (Lc).

As shown in Figure 1, individual measurements often yield contradictory results. In this example, measurements 3, 5, 7, 8, and 10 fall below their respective decision thresholds ($Net < Lc$), leading to a "no" result or "< LD" classification. If these were the only data points considered, the presence of radioactivity might be dismissed as inconclusive.

However, by applying the accumulation method, the statistical power of the dataset is fully realized.

Table 2: Results of accumulation by summation for the same dataset, demonstrating a clear detection and significantly reduced relative uncertainty.

Figure 3 illustrates the "Aha" moment: the accumulated net result (273) is clearly greater than the combined decision threshold (94). Furthermore, the relative uncertainty drops to 37%, a marked improvement over the 60-80% uncertainty seen in the individual significant measurements. This method turns a series of ambiguous results into a confirmed detection.

Key Insights and Impact

  • Sensitivity Gain: The combined decision threshold for an average of $n$ measurements is roughly $1/\sqrt{n}$ times the individual thresholds. For 16 measurements, the system becomes four times more sensitive.
  • Avoiding Bias: Discarding "< LD" values introduces a massive positive bias in reported averages. In one example, this led to a nearly 100% skew in the reported annual average.
  • Homogeneity is Critical: This method assumes the underlying population is homogeneous. If one is searching for a "hot spot" (a single contaminated sample among many clean ones), averaging will hide the signal.

Conclusion

The authors conclude that current reporting cultures must change. To improve the sensitivity of environmental assessments, laboratories should store and report raw data rather than censored "non-detect" values. Integrating these accumulation methods into standard software for gamma spectrometry and environmental database management would allow for more accurate and sensitive synthesis reports.

Summary updated

Abstract

When the sample activity is measured for various reasons several times, then with each measurement can be associated an individual decision threshold and limit of detection. Each measurement can be analyzed through its own decision threshold. The whole measurements can sometimes present contradictory results, some measurements being lower than the decision threshold and other higher. The problem then arises to build a decision threshold and a detection limit taking into account all the individual results, and to decide if the radioactivity is finally detected or not. It is interesting to note that it is possible sometimes that the decision threshold taking account all results makes it possible to decide that the radioactivity is present whereas the totality of the individual results are negative in terms of individual decision threshold. The purpose of this article is to show how these thresholds and these coherent limits cumulated can be determined in way according to the experimental conditions. In a general way a rigorous method of cumulating makes it possible to systematically decrease the decision threshold and limit of detection in terms of activity. This approach has interesting applications in gamma spectrometry with multi-emitters, discharge or periodical environmental measurements. On the basis of measurements realized by the IRSN within the framework of the national monitoring of the environment, we will see the potential impact of these methods on the final assessments.
BibTeX
@inproceedings{vivier2012decision,
  author = {A. Vivier and G. Manificat and J-L. Picolo and Sylvain Fleury and Marcel Mokili and Xin Guo},
  title = {{Decision threshold associated with multiple measurements. Application to the synthesis of the environment monitoring results}},
  booktitle = {Radioprotection},
  year = {2012},
  doi = {10.1051/radiopro/2011153},
}
Figure