What incentives encourage local communities to collect and upload mosquito sound data by using smartphones? A case study in the Democratic Republic of the Congo

Kieran E. Storer, Jane P. Messina, Eva Herreros-Moya, Emery Metelo, Josué Zanga, Nono Mvuama, Soleil Muzinga, Rinita Dam, Marianne Sinka, Ivan Kiskin, J. D. Everett, Yunpeng Li, Stephen Roberts, Katherine J. WillismedRxiv 2024 · DOI

This study explores the intersection of public health, mobile technology, and behavioral economics in the Democratic Republic of the Congo (DRC). Researchers investigated whether monetary incentives could sustain a citizen science project aimed at monitoring malaria-carrying mosquitoes.

TL;DR

While monetary incentives provide an initial boost to citizen science participation, they fail to sustain long-term engagement or improve data quality compared to intrinsic motivations. The study reveals that community-specific factors and the perceived value of the technology itself (the smartphone) often outweigh small cash rewards in driving data collection.

What Problem Does This Paper Address?

Malaria remains a leading cause of death in sub-Saharan Africa. Effective management requires high-resolution data on mosquito populations, but traditional entomological surveillance is labor-intensive and expensive. Citizen science—where local residents use smartphones to record mosquito "flight tones"—offers a scalable alternative.

However, the "human factor" is a major bottleneck. For data to be scientifically useful, it must be collected consistently over long periods. The researchers sought to determine if extrinsic motivators (money) could solve the problem of "participation fatigue" or if they might inadvertently "crowd out" the intrinsic desire to contribute to community health.

Methods

The researchers deployed the HumBug tool, a system consisting of a budget smartphone running the MozzWear app and a modified bed net designed to trap mosquitoes near the phone’s microphone.

The study was a 16-week trial involving 132 participants across two districts: rural Kinshasa and Bandundu. The experimental design used a control/incentive split:

  • Control Group: Received the smartphone, a bed net, and $1/month for data upload costs.
  • Incentive Group: Received the same kit plus $10/month in mobile airtime.

The team used a mixed-methods approach, combining quantitative analysis of upload counts and "active weeks" (using Wilcoxon Rank Sum and Kruskal-Wallis tests) with qualitative data from pre- and post-trial Focus Group Discussions (FGDs).

Datasets

  • Acoustic Data: Thousands of hours of audio recordings uploaded to a server at the University of Oxford for algorithmic mosquito species identification.
  • Demographic Data: Collected via the DHS Phase 8 Questionnaire (covering income, education, and household variables).
  • Qualitative Data: Transcripts and thematic coding from 12 pre-trial and 6 post-trial FGDs involving 148 total participants.

Key Insights and Ideas

  • The "Crowding Out" Effect: The data suggests that external rewards didn't necessarily help. In some cases, intrinsic benefits—like the satisfaction of contributing to malaria control—were diminished when small monetary incentives were introduced.
  • Geography Trumps Gold: Location was the strongest predictor of success. Participants in Bandundu were significantly more active and consistent than those in Kinshasa, regardless of whether they were paid. This suggests that local leadership and community culture are more powerful drivers than individual financial gain.
  • Technology as the Incentive: Participants often valued the smartphone itself more than the $10 monthly airtime. This led to a high rate of "phone retention" (refusal to return the device), with some participants viewing the phone as a just reward for their labor.
  • The Feedback Gap: A major takeaway from the focus groups was that participants felt "abandoned" by the researchers. They didn't just want money; they wanted a "sign" that their data had arrived and was being used to help their community.

Key Results

  • No Significant Difference: Across the entire study, there was no statistically significant difference in the total number of uploads between the incentive and control groups ($p = 0.88$).
  • Participation Decay: Most groups saw a sharp decline in activity after week 8. The notable exception was the Bandundu Control group, which maintained a high participation rate of ~77% through the end of the trial.
  • Quantitative Edge for Bandundu: Bandundu participants uploaded data for more weeks ($p < 0.001$) and had higher total upload counts ($p = 0.009$) than those in Kinshasa.
  • Unintended Outcomes: 33 smartphones were never returned. Interestingly, the Kinshasa incentive group and the Bandundu control group were the most likely to retain their phones, suggesting that "entitlement" to the hardware mirrored the effort put into the study.

Limitations and Future Work

The authors acknowledge that the incentive structure was "flat"—participants received $10 regardless of how much data they uploaded. This may have encouraged "cutting corners" or simple apathy once the payment was secured.

Future work should explore performance-based incentives (paying per valid upload) and, more importantly, enhanced communication loops. Providing real-time feedback to citizen scientists about the impact of their data may be a more sustainable and ethical way to maintain long-term engagement than small cash transfers. The researchers also suggest that future trials should assess participants' baseline motivations before the study begins to better tailor incentive structures.

Summary updated

Abstract

Abstract Malaria is one of the deadliest vector borne diseases effecting sub-Saharan Africa. A suite of systems are being used to monitor and manage malaria risk and disease incidence, with an increasing focus on technological interventions that allow private citizens to remotely record and upload data. However, data collected by citizen scientists must be standardised and consistent if it is to be used for scientific analysis. Studies that aim to improve data collection quality and quantity have often included incentivisation, providing citizen scientists with monetary or other benefits for their participation in data collection. We tested whether monetary incentives enhance participation and data collection in a study trialling an acoustic mosquito sensor. Working with the community in two health districts in the Democratic Republic of Congo, we measured data collection participation, completeness, and community responses. Our results showed mixed responses to the incentive, with more participants interested in the social status and monetary value of the technology used than the monetary incentive itself. The effect of incentives on data collection varied over the course of the trial, increasing participation in the start of the trial but with no effect in the latter half of the trial. Feedback from participants showed that opinions on technology, research objectives, and incentives varied between communities, and was associated with differences in data collection quantity and quality, suggesting that differences in community interest in data collection and the incentives may be more important than the incentive value itself. These results suggest that though there is an initial benefit, extrinsic motivations do not override differences in intrinsic motivations over time, and enhanced communication and dialogue with participants may improve citizen science participation and attitudes. Attribution KES contributed to data curation, formal analysis, methodology, visualization, and writing the original draft. JPM contributed to formal analysis and visualization. EHM contributed to conceptualization, investigation, methodology, project administration, supervision, visualization, and the review and editing of the manuscript. EM, JZ, NMM, and SM contributed to conceptualization, investigation, methodology, data collection, and review and editing of the manuscript. RD, MS, IK, JE, YL, and SR contributed to conceptualization, methodology, and review and editing of the manuscript. KJW contributed to funding acquisition, methodology, supervision, and the review and editing of the manuscript. Funding This study was funded by the Bill and Melinda Gates Foundation Grant Award Number: OPP1209888.
BibTeX
@misc{storer2024what,
  author = {Kieran E. Storer and Jane P. Messina and Eva Herreros-Moya and Emery Metelo and Josué Zanga and Nono Mvuama and Soleil Muzinga and Rinita Dam and Marianne Sinka and Ivan Kiskin and J. D. EVERETT and Yunpeng Li and Stephen Roberts and Katherine J. Willis},
  title = {{What incentives encourage local communities to collect and upload mosquito sound data by using smartphones? A case study in the Democratic Republic of the Congo}},
  year = {2024},
  doi = {10.1101/2024.11.11.24316900},
  howpublished = {medRxiv},
}

Loading related content...

Figure