Does Benefit Framing Improve Record Linkage Consent Rates? A Survey Experiment

Joseph W. Sakshaug, Jens Stegmaier, Mark Trappmann, Frauke KreuterPubMed 2018 · DOI

Abstract

Survey researchers are increasingly seeking opportunities to link interview data with administrative records. However, obtaining consent from all survey respondents remains a barrier to performing record linkage in many studies. We experimentally investigated whether emphasizing different benefits of record linkage to respondents in a telephone survey of employee working conditions improves respondents' willingness to consent to linkage of employment administrative records relative to a neutral consent request. We found that emphasizing linkage benefits related to "time savings" yielded a small, albeit statistically significant, improvement in the overall linkage consent rate (86.0%) relative to the neutral consent request (83.8 percent). The time savings argument was particularly effective among "busy" respondents. A second benefit argument related to "improved study value" did not yield a statistically significant improvement in the linkage consent rate (84.4 percent) relative to the neutral request. This benefit argument was also ineffective among the subgroup of respondents considered to be most likely to have a self-interest in the study outcomes. The article concludes with a brief discussion of the practical implications of these findings and offers suggestions for possible research extensions.

Introduction

In survey research, "record linkage"—combining survey answers with administrative data like tax records or employment files—is a gold mine for high-quality, longitudinal data. It reduces respondent burden and provides variables that are nearly impossible to capture accurately through memory alone. However, researchers face a major hurdle: informed consent. If a significant portion of the sample refuses to link their data, the resulting dataset may suffer from "non-consent bias."

This study investigates whether "benefit framing"—highlighting specific advantages of linkage—can serve as a low-cost "nudge" to improve these consent rates. The authors embedded a randomized experiment within a large-scale telephone survey in Germany called the "Diversity of Employment Relationships" (VA) survey, involving 7,561 respondents.

Methods

Respondents were randomly assigned to one of three framing conditions immediately before the record linkage consent request:

  1. Control (Neutral): No benefit mentioned.
  2. Time Savings: "To keep the interview as short as possible..."
  3. Improved Study Value: "The informative value of this study can be significantly improved if we can supplement your information with additional data."

The researchers used logistic regression to analyze main effects and interaction effects, specifically testing if the "time savings" argument resonated more with people who were objectively "busy."

Key Results

The "time savings" intervention was the most successful. It resulted in a consent rate of 86.0%, compared to 83.8% in the control group. This 2.2 percentage point difference was statistically significant ($p = 0.027$). In contrast, the "improved study value" group reached 84.4%, which was not a statistically significant improvement over the control.

Linkage consent rates by experimental condition, showing the significant boost from the time savings frame.

Subgroup Analysis: The "Busy" Nudge

The most successful intervention was the "time savings" argument, which specifically resonated with respondents who had two or more children or worked 40+ hours per week. For respondents with 2+ children, the "time savings" argument increased consent by roughly 10 percentage points compared to the control group in that same demographic.

Interaction effects of the 'time savings' frame across respondent subgroups, highlighting its effectiveness for busy respondents.

Surprisingly, the "Improved Study Value" argument failed to move the needle, even among highly educated respondents or those with a personal stake in the study's topic (e.g., workers whose rights were being withheld). This suggests that altruism and scientific rigor are harder sells than direct appeals to personal time management.

Discussion and Practical Implications

The overall consent rates were already quite high (around 84-86%), likely due to a "ceiling effect" where the people who agreed to the 30-minute interview were already highly cooperative.

However, the findings suggest that "tailoring" the request based on what the interviewer knows about the respondent (e.g., "I hear kids in the background, let me mention this saves time") could be a powerful strategy. Future research should focus on "dynamic tailoring" and testing these frames in self-administered web surveys where benefits can be made visually salient.

Summary updated

Abstract

Survey researchers are increasingly seeking opportunities to link interview data with administrative records. However, obtaining consent from all survey respondents (or certain subgroups) remains a barrier to performing record linkage in many studies. We experimentally investigated whether emphasizing different benefits of record linkage to respondents in a telephone survey of employee working conditions improves respondents' willingness to consent to linkage of employment administrative records relative to a neutral consent request. We found that emphasizing linkage benefits related to "time savings" yielded a small, albeit statistically significant, improvement in the overall linkage consent rate (86.0) relative to the neutral consent request (83.8 percent). The time savings argument was particularly effective among "busy" respondents. A second benefit argument related to "improved study value" did not yield a statistically significant improvement in the linkage consent rate (84.4 percent) relative to the neutral request. This benefit argument was also ineffective among the subgroup of respondents considered to be most likely to have a self-interest in the study outcomes. The article concludes with a brief discussion of the practical implications of these findings and offers suggestions for possible research extensions.
BibTeX
@inproceedings{sakshaug2018does,
  author = {Joseph W. Sakshaug and Jens Stegmaier and Mark Trappmann and Frauke Kreuter},
  title = {{Does Benefit Framing Improve Record Linkage Consent Rates? A Survey Experiment}},
  booktitle = {PubMed},
  year = {2018},
  doi = {10.18148/srm/2019.v13i3.7391},
}
Figure