Are Open News Systems Credible? - An Investigation Into Perceptions of Participatory and Citizen News

Jonathan Scott, David E. Millard, Pauline LeonardWEBIST 2016 · DOI

TL;DR

This paper investigates whether perceived credibility explains why people view traditional news systems as more trustworthy than open, participatory online news platforms. The study found a modest but significant correlation between a news system's openness and its perceived credibility, suggesting credibility is a useful, though imperfect, lens for understanding these differences.

What Problem Does This Paper Address?

The digital age has fundamentally reshaped how we consume and interact with news. The rise of social media and participatory platforms has blurred the lines between news producers and consumers, leading to new models of journalism like "produsage" and "citizen journalism." While previous research has categorized news systems along a spectrum of "openness" (how much they allow user contribution), it's been observed that the most open systems (like YouTube) are often not even considered "news systems" despite sharing functional characteristics with traditional media. This raises a crucial question: what factors drive these differing perceptions? This paper hypothesizes that perceived credibility is a key differentiator and seeks to empirically test this by examining how the openness of a news system relates to its perceived trustworthiness.

Methods

The researchers conducted a web-based survey to measure the relationship between a news system's position on an established "openness spectrum" and its perceived credibility. Participants were presented with a list of news systems they were familiar with and asked to rate them on five factors of credibility, adapted from Meyer's (1988) widely used scales: Unbiased/Biased, Fair/Unfair, Tells/Does not tell the whole story, Accurate/Inaccurate, and Can/Cannot be trusted. They also rated their level of interaction with each system. Spearman's Rank Correlation was used to analyze the relationship between the openness spectrum position and the credibility ratings.

Datasets

The study utilized a dataset of 32 news systems previously categorized on an "openness spectrum" by Scott et al. (2015). The survey collected data from 79 participants, resulting in 598 ratings across 26 systems after excluding those with insufficient ratings. No new datasets were introduced; the focus was on analyzing existing systems through the lens of credibility.

Key Insights and Ideas

  • Credibility as a Differentiator: The study provides empirical support for the idea that perceived credibility plays a significant role in how people distinguish between traditional and open news systems.
  • Openness vs. Credibility Trade-off: There's a discernible trend: as news systems become more open to user participation, their perceived credibility tends to decrease.
  • Beyond Technical Functionality: Even though open systems share functional characteristics with traditional news, their perceived credibility is lower, suggesting that factors beyond mere functionality influence user judgment.
  • The "News" Definition Problem: Many participants struggled to even classify certain open platforms (like Flickr or YouTube) as "news systems," highlighting a fundamental disagreement on what constitutes news in the digital age.
  • Brand Reputation Matters: For some established media outlets, their brand reputation and perceived editorial process (even for participatory elements) contributed to higher credibility ratings, overriding the openness factor.
  • Outliers Tell a Story: Tabloid news outlets like The Sun and Daily Mail, despite being very closed systems, were rated as highly uncredible. This suggests that sensationalism and perceived ideological bias can override the "closedness" advantage.

Key Results

The study found a modest but statistically significant correlation between the openness of a news system and its perceived credibility across all five measured factors (Unbiased, Fair, Tells the Whole Story, Accurate, Trustworthy). This correlation remained significant even after removing the outlier tabloid systems. For instance, the correlation between openness and "Trustworthy" was -0.202 (p < 0.01). The most closed systems generally received higher credibility ratings, while the most open systems received lower ratings.

Limitations and Future Work

The authors acknowledge that the correlation found is "modest" and "imperfect," meaning credibility is not the sole explanation for the perceived differences. They also note the inconsistent use of terms and scales in existing credibility research, which made choosing a standard difficult.

Future work suggested includes:

  • Investigating the credibility of systems that don't neatly fit the openness spectrum (e.g., liveblogs, microblogs).
  • Exploring whether this relationship between openness and credibility holds true for non-English language media.
  • Further research into specific features that enhance the perceived credibility of alternative news outlets.
  • Investigating how the addition of an editorial process might improve the credibility of open news systems.

Summary updated

BibTeX
@inproceedings{scott2016are,
  author = {Jonathan Scott and David E. Millard and Pauline Leonard},
  title = {{Are Open News Systems Credible? - An Investigation Into Perceptions of Participatory and Citizen News}},
  booktitle = {WEBIST},
  year = {2016},
  doi = {10.5220/0005858702630270},
}
Figure