Attendee-Sourcing: Exploring The Design Space of Community-Informed Conference Scheduling

Anant P. Bhardwaj, Juho Kim, Steven Dow, David R. Karger, Sam Madden, Rob Miller, Haoqi Zhang

Scheduling a massive, multi-track conference is a logistical nightmare often prone to "thematic conflicts"—where two talks an attendee wishes to see happen at the exact same time. This research introduces attendee-sourcing, a method that leverages a paper-recommendation tool called Confer to gather thousands of attendee preferences months before the event. This data allows organizers to build schedules that maximize satisfaction and minimize room-size miscalculations.

The Challenge of Large-Scale Scheduling

For flagship conferences like ACM CHI, which features hundreds of papers across 16 parallel tracks, the scheduling process is traditionally a manual, "paper-on-the-wall" exercise for a few organizers. Even with digital tools, organizers struggle to account for the diverse interests of thousands of attendees.

Previous attempts to solve this, such as the Cobi system, relied on "author-sourcing"—asking authors to identify papers similar to their own. However, authors are often biased or limited by a narrow view of the field. The gap addressed here is the "unvoiced opinion" of the general attendee. Without their input, organizers often end up with incoherent sessions or "rockstar" talks scheduled in tiny rooms while niche sessions sit in half-empty auditoriums.

The traditional author-sourcing interface asks authors to rate the similarity of specific papers to their own work.

Methodology: The Confer Tool

The authors developed and deployed Confer, a social recommendation and scheduling tool designed to capture attendee preferences through:

  1. Early Access: Releasing the full list of accepted papers to attendees four months before the conference (and 45 days before the schedule is finalized).
  2. Natural Exploration: Unlike authors, who judge a fixed list of papers, attendees explore the entire dataset via search, keywords, and collaborative filtering recommendations.
  3. Preference Encoding: Every time an attendee "bookmarks" a paper they want to see, it is recorded as a preference.
  4. Affinity Mapping: The system calculates "affinity scores" between pairs of papers based on how many people wanted to see both. High affinity suggests papers should be in the same session or at least not scheduled concurrently.
The Confer interface allows attendees to tag papers they want to see and receive personalized recommendations.

Key Insights and Data Comparison

The study was conducted using data from CHI 2014, comparing 3,869 preferences from 634 authors against 7,228 preferences from 347 attendees.

  • Recall vs. Precision: Author-sourcing provides high precision (technical relatedness) but low recall (missing connections outside immediate sub-fields). Attendee-sourcing provides high recall, identifying "hidden" affinities. For example, attendees linked papers on "Body Pose" and "Mid-Air Keyboards" via the concept of "in-air interaction," a connection missed by automated text-based tools and authors.
  • Predicting Popularity: Attendee-sourcing acts as a census for room capacity. By tracking which papers are bookmarked most, organizers can move popular sessions to larger rooms, preventing the common frustration of being turned away from a full session.
  • Complementary Strengths: Author data helps create thematically coherent sessions, while attendee data helps resolve conflicts between those sessions.

Results and Future Directions

Despite having fewer participants than the author group, attendees were significantly more active, marking an average of 20.8 papers each (compared to 6.1 for authors). This resulted in better coverage, capturing preferences for 98.98% of all papers.

While promising, attendee-sourcing faces challenges regarding incentives and potential social bias. Future work aims to move from providing data to organizers to fully automated session creation, treating scheduling as an optimization problem where attendee preferences serve as the primary constraints.

Summary updated

Abstract

Constructing a good conference schedule for a large multi-track conference needs to take into account the preferences and constraints of organizers, authors, and attendees. Creating a schedule which has fewer conflicts for authors and attendees, and thematically coherent sessions is a challenging task. Cobi introduced an alternative approach to conference scheduling by engaging the community to play an active role in the planning process. The current Cobi pipeline consists of committee-sourcing and author-sourcing to plan a conference schedule. We further explore the design space of community-sourcing by introducing attendee-sourcing -- a process that collects input from conference attendees and encodes them as preferences and constraints for creating sessions and schedule. For CHI 2014, a large multi-track conference in human-computer interaction with more than 3,000 attendees and 1,000 authors, we collected attendees’ preferences by making available all the accepted papers at the conference on a paper recommendation tool we built called Confer, for a period of 45 days before announcing the conference program (sessions and schedule). We compare the preferences marked on Confer with the preferences collected from Cobi’s author-sourcing approach. We show that attendee-sourcing can provide insights beyond what can be discovered by author-sourcing. For CHI 2014, the results show value in the method and attendees’ participation. It produces data that provides more alternatives in scheduling and complements data collected from other methods for creating coherent sessions and reducing conflicts.
BibTeX
@inproceedings{bhardwaj2014attendee,
  author = {Anant P. Bhardwaj and Juho Kim and Steven Dow and David R. Karger and Sam Madden and Rob Miller and Haoqi Zhang},
  title = {{Attendee-Sourcing: Exploring The Design Space of Community-Informed Conference Scheduling}},
  booktitle = {HCOMP},
  year = {2014},
  doi = {10.1609/hcomp.v2i1.13163},
}

Loading related content...

Figure