The living-room: browsing, organizing and presenting digital image collections in interactive environments

Otmar Hilliges, Markus Wagner, Lucia Terrenghi, Andreas Butz2007 · DOI

TL;DR

This paper introduces the "Living-Room," an interactive system designed for co-located browsing, organizing, and sharing of digital photos within a simulated living room environment. It leverages a large interactive tabletop and a wall display to enable more natural, social interactions with photo collections, moving beyond single-user desktop experiences.

What Problem Does This Paper Address?

The paper addresses the limitations of traditional desktop computer interfaces for managing and sharing digital photo collections in social settings. While digital photography has exploded in popularity, existing software is largely optimized for individual use. This makes co-located sharing and manipulation of photos awkward, often forcing people to huddle around a small screen. The authors aim to bridge this gap by creating an interactive environment that mimics the tangibility and flexibility of physical media while retaining the advantages of digital formats, fostering more natural and engaging social interactions around photos.

Methods

The core of the system is the "Living-Room" prototype, implemented within the FLUIDUM instrumented environment. This setup features a large interactive tabletop display and multiple back-projected wall displays. The interaction techniques are designed to be intuitive and leverage bi-manual input, inspired by models of human motor control. Key methods include:

  • Tabletop Interaction: Users can manipulate photos and "piles" of photos directly on the tabletop using single or two-handed gestures for moving, scaling, and rotating. This mimics physical photo handling.
  • Bi-Manual Interaction: For more complex tasks like scaling and rotating, two pointers (fingers or the toolstick) are used. This allows for fluid manipulation.
  • Toolstick and Magic Lens/Toolglass: A physical "toolstick" acts as a hybrid input device. When used upright, it functions as a pointer. When inverted, it enables annotation and filtering through a "magic lens" metaphor.
  • Annotation and Filtering: Users can annotate photos by handwriting tags (person, object, location, event) onto them via the toolstick. Handwriting recognition is used to create searchable labels. Filtering allows users to search within piles based on these annotations.
  • Wall Display Presentation: Selected photos or piles can be seamlessly transferred to the wall display for a slideshow presentation, with controls accessible via a proxy on the tabletop.

Datasets

Not discussed in the paper. The paper mentions using a set of pictures constituted from car-, tree-, and landscape-shots (mostly beach scenery) for evaluation tasks.

Key Insights and Ideas

  • Mimicking Physicality for Social Interaction: The most significant insight is that replicating the tactile and spatial interactions of handling physical photos on large interactive surfaces can greatly enhance social engagement with digital collections.
  • Bi-Manual Interaction as a Natural Fit: The paper strongly advocates for bi-manual interaction on large surfaces, suggesting it's crucial for natural manipulation and control, especially when mimicking real-world object handling.
  • The "Pile" Metaphor: The use of "piles" for organizing photos, inspired by real-world stacking, proves effective for both browsing and presentation, offering an alternative to traditional hierarchical folder structures.
  • Context-Sensitive Interfaces: The toolstick's dual functionality and the magic lens metaphor demonstrate the power of context-sensitive interfaces that adapt to the user's current task and the information being interacted with.
  • The Challenge of Annotation: While the concept of handwriting annotations is appealing, the technical implementation and user experience for this specific feature proved challenging, highlighting the difficulty of translating intuitive concepts into robust interactive systems.

Key Results

  • High Appreciation for Core Functionalities: Participants rated the flexibility to move, scale, and rotate pictures (4.2/5), using piles (4.2/5), and the slideshow functionality (4.7/5) highly.
  • Lower Appreciation for Annotation and Filtering: Annotation (2.5/5) and filtering (3.2/5) received lower scores, primarily attributed to technical difficulties (occlusions in the input system) rather than the conceptual design itself.
  • Usability of Interaction Styles: Participants found interactions with pictures and piles, as well as slideshow control, to be highly suitable and enjoyable.
  • User Preference for Presentation: Participants indicated they would frequently use the photo browsing, pile management, and presentation features if available at home, but only seldom or never use the annotation and filtering features.

Limitations and Future Work

  • Technical Difficulties with Annotation: The primary limitation acknowledged is the technical challenge with the DVIT technology, which caused occlusions during bi-manual input, making annotation and handwriting recognition cumbersome and error-prone.
  • Toolstick Confusion: Participants had difficulty remembering which orientation of the toolstick corresponded to which function, suggesting a need for clearer physical design cues.
  • Scalability: The system performs well with up to 2000 photos, but current photo libraries often exceed this number, indicating a need for better scalability for larger collections.
  • Future Work: The authors suggest improving the physical design of the toolstick for better distinguishability, exploring alternative filtering mechanisms beyond handwriting, and investigating hierarchical organization structures for managing very large collections. They also plan to address the technical issues with input occlusion.

Summary updated

Abstract

We present the living-room, an interactive application for browsing, organizing and sharing digital photos. The application runs in an instrumented environment on a wall display and an interactive tabletop, which is meant to simulate a future living room. We discuss the design rationale as well as the interaction techniques and the technical implementation. To asses how well our design goals were met, we evaluated the application in a study with 10 participants with mostly good results.
BibTeX
@misc{hilliges2007living,
  author = {Otmar Hilliges and Markus Wagner and Lucia Terrenghi and Andreas Butz},
  title = {{The living-room: browsing, organizing and presenting digital image collections in interactive environments}},
  year = {2007},
  doi = {10.1049/cp:20070425},
}
Figure