Integrarte: Digital Art Using Body Interaction

Barbara P. Castro, Luiz Velho, Doris KosminskyCAe@Expressive 2012 · DOI

TL;DR

This paper introduces INTEGRARTE, an interactive art installation that explores the integration of the whole body into digital art experiences. By leveraging new media technologies and a post-medium perspective, the project aims to create a deeper connection between the audience and artwork through multi-sensory engagement.

What Problem Does This Paper Address?

The paper addresses the evolving landscape of art in the digital age, particularly the concept of "post-medium condition" where traditional artistic boundaries blur. It questions how digital art can move beyond simply "remediating" analog forms and instead foster truly novel interactive experiences. The authors highlight a tendency for digital art to mimic existing analog tools (like digital paintbrushes) and argue for a more profound integration of the body, not just as a controller, but as a "living medium" itself. This leads to the challenge of designing interactive art that encourages a holistic, multi-sensory engagement with the audience, moving beyond purely visual or gestural interactions.

Methods

The INTEGRARTE project utilizes a framework built around a Microsoft Kinect sensor, a computer, a projector, and audio output. The Kinect's 3D camera and skeleton tracking capabilities are central to the system, allowing it to capture human movement in real-time without the need for physical markers on the participant. This raw body data is then mapped to various artistic outputs, including visual elements and sound. The authors emphasize the use of Processing, a Java-based programming language designed for artists, for rendering visual outputs and Ableton Live for sound design. They developed four distinct interactive experiments, each focusing on different body parts or relationships between them to generate unique visual and auditory responses.

Datasets

Not discussed in the paper. The project focuses on real-time interaction with participants rather than training on pre-existing datasets.

Key Insights and Ideas

  • Body as a "Living Medium": The paper champions the idea of the human body not just as an input device, but as an integral part of the artistic creation process, akin to a living canvas or instrument.
  • Beyond Remediation: The authors actively push against the idea of digital art merely replicating analog forms. They seek to create experiences that are uniquely enabled by digital technology and body interaction.
  • Multi-Sensory Integration: The project emphasizes the importance of combining visual and auditory stimuli to create a richer, more immersive aesthetic experience, moving beyond the dominance of sight in many digital interactions.
  • Post-Medium Condition in Practice: INTEGRARTE demonstrates how the blurring of media boundaries can lead to new forms of artistic expression, where movement, sound, and visuals are seamlessly interwoven.
  • Intuitive Interaction Design: The experiments highlight the trade-offs between complexity and user-friendliness in interactive art, suggesting that simpler, more intuitive interactions (like "Circle Field") can lead to greater public engagement.

Key Results

The paper describes four interactive experiments: "Wave," "Eco," "Circle Field," and "Graf."

  • "Wave" and "Eco": These experiments explored more complex body movements and relationships, resulting in visually attractive but less explored interactions by the public, possibly due to shyness or the exhibition environment. "Eco" generated a rich soundscape but was noted as potentially too complex for intuitive understanding.
  • "Circle Field": This experiment, which used hand distance to control circle size and sound frequency, was the most successful in terms of public engagement. Its intuitive interaction and clear connection between visual and auditory elements made it easily accessible.
  • "Graf": This sketch, using only one hand to create squares, was the least memorable, likely due to its common interaction method and limited body involvement.

Overall, the project demonstrated the potential for body interaction in digital art but also highlighted the challenges in designing universally engaging experiences.

Limitations and Future Work

The authors acknowledge several limitations and suggest future directions:

  • Limited Body Part Focus: The current experiments primarily focused on upper body interaction. Future work aims to incorporate leg movements for a more comprehensive body engagement.
  • Exhibition Environment: The festival setting, with its public visibility, may have inhibited some participants. Future exhibitions will aim for a less exposed environment to encourage spontaneity.
  • Artist's Body Integration: A key future direction is to explore the integration of virtual instances of the artist's body into interactive installations, creating a digital presence that can meet the public.
  • Further Research on Public Engagement: The project is seen as a starting point for ongoing research into interactive installations and public engagement, with a focus on encouraging exploration of new media and fostering new ways of creating and perceiving art.

Summary updated

BibTeX
@inproceedings{castro2012integrarte,
  author = {Barbara P. Castro and Luiz Velho and Doris Kosminsky},
  title = {{Integrarte: Digital Art Using Body Interaction}},
  booktitle = {CAe@Expressive},
  year = {2012},
  doi = {10.2312/compaesth/compaesth12/011-015},
}
Figure