Leonardo Abstracts Service | Leonardo/ISASTwith Arizona State University

Leonardo Abstracts Service

  • 3273
    Pearlman, Ellen "I Move In Decades." PhD , School of Creative Media, Hong Kong City University, 2011
    Keywords/Fields of Study : Telematic Art, motion capture, data mapping, World Trade Towers, 9/11, Visual data, dance

    Abstract: I Move In Decades is a work of visual art, gesture, movement, and sonic representations translated into hybridized data combinations and communicated over a high speed telematic research network. Data mapping creates interactive productions and responsive environments over vast distances. Data describing human motion impacts transdisciplinary processes. This thesis describes a series of experiments leading to a work using physical gestural data as a compositional indicator in telematic productions. Theoretical and artistic concepts leading to the interpretation and evaluation of this data in the context of a complex international networked performance will be discussed. The technologies of motion capture, data mapping and visual effects produced in both VDMX and MAX/MSP is shown to be experimentally problematic in multimodality arts practices. Data describing human motion can disrupt creative practices in terms of new combinations but does significantly impact transdisciplinary processes. The technical part of the investigation explored the use of a 12-camera EvArt infra-red motion capture technology and body mapping. I translated body motion into triggers for visual effects by recording the data of three locations on a dancer's body; the joints of the wrist, the ankle and the elbow. Tracking the range of these movements on a motion capture grid the data of these joints X, Y and Z positions moving in space were recorded. The Y position was set to trigger visual effects when reaching specific parameters in a range. This data was sent over the network and transformed by a C++ program that changed it to OSC. The OSC data was imported into a MAX/MSP/Jitter patch to trigger visual effects in a remixed video. An alternate method was deployed using live time effects sent over the network using VDMX.

    Department: Interdisciplinary Graduate Program , School of Creative Media, Hong Kong City University
    Advisor(s): Kenneth FIelds, James Parker
  • 3273
    Pearlman, Ellen "I Move In Decades." PhD , University of Calgary, 2011
    Keywords/Fields of Study : Telematic Art, motion capture, data mapping, World Trade Towers, 9/11, Visual data, dance

    Abstract: I Move In Decades is a work of visual art, gesture, movement, and sonic representations translated into hybridized data combinations and communicated over a high speed telematic research network. Data mapping creates interactive productions and responsive environments over vast distances. Data describing human motion impacts transdisciplinary processes. This thesis describes a series of experiments leading to a work using physical gestural data as a compositional indicator in telematic productions. Theoretical and artistic concepts leading to the interpretation and evaluation of this data in the context of a complex international networked performance will be discussed. The technologies of motion capture, data mapping and visual effects produced in both VDMX and MAX/MSP is shown to be experimentally problematic in multimodality arts practices. Data describing human motion can disrupt creative practices in terms of new combinations but does significantly impact transdisciplinary processes. The technical part of the investigation explored the use of a 12-camera EvArt infra-red motion capture technology and body mapping. I translated body motion into triggers for visual effects by recording the data of three locations on a dancer's body; the joints of the wrist, the ankle and the elbow. Tracking the range of these movements on a motion capture grid the data of these joints X, Y and Z positions moving in space were recorded. The Y position was set to trigger visual effects when reaching specific parameters in a range. This data was sent over the network and transformed by a C++ program that changed it to OSC. The OSC data was imported into a MAX/MSP/Jitter patch to trigger visual effects in a remixed video. An alternate method was deployed using live time effects sent over the network using VDMX.

    Department: Interdisciplinary Graduate Program , University of Calgary
    Advisor(s): Kenneth FIelds, James Parker