Calligraphic Video
Time-Sand: Responsive Microcosm PDF Print

Time-Sand is a 'responsive microcosm' with its own space-time dynamics. Visitors are invited to meddle, to manipulate the landscape and alter the flows of water, light, and even time. Interactions perturb the microcosm, sending waves that gush and bleed, revealing the past and slowing time in a manner like kicking up dust on the sea-floor or dripping ink on thick, porous paper.

The piece consists of an architectural model of a soil-remediation process (developed by Gregory Rubin for his master's thesis in architecture) augmented with responsive video and sound. A time-lapse video was created of cleansing and drying experiments over the period of a month and is projected down onto the model itself, giving the effect that the model is evolving on a time-scale faster than our own. Synchretic, synaesthetic, sound was composed to follow the ebb and flow of the time-lapse video and is looped in sync. Movement, captured from a camera above, causes local responses including simultaneous timbral and temporal shifting and blurring in both the video and sound. The model is periodically filled with water, which forms small streams and pools as it flows through sand and around clay foundations. Visitors manipulate not just the computational media, but the physical model itself. Like playing with mud puddles on a dirt road in the rain, they can add material (sand) and shape the flows. The virtual and the real are thus phenomenologically fused to form a hybrid computational-physical material.


Time-Sand: Responsive Microcosm from Morgan Sutherland on Vimeo.

Time-Sand is a collaboration between Morgan Sutherland (concept, responsive video), Gregory Beck Rubin (concept, model), and Aaron Munson (responsive sound). Time-Sand uses software developed by Jean-Sébastien Rousseau, Michael Fortin, and Yoichiro Serita at the Topological Media Lab.

Photo of Time-Sand

Full documentation can be found at Morgan Sutherland's website.

 
Meteor Shower PDF Print

Sha Xin Wei - Concept & meta-physics
Jean-Sébastien Rousseau - video and particle programming
Timothy Sutton - Sound design and programming
Emmanuel Thivierge - state evolution and video feature extraction
Louis-Andre Fortin -  visual design and programming
Freida Abtan - sound and systems design advisor

Meteor Shower is an experiment in gesture-controlled video and sound synthesis. Participants are represented as solar bodies with gravitational potential in a particle-based starfield.  Built initially as a simple responsive environment, its next incarnation will incorporate state-aware behaviour, and further explore ideas of nature/artifice by building narrative structures involving "lunar characters."

As a deployable installation, Meteor Shower holds potential as an environment for architectural installations, play spaces, and performance events – it is being designed with such flexibility in mind.


 VIDEO (320 X 240:: 15 MB)  VIDEO (320 X 240:: 28 MB)
  VIDEO (320 X 240:: 26 MB)

Meteor Shower

ms2 ms3

 

  

 
Ubicomp 2003 PDF Print

Projecting live video modified by physically-models video texture synthesis, nuanced by the activity of passersby. The membrane was steel mesh, allowing people to see each other through the projected image.

ubi01 ubi04

 
What Color is Communication? PDF Print

Sha Xin Wei, Live Misting of Craig Dongoski Drawing
B-Complex, Atlanta, May 1, 2004

 craig-redmist  xwhite

 
Physics-based Interactive Fluids PDF Print
Maria Cordell, Delphine Nain

Parametrizing video textures through gesture allows us to pour video and shape it the way a calligrapher works with ink. We use physics-based fluid modeling implemented in Jitter to produce realistic, real-time smoke and water video effects.

 cv_smoke1  Wave Kernel


Combined with motion tracking and a host of other image processing techniques, our simulations enable natural and engaging gestural play with video as structured light.

Prior work by Yoichiro Serita and Erik Conrad