Creating An Abstract Moving Sculpture Using Kinect Data

If you remember the Sandman from Spider-Man 3, then picture him doing some graceful dancing and you’ve nearly arrived at the abstract work entitled unnamed soundsculpture by onformative and chopchop.

By asking a dancer to physically interpret the song “Kreukeltape” by Machinenfabriek, and recording her movements on three Kinect cameras, the project creates a moving sculpture from the captured motion data. The three Kinect perspectives are then spliced together as point clouds to create the fluid abstraction in the video above. They explain:

The three-dimensional image allowed us a completely free handling of the digital camera, without limitations of the perspective. The camera also reacts to the sound and supports the physical imitation of the musical piece by the performer. She moves to a noise field, where a simple modification of the random seed can consistently create new versions of the video, each offering a different composition of the recorded performance. The multi-dimensionality of the sound sculpture is already contained in every movement of the dancer, as the camera footage allows any imaginable perspective.

Similar to painting, a single point appears to be still very abstract, but the more points are connected to each other, the more complex and concrete the image seems. The more perfect and complex the “alternative worlds” we project (Vilém Flusser) and the closer together their point elements, the more tangible they become. A digital body, consisting of 22 000 points, thus seems so real that it comes to life again.

The shapes and forms that appear throughout the video take on a kind of Rorschach test effect, allowing you to project images of rhinos, dinosaurs, or whatever your mind desires as the dancer tumbles around in this dynamic visualisation. Below is documentation of how it was done.


[via Creative Applications]