Concept: The aim of this project is to combine reality and virtuality. Persons and there movements are tracked with a Kinect camera. The recorded movements are transformed into silhouettes and projected as shadows on a wall.
The miniature of the viewer appears in a window of Carl Spitzweg’s painting “Der arme Poet”. Existing reality is removed from its initial atmosphere and placed in a new spatial situation. This new atmosphere (painting) can actively be influenced. Two separate existing realities: the viewer and the painting are directly connected. Through the projection they influence each other and both are changing.
Implementation: The Kinect combines ordinary camera and depth sensor. The camera generates a grayscale image with additional depth information per pixel. The gray values are dependent on the measured distance. It is possible to define a particular recording area. The reference space has to be at a distance of 30-200 cm in front of the camera.
The software “vvvv” generates and manipulates video, graphics and data streams in real time. For this project it was used for processing the Kinect camera signal. With the software the grayscale image in the desired recording area is filtered to display only the silhouette of the person in the camera field without disturbing objects in the background. That algorithm converts the grayscale image into pure black (shadow) and reduces the scale to receive a miniature-like effect.