Hello everybody, I want to present our experiments with Realtime holographic Mappping and Unity3d!
Through the use of specific technologies and materials, we have carried on an in depth feasibility research for the construction of holographic projections, mapped in real time, to create virtual sets that can interact with the physical presence of the actors.
We focus our attention on the software to recognize the presence of bodies on stage,
on the structural part in order to facilitate the interaction between man and software and improve the holographic illusion,
on the graphics by using a framework normally used to create video games, here at the service of theater or other live shows.
The process can be divided into three main areas:
capturing, real-time rendering, projection mapping.
The capturing of the actor is realized with Microsoft Kinect to extrapolate the skeleton of the actor in the scene,
the skeleton of the actor is transmitted in real time to the engine Unity 3D with which are generated renderings in real time,
renderings are projected onto a plastic material that allows the visualization on the actor in transparency thereby creating the holographic effect.
This study is part of the production process of the show “Augmented Pinocchio” directed by and starring Michele Cremaschi which will debut in July 2013 at the Napoli Fringe Festival.
Regards
Davide aka tucano and The RecipientCollective