That’s neat. This could be used for simple translational headtracking.
btw you can set unity to always update even if it’s not focused. Edit->Project settings->Player->Resolution and presentation->Run in background
Now this is very original project! Actually, it opens pretty many possibilities. Like real-time interactions, actors as game characters and even theater in Unity.
One of the most fascinating projects with Unity I’ve seen.
@okimoki. Absolutely! TSPS is designed for sensing people in environments, but really it works in any case where a video scene has high enough contrast for background-subtraction blob detection to work. So tracking markers on a table would definitely work.
But, there actually is a really neat project developed more specifically for using markers / touch tables with Unity. it’s called uniTUIO and is based on the TUIO specification: