E-Toy/eye-toy like games

Does anyone know how viable doing a game with Unity is that takes video input as the interaction like the e-toy games? I know that you can write C plugins, I just don’t know how feasable it is with the way Unity objects interact.

Also, has anyone used Quartz Composer? Could information be passed from the video draw layer to Unity, or is this completely seperate from the OpenGL layer that Unity is drawn in?

Thanks for any input.

Writing a plugin to make a library for games like Toy Sight is definately possible with the plugin API.

Take a look at the midi sample. (You need the pro version for this.)
The xCode project is quite small, so is the C# code.
There are two samples included which show how to make some boxes and particle systems jump based on the pressed keys.

There are two projects that contain quite a bit of code for the image analysis part of video as an input:

http://webcamxtra.sourceforge.net/

By using one of those libraries i think you could get a iToy like library up and running very quickly.

Thanks Joachim.
I tried the midi plugin and I have a Unity Pro demo license, but nothing happens when I play it (tried keys on the keyboard as well as mouse clicks). Also have confirmed that Midi is working on my machine. Did I need to recompile the plugin? It appears to be a bundle that’s in the Plugins folder of the project…

A readme or some further documentation on this would be nice to get people quickly up and running with plugins.

I uploaded a new midi plugin sample.

It now includes a readme and standalone player of the midi boxes sample.

You should be able to just:

  1. Connect your keyboard
  2. Open the sample application.
  3. Hit a key on the keyboard (Needs to be note 48-99

This should make the boxes jump about when you hit a key.

(If this is not working for you, please do Report a bug or send me a mail about it)