Has anyone here tried making custom AR/VR hardware?

Basically, I got myself an arduino, and suddenly realized that it would be relatively easy to jury-rig a VR glove these days.

Yes… Coupled with 16 MIDI triggers per hand…and got a design patent on it. Arduinos rock.

3 Likes

I haven’t considered MIDI - I thought about using serial communication via usb, but I see how MIDI could work as well - bending could be sent as an aftertouch MIDI event for example. Or just note on/off events.

Did you have any experience using gyros/accelerometers on Arduinos?

I used MIDI triggers as a drummers aid to rid themselves of drum machines and be able to play on any surface. You could actually assign anything to it and use fingers, palms and thumb to play the notes. Say you wanted to record a piano piece in A minor. You set the triggers up and have 3 full octaves in tune to go nuts with.Or you were doing sound efx for a film…Just load the triggers and hit the appropriate finger joints per sound. Conversely the piezo triggers can be used the same as buttons and joysticks. I used accelerometers and gyros to control the inflection of the triggered sounds and to track where the gloves were and how much flexion was on the wrist… There are Arduino forums that are pretty comprehensive. There is a Uniduino plugin that used to work with 4.x on the Asset Store for interfacing with Unity. I would also look into sensors that determine the amount of bend for the joints and between gyros and accelerometers get a fairly accurate by the numbers position, rotation and articulation of all the hand joints. The best way to calibrate initialization is to place your hands at shoulder level with arms extended and clap them together.

3 Likes