Hi all, just wanted to share my latest Honours project with everyone.
It’s an Augmented Reality/Geo reality FPS using the gyroscope and camera. I’m also using the compass and GPS to track the player’s location and use the nearby landmarks as part of the game world. For instance, real-life shops become shops in-game and real life hospitals + pharmacies can heal you in game. It’s an attempt to combine both the real world and digital world together
Here is a list of plugins that I used:
sleglik’s RPG kit
Prime31’s corelocation + AR plugin
UIToolkit
iTween
FingerGestures v2.1.2
Mixamo’s zombie pack (saved me a weeks worth of animations :))
Armory/Gun assortment pack
I’ll be happy to answer any questions and please give me some feedback!
Will be interesting to see people walking around focusing on their iPad and running into things or getting hit by a car. This is really cool though, shame its so jittery.Would be cool to play zombies from COD in your house. You can dictate where windows and doors are and put markers on the floor. The camera would pick up said markers and make the zombies actually move on your plane and not all jittery
Unfortunately it’s really hard to align the virtual world to the real world properly using the gyroscope, you’ll run into tonnes of perspective, sight elevation, field of view and depth problems.
The alternative of using markers is impractical given that the game is meant to be playable anywhere in the world
The only way I can think of is use motion tracking technology used in films/vfx but that has to be done in real time so the computing power needed is immense… We’ll just have to see what the future holds
Glad you guys liked it, the challenge for me is to design something that can utilise the GPS and real world locations as part of the gameplay. I knew I was going to have problems with the AR vision which can’t be resolved so I just made do with what I could
Sorry Dreamlarp, this is just a POC for an university project. I would love to get the funding to develop this game further but it takes a lot of resources to map the entire real world into the game
@janpec I’m hoping that Apple will eventually use a depth sensing camera like the Kinect on their iOS devices to I can have real world occlusion and hopefully dynamic shadows as well!
Sorry Dreamlarp, this is just a POC for an university project. I would love to get the funding to develop this game further but it takes a lot of resources to map the entire real world into the game
@janpec I’m hoping that Apple will eventually use a depth sensing camera like the Kinect on their iOS devices to I can have real world occlusion and hopefully dynamic shadows as well!
Great project, well done! I’m working on a different way of positioning in game characters… went down the AR route for years and GPS but have come full circle almost and looking hard at camera tracking again. Definitely on the same idea, with real and game world. All the AR stuff looks a bit floaty, do you think it’s getting too much hype like VR did? excellent work, thanks for sharing
Do you think it may be possible to generate markers on the fly by making a script to pick out unique objects/lights, then tracking that along with the gyroscope?
Very nice! We’ve been working along the same lines – released our first app (mainly a tech demo) “MoonWalking” last month - http://www.moon-walking.com - and we’re talking to several historic sites about more elaborate apps using this approach. One thing we found was essential to create a persuasive illusion: shadows (well, fake shadows). We put static shadow textures below the lunar module and astronauts, and it’s amazing how much that helps to ground them. It’s also important to match the FOV of the Unity camera and device camera so both virtual and real world move as one when you tilt and rotate the app.
I think in general, the media is hyping it up a bit too much. I personally hate the concept of AR being solely marker-based. For me, the real potential lies in the integration of relevant local data with the virtual/game world. It would be awesome to have natural feature tracking on the fly like what we use for motion tracking in the film industry but we’ll have to wait for the iPhone 9SSS for that
We just need powerful enough mobile devices to do motion tracking by picking out natural features like the programs used for live/3d integration in films such as Boujou, Syntheyes. If it can do that in real time without blowing out the cpus then AR will be complete Oh we also need real-time occlusion of real objects so the camera needs to be a depth sensing camera like the Kinect. My gyroscope tracking is correct but since there is no real world occlusion, the depth perception is non-existent.
Nice work! The shadows really do help out a lot. I had shadows in Unity but I didn’t realise that iOS devices couldn’t handle dynamic shadows From now on I bake out my shadows and use them like a spritesheet. Another annoying thing is the FOV of the camera devices changes depending on orientation. All of these little things add up to a big problem that needs a lot of time to address
Hi, could you explain how do you match the gps coordinates with the Virtual world? Do you have a transformation from latitude and longitude to Cartesian coordinates?
I would like to know how you implement prime31’s core location with ar plugin, and which plugin did you use for ar? thanks
maybe you can sell in the assetstore your project?
Need more tweaking i guess