Augmented Reality : Recognize hand written number by the user?

Questions & Answers
1

Hello everyone,

Its been a few days I am trying to find a solution to my topic.

Basically I want the app to recognize a written number by the user.

The app will tell the user to write down for example number 24 on a paper and move the camera over the written number to see the 3d object.

This might be used for saving a Birthday, a wedding date … etc

For accuracy, the app instructions will show the user a preview to tell please write the number 24 similar to this…

Although each hand writing will differ, but at least we do not get curly “2”-s or “4” with an open edge …etc

So here we need AR to recognize the number, or be able to read the number according to approximation.

And the first question is: Is such a behavior doable or anyone familiar with a similar concept?

After searching similar apps, I found “Ink Hunter” apps for tatoo preview-s, although these apps use
symbols not number, but we can think of a number as a symbol as well.

Also as this video: Augmented Reality Tattoo App Helps You Think Before You Ink - Newsy - YouTube shows, each user draws the symbol in a different way and still they get it working.

using Vuforia, they offer the free samples on the website, and there is one named
“Text Recognition” , and here’s the tutorial link: Augmented Reality Tutorial No. 18: Unity3D and Vuforia for Text Recognition and Tracking - YouTube

But unfortunately couldn’t make it work.

If someone has developed such a functionality using these sample projects from vuforia or have any ulternative method please I need you help :slight_smile:

thanks in advance
moghes

2

This is something that requires some very sophisticated technology and you’re going to need to find a product to help you with it. Google has their project to digitize all the things, so on the assumption that they maybe surfaced an API to the public I, uh, Googled it…

It does optical character recognition, but I don’t know if it handles handwriting. But it should at least point you in the right direction for further research.

3

This is a great research question. I can see it requiring some type of very sophisticated machine learning algorithm. The mathematics behind would be quite beautiful in my opinion. As the others have suggested, it’ll be best to find some already made technology by Google or Microsoft or some other well respected company and try incorporating into your game. That itself is might be a long task.

So a better question would be does your game/idea require this system? Is there a work around?

4

Would something like Procrustes analysis work ?

5

Were you able to complete this project as i am doing the similar project right now so kindly help me with this