Create a 3d model face texture using a photo

News & General Discussion
1

I am planning to create an app where user import their portrait photo either from camera or select from gallery.
There will be a 3d model with custom uv for face mesh to apply the selected images as a face texture.But the problem with this approach is that the merging of face color and neck color is difficult and a solid line can be seen in the edge of the face mesh.
What is the best way to apply photo texture to a 3d face model? Or is there any different approach to achieve this?
Thank you.

2

Hey Bigg_P,

Did you ever find a viable solution for this? I am in the same situation and Google search takes me nowhere.

Regards,
Carlos

3

In this scenario you project multiple textures from different angles onto final model, and then blend them together based on multiple parameters (like angle of affected surface). The face could be detected with algorithms from OpenCV.

The process is quite fiddly.

4

Hello neginfinity,

Thank you for your input! I appreciate it. Do you have any links to resources that I can learn from? Studies, forums, or any other?

Regards,
Carlos

5

You can locate opencv face detection by googling “opencv detect face”. I believe they had at least a basic Haar Cascade techinque that can locate a square around face area. In unity interfacing with OpenCV might be unpleasant, but could be done using OpenCV sharp. OpenCV is quite large, so you might need to seek isolated implementation of the algorithm if you’re planning to use this on android.

Regarding slappingg face onto the model, the process is pretty similar to projecting a textured spotlight. Except that you’ll need to bake that into a texture. This shouldn’t be difficult, as you can render a model into UV space fairly easily.

https://www.youtube.com/watch?v=hpWNeEmj38A

6

Thank you so much! Very helpful info.

Regards,
Carlos

7

Hello neginfinity,

Hey, I am currently working for a company that wants to create an avatar capable of using the user’s uploaded picture as texture for their avatar’s face. We are looking for a great Unity programmer among other skills that would be able to help with this task among others.

By any change are you interesting in a paid position doing this kind of work? if so, do you think you have the skills to do so? Let me know.

Regards,
Carlos

8

Thanks for the offer.

However, I’m already doing contract work for someone and due to RL circumstances cannot accept additional contract work on top of that.