Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bad results when face has bangs #32

Open
doublexxking opened this issue Jun 28, 2023 · 7 comments
Open

Bad results when face has bangs #32

doublexxking opened this issue Jun 28, 2023 · 7 comments

Comments

@doublexxking
Copy link

doublexxking commented Jun 28, 2023

As title mentioned, if the face has bangs, especially girls, the high mesh will get very bad results on forehead. However, I know you got very high mark on forehead part in REALY. Why I got this situation and Do you have some suggestions to solve this problem?

The following pictures show some examples.

Screenshot from 2023-06-28 11-58-32

Screenshot from 2023-06-28 10-49-04

@yosun
Copy link

yosun commented Jun 28, 2023

Do some basic image processing to remove hair

@doublexxking
Copy link
Author

Although I use bareheaded, the forehead is weird sometimes, as shown following
Screenshot from 2023-06-28 14-43-33
Screenshot from 2023-06-28 14-44-18

@yosun
Copy link

yosun commented Jun 28, 2023

use some quick image processing techniques to remove the weird shine and uneven lighting in forehead

@doublexxking
Copy link
Author

Thanks for your reply and I will try your method.
By the way, is there some parameters could be set to control the weight of changes? For example, I do not want to forehead to change so much towards the mean face.

@doublexxking
Copy link
Author

Moreover, I find the reason is not the weird shine or uneven lighting...
The reason is the girl face is quite smaller than the mask. And the algorithm think the boundary of head is wrinkle as following shown.
Screenshot from 2023-07-01 16-25-26

@yosun
Copy link

yosun commented Jul 1, 2023

it seems you got the forehead to be smooth. you can just use dlib 16 face border points to adjust the mesh for smaller faces

@kizum
Copy link

kizum commented Sep 21, 2023

I suppose the high mesh is not the results that author used to evaluate on the Realy or other benchmark. The displacement map should only effects the texture part by change the normal of the face. The geometry of the final results should only be Deep3DFace result + deformation map.

The high mesh is just an addition toy output of the HRN, as mentioned in #6 .
If I was wrong, pls let me know. :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants