- This topic has 2 replies, 2 voices, and was last updated 4 months, 3 weeks ago by
.
-
Posts
-
My question goes for everyone that has done some research about this topic. I'm almost sure vendors like RKS uses AI for this. Has anyone has some more information about the tools used?
Consider: Stable Diffusion (and other deep learning image generation models) with appropriate checkpoints and loras can produce extremely realistic images with 'perfect' lighting. Those images can then be used via Face Transfer 2 in DS to create face textures. Doubtless, Blender and others have similar (likely more advanced) 'Face Transfer-esque' capabilities.
There are checkpoints/loras capable of making 'UV unwrapped' heads (essentially a planar projection of a head) based on AI-trained images. I did some searching for checkpoints/loras capable of applying the result directly to a Genesis 8/9 template format, but I didn't have any luck. It seems like it would be an excellent method, if possible. However...
Off the top of my head, it seems like you could create an AI UV unwrapped image (maybe of a famous person?), and then in Photoshop, adjust the image 'manually' to overlay the Genesis8/9 template. It also seems reasonable that the process could be recorded as a Photoshop Action to be repeated whenever necessary. And then no doubt refine the results.
Or alternatively, use the UV unwrapped head image in Face Transfer 2 and let it do the work. And then make refinements in Photoshop.
I think it's a fascinating topic.
I agree about being fascinating and thank you so much for the detailed comment. I feel there isn't too much information because of course the gatekeeping and processes are complex and it's their way of making money after all.
I agree the method you said with the AI UV must be the one they're doing it. I have to do a big research about ai models and investigate how they work because at the moment I don't know anything. Complex thing for me I guess would be to understand how to transform some image into UV via prompt or even after trying to make it fit in software like Photoshop. Also, another thing I think can be used depending on complexity and that I know a bit about, is using Wrap software for convertion.
- You must be logged in to reply to this topic.
