Researchers from The University of Hong Kong developed a deep learning-based sketching system that lets users easily create a 3D face in minutes.
The low-cost interactive face modeling system allows the user to draw freehand imprecise 2D lines and then with the help of deep learning, they’re able to further manipulate the expressions of the 3D model.
According to the researcher’s paper, the key issue in gesture-based 3D face refinement is achieving high accuracy in gesture classification. Using a TITAN X GPU, CUDA and the cuDNN accelerated Caffe deep learning framework, they trained their convolutional neural network on thousands of 3D face models with varying shapes and expressions that were rendered into sketches.
For future work, the researchers plan to take advantage of Generative Adversarial Networks (GANs) to help with the pixel-to-pixel prediction which will be used to create geometric details such as wrinkles.
Read more >
Create a 3D Caricature in Minutes with Deep Learning
May 15, 2017
Discuss (0)
Related resources
- GTC session: One-Click Creation of Hyper-Realistic 3D Characters from AI-Powered Conversations and Designs
- GTC session: Efficient Geometry-Aware 3D Generative Adversarial Networks
- GTC session: AI for Learning Photorealistic 3D Digital Humans from In-the-Wild Data
- SDK: NGC Models
- Webinar: Isaac Developer Meetup #2 - Build AI-Powered Robots with NVIDIA Isaac Replicator and NVIDIA TAO
- Webinar: Accelerated Creative AI – Using NVIDIA-optimized image generation for Media and Entertainment