Real-time Hair Segmentation and Recoloring on Mobile GPUs
We present a novel approach for neural network-based hair segmentation from a single camera input specifically designed for real-time, mobile application. Our relatively small neural network produces a high-quality hair segmentation mask that is well suited for AR effects, e.g. virtual hair recoloring. The proposed model achieves real-time inference speed on mobile GPUs (30-100+ FPS, depending on the device) with high accuracy. We also propose a very realistic hair recoloring scheme. Our method has been deployed in major AR application and is used by millions of users.
NurtureToken New!

Token crowdsale for this paper ends in

Buy Nurture Tokens

Authors

Are you an author of this paper? Check the Twitter handle we have for you is correct.

Andrei Tkachenka (add twitter)
Gregory Karpiak (add twitter)
Andrey Vakunov (add twitter)
Yury Kartynnik (add twitter)
Artsiom Ablavatski (edit)
Valentin Bazarevsky (add twitter)
Siargey Pisarchyk (add twitter)
Ask The Authors

Ask the authors of this paper a question or leave a comment.

Read it. Rate it.
#1. Which part of the paper did you read?

#2. The paper contains new data or analyses that is openly accessible?
#3. The conclusion is supported by the data and analyses?
#4. The conclusion is of scientific interest?
#5. The result is likely to lead to future research?

Github
User:
None (add)
Repo:
None (add)
Stargazers:
0
Forks:
0
Open Issues:
0
Network:
0
Subscribers:
0
Language:
None
Youtube
Link:
None (add)
Views:
0
Likes:
0
Dislikes:
0
Favorites:
0
Comments:
0
Other
Sample Sizes (N=):
Inserted:
Words Total:
Words Unique:
Source:
Abstract:
None
07/16/19 06:04PM
1,649
790
Tweets
FatGarfieldj: RT @arxiv_org: Real-time Hair Segmentation and Recoloring on Mobile GPUs. https://t.co/nofmBdAANf https://t.co/KXTrJflowt
McCloudStrife: RT @arxiv_org: Real-time Hair Segmentation and Recoloring on Mobile GPUs. https://t.co/nofmBdAANf https://t.co/KXTrJflowt
k_takuya_2001: RT @arxiv_org: Real-time Hair Segmentation and Recoloring on Mobile GPUs. https://t.co/nofmBdAANf https://t.co/KXTrJflowt
hey_kishore: RT @arxiv_org: Real-time Hair Segmentation and Recoloring on Mobile GPUs. https://t.co/nofmBdAANf https://t.co/KXTrJflowt
Bittersweet1314: RT @arxiv_org: Real-time Hair Segmentation and Recoloring on Mobile GPUs. https://t.co/nofmBdAANf https://t.co/KXTrJflowt
JawaeChan: RT @arxiv_org: Real-time Hair Segmentation and Recoloring on Mobile GPUs. https://t.co/nofmBdAANf https://t.co/KXTrJflowt
Neku42: RT @arxiv_org: Real-time Hair Segmentation and Recoloring on Mobile GPUs. https://t.co/nofmBdAANf https://t.co/KXTrJflowt
rezamahmooudi: Real-Time Hair Segmentation and Recoloring on Mobile GPUs Real-time inference speed on mobile GPUs with high accuracy Full size (512×512) in 5.7 ms on iPhone XS with 81.0% IOU accuracy Small size (256×256) in 6 ms on Pixel 3 with 80.2% IOU accuracy https://t.co/kmFtkiV6jF #AI https://t.co/wVZWPag5fT
mvaldenegro: RT @arxiv_org: Real-time Hair Segmentation and Recoloring on Mobile GPUs. https://t.co/nofmBdAANf https://t.co/KXTrJflowt
syoyo: RT @arxiv_org: Real-time Hair Segmentation and Recoloring on Mobile GPUs. https://t.co/nofmBdAANf https://t.co/KXTrJflowt
arxiv_org: Real-time Hair Segmentation and Recoloring on Mobile GPUs. https://t.co/nofmBdAANf https://t.co/KXTrJflowt
arxiv_cscv: Real-time Hair Segmentation and Recoloring on Mobile GPUs https://t.co/QF9WJwvpuM
BrundageBot: Real-time Hair Segmentation and Recoloring on Mobile GPUs. Andrei Tkachenka, Gregory Karpiak, Andrey Vakunov, Yury Kartynnik, Artsiom Ablavatski, Valentin Bazarevsky, and Siargey Pisarchyk https://t.co/H9SQ0rEyN0
Images
Related