One-shot Face Reenactment
To enable realistic shape (e.g. pose and expression) transfer, existing face reenactment methods rely on a set of target faces for learning subject-specific traits. However, in real-world scenario end-users often only have one target face at hand, rendering existing methods inapplicable. In this work, we bridge this gap by proposing a novel one-shot face reenactment learning framework. Our key insight is that the one-shot learner should be able to disentangle and compose appearance and shape information for effective modeling. Specifically, the target face appearance and the source face shape are first projected into latent spaces with their corresponding encoders. Then these two latent spaces are associated by learning a shared decoder that aggregates multi-level features to produce the final reenactment results. To further improve the synthesizing quality on mustache and hair regions, we additionally propose FusionNet which combines the strengths of our learned decoder and the traditional warping method. Extensive experiments show that our one-shot face reenactment system achieves superior transfer fidelity as well as identity preserving capability than alternatives. More remarkably, our approach trained with only one target image per subject achieves competitive results to those using a set of target images, demonstrating the practical merit of this work. Code, models and an additional set of reenacted faces have been publicly released at the project page.
NurtureToken New!

Token crowdsale for this paper ends in

Buy Nurture Tokens

Authors

Are you an author of this paper? Check the Twitter handle we have for you is correct.

Yunxuan Zhang (add twitter)
Siwei Zhang (add twitter)
Yue He (add twitter)
Cheng Li (add twitter)
Chen Change Loy (edit)
Ziwei Liu (edit)
Ask The Authors

Ask the authors of this paper a question or leave a comment.

Read it. Rate it.
#1. Which part of the paper did you read?

#2. The paper contains new data or analyses that is openly accessible?
#3. The conclusion is supported by the data and analyses?
#4. The conclusion is of scientific interest?
#5. The result is likely to lead to future research?

Github
Stargazers:
31
Forks:
7
Open Issues:
3
Network:
7
Subscribers:
6
Language:
Python
Official test script for 2019 BMVC paper 'One-shot Face Reenactment' in PyTorch.
Youtube
Link:
None (add)
Views:
0
Likes:
0
Dislikes:
0
Favorites:
0
Comments:
0
Other
Sample Sizes (N=):
Inserted:
Words Total:
Words Unique:
Source:
Abstract:
None
08/11/19 06:05PM
5,541
1,904
Tweets
subhobrata1: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
dragonmeteor: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
_Synt4x3rr0r: "One-shot Face Reenactment" Zhang et al.: https://t.co/le2dEHXfdb Project: https://t.co/W8rClel9l4 GitHub: https://t.co/JNv38Eou83 #ArtificialIntelligence #DeepLearning #MachineLearning
rezamahmooudi: "One-shot Face Reenactment" Zhang et al.: https://t.co/kcFfQv8TYn Project: https://t.co/R8Wjouyt1V GitHub: https://t.co/0sPKwZEnAr #ArtificialIntelligence #DeepLearning #MachineLearning #ai #DataScience https://t.co/kziDEmGgIE
iantimmis: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
UkiwhY: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
TopicSociety: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
0xhexhex: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
vinaykumarpns: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
cschan9: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
bhargavbardipur: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
whyboris: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
patricklee90: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
arxiv_cscv: One-shot Face Reenactment https://t.co/vTXV3GQslY
abcde_abcdef: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
ccloy: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
subhobrata1: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
gettoankit: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
PerthMLGroup: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
AssistedEvolve: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
fixedcaye: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
arxivml: "One-shot Face Reenactment", Yunxuan Zhang, Siwei Zhang, Yue He, Cheng Li, Chen Change Loy, Ziwei Liu https://t.co/YEcipkU4CA
krunal_wrote: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
sohom_vision: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
Swetava: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
Pol09122455: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
A_K_Nain: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
yshhrknmr: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
jp_axs4ll: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
johntigue: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
NonLocalityGuy: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
HouhouinK: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
iamx9000: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
cHer_jbl: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
liuziwei7: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
CarlRioux: [R] One-shot Face Reenactment: paper: https://t.co/P7zxhVZbK5 code: https://t.co/0PbY8okVF8 demo: https://t.co/wOF3SVDEHN submitted by /u/PuzzledProgrammer3 [visit reddit] [comments] https://t.co/g49CAMN6lH
Jotarun: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
DYGV: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
deeppomf: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
caymanlee: RT @roadrunning01: One-shot Face Reenactment pdf: https://t.co/gz5p4ForDo abs: https://t.co/MYS7UsBrpH project page: https://t.co/z7sqJQxln…
Images
Related