Towards Generalizable Forgery Detection with Locality-aware AutoEncoder
With advancements of deep learning techniques, it is now possible to generate super-realistic fake images and videos. These manipulated forgeries could reach mass audience and result in adverse impacts on our society. Although lots of efforts have been devoted to detect forgeries, their performance drops significantly on previously unseen but related manipulations and the detection generalization capability remains a problem. To bridge this gap, in this paper we propose Locality-aware AutoEncoder (LAE), which combines fine-grained representation learning and enforcing locality in a unified framework. In the training process, we use pixel-wise mask to regularize local interpretation of LAE to enforce the model to learn intrinsic representation from the forgery region, instead of capturing artifacts in the training set and learning spurious correlations to perform detection. We further propose an active learning framework to select the challenging candidates for labeling, to reduce the annotation efforts to regularize interpretations. Experimental results indicate that LAE indeed could focus on the forgery regions to make decisions. The results further show that LAE achieves superior generalization performance compared to state-of-the-arts on forgeries generated by alternative manipulation methods.
NurtureToken New!

Token crowdsale for this paper ends in

Buy Nurture Tokens

Authors

Are you an author of this paper? Check the Twitter handle we have for you is correct.

Mengnan Du (add twitter)
Shiva Pentyala (edit)
Yuening Li (edit)
Xia Hu (edit)
Ask The Authors

Ask the authors of this paper a question or leave a comment.

Read it. Rate it.
#1. Which part of the paper did you read?

#2. The paper contains new data or analyses that is openly accessible?
#3. The conclusion is supported by the data and analyses?
#4. The conclusion is of scientific interest?
#5. The result is likely to lead to future research?

Github
User:
None (add)
Repo:
None (add)
Stargazers:
0
Forks:
0
Open Issues:
0
Network:
0
Subscribers:
0
Language:
None
Youtube
Link:
None (add)
Views:
0
Likes:
0
Dislikes:
0
Favorites:
0
Comments:
0
Other
Sample Sizes (N=):
Inserted:
Words Total:
Words Unique:
Source:
Abstract:
None
09/15/19 06:05PM
7,090
2,151
Tweets
arxiv_cscv: Towards Generalizable Forgery Detection with Locality-aware AutoEncoder https://t.co/r31XwWcLdt
arxivml: "Towards Generalizable Forgery Detection with Locality-aware AutoEncoder", Mengnan Du, Shiva Pentyala, Yuening Li, … https://t.co/iYx9o1Nc8S
arxiv_cscv: Towards Generalizable Forgery Detection with Locality-aware AutoEncoder https://t.co/r31XwVValV
arxiv_cscv: Towards Generalizable Forgery Detection with Locality-aware AutoEncoder https://t.co/r31XwVValV
BrundageBot: Towards Generalizable Forgery Detection with Locality-aware AutoEncoder. Mengnan Du, Shiva Pentyala, Yuening Li, and Xia Hu https://t.co/rJDIKfsgGp
Images
Related