Exploiting Spatial Correlation in Convolutional Neural Networks for Activation Value Prediction
Convolutional neural networks (CNNs) compute their output using weighted-sums of adjacent input elements. This method enables CNNs to achieve state-of-the-art results in a wide range of applications such as computer vision and speech recognition. However, it also comes with the cost of high computational intensity. In this paper we propose to exploit the spatial correlation inherent in CNNs, and use it for value prediction. We show that spatial correlation may be exploited to predict activation values, thus reducing the needed computations in the network. We demonstrate this method with a heuristic that predicts which activations are zero-valued according to nearby activation values, in a scheme we call cross-neuron prediction. Our prediction heuristic reduces the number of multiply-accumulate operations by an average of 40.8%, 36.2%, and 20.8%, with degradation in top-5 accuracy of 2.9%, 5.1%, and 7.6%, for AlexNet, VGG-16, and ResNet-18, respectively.
NurtureToken New!

Token crowdsale for this paper ends in

Buy Nurture Tokens

Authors

Are you an author of this paper? Check the Twitter handle we have for you is correct.

Gil Shomron (add twitter)
Uri Weiser (add twitter)
Ask The Authors

Ask the authors of this paper a question or leave a comment.

Read it. Rate it.
#1. Which part of the paper did you read?

#2. The paper contains new data or analyses that is openly accessible?
#3. The conclusion is supported by the data and analyses?
#4. The conclusion is of scientific interest?
#5. The result is likely to lead to future research?

Github
User:
None (add)
Repo:
None (add)
Stargazers:
0
Forks:
0
Open Issues:
0
Network:
0
Subscribers:
0
Language:
None
Youtube
Link:
None (add)
Views:
0
Likes:
0
Dislikes:
0
Favorites:
0
Comments:
0
Other
Sample Sizes (N=):
Inserted:
Words Total:
Words Unique:
Source:
Abstract:
None
07/29/18 05:52PM
3,863
1,405
Tweets
arxiv_cscv: Spatial Correlation and Value Prediction in Convolutional Neural Networks https://t.co/RCCjEei80P
arxiv_cscv: Spatial Correlation and Value Prediction in Convolutional Neural Networks https://t.co/RCCjEei80P
EldarSilver: RT @arxiv_cscv: Exploiting Spatial Correlation in Convolutional Neural Networks for Activation Value Prediction https://t.co/RCCjEei80P
nmfeeds: [CV] https://t.co/2y6vn5Pb3D Exploiting Spatial Correlation in Convolutional Neural Networks for Activation Value Predicti...
ComputerPapers: Exploiting Spatial Correlation in Convolutional Neural Networks for Activation Value Prediction. https://t.co/MUVEv6uYrt
Images
Related