ExGate: Externally Controlled Gating for Feature-based Attention in Artificial Neural Networks
Perceptual capabilities of artificial systems have come a long way since the advent of deep learning. These methods have proven to be effective, however they are not as efficient as their biological counterparts. Visual attention is a set of mechanisms that are employed in biological visual systems to ease computational load by only processing pertinent parts of the stimuli. This paper addresses the implementation of top-down, feature-based attention in an artificial neural network by use of externally controlled neuron gating. Our results showed a 5% increase in classification accuracy on the CIFAR-10 dataset versus a non-gated version, while adding very few parameters. Our gated model also produces more reasonable errors in predictions by drastically reducing prediction of classes that belong to a different category to the true class.
Authors

Are you an author of this paper? Check the Twitter handle we have for you is correct.

Jarryd Son (add twitter)
Amit Mishra (add twitter)
Ask The Authors

Ask the authors of this paper a question or leave a comment.

Read it. Rate it.
#1. Which part of the paper did you read?

#2. The paper contains new data or analyses that is openly accessible?
#3. The conclusion is supported by the data and analyses?
#4. The conclusion is of scientific interest?
#5. The result is likely to lead to future research?

Github
User:
None (add)
Repo:
None (add)
Stargazers:
0
Forks:
0
Open Issues:
0
Network:
0
Subscribers:
0
Language:
None
Youtube
Link:
None (add)
Views:
0
Likes:
0
Dislikes:
0
Favorites:
0
Comments:
0
Other
Sample Sizes (N=):
Inserted:
Words Total:
Words Unique:
Source:
Abstract:
None
11/08/18 06:03PM
5,292
1,676
Tweets
Rosenchild: RT @arxiv_org: ExGate: Externally Controlled Gating for Feature-based Attention in Artificial Neural Net... https://t.co/fZHVw6W5WZ https:/…
arxiv_org: ExGate: Externally Controlled Gating for Feature-based Attention in Artificial Neural Net... https://t.co/fZHVw6W5WZ https://t.co/ybk3S04t8y
arxiv_cscv: ExGate: Externally Controlled Gating for Feature-based Attention in Artificial Neural Networks https://t.co/jviCnEa5u9
arxiv_cscv: ExGate: Externally Controlled Gating for Feature-based Attention in Artificial Neural Networks https://t.co/jviCnEa5u9
arxiv_cscv: ExGate: Externally Controlled Gating for Feature-based Attention in Artificial Neural Networks https://t.co/jviCnEa5u9
Soul: ExGate: Externally Controlled Gating for Feature-based Attention in Artificial Neural Networks. https://t.co/iNp5GIGOXt
arxiv_cscv: ExGate: Externally Controlled Gating for Feature-based Attention in Artificial Neural Networks https://t.co/jviCnEa5u9
arxiv_cscv: ExGate: Externally Controlled Gating for Feature-based Attention in Artificial Neural Networks https://t.co/jviCnEa5u9
nmfeeds: [O] https://t.co/bIU3RxW7bG ExGate: Externally Controlled Gating for Feature-based Attention in Artificial Neural Networks...
nmfeeds: [NE] https://t.co/bIU3RxW7bG ExGate: Externally Controlled Gating for Feature-based Attention in Artificial Neural Network...
nmfeeds: [CV] https://t.co/bIU3RxW7bG ExGate: Externally Controlled Gating for Feature-based Attention in Artificial Neural Network...
arxivml: "ExGate: Externally Controlled Gating for Feature-based Attention in Artificial Neural Networks", Jarryd Son, Amit … https://t.co/UGRgZiIeEJ
udoooom: RT @imenurok: ExGate: Externally Controlled Gating for Feature-based Attention in Artificial Neural Networks https://t.co/7LTamowwkb 今日のar…
fam_taro: RT @imenurok: ExGate: Externally Controlled Gating for Feature-based Attention in Artificial Neural Networks https://t.co/7LTamowwkb 今日のar…
nardtree: RT @imenurok: ExGate: Externally Controlled Gating for Feature-based Attention in Artificial Neural Networks https://t.co/7LTamowwkb 今日のar…
arxiv_cscv: ExGate: Externally Controlled Gating for Feature-based Attention in Artificial Neural Networks https://t.co/jviCnEa5u9
BrundageBot: ExGate: Externally Controlled Gating for Feature-based Attention in Artificial Neural Networks. Jarryd Son and Amit Mishra https://t.co/ly4DYrBj7U
imenurok: ExGate: Externally Controlled Gating for Feature-based Attention in Artificial Neural Networks https://t.co/7LTamowwkb 今日のarxiv、ほぼ同じアイデアだコレ…
Images
Related