Unsupervised feature extraction algorithms form one of the most important
building blocks in machine learning systems. These algorithms are often adapted
to the event-based domain to perform online learning in neuromorphic hardware.
However, not designed for the purpose, such algorithms typically require
significant simplification during implementation to meet hardware constraints,
creating trade offs with performance. Furthermore, conventional feature
extraction algorithms are not designed to generate useful intermediary signals
which are valuable only in the context of neuromorphic hardware limitations. In
this work a novel event-based feature extraction method is proposed that
focuses on these issues. The algorithm operates via simple adaptive selection
thresholds which allow a simpler implementation of network homeostasis than
previous works by trading off a small amount of information loss in the form of
missed events that fall outside the selection thresholds. The behavior of the
selection thresholds and the output of the...

more |
pdf
| html
arxivml:
"Event-based Feature Extraction Using Adaptive Selection Thresholds",
Saeed Afshar, Ying Xu, Jonathan Tapson, André…
https://t.co/VfxnjbRLCq

arxiv_cscv:
Event-based Feature Extraction Using Adaptive Selection Thresholds https://t.co/OryUt3MS0l

arxiv_cscv:
Event-based Feature Extraction Using Adaptive Selection Thresholds https://t.co/OryUt3MS0l

arxiv_cscv:
Event-based Feature Extraction Using Adaptive Selection Thresholds https://t.co/OryUt3MS0l

udmrzn:
RT @arxiv_cscv: Event-based Feature Extraction Using Adaptive Selection Thresholds https://t.co/OryUt44sRT

None.

None.

Sample Sizes : None.

Authors: 5

Total Words: 13220

Unqiue Words: 3244

The state-of-the-art approaches employ approximate computing to improve the
energy consumption of DNN hardware. Approximate DNNs then require "extensive
retraining" afterwards to recover from the accuracy loss caused by the use of
approximate operations. However, retraining of complex DNNs does not scale
well. In this paper, we demonstrate that efficient approximations can be
introduced into the computational path of DNN accelerators "while retraining
can completely be avoided". ALWANN provides highly optimized implementations of
DNNs for custom low-power accelerators in which the number of computing units
is lower than the number of DNN layers. First, a fully trained DNN (e.g. in
TensorFlow) is converted to operate with 8-bit weights and 8-bit multipliers in
convolutional layers. A suitable approximate multiplier is then selected for
each computing element from a library of approximate multipliers in such a way
that (i) one approximate multiplier serves several layers, and (ii) the overall
classification error and energy...

more |
pdf
| html
None.

arxiv_org:
ALWANN: Automatic Layer-Wise Approximation of Deep Neural Network Accelerators without Re... https://t.co/AasOBiI6Wp https://t.co/75j2RBPKgN

arxivml:
"ALWANN: Automatic Layer-Wise Approximation of Deep Neural Network Accelerators without Retraining",
Vojtech Mrazek…
https://t.co/ib9Dd7MN4j

Memoirs:
ALWANN: Automatic Layer-Wise Approximation of Deep Neural Network Accelerators without Retraining. https://t.co/YsKeAcVMEy

Eschersand:
RT @arxiv_org: ALWANN: Automatic Layer-Wise Approximation of Deep Neural Network Accelerators without Re... https://t.co/AasOBiI6Wp https:/…

DSPonFPGA:
RT @arxiv_org: ALWANN: Automatic Layer-Wise Approximation of Deep Neural Network Accelerators without Re... https://t.co/AasOBiI6Wp https:/…

straybrid:
RT @arxiv_org: ALWANN: Automatic Layer-Wise Approximation of Deep Neural Network Accelerators without Re... https://t.co/AasOBiI6Wp https:/…

None.

None.

Sample Sizes : None.

Authors: 5

Total Words: 0

Unqiue Words: 0

This work shows that a differentiable activation function is not necessary
any more for error backpropagation. The derivative of the activation function
can be replaced by an iterative temporal differencing using fixed random
feedback alignment. Using fixed random synaptic feedback alignment with an
iterative temporal differencing is transforming the traditional error
backpropagation into a more biologically plausible approach for learning deep
neural network architectures. This can be a big step toward the integration of
STDP-based error backpropagation in deep learning.

more |
pdf
| html
None.

arxivml:
"Iterative temporal differencing with random synaptic feedback weights support error backpropagation for deep learn…
https://t.co/36iigTn0dh

Memoirs:
Iterative temporal differencing with random synaptic feedback weights support error backpropagation for deep learning. https://t.co/qDXZ5cdm03

None.

None.

Sample Sizes : None.

Authors: 1

Total Words: 0

Unqiue Words: 0

In many situations, simulation models are developed to handle complex
real-world business optimisation problems. For example, a discrete-event
simulation model is used to simulate the trailer management process in a big
Fast-Moving Consumer Goods company. To address the problem of finding suitable
inputs to this simulator for optimising fleet configuration, we propose a
simulation optimisation approach in this paper. The simulation optimisation
model combines a metaheuristic search (genetic algorithm), with an
approximation model filter (feed-forward neural network) to optimise the
parameter configuration of the simulation model. We introduce an ensure
probability that overrules the rejection of potential solutions by the
approximation model and we demonstrate its effectiveness. In addition, we
evaluate the impact of the parameters of the optimisation model on its
effectiveness and show the parameters such as population size, filter
threshold, and mutation probability can have a significant impact on the
overall optimisation...

more |
pdf
| html
None.

arxivml:
"Machine Learning based Simulation Optimisation for Trailer Management",
Dylan Rijnen, Jason Rhuggenaath, Paulo R． …
https://t.co/VytwPXr3O2

arxiv_cs_LG:
Machine Learning based Simulation Optimisation for Trailer Management. Dylan Rijnen, Jason Rhuggenaath, Paulo R. de O. da Costa, and Yingqian Zhang https://t.co/duE0JDKcQs

Memoirs:
Machine Learning based Simulation Optimisation for Trailer Management. https://t.co/apuWbOX8C5

None.

None.

Sample Sizes : None.

Authors: 4

Total Words: 5528

Unqiue Words: 1628

Random weight change (RWC) algorithm is extremely component and robust for
the hardware implementation of neural networks. RWC and Genetic algorithm (GA)
are well known methodologies used for optimizing and learning the neural
network (NN). Individually, each of these two algorithms has its strength and
weakness along with separate objectives. However, recently, researchers combine
these two algorithms for better learning and optimization of NN. In this paper,
we proposed a methodology by combining the RWC and GA, namely Genetic Random
Weight Change (GRWC), as well as demonstrate a seminal way to reduce the
complexity of the neural network by removing weak weights of GRWC. In contrast
to RWC and GA, GRWC contains an effective optimization procedure which is
worthy at exploring a large and complex space in intellectual strategies
influenced by the GA/RWC synergy. The learning behavior of the proposed
algorithm was tested on MNIST dataset and it was able to prove its performance.

more |
pdf
| html
None.

arxivml:
"Optimizing method for Neural Network based on Genetic Random Weight Change Learning Algorithm",
Mohammad Ibrahim S…
https://t.co/BxaLrt08Re

None.

None.

Sample Sizes : None.

Authors: 3

Total Words: 1407

Unqiue Words: 615

Assert is a website where the best academic papers on arXiv (computer science, math, physics), bioRxiv (biology), BITSS (reproducibility), EarthArXiv (earth science), engrXiv (engineering), LawArXiv (law), PsyArXiv (psychology), SocArXiv (social science), and SportRxiv (sport research) bubble to the top each day.

Papers are scored (in real-time) based on how verifiable they are (as determined by their Github repos) and how interesting they are (based on Twitter).

To see top papers, follow us on twitter @assertpub_ (arXiv), @assert_pub (bioRxiv), and @assertpub_dev (everything else).

To see beautiful figures extracted from papers, follow us on Instagram.

*Tracking 160,434 papers.*

Sort results based on if they are interesting or reproducible.

Interesting

Reproducible