Top 5 Arxiv Papers Today in Neural And Evolutionary Computing


2.024 Mikeys
#1. Event-based Feature Extraction Using Adaptive Selection Thresholds
Saeed Afshar, Ying Xu, Jonathan Tapson, André van Schaik, Gregory Cohen
Unsupervised feature extraction algorithms form one of the most important building blocks in machine learning systems. These algorithms are often adapted to the event-based domain to perform online learning in neuromorphic hardware. However, not designed for the purpose, such algorithms typically require significant simplification during implementation to meet hardware constraints, creating trade offs with performance. Furthermore, conventional feature extraction algorithms are not designed to generate useful intermediary signals which are valuable only in the context of neuromorphic hardware limitations. In this work a novel event-based feature extraction method is proposed that focuses on these issues. The algorithm operates via simple adaptive selection thresholds which allow a simpler implementation of network homeostasis than previous works by trading off a small amount of information loss in the form of missed events that fall outside the selection thresholds. The behavior of the selection thresholds and the output of the...
more | pdf | html
Figures
Tweets
arxivml: "Event-based Feature Extraction Using Adaptive Selection Thresholds", Saeed Afshar, Ying Xu, Jonathan Tapson, André… https://t.co/VfxnjbRLCq
arxiv_cscv: Event-based Feature Extraction Using Adaptive Selection Thresholds https://t.co/OryUt3MS0l
arxiv_cscv: Event-based Feature Extraction Using Adaptive Selection Thresholds https://t.co/OryUt3MS0l
arxiv_cscv: Event-based Feature Extraction Using Adaptive Selection Thresholds https://t.co/OryUt3MS0l
udmrzn: RT @arxiv_cscv: Event-based Feature Extraction Using Adaptive Selection Thresholds https://t.co/OryUt44sRT
Github
None.
Youtube
None.
Other stats
Sample Sizes : None.
Authors: 5
Total Words: 13220
Unqiue Words: 3244

2.008 Mikeys
#2. ALWANN: Automatic Layer-Wise Approximation of Deep Neural Network Accelerators without Retraining
Vojtech Mrazek, Zdenek Vasicek, Lukas Sekanina, Muhammad Abdullah Hanif, Muhammad Shafique
The state-of-the-art approaches employ approximate computing to improve the energy consumption of DNN hardware. Approximate DNNs then require "extensive retraining" afterwards to recover from the accuracy loss caused by the use of approximate operations. However, retraining of complex DNNs does not scale well. In this paper, we demonstrate that efficient approximations can be introduced into the computational path of DNN accelerators "while retraining can completely be avoided". ALWANN provides highly optimized implementations of DNNs for custom low-power accelerators in which the number of computing units is lower than the number of DNN layers. First, a fully trained DNN (e.g. in TensorFlow) is converted to operate with 8-bit weights and 8-bit multipliers in convolutional layers. A suitable approximate multiplier is then selected for each computing element from a library of approximate multipliers in such a way that (i) one approximate multiplier serves several layers, and (ii) the overall classification error and energy...
more | pdf | html
Figures
None.
Tweets
arxiv_org: ALWANN: Automatic Layer-Wise Approximation of Deep Neural Network Accelerators without Re... https://t.co/AasOBiI6Wp https://t.co/75j2RBPKgN
arxivml: "ALWANN: Automatic Layer-Wise Approximation of Deep Neural Network Accelerators without Retraining", Vojtech Mrazek… https://t.co/ib9Dd7MN4j
Memoirs: ALWANN: Automatic Layer-Wise Approximation of Deep Neural Network Accelerators without Retraining. https://t.co/YsKeAcVMEy
Eschersand: RT @arxiv_org: ALWANN: Automatic Layer-Wise Approximation of Deep Neural Network Accelerators without Re... https://t.co/AasOBiI6Wp https:/…
DSPonFPGA: RT @arxiv_org: ALWANN: Automatic Layer-Wise Approximation of Deep Neural Network Accelerators without Re... https://t.co/AasOBiI6Wp https:/…
straybrid: RT @arxiv_org: ALWANN: Automatic Layer-Wise Approximation of Deep Neural Network Accelerators without Re... https://t.co/AasOBiI6Wp https:/…
Github
None.
Youtube
None.
Other stats
Sample Sizes : None.
Authors: 5
Total Words: 0
Unqiue Words: 0

2.0 Mikeys
#3. Iterative temporal differencing with random synaptic feedback weights support error backpropagation for deep learning
Aras R. Dargazany
This work shows that a differentiable activation function is not necessary any more for error backpropagation. The derivative of the activation function can be replaced by an iterative temporal differencing using fixed random feedback alignment. Using fixed random synaptic feedback alignment with an iterative temporal differencing is transforming the traditional error backpropagation into a more biologically plausible approach for learning deep neural network architectures. This can be a big step toward the integration of STDP-based error backpropagation in deep learning.
more | pdf | html
Figures
None.
Tweets
arxivml: "Iterative temporal differencing with random synaptic feedback weights support error backpropagation for deep learn… https://t.co/36iigTn0dh
Memoirs: Iterative temporal differencing with random synaptic feedback weights support error backpropagation for deep learning. https://t.co/qDXZ5cdm03
Github
None.
Youtube
None.
Other stats
Sample Sizes : None.
Authors: 1
Total Words: 0
Unqiue Words: 0

2.0 Mikeys
#4. Machine Learning based Simulation Optimisation for Trailer Management
Dylan Rijnen, Jason Rhuggenaath, Paulo R. de O. da Costa, Yingqian Zhang
In many situations, simulation models are developed to handle complex real-world business optimisation problems. For example, a discrete-event simulation model is used to simulate the trailer management process in a big Fast-Moving Consumer Goods company. To address the problem of finding suitable inputs to this simulator for optimising fleet configuration, we propose a simulation optimisation approach in this paper. The simulation optimisation model combines a metaheuristic search (genetic algorithm), with an approximation model filter (feed-forward neural network) to optimise the parameter configuration of the simulation model. We introduce an ensure probability that overrules the rejection of potential solutions by the approximation model and we demonstrate its effectiveness. In addition, we evaluate the impact of the parameters of the optimisation model on its effectiveness and show the parameters such as population size, filter threshold, and mutation probability can have a significant impact on the overall optimisation...
more | pdf | html
Figures
None.
Tweets
arxivml: "Machine Learning based Simulation Optimisation for Trailer Management", Dylan Rijnen, Jason Rhuggenaath, Paulo R. … https://t.co/VytwPXr3O2
arxiv_cs_LG: Machine Learning based Simulation Optimisation for Trailer Management. Dylan Rijnen, Jason Rhuggenaath, Paulo R. de O. da Costa, and Yingqian Zhang https://t.co/duE0JDKcQs
Memoirs: Machine Learning based Simulation Optimisation for Trailer Management. https://t.co/apuWbOX8C5
Github
None.
Youtube
None.
Other stats
Sample Sizes : None.
Authors: 4
Total Words: 5528
Unqiue Words: 1628

1.997 Mikeys
#5. Optimizing method for Neural Network based on Genetic Random Weight Change Learning Algorithm
Mohammad Ibrahim Sarker, Zubaer Ibna Mannan, Hyongsuk Kim
Random weight change (RWC) algorithm is extremely component and robust for the hardware implementation of neural networks. RWC and Genetic algorithm (GA) are well known methodologies used for optimizing and learning the neural network (NN). Individually, each of these two algorithms has its strength and weakness along with separate objectives. However, recently, researchers combine these two algorithms for better learning and optimization of NN. In this paper, we proposed a methodology by combining the RWC and GA, namely Genetic Random Weight Change (GRWC), as well as demonstrate a seminal way to reduce the complexity of the neural network by removing weak weights of GRWC. In contrast to RWC and GA, GRWC contains an effective optimization procedure which is worthy at exploring a large and complex space in intellectual strategies influenced by the GA/RWC synergy. The learning behavior of the proposed algorithm was tested on MNIST dataset and it was able to prove its performance.
more | pdf | html
Figures
None.
Tweets
arxivml: "Optimizing method for Neural Network based on Genetic Random Weight Change Learning Algorithm", Mohammad Ibrahim S… https://t.co/BxaLrt08Re
Github
None.
Youtube
None.
Other stats
Sample Sizes : None.
Authors: 3
Total Words: 1407
Unqiue Words: 615

About

Assert is a website where the best academic papers on arXiv (computer science, math, physics), bioRxiv (biology), BITSS (reproducibility), EarthArXiv (earth science), engrXiv (engineering), LawArXiv (law), PsyArXiv (psychology), SocArXiv (social science), and SportRxiv (sport research) bubble to the top each day.

Papers are scored (in real-time) based on how verifiable they are (as determined by their Github repos) and how interesting they are (based on Twitter).

To see top papers, follow us on twitter @assertpub_ (arXiv), @assert_pub (bioRxiv), and @assertpub_dev (everything else).

To see beautiful figures extracted from papers, follow us on Instagram.

Tracking 160,434 papers.

Search
Sort results based on if they are interesting or reproducible.
Interesting
Reproducible
Categories
All
Astrophysics
Cosmology and Nongalactic Astrophysics
Earth and Planetary Astrophysics
Astrophysics of Galaxies
High Energy Astrophysical Phenomena
Instrumentation and Methods for Astrophysics
Solar and Stellar Astrophysics
Condensed Matter
Disordered Systems and Neural Networks
Mesoscale and Nanoscale Physics
Materials Science
Other Condensed Matter
Quantum Gases
Soft Condensed Matter
Statistical Mechanics
Strongly Correlated Electrons
Superconductivity
Computer Science
Artificial Intelligence
Hardware Architecture
Computational Complexity
Computational Engineering, Finance, and Science
Computational Geometry
Computation and Language
Cryptography and Security
Computer Vision and Pattern Recognition
Computers and Society
Databases
Distributed, Parallel, and Cluster Computing
Digital Libraries
Discrete Mathematics
Data Structures and Algorithms
Emerging Technologies
Formal Languages and Automata Theory
General Literature
Graphics
Computer Science and Game Theory
Human-Computer Interaction
Information Retrieval
Information Theory
Machine Learning
Logic in Computer Science
Multiagent Systems
Multimedia
Mathematical Software
Numerical Analysis
Neural and Evolutionary Computing
Networking and Internet Architecture
Other Computer Science
Operating Systems
Performance
Programming Languages
Robotics
Symbolic Computation
Sound
Software Engineering
Social and Information Networks
Systems and Control
Economics
Econometrics
General Economics
Theoretical Economics
Electrical Engineering and Systems Science
Audio and Speech Processing
Image and Video Processing
Signal Processing
General Relativity and Quantum Cosmology
General Relativity and Quantum Cosmology
High Energy Physics - Experiment
High Energy Physics - Experiment
High Energy Physics - Lattice
High Energy Physics - Lattice
High Energy Physics - Phenomenology
High Energy Physics - Phenomenology
High Energy Physics - Theory
High Energy Physics - Theory
Mathematics
Commutative Algebra
Algebraic Geometry
Analysis of PDEs
Algebraic Topology
Classical Analysis and ODEs
Combinatorics
Category Theory
Complex Variables
Differential Geometry
Dynamical Systems
Functional Analysis
General Mathematics
General Topology
Group Theory
Geometric Topology
History and Overview
Information Theory
K-Theory and Homology
Logic
Metric Geometry
Mathematical Physics
Numerical Analysis
Number Theory
Operator Algebras
Optimization and Control
Probability
Quantum Algebra
Rings and Algebras
Representation Theory
Symplectic Geometry
Spectral Theory
Statistics Theory
Mathematical Physics
Mathematical Physics
Nonlinear Sciences
Adaptation and Self-Organizing Systems
Chaotic Dynamics
Cellular Automata and Lattice Gases
Pattern Formation and Solitons
Exactly Solvable and Integrable Systems
Nuclear Experiment
Nuclear Experiment
Nuclear Theory
Nuclear Theory
Physics
Accelerator Physics
Atmospheric and Oceanic Physics
Applied Physics
Atomic and Molecular Clusters
Atomic Physics
Biological Physics
Chemical Physics
Classical Physics
Computational Physics
Data Analysis, Statistics and Probability
Physics Education
Fluid Dynamics
General Physics
Geophysics
History and Philosophy of Physics
Instrumentation and Detectors
Medical Physics
Optics
Plasma Physics
Popular Physics
Physics and Society
Space Physics
Quantitative Biology
Biomolecules
Cell Behavior
Genomics
Molecular Networks
Neurons and Cognition
Other Quantitative Biology
Populations and Evolution
Quantitative Methods
Subcellular Processes
Tissues and Organs
Quantitative Finance
Computational Finance
Economics
General Finance
Mathematical Finance
Portfolio Management
Pricing of Securities
Risk Management
Statistical Finance
Trading and Market Microstructure
Quantum Physics
Quantum Physics
Statistics
Applications
Computation
Methodology
Machine Learning
Other Statistics
Statistics Theory
Feedback
Online
Stats
Tracking 160,434 papers.