### Top 10 Arxiv Papers Today in Neural And Evolutionary Computing

##### #1. Controllability, Multiplexing, and Transfer Learning in Networks using Evolutionary Learning
###### Rise Ooi, C. -H. Huck Yang, Pin-Yu Chen, Vìctor Eguìluz, Narsis Kiani, Hector Zenil, David Gomez-Cabrero, Jesper Tegnèr
Networks are fundamental building blocks for representing data, and computations. Remarkable progress in learning in structurally defined (shallow or deep) networks has recently been achieved. Here we introduce evolutionary exploratory search and learning method of topologically flexible networks under the constraint of producing elementary computational steady-state input-output operations. Our results include; (1) the identification of networks, over four orders of magnitude, implementing computation of steady-state input-output functions, such as a band-pass filter, a threshold function, and an inverse band-pass function. Next, (2) the learned networks are technically controllable as only a small number of driver nodes are required to move the system to a new state. Furthermore, we find that the fraction of required driver nodes is constant during evolutionary learning, suggesting a stable system design. (3), our framework allows multiplexing of different computations using the same network. For example, using a binary...
more | pdf | html
###### Tweets
arxiv_org: Controllability, Multiplexing, and Transfer Learning in Networks using Evolutionary Learn... https://t.co/QZ9YghgtAO https://t.co/XKLtRcMH5D
net_science: "Controllability, Multiplexing, and Transfer Learning in Networks using Evolutionary Learning. (arXiv:1811.05592v1 [https://t.co/wj7sSzFbWK])" https://t.co/1JceQva4F2
BrundageBot: Controllability, Multiplexing, and Transfer Learning in Networks using Evolutionary Learning. Rise Ooi, C. -H. Huck Yang, Pin-Yu Chen, Vìctor Eguìluz, Narsis Kiani, Hector Zenil, David Gomez-Cabrero, and Jesper Tegnèr https://t.co/Ad6XEaaAhW
pinyuchenTW: Check out our preprint about "Controllability, Multiplexing, and Transfer Learning in Networks using Evolutionary Learning". We establish a nice connection between evolutionary learning for network patterns and network controllability. Paper link: https://t.co/yCiTAr4Hu0 https://t.co/pBR8NH9II5
BioPapers: Controllability, Multiplexing, and Transfer Learning in Networks using Evolutionary Learning. https://t.co/xP96WbsqBV
Rosenchild: RT @arxiv_org: Controllability, Multiplexing, and Transfer Learning in Networks using Evolutionary Learn... https://t.co/QZ9YghgtAO https:/…
robotic_hands: RT @arxiv_org: Controllability, Multiplexing, and Transfer Learning in Networks using Evolutionary Learn... https://t.co/QZ9YghgtAO https:/…
BedabrataChoud1: RT @arxiv_org: Controllability, Multiplexing, and Transfer Learning in Networks using Evolutionary Learn... https://t.co/QZ9YghgtAO https:/…
None.
None.
###### Other stats
Sample Sizes : None.
Authors: 8
Total Words: 6113
Unqiue Words: 2058

##### #2. IOHprofiler: A Benchmarking and Profiling Tool for Iterative Optimization Heuristics
###### Carola Doerr, Hao Wang, Furong Ye, Sander van Rijn, Thomas Bäck
IOHprofiler is a new tool for analyzing and comparing iterative optimization heuristics. Given as input algorithms and problems written in C or Python, it provides as output a statistical evaluation of the algorithms' performance by means of the distribution on the fixed-target running time and the fixed-budget function values. In addition, IOHprofiler also allows to track the evolution of algorithm parameters, making our tool particularly useful for the analysis, comparison, and design of (self-)adaptive algorithms. IOHprofiler is a ready-to-use software. It consists of two parts: an experimental part, which generates the running time data, and a post-processing part, which produces the summarizing comparisons and statistical evaluations. The experimental part is build on the COCO software, which has been adjusted to cope with optimization problems that are formulated as functions $f:\mathcal{S}^n \to \R$ with $\mathcal{S}$ being a discrete alphabet of integers. The post-processing part is our own work. It can be used as...
more | pdf | html
###### Tweets
arxivml: "IOHprofiler: A Benchmarking and Profiling Tool for Iterative Optimization Heuristics", Carola Doerr, Hao Wang, Fur… https://t.co/1n2Y3ShdP9
Soul: IOHprofiler: A Benchmarking and Profiling Tool for Iterative Optimization Heuristics. https://t.co/JPBTxjc6ux
None.
None.
###### Other stats
Sample Sizes : None.
Authors: 5
Total Words: 11354
Unqiue Words: 2500

##### #3. BSAS: Beetle Swarm Antennae Search Algorithm for Optimization Problems
###### Jiangyu Wang, Huanxin Chen
Beetle antennae search (BAS) is an efficient meta-heuristic algorithm. However, the convergent results of BAS rely heavily on the random beetle direction in every iterations. More specifically, different random seeds may cause different optimized results. Besides, the step-size update algorithm of BAS cannot guarantee objective become smaller in iterative process. In order to solve these problems, this paper proposes Beetle Swarm Antennae Search Algorithm (BSAS) which combines swarm intelligence algorithm with feedback-based step-size update strategy. BSAS employs k beetles to find more optimal position in each moving rather than one beetle. The step-size updates only when k beetles return without better choices. Experiments are carried out on building system identification. The results reveal the efficacy of the BSAS algorithm to avoid influence of random direction of Beetle. In addition, the estimation errors decrease as the beetles number goes up.
more | pdf | html
###### Tweets
Soul: BSAS: Beetle Swarm Antennae Search Algorithm for Optimization Problems. https://t.co/4Sjol1boOC
###### Github

Implementation of the (beetle antennae search) BAS algorithm and its mutations in R code

Repository: rBAS
User: jywang2016
Language: R
Stargazers: 1
Subscribers: 1
Forks: 0
Open Issues: 0
None.
###### Other stats
Sample Sizes : None.
Authors: 2
Total Words: 2302
Unqiue Words: 870

##### #4. Prototype Discovery using Quality-Diversity
###### Alexander Hagg, Alexander Asteroth, Thomas Bäck
An iterative computer-aided ideation procedure is introduced, building on recent quality-diversity algorithms, which search for diverse as well as high-performing solutions. Dimensionality reduction is used to define a similarity space, in which solutions are clustered into classes. These classes are represented by prototypes, which are presented to the user for selection. In the next iteration, quality-diversity focuses on searching within the selected class. A quantitative analysis is performed on a 2D airfoil, and a more complex 3D side view mirror domain shows how computer-aided ideation can help to enhance engineers' intuition while allowing their design decisions to influence the design process.
more | pdf | html
None.
None.
###### Other stats
Sample Sizes : None.
Authors: 3
Total Words: 4917
Unqiue Words: 1797

##### #5. A Two-Dimensional (2-D) Learning Framework for Particle Swarm based Feature Selection
###### Faizal Hafiz, Akshya Swain, Nitish Patel, Chirag Naik
This paper proposes a new generalized two dimensional learning approach for particle swarm based feature selection. The core idea of the proposed approach is to include the information about the subset cardinality into the learning framework by extending the dimension of the velocity. The 2D-learning framework retains all the key features of the original PSO, despite the extra learning dimension. Most of the popular variants of PSO can easily be adapted into this 2D learning framework for feature selection problems. The efficacy of the proposed learning approach has been evaluated considering several benchmark data and two induction algorithms: Naive-Bayes and k-Nearest Neighbor. The results of the comparative investigation including the time-complexity analysis with GA, ACO and five other PSO variants illustrate that the proposed 2D learning approach gives feature subset with relatively smaller cardinality and better classification performance with shorter run times.
more | pdf | html
None.
None.
###### Other stats
Sample Sizes : None.
Authors: 4
Total Words: 16277
Unqiue Words: 4183

##### #6. Differentiable plasticity: training plastic neural networks with backpropagation
###### Thomas Miconi, Jeff Clune, Kenneth O. Stanley
How can we build agents that keep learning from experience, quickly and efficiently, after their initial training? Here we take inspiration from the main mechanism of learning in biological brains: synaptic plasticity, carefully tuned by evolution to produce efficient lifelong learning. We show that plasticity, just like connection weights, can be optimized by gradient descent in large (millions of parameters) recurrent networks with Hebbian plastic connections. First, recurrent plastic networks with more than two million parameters can be trained to memorize and reconstruct sets of novel, high-dimensional 1000+ pixels natural images not seen during training. Crucially, traditional non-plastic recurrent networks fail to solve this task. Furthermore, trained plastic networks can also solve generic meta-learning tasks such as the Omniglot task, with competitive results and little parameter overhead. Finally, in reinforcement learning settings, plastic networks outperform a non-plastic equivalent in a maze exploration task. We...
more | pdf | html
###### Tweets
MEmambakhsh: Important paper: "Differentiable plasticity: training plastic neural networks with backpropagation" https://t.co/p9yIYcZP3R
AS_Insects: 日経サイエンス／Scientific American に載ってた「生涯学習する（keep learning）」AIの元論文見つけた。 https://t.co/rTnEfOxNPi
###### Github

Implementations of the algorithms described in Differentiable plasticity: training plastic networks with gradient descent, a research paper from Uber AI Labs.

Repository: differentiable-plasticity
User: uber-research
Language: Python
Stargazers: 271
Subscribers: 21
Forks: 33
Open Issues: 1
None.
###### Other stats
Sample Sizes : None.
Authors: 3
Total Words: 7755
Unqiue Words: 2479

##### #7. Robust Optimization through Neuroevolution
###### Paolo Pagliuca, Stefano Nolfi
We propose a method for evolving solutions that are robust with respect to variations of the environmental conditions (i.e. that can operate effectively in new conditions immediately, without the need to adapt to variations). The obtained results show how the method proposed is effective and computational tractable. It permits to improve performance on an extended version of the double-pole balancing problem, to outperform the best available human-designed controllers on a car racing problem, and to generate rather effective solutions for a swarm robotic problem. The comparison of different algorithms indicates that the CMA-ES and xNES methods, that operate by optimizing a distribution of parameters, represent the best options for the evolution of robust neural network controllers.
more | pdf | html
None.
None.
###### Other stats
Sample Sizes : None.
Authors: 2
Total Words: 12255
Unqiue Words: 2849

##### #8. Conditions for Major Transitions in Biological and Cultural Evolution
###### Peter D. Turney
Evolution by natural selection can be seen an algorithm for generating creative solutions to difficult problems. More precisely, evolution by natural selection is a class of algorithms that share a set of properties. The question we address here is, what are the conditions that define this class of algorithms? There is a standard answer to this question: Briefly, the conditions are variation, heredity, and selection. We agree that these three conditions are sufficient for a limited type of evolution, but they are not sufficient for open-ended evolution. By open-ended evolution, we mean evolution that generates a continuous stream of creative solutions, without stagnating. We propose a set of conditions for open-ended evolution. The new conditions build on the standard conditions by adding fission, fusion, and cooperation. We test the proposed conditions by applying them to major transitions in the evolution of life and culture. We find that the proposed conditions are able to account for the major transitions.
more | pdf | html
None.
###### Tweets
AlifePapers: Conditions for Major Transitions in Biological and Cultural Evolution "We propose a set of conditions for open-ended evolution. [They] are able to account for the major transitions [in the evolution of life and culture]." https://t.co/LhP4nDVpxy https://t.co/AH28Ej4mnk
None.
None.
###### Other stats
Sample Sizes : None.
Authors: 1
Total Words: 6858
Unqiue Words: 2244

##### #9. Complexity Theory for Discrete Black-Box Optimization Heuristics
###### Carola Doerr
A predominant topic in the theory of evolutionary algorithms and, more generally, theory of randomized black-box optimization techniques is running time analysis. Running time analysis aims at understanding the performance of a given heuristic on a given problem by bounding the number of function evaluations that are needed by the heuristic to identify a solution of a desired quality. As in general algorithms theory, this running time perspective is most useful when it is complemented by a meaningful complexity theory that studies the limits of algorithmic solutions. In the context of discrete black-box optimization, several black-box complexity models have been developed to analyze the best possible performance that a black-box optimization algorithm can achieve on a given problem. The models differ in the classes of algorithms to which these lower bounds apply. This way, black-box complexity contributes to a better understanding of how certain algorithmic choices (such as the amount of memory used by a heuristic, its selective...
more | pdf | html
None.
None.
###### Other stats
Sample Sizes : None.
Authors: 1
Total Words: 36774
Unqiue Words: 4904

##### #10. Quantization for Rapid Deployment of Deep Neural Networks
###### Jun Haeng Lee, Sangwon Ha, Saerom Choi, Won-Jo Lee, Seungwon Lee
This paper aims at rapid deployment of the state-of-the-art deep neural networks (DNNs) to energy efficient accelerators without time-consuming fine tuning or the availability of the full datasets. Converting DNNs in full precision to limited precision is essential in taking advantage of the accelerators with reduced memory footprint and computation power. However, such a task is not trivial since it often requires the full training and validation datasets for profiling the network statistics and fine tuning the networks to recover the accuracy lost after quantization. To address these issues, we propose a simple method recognizing channel-level distribution to reduce the quantization-induced accuracy loss and minimize the required image samples for profiling. We evaluated our method on eleven networks trained on the ImageNet classification benchmark and a network trained on the Pascal VOC object detection benchmark. The results prove that the networks can be quantized into 8-bit integer precision without fine tuning.
more | pdf | html
###### Tweets
BrundageBot: Quantization for Rapid Deployment of Deep Neural Networks. Jun Haeng Lee, Sangwon Ha, Saerom Choi, Won-Jo Lee, and Seungwon Lee https://t.co/xu3ppysEw8
nmfeeds: [NE] https://t.co/pQ6DibQUse Quantization for Rapid Deployment of Deep Neural Networks. This paper aims at rapid deploymen...
nmfeeds: [O] https://t.co/pQ6DibQUse Quantization for Rapid Deployment of Deep Neural Networks. This paper aims at rapid deployment...
Soul: Quantization for Rapid Deployment of Deep Neural Networks. https://t.co/03stI0xvVr
None.
None.
###### Other stats
Sample Sizes : None.
Authors: 5
Total Words: 4398
Unqiue Words: 1517

Assert is a website where the best academic papers on arXiv (computer science, math, physics), bioRxiv (biology), BITSS (reproducibility), EarthArXiv (earth science), engrXiv (engineering), LawArXiv (law), PsyArXiv (psychology), SocArXiv (social science), and SportRxiv (sport research) bubble to the top each day.

Papers are scored (in real-time) based on how verifiable they are (as determined by their Github repos) and how interesting they are (based on Twitter).

To see top papers, follow us on twitter @assertpub_ (arXiv), @assert_pub (bioRxiv), and @assertpub_dev (everything else).

To see beautiful figures extracted from papers, follow us on Instagram.

Tracking 72,893 papers.

###### Search
Sort results based on if they are interesting or reproducible.
Interesting
Reproducible
Online
###### Stats
Tracking 72,893 papers.