Networks are fundamental building blocks for representing data, and
computations. Remarkable progress in learning in structurally defined (shallow
or deep) networks has recently been achieved. Here we introduce evolutionary
exploratory search and learning method of topologically flexible networks under
the constraint of producing elementary computational steady-state input-output
operations.
Our results include; (1) the identification of networks, over four orders of
magnitude, implementing computation of steady-state input-output functions,
such as a band-pass filter, a threshold function, and an inverse band-pass
function. Next, (2) the learned networks are technically controllable as only a
small number of driver nodes are required to move the system to a new state.
Furthermore, we find that the fraction of required driver nodes is constant
during evolutionary learning, suggesting a stable system design. (3), our
framework allows multiplexing of different computations using the same network.
For example, using a binary...

more |
pdf
| html
arxiv_org:
Controllability, Multiplexing, and Transfer Learning in Networks using Evolutionary Learn... https://t.co/QZ9YghgtAO https://t.co/XKLtRcMH5D

net_science:
"Controllability, Multiplexing, and Transfer Learning in Networks using Evolutionary Learning. (arXiv:1811.05592v1 [https://t.co/wj7sSzFbWK])" https://t.co/1JceQva4F2

BrundageBot:
Controllability, Multiplexing, and Transfer Learning in Networks using Evolutionary Learning. Rise Ooi, C. -H. Huck Yang, Pin-Yu Chen, Vìctor Eguìluz, Narsis Kiani, Hector Zenil, David Gomez-Cabrero, and Jesper Tegnèr https://t.co/Ad6XEaaAhW

pinyuchenTW:
Check out our preprint about "Controllability, Multiplexing, and Transfer Learning in Networks using Evolutionary Learning". We establish a nice connection between evolutionary learning for network patterns and network controllability.
Paper link: https://t.co/yCiTAr4Hu0 https://t.co/pBR8NH9II5

BioPapers:
Controllability, Multiplexing, and Transfer Learning in Networks using Evolutionary Learning. https://t.co/xP96WbsqBV

Rosenchild:
RT @arxiv_org: Controllability, Multiplexing, and Transfer Learning in Networks using Evolutionary Learn... https://t.co/QZ9YghgtAO https:/…

robotic_hands:
RT @arxiv_org: Controllability, Multiplexing, and Transfer Learning in Networks using Evolutionary Learn... https://t.co/QZ9YghgtAO https:/…

BedabrataChoud1:
RT @arxiv_org: Controllability, Multiplexing, and Transfer Learning in Networks using Evolutionary Learn... https://t.co/QZ9YghgtAO https:/…

None.

None.

Sample Sizes : None.

Authors: 8

Total Words: 6113

Unqiue Words: 2058

IOHprofiler is a new tool for analyzing and comparing iterative optimization
heuristics. Given as input algorithms and problems written in C or Python, it
provides as output a statistical evaluation of the algorithms' performance by
means of the distribution on the fixed-target running time and the fixed-budget
function values. In addition, IOHprofiler also allows to track the evolution of
algorithm parameters, making our tool particularly useful for the analysis,
comparison, and design of (self-)adaptive algorithms.
IOHprofiler is a ready-to-use software. It consists of two parts: an
experimental part, which generates the running time data, and a post-processing
part, which produces the summarizing comparisons and statistical evaluations.
The experimental part is build on the COCO software, which has been adjusted to
cope with optimization problems that are formulated as functions
$f:\mathcal{S}^n \to \R$ with $\mathcal{S}$ being a discrete alphabet of
integers. The post-processing part is our own work. It can be used as...

more |
pdf
| html
arxivml:
"IOHprofiler: A Benchmarking and Profiling Tool for Iterative Optimization Heuristics",
Carola Doerr, Hao Wang, Fur…
https://t.co/1n2Y3ShdP9

Soul:
IOHprofiler: A Benchmarking and Profiling Tool for Iterative Optimization Heuristics. https://t.co/JPBTxjc6ux

None.

None.

Sample Sizes : None.

Authors: 5

Total Words: 11354

Unqiue Words: 2500

Beetle antennae search (BAS) is an efficient meta-heuristic algorithm.
However, the convergent results of BAS rely heavily on the random beetle
direction in every iterations. More specifically, different random seeds may
cause different optimized results. Besides, the step-size update algorithm of
BAS cannot guarantee objective become smaller in iterative process. In order to
solve these problems, this paper proposes Beetle Swarm Antennae Search
Algorithm (BSAS) which combines swarm intelligence algorithm with
feedback-based step-size update strategy. BSAS employs k beetles to find more
optimal position in each moving rather than one beetle. The step-size updates
only when k beetles return without better choices. Experiments are carried out
on building system identification. The results reveal the efficacy of the BSAS
algorithm to avoid influence of random direction of Beetle. In addition, the
estimation errors decrease as the beetles number goes up.

more |
pdf
| html
Soul:
BSAS: Beetle Swarm Antennae Search Algorithm for Optimization Problems. https://t.co/4Sjol1boOC

Implementation of the (beetle antennae search) BAS algorithm and its mutations in R code

None.

Sample Sizes : None.

Authors: 2

Total Words: 2302

Unqiue Words: 870

An iterative computer-aided ideation procedure is introduced, building on
recent quality-diversity algorithms, which search for diverse as well as
high-performing solutions. Dimensionality reduction is used to define a
similarity space, in which solutions are clustered into classes. These classes
are represented by prototypes, which are presented to the user for selection.
In the next iteration, quality-diversity focuses on searching within the
selected class. A quantitative analysis is performed on a 2D airfoil, and a
more complex 3D side view mirror domain shows how computer-aided ideation can
help to enhance engineers' intuition while allowing their design decisions to
influence the design process.

more |
pdf
| html
None.

None.

Sample Sizes : None.

Authors: 3

Total Words: 4917

Unqiue Words: 1797

This paper proposes a new generalized two dimensional learning approach for
particle swarm based feature selection. The core idea of the proposed approach
is to include the information about the subset cardinality into the learning
framework by extending the dimension of the velocity. The 2D-learning framework
retains all the key features of the original PSO, despite the extra learning
dimension. Most of the popular variants of PSO can easily be adapted into this
2D learning framework for feature selection problems. The efficacy of the
proposed learning approach has been evaluated considering several benchmark
data and two induction algorithms: Naive-Bayes and k-Nearest Neighbor. The
results of the comparative investigation including the time-complexity analysis
with GA, ACO and five other PSO variants illustrate that the proposed 2D
learning approach gives feature subset with relatively smaller cardinality and
better classification performance with shorter run times.

more |
pdf
| html
None.

None.

Sample Sizes : None.

Authors: 4

Total Words: 16277

Unqiue Words: 4183

How can we build agents that keep learning from experience, quickly and
efficiently, after their initial training? Here we take inspiration from the
main mechanism of learning in biological brains: synaptic plasticity, carefully
tuned by evolution to produce efficient lifelong learning. We show that
plasticity, just like connection weights, can be optimized by gradient descent
in large (millions of parameters) recurrent networks with Hebbian plastic
connections. First, recurrent plastic networks with more than two million
parameters can be trained to memorize and reconstruct sets of novel,
high-dimensional 1000+ pixels natural images not seen during training.
Crucially, traditional non-plastic recurrent networks fail to solve this task.
Furthermore, trained plastic networks can also solve generic meta-learning
tasks such as the Omniglot task, with competitive results and little parameter
overhead. Finally, in reinforcement learning settings, plastic networks
outperform a non-plastic equivalent in a maze exploration task. We...

more |
pdf
| html
MEmambakhsh:
Important paper: "Differentiable plasticity: training plastic neural networks with backpropagation"
https://t.co/p9yIYcZP3R

AS_Insects:
日経サイエンス／Scientific American に載ってた「生涯学習する（keep learning）」AIの元論文見つけた。 https://t.co/rTnEfOxNPi

Implementations of the algorithms described in Differentiable plasticity: training plastic networks with gradient descent, a research paper from Uber AI Labs.

Stargazers: 271

Subscribers: 21

Subscribers: 21

Forks: 33

Open Issues: 1

Open Issues: 1

None.

Sample Sizes : None.

Authors: 3

Total Words: 7755

Unqiue Words: 2479

We propose a method for evolving solutions that are robust with respect to
variations of the environmental conditions (i.e. that can operate effectively
in new conditions immediately, without the need to adapt to variations). The
obtained results show how the method proposed is effective and computational
tractable. It permits to improve performance on an extended version of the
double-pole balancing problem, to outperform the best available human-designed
controllers on a car racing problem, and to generate rather effective solutions
for a swarm robotic problem. The comparison of different algorithms indicates
that the CMA-ES and xNES methods, that operate by optimizing a distribution of
parameters, represent the best options for the evolution of robust neural
network controllers.

more |
pdf
| html
None.

None.

Sample Sizes : None.

Authors: 2

Total Words: 12255

Unqiue Words: 2849

Evolution by natural selection can be seen an algorithm for generating
creative solutions to difficult problems. More precisely, evolution by natural
selection is a class of algorithms that share a set of properties. The question
we address here is, what are the conditions that define this class of
algorithms? There is a standard answer to this question: Briefly, the
conditions are variation, heredity, and selection. We agree that these three
conditions are sufficient for a limited type of evolution, but they are not
sufficient for open-ended evolution. By open-ended evolution, we mean evolution
that generates a continuous stream of creative solutions, without stagnating.
We propose a set of conditions for open-ended evolution. The new conditions
build on the standard conditions by adding fission, fusion, and cooperation. We
test the proposed conditions by applying them to major transitions in the
evolution of life and culture. We find that the proposed conditions are able to
account for the major transitions.

more |
pdf
| html
None.

AlifePapers:
Conditions for Major Transitions in Biological and Cultural Evolution
"We propose a set of conditions for open-ended evolution. [They] are able to account for the major transitions [in the evolution of life and culture]."
https://t.co/LhP4nDVpxy https://t.co/AH28Ej4mnk

None.

None.

Sample Sizes : None.

Authors: 1

Total Words: 6858

Unqiue Words: 2244

A predominant topic in the theory of evolutionary algorithms and, more
generally, theory of randomized black-box optimization techniques is running
time analysis. Running time analysis aims at understanding the performance of a
given heuristic on a given problem by bounding the number of function
evaluations that are needed by the heuristic to identify a solution of a
desired quality. As in general algorithms theory, this running time perspective
is most useful when it is complemented by a meaningful complexity theory that
studies the limits of algorithmic solutions.
In the context of discrete black-box optimization, several black-box
complexity models have been developed to analyze the best possible performance
that a black-box optimization algorithm can achieve on a given problem. The
models differ in the classes of algorithms to which these lower bounds apply.
This way, black-box complexity contributes to a better understanding of how
certain algorithmic choices (such as the amount of memory used by a heuristic,
its selective...

more |
pdf
| html
None.

None.

Sample Sizes : None.

Authors: 1

Total Words: 36774

Unqiue Words: 4904

This paper aims at rapid deployment of the state-of-the-art deep neural
networks (DNNs) to energy efficient accelerators without time-consuming fine
tuning or the availability of the full datasets. Converting DNNs in full
precision to limited precision is essential in taking advantage of the
accelerators with reduced memory footprint and computation power. However, such
a task is not trivial since it often requires the full training and validation
datasets for profiling the network statistics and fine tuning the networks to
recover the accuracy lost after quantization. To address these issues, we
propose a simple method recognizing channel-level distribution to reduce the
quantization-induced accuracy loss and minimize the required image samples for
profiling. We evaluated our method on eleven networks trained on the ImageNet
classification benchmark and a network trained on the Pascal VOC object
detection benchmark. The results prove that the networks can be quantized into
8-bit integer precision without fine tuning.

more |
pdf
| html
BrundageBot:
Quantization for Rapid Deployment of Deep Neural Networks. Jun Haeng Lee, Sangwon Ha, Saerom Choi, Won-Jo Lee, and Seungwon Lee https://t.co/xu3ppysEw8

nmfeeds:
[NE] https://t.co/pQ6DibQUse Quantization for Rapid Deployment of Deep Neural Networks. This paper aims at rapid deploymen...

nmfeeds:
[O] https://t.co/pQ6DibQUse Quantization for Rapid Deployment of Deep Neural Networks. This paper aims at rapid deployment...

Soul:
Quantization for Rapid Deployment of Deep Neural Networks. https://t.co/03stI0xvVr

None.

None.

Sample Sizes : None.

Authors: 5

Total Words: 4398

Unqiue Words: 1517

Assert is a website where the best academic papers on arXiv (computer science, math, physics), bioRxiv (biology), BITSS (reproducibility), EarthArXiv (earth science), engrXiv (engineering), LawArXiv (law), PsyArXiv (psychology), SocArXiv (social science), and SportRxiv (sport research) bubble to the top each day.

Papers are scored (in real-time) based on how verifiable they are (as determined by their Github repos) and how interesting they are (based on Twitter).

To see top papers, follow us on twitter @assertpub_ (arXiv), @assert_pub (bioRxiv), and @assertpub_dev (everything else).

To see beautiful figures extracted from papers, follow us on Instagram.

*Tracking 72,893 papers.*

Sort results based on if they are interesting or reproducible.

Interesting

Reproducible