Top 10 Arxiv Papers Today in Information Theory


2.012 Mikeys
#1. Estimating Entropy of Distributions in Constant Space
Jayadev Acharya, Sourbh Bhadane, Piotr Indyk, Ziteng Sun
We consider the task of estimating the entropy of $k$-ary distributions from samples in the streaming model, where space is limited. Our main contribution is an algorithm that requires $O\left(\frac{k \log (1/\varepsilon)^2}{\varepsilon^3}\right)$ samples and a constant $O(1)$ memory words of space and outputs a $\pm\varepsilon$ estimate of $H(p)$. Without space limitations, the sample complexity has been established as $S(k,\varepsilon)=\Theta\left(\frac k{\varepsilon\log k}+\frac{\log^2 k}{\varepsilon^2}\right)$, which is sub-linear in the domain size $k$, and the current algorithms that achieve optimal sample complexity also require nearly-linear space in $k$. Our algorithm partitions $[0,1]$ into intervals and estimates the entropy contribution of probability values in each interval. The intervals are designed to trade off the bias and variance of these estimates.
more | pdf | html
Figures
None.
Tweets
AcharyaJayadev: Estimating Entropy of Distributions in Constant memory words (paper in NeurIPS 2019) with several open directions uploaded to arxiv: https://t.co/KMZPuTHXum https://t.co/FYaDBi2L40
mathITbot: Jayadev Acharya, Sourbh Bhadane, Piotr Indyk, Ziteng Sun : Estimating Entropy of Distributions in Constant Space https://t.co/Xeb7FS2KOt https://t.co/pVCgYwsueI
Memoirs: Estimating Entropy of Distributions in Constant Space. https://t.co/kK4P0vC8Pz
Github
None.
Youtube
None.
Other stats
Sample Sizes : None.
Authors: 4
Total Words: 0
Unqiue Words: 0

2.006 Mikeys
#2. Placement Optimization of Aerial Base Stations with Deep Reinforcement Learning
Jin Qiu, Jiangbin Lyu, Liqun Fu
Unmanned aerial vehicles (UAVs) can be utilized as aerial base stations (ABSs) to assist terrestrial infrastructure for keeping wireless connectivity in various emergency scenarios. To maximize the coverage rate of N ground users (GUs) by jointly placing multiple ABSs with limited coverage range is known to be a NP-hard problem with exponential complexity in N. The problem is further complicated when the coverage range becomes irregular due to site-specific blockage (e.g., buildings) on the air-ground channel in the 3-dimensional (3D) space. To tackle this challenging problem, this paper applies the Deep Reinforcement Learning (DRL) method by 1) representing the state by a coverage bitmap to capture the spatial correlation of GUs/ABSs, whose dimension and associated neural network complexity is invariant with arbitrarily large N; and 2) designing the action and reward for the DRL agent to effectively learn from the dynamic interactions with the complicated propagation environment represented by a 3D Terrain Map. Specifically, a...
more | pdf | html
Figures
Tweets
mathITbot: Jin Qiu, Jiangbin Lyu, Liqun Fu : Placement Optimization of Aerial Base Stations with Deep Reinforcement Learning https://t.co/YJhdMUaMjj https://t.co/kisiLDBAxt
SciFi: Placement Optimization of Aerial Base Stations with Deep Reinforcement Learning. https://t.co/YkdBHJPzNO
Github
None.
Youtube
None.
Other stats
Sample Sizes : None.
Authors: 3
Total Words: 5452
Unqiue Words: 1614

2.006 Mikeys
#3. Low Complexity Autoencoder based End-to-End Learning of Coded Communications Systems
Nuwanthika Rajapaksha, Nandana Rajatheva, Matti Latva-aho
End-to-end learning of a communications system using the deep learning-based autoencoder concept has drawn interest in recent research due to its simplicity, flexibility and its potential of adapting to complex channel models and practical system imperfections. In this paper, we have compared the bit error rate (BER) performance of autoencoder based systems and conventional channel coded systems with convolutional coding, in order to understand the potential of deep learning-based systems as alternatives to conventional systems. From the simulations, autoencoder implementation was observed to have a better BER in 0-5 dB $E_{b}/N_{0}$ range than its equivalent half-rate convolutional coded BPSK with hard decision decoding, and to have only less than 1 dB gap at a BER of $10^{-5}$. Furthermore, we have also proposed a novel low complexity autoencoder architecture to implement end-to-end learning of coded systems in which we have shown better BER performance than the baseline implementation. The newly proposed low complexity...
more | pdf | html
Figures
None.
Tweets
mathITbot: Nuwanthika Rajapaksha, Nandana Rajatheva, Matti Latva-aho : Low Complexity Autoencoder based End-to-End Learning of Coded Communications Systems https://t.co/GOtoGb6KXZ https://t.co/EZ8TGKYBBM
Memoirs: Low Complexity Autoencoder based End-to-End Learning of Coded Communications Systems. https://t.co/9TUikPCjnT
Github
None.
Youtube
None.
Other stats
Sample Sizes : None.
Authors: 3
Total Words: 0
Unqiue Words: 0

2.001 Mikeys
#4. Joint Unicast and Multi-group Multicast Transmission in Massive MIMO Systems
Meysam Sadeghi, Emil Björnson, Erik G. Larsson, Chau Yuen, Thomas L. Marzetta
We study the joint unicast and multi-group multicast transmission in massive multiple-input-multiple-output (MIMO) systems. We consider a system model that accounts for channel estimation and pilot contamination, and derive achievable spectral efficiencies (SEs) for unicast and multicast user terminals (UTs), under maximum ratio transmission and zero-forcing precoding. For unicast transmission, our objective is to maximize the weighted sum SE of the unicast UTs, and for the multicast transmission, our objective is to maximize the minimum SE of the multicast UTs. These two objectives are coupled in a conflicting manner, due to their shared power resource. Therefore, we formulate a multiobjective optimization problem (MOOP) for the two conflicting objectives. We derive the Pareto boundary of the MOOP analytically. As each Pareto optimal point describes a particular efficient trade-off between the two objectives of the system, we determine the values of the system parameters (uplink training powers, downlink transmission powers,...
more | pdf | html
Figures
None.
Tweets
mathITbot: Meysam Sadeghi, Emil Björnson, Erik G. Larsson, Chau Yuen, Thomas L. Marzetta : Joint Unicast and Multi-group Multicast Transmission in Massive MIMO Systems https://t.co/A3SCJ7SW92 https://t.co/AZtN3eBXSo
Github
None.
Youtube
None.
Other stats
Sample Sizes : [500, 500, 250, 250, 100, 100, 100, 150, 200, 250, 300, 100, 150, 200, 250, 300]
Authors: 5
Total Words: 12258
Unqiue Words: 2467

2.001 Mikeys
#5. Towards A Theory of Duality for Graph Signal Processing
B Subbareddy, S Sai Ashish, Aditya Siripuram
Motivated by duality in traditional signal processing, we investigate the concept of duality for graph Fourier transforms. Given two graphs, we define their dualness, a measure of how close the graphs are to being (signal processing) duals of each other. We show that this definition satisfies some desirable properties, and develop an algorithm based on co-ordinate descent and perfect matching to compute the dualness when the graphs have distinct eigen values.
more | pdf | html
Figures
None.
Tweets
mathITbot: B Subbareddy, S Sai Ashish, Aditya Siripuram : Towards A Theory of Duality for Graph Signal Processing https://t.co/sE8MMtiTzP https://t.co/2ZP3h87Dzq
Github
None.
Youtube
None.
Other stats
Sample Sizes : None.
Authors: 3
Total Words: 0
Unqiue Words: 0

2.001 Mikeys
#6. Hierarchical Distribution Matching: a Versatile Tool for Probabilistic Shaping
Stella Civelli, Marco Secondini
The hierarchical distribution matching (Hi-DM) approach for probabilistic shaping is described. The potential of Hi-DM in terms of trade-off between performance,complexity, and memory is illustrated through three case studies.
more | pdf | html
Figures
None.
Tweets
mathITbot: Stella Civelli, Marco Secondini : Hierarchical Distribution Matching: a Versatile Tool for Probabilistic Shaping https://t.co/uOAlyzKkYf https://t.co/qTb4PiPvTp
Github
None.
Youtube
None.
Other stats
Sample Sizes : None.
Authors: 2
Total Words: 0
Unqiue Words: 0

2.001 Mikeys
#7. Computation Offloading in the Untrusted MEC-aided Mobile Blockchain IoT System
Yiping Zuo, Shi Jin, Shengli Zhang
Deploying mobile edge computing (MEC) server in the mobile blockchain-enabled Internet of things (IoT) system is a promising approach to improve the system performance, however, it imposes a significant challenge on the trust of MEC server. To address this problem, we first propose an untrusted MEC proof of work scheme in mobile blockchain network where plenty of nonce hash computing demands can be offloaded to MEC server. Then, we design a nonce ordering algorithm for this scheme to provide fairer computing resource allocation for all mobile IoT devices/users. Specifically, we formulate the user's nonce selection strategy as a non-cooperative game, where the utilities of individual user are maximized in the untrusted MEC-aided mobile blockchain network. We also prove the existence of Nash equilibrium and analyze that the cooperation behavior is unsuitable for the blockchain-enabled IoT devices by using the repeated game. Finally, we design the blockchain's difficulty adjustment mechanism to ensure stable block times during a long...
more | pdf | html
Figures
Tweets
mathITbot: Yiping Zuo, Shi Jin, Shengli Zhang : Computation Offloading in the Untrusted MEC-aided Mobile Blockchain IoT System https://t.co/g9iA70pZq2 https://t.co/GuZyI9YjDC
Github
None.
Youtube
None.
Other stats
Sample Sizes : None.
Authors: 3
Total Words: 11335
Unqiue Words: 2289

2.001 Mikeys
#8. On the Upper Bound of the Kullback-Leibler Divergence and Cross Entropy
Min Chen, Mateu Sbert
This archiving article consists of several short reports on the discussions between the two authors over the past two years at Oxford and Madrid, and their work carried out during that period on the upper bound of the Kullback-Leibler divergence and cross entropy. The work was motivated by the cost-benefit ratio proposed by Chen and Golan [1], and the less desirable property that the Kullback-Leibler (KL) divergence used in the measure is unbounded. The work subsequently (i) confirmed that the KL-divergence used in the cost-benefit ratio should exhibit a bounded property, (ii) proposed a new divergence measure, and (iii) compared this new divergence measure with a few other bounded measures.
more | pdf | html
Figures
None.
Tweets
mathITbot: Min Chen, Mateu Sbert : On the Upper Bound of the Kullback-Leibler Divergence and Cross Entropy https://t.co/uqKDWSZo1H https://t.co/697OBvnQKr
Github
None.
Youtube
None.
Other stats
Sample Sizes : None.
Authors: 2
Total Words: 3220
Unqiue Words: 969

2.001 Mikeys
#9. Optimal repairing schemes for Reed-Solomon codes with alphabet sizes linear in lengths under the rack-aware model
Lingfei Jin, Gaojun Luo, Chaoping Xing
In modern practical data centers, storage nodes are usually organized into equally sized groups, which is called racks. The cost of cross-rack communication is much more expensive compared with the intra-rack communication cost. The codes for this system are called rack-aware regenerating codes. Similar to standard minimum storage regenerating (MSR) codes, it is a challenging task to construct minimum storage rack-aware regenerating (MSRR) codes achieving the cut-set bound. The known constructions of MSRR codes achieving the cut-set bound give codes with alphabet size $q$ exponential in the code length $n$, more precisely, $q=\Omega(\exp(n^n))$. The main contribution of this paper is to provide explicit construction of MSRR codes achieving the cut-set bound with the alphabet size linear in $n$. To achieve this goal, we first present a general framework to repair Reed-Solomon codes. It turns out that the known repairing schemes of Reed-Solomon codes can be realized under our general framework. Several techniques are used in...
more | pdf | html
Figures
None.
Tweets
mathITbot: Lingfei Jin, Gaojun Luo, Chaoping Xing : Optimal repairing schemes for Reed-Solomon codes with alphabet sizes linear in lengths under the rack-aware model https://t.co/pBEC2RBJVv https://t.co/FHHjCUgZXb
Github
None.
Youtube
None.
Other stats
Sample Sizes : None.
Authors: 3
Total Words: 8206
Unqiue Words: 1631

2.001 Mikeys
#10. Low-Complexity Linear Equalization for OTFS Systems with Rectangular Waveforms
Wenjun Xu, Tingting Zou, Hui Gao, Zhisong Bie, Zhiyong Feng, Zhiguo Ding
Orthogonal time frequency space (OTFS) is a promising technology for high-mobility wireless communications. However, the equalization realization in practical OTFS systems is a great challenge when the non-ideal rectangular waveforms are adopted. In this paper, first of all, we theoretically prove that the effective channel matrix under rectangular waveforms holds the block-circulant property and the special Fourier transform structure with time-domain channel. Then, by exploiting the proved property and structure, we further propose the corresponding low-complexity algorithms for two mainstream linear equalization methods, i.e., zero-forcing (ZF) and minimum mean square error (MMSE). Compared with the existing direct-matrix-inversion-based equalization, the complexities can be reduced by a few thousand times for ZF and a few hundred times for MMSE without any performance loss, when the numbers of symbols and subcarriers are both 32 in OTFS systems.
more | pdf | html
Figures
None.
Tweets
mathITbot: Wenjun Xu, Tingting Zou, Hui Gao, Zhisong Bie, Zhiyong Feng, Zhiguo Ding : Low-Complexity Linear Equalization for OTFS Systems with Rectangular Waveforms https://t.co/DD540Wz6s5 https://t.co/3Oz0XEjjGt
Github
None.
Youtube
None.
Other stats
Sample Sizes : None.
Authors: 6
Total Words: 0
Unqiue Words: 0

About

Assert is a website where the best academic papers on arXiv (computer science, math, physics), bioRxiv (biology), BITSS (reproducibility), EarthArXiv (earth science), engrXiv (engineering), LawArXiv (law), PsyArXiv (psychology), SocArXiv (social science), and SportRxiv (sport research) bubble to the top each day.

Papers are scored (in real-time) based on how verifiable they are (as determined by their Github repos) and how interesting they are (based on Twitter).

To see top papers, follow us on twitter @assertpub_ (arXiv), @assert_pub (bioRxiv), and @assertpub_dev (everything else).

To see beautiful figures extracted from papers, follow us on Instagram.

Tracking 225,779 papers.

Search
Sort results based on if they are interesting or reproducible.
Interesting
Reproducible
Categories
All
Astrophysics
Cosmology and Nongalactic Astrophysics
Earth and Planetary Astrophysics
Astrophysics of Galaxies
High Energy Astrophysical Phenomena
Instrumentation and Methods for Astrophysics
Solar and Stellar Astrophysics
Condensed Matter
Disordered Systems and Neural Networks
Mesoscale and Nanoscale Physics
Materials Science
Other Condensed Matter
Quantum Gases
Soft Condensed Matter
Statistical Mechanics
Strongly Correlated Electrons
Superconductivity
Computer Science
Artificial Intelligence
Hardware Architecture
Computational Complexity
Computational Engineering, Finance, and Science
Computational Geometry
Computation and Language
Cryptography and Security
Computer Vision and Pattern Recognition
Computers and Society
Databases
Distributed, Parallel, and Cluster Computing
Digital Libraries
Discrete Mathematics
Data Structures and Algorithms
Emerging Technologies
Formal Languages and Automata Theory
General Literature
Graphics
Computer Science and Game Theory
Human-Computer Interaction
Information Retrieval
Information Theory
Machine Learning
Logic in Computer Science
Multiagent Systems
Multimedia
Mathematical Software
Numerical Analysis
Neural and Evolutionary Computing
Networking and Internet Architecture
Other Computer Science
Operating Systems
Performance
Programming Languages
Robotics
Symbolic Computation
Sound
Software Engineering
Social and Information Networks
Systems and Control
Economics
Econometrics
General Economics
Theoretical Economics
Electrical Engineering and Systems Science
Audio and Speech Processing
Image and Video Processing
Signal Processing
General Relativity and Quantum Cosmology
General Relativity and Quantum Cosmology
High Energy Physics - Experiment
High Energy Physics - Experiment
High Energy Physics - Lattice
High Energy Physics - Lattice
High Energy Physics - Phenomenology
High Energy Physics - Phenomenology
High Energy Physics - Theory
High Energy Physics - Theory
Mathematics
Commutative Algebra
Algebraic Geometry
Analysis of PDEs
Algebraic Topology
Classical Analysis and ODEs
Combinatorics
Category Theory
Complex Variables
Differential Geometry
Dynamical Systems
Functional Analysis
General Mathematics
General Topology
Group Theory
Geometric Topology
History and Overview
Information Theory
K-Theory and Homology
Logic
Metric Geometry
Mathematical Physics
Numerical Analysis
Number Theory
Operator Algebras
Optimization and Control
Probability
Quantum Algebra
Rings and Algebras
Representation Theory
Symplectic Geometry
Spectral Theory
Statistics Theory
Mathematical Physics
Mathematical Physics
Nonlinear Sciences
Adaptation and Self-Organizing Systems
Chaotic Dynamics
Cellular Automata and Lattice Gases
Pattern Formation and Solitons
Exactly Solvable and Integrable Systems
Nuclear Experiment
Nuclear Experiment
Nuclear Theory
Nuclear Theory
Physics
Accelerator Physics
Atmospheric and Oceanic Physics
Applied Physics
Atomic and Molecular Clusters
Atomic Physics
Biological Physics
Chemical Physics
Classical Physics
Computational Physics
Data Analysis, Statistics and Probability
Physics Education
Fluid Dynamics
General Physics
Geophysics
History and Philosophy of Physics
Instrumentation and Detectors
Medical Physics
Optics
Plasma Physics
Popular Physics
Physics and Society
Space Physics
Quantitative Biology
Biomolecules
Cell Behavior
Genomics
Molecular Networks
Neurons and Cognition
Other Quantitative Biology
Populations and Evolution
Quantitative Methods
Subcellular Processes
Tissues and Organs
Quantitative Finance
Computational Finance
Economics
General Finance
Mathematical Finance
Portfolio Management
Pricing of Securities
Risk Management
Statistical Finance
Trading and Market Microstructure
Quantum Physics
Quantum Physics
Statistics
Applications
Computation
Methodology
Machine Learning
Other Statistics
Statistics Theory
Feedback
Online
Stats
Tracking 225,779 papers.