### Top 10 Arxiv Papers Today in Information Theory

##### #1. Estimating Entropy of Distributions in Constant Space
We consider the task of estimating the entropy of $k$-ary distributions from samples in the streaming model, where space is limited. Our main contribution is an algorithm that requires $O\left(\frac{k \log (1/\varepsilon)^2}{\varepsilon^3}\right)$ samples and a constant $O(1)$ memory words of space and outputs a $\pm\varepsilon$ estimate of $H(p)$. Without space limitations, the sample complexity has been established as $S(k,\varepsilon)=\Theta\left(\frac k{\varepsilon\log k}+\frac{\log^2 k}{\varepsilon^2}\right)$, which is sub-linear in the domain size $k$, and the current algorithms that achieve optimal sample complexity also require nearly-linear space in $k$. Our algorithm partitions $[0,1]$ into intervals and estimates the entropy contribution of probability values in each interval. The intervals are designed to trade off the bias and variance of these estimates.
more | pdf | html
None.
###### Tweets
AcharyaJayadev: Estimating Entropy of Distributions in Constant memory words (paper in NeurIPS 2019) with several open directions uploaded to arxiv: https://t.co/KMZPuTHXum https://t.co/FYaDBi2L40
mathITbot: Jayadev Acharya, Sourbh Bhadane, Piotr Indyk, Ziteng Sun : Estimating Entropy of Distributions in Constant Space https://t.co/Xeb7FS2KOt https://t.co/pVCgYwsueI
Memoirs: Estimating Entropy of Distributions in Constant Space. https://t.co/kK4P0vC8Pz
None.
None.
###### Other stats
Sample Sizes : None.
Authors: 4
Total Words: 0
Unqiue Words: 0

##### #2. Placement Optimization of Aerial Base Stations with Deep Reinforcement Learning
###### Jin Qiu, Jiangbin Lyu, Liqun Fu
Unmanned aerial vehicles (UAVs) can be utilized as aerial base stations (ABSs) to assist terrestrial infrastructure for keeping wireless connectivity in various emergency scenarios. To maximize the coverage rate of N ground users (GUs) by jointly placing multiple ABSs with limited coverage range is known to be a NP-hard problem with exponential complexity in N. The problem is further complicated when the coverage range becomes irregular due to site-specific blockage (e.g., buildings) on the air-ground channel in the 3-dimensional (3D) space. To tackle this challenging problem, this paper applies the Deep Reinforcement Learning (DRL) method by 1) representing the state by a coverage bitmap to capture the spatial correlation of GUs/ABSs, whose dimension and associated neural network complexity is invariant with arbitrarily large N; and 2) designing the action and reward for the DRL agent to effectively learn from the dynamic interactions with the complicated propagation environment represented by a 3D Terrain Map. Specifically, a...
more | pdf | html
###### Tweets
mathITbot: Jin Qiu, Jiangbin Lyu, Liqun Fu : Placement Optimization of Aerial Base Stations with Deep Reinforcement Learning https://t.co/YJhdMUaMjj https://t.co/kisiLDBAxt
SciFi: Placement Optimization of Aerial Base Stations with Deep Reinforcement Learning. https://t.co/YkdBHJPzNO
None.
None.
###### Other stats
Sample Sizes : None.
Authors: 3
Total Words: 5452
Unqiue Words: 1614

##### #3. Low Complexity Autoencoder based End-to-End Learning of Coded Communications Systems
###### Nuwanthika Rajapaksha, Nandana Rajatheva, Matti Latva-aho
End-to-end learning of a communications system using the deep learning-based autoencoder concept has drawn interest in recent research due to its simplicity, flexibility and its potential of adapting to complex channel models and practical system imperfections. In this paper, we have compared the bit error rate (BER) performance of autoencoder based systems and conventional channel coded systems with convolutional coding, in order to understand the potential of deep learning-based systems as alternatives to conventional systems. From the simulations, autoencoder implementation was observed to have a better BER in 0-5 dB $E_{b}/N_{0}$ range than its equivalent half-rate convolutional coded BPSK with hard decision decoding, and to have only less than 1 dB gap at a BER of $10^{-5}$. Furthermore, we have also proposed a novel low complexity autoencoder architecture to implement end-to-end learning of coded systems in which we have shown better BER performance than the baseline implementation. The newly proposed low complexity...
more | pdf | html
None.
###### Tweets
mathITbot: Nuwanthika Rajapaksha, Nandana Rajatheva, Matti Latva-aho : Low Complexity Autoencoder based End-to-End Learning of Coded Communications Systems https://t.co/GOtoGb6KXZ https://t.co/EZ8TGKYBBM
Memoirs: Low Complexity Autoencoder based End-to-End Learning of Coded Communications Systems. https://t.co/9TUikPCjnT
None.
None.
###### Other stats
Sample Sizes : None.
Authors: 3
Total Words: 0
Unqiue Words: 0

##### #4. Joint Unicast and Multi-group Multicast Transmission in Massive MIMO Systems
###### Meysam Sadeghi, Emil Björnson, Erik G. Larsson, Chau Yuen, Thomas L. Marzetta
We study the joint unicast and multi-group multicast transmission in massive multiple-input-multiple-output (MIMO) systems. We consider a system model that accounts for channel estimation and pilot contamination, and derive achievable spectral efficiencies (SEs) for unicast and multicast user terminals (UTs), under maximum ratio transmission and zero-forcing precoding. For unicast transmission, our objective is to maximize the weighted sum SE of the unicast UTs, and for the multicast transmission, our objective is to maximize the minimum SE of the multicast UTs. These two objectives are coupled in a conflicting manner, due to their shared power resource. Therefore, we formulate a multiobjective optimization problem (MOOP) for the two conflicting objectives. We derive the Pareto boundary of the MOOP analytically. As each Pareto optimal point describes a particular efficient trade-off between the two objectives of the system, we determine the values of the system parameters (uplink training powers, downlink transmission powers,...
more | pdf | html
None.
###### Tweets
mathITbot: Meysam Sadeghi, Emil Björnson, Erik G. Larsson, Chau Yuen, Thomas L. Marzetta : Joint Unicast and Multi-group Multicast Transmission in Massive MIMO Systems https://t.co/A3SCJ7SW92 https://t.co/AZtN3eBXSo
None.
None.
###### Other stats
Sample Sizes : [500, 500, 250, 250, 100, 100, 100, 150, 200, 250, 300, 100, 150, 200, 250, 300]
Authors: 5
Total Words: 12258
Unqiue Words: 2467

##### #5. Towards A Theory of Duality for Graph Signal Processing
###### B Subbareddy, S Sai Ashish, Aditya Siripuram
Motivated by duality in traditional signal processing, we investigate the concept of duality for graph Fourier transforms. Given two graphs, we define their dualness, a measure of how close the graphs are to being (signal processing) duals of each other. We show that this definition satisfies some desirable properties, and develop an algorithm based on co-ordinate descent and perfect matching to compute the dualness when the graphs have distinct eigen values.
more | pdf | html
None.
###### Tweets
mathITbot: B Subbareddy, S Sai Ashish, Aditya Siripuram : Towards A Theory of Duality for Graph Signal Processing https://t.co/sE8MMtiTzP https://t.co/2ZP3h87Dzq
None.
None.
###### Other stats
Sample Sizes : None.
Authors: 3
Total Words: 0
Unqiue Words: 0

##### #6. Hierarchical Distribution Matching: a Versatile Tool for Probabilistic Shaping
###### Stella Civelli, Marco Secondini
The hierarchical distribution matching (Hi-DM) approach for probabilistic shaping is described. The potential of Hi-DM in terms of trade-off between performance,complexity, and memory is illustrated through three case studies.
more | pdf | html
None.
###### Tweets
mathITbot: Stella Civelli, Marco Secondini : Hierarchical Distribution Matching: a Versatile Tool for Probabilistic Shaping https://t.co/uOAlyzKkYf https://t.co/qTb4PiPvTp
None.
None.
###### Other stats
Sample Sizes : None.
Authors: 2
Total Words: 0
Unqiue Words: 0

##### #7. Computation Offloading in the Untrusted MEC-aided Mobile Blockchain IoT System
###### Yiping Zuo, Shi Jin, Shengli Zhang
Deploying mobile edge computing (MEC) server in the mobile blockchain-enabled Internet of things (IoT) system is a promising approach to improve the system performance, however, it imposes a significant challenge on the trust of MEC server. To address this problem, we first propose an untrusted MEC proof of work scheme in mobile blockchain network where plenty of nonce hash computing demands can be offloaded to MEC server. Then, we design a nonce ordering algorithm for this scheme to provide fairer computing resource allocation for all mobile IoT devices/users. Specifically, we formulate the user's nonce selection strategy as a non-cooperative game, where the utilities of individual user are maximized in the untrusted MEC-aided mobile blockchain network. We also prove the existence of Nash equilibrium and analyze that the cooperation behavior is unsuitable for the blockchain-enabled IoT devices by using the repeated game. Finally, we design the blockchain's difficulty adjustment mechanism to ensure stable block times during a long...
more | pdf | html
###### Tweets
mathITbot: Yiping Zuo, Shi Jin, Shengli Zhang : Computation Offloading in the Untrusted MEC-aided Mobile Blockchain IoT System https://t.co/g9iA70pZq2 https://t.co/GuZyI9YjDC
None.
None.
###### Other stats
Sample Sizes : None.
Authors: 3
Total Words: 11335
Unqiue Words: 2289

##### #8. On the Upper Bound of the Kullback-Leibler Divergence and Cross Entropy
###### Min Chen, Mateu Sbert
This archiving article consists of several short reports on the discussions between the two authors over the past two years at Oxford and Madrid, and their work carried out during that period on the upper bound of the Kullback-Leibler divergence and cross entropy. The work was motivated by the cost-benefit ratio proposed by Chen and Golan [1], and the less desirable property that the Kullback-Leibler (KL) divergence used in the measure is unbounded. The work subsequently (i) confirmed that the KL-divergence used in the cost-benefit ratio should exhibit a bounded property, (ii) proposed a new divergence measure, and (iii) compared this new divergence measure with a few other bounded measures.
more | pdf | html
None.
###### Tweets
mathITbot: Min Chen, Mateu Sbert : On the Upper Bound of the Kullback-Leibler Divergence and Cross Entropy https://t.co/uqKDWSZo1H https://t.co/697OBvnQKr
None.
None.
###### Other stats
Sample Sizes : None.
Authors: 2
Total Words: 3220
Unqiue Words: 969

##### #9. Optimal repairing schemes for Reed-Solomon codes with alphabet sizes linear in lengths under the rack-aware model
###### Lingfei Jin, Gaojun Luo, Chaoping Xing
In modern practical data centers, storage nodes are usually organized into equally sized groups, which is called racks. The cost of cross-rack communication is much more expensive compared with the intra-rack communication cost. The codes for this system are called rack-aware regenerating codes. Similar to standard minimum storage regenerating (MSR) codes, it is a challenging task to construct minimum storage rack-aware regenerating (MSRR) codes achieving the cut-set bound. The known constructions of MSRR codes achieving the cut-set bound give codes with alphabet size $q$ exponential in the code length $n$, more precisely, $q=\Omega(\exp(n^n))$. The main contribution of this paper is to provide explicit construction of MSRR codes achieving the cut-set bound with the alphabet size linear in $n$. To achieve this goal, we first present a general framework to repair Reed-Solomon codes. It turns out that the known repairing schemes of Reed-Solomon codes can be realized under our general framework. Several techniques are used in...
more | pdf | html
None.
###### Tweets
mathITbot: Lingfei Jin, Gaojun Luo, Chaoping Xing : Optimal repairing schemes for Reed-Solomon codes with alphabet sizes linear in lengths under the rack-aware model https://t.co/pBEC2RBJVv https://t.co/FHHjCUgZXb
None.
None.
###### Other stats
Sample Sizes : None.
Authors: 3
Total Words: 8206
Unqiue Words: 1631

##### #10. Low-Complexity Linear Equalization for OTFS Systems with Rectangular Waveforms
###### Wenjun Xu, Tingting Zou, Hui Gao, Zhisong Bie, Zhiyong Feng, Zhiguo Ding
Orthogonal time frequency space (OTFS) is a promising technology for high-mobility wireless communications. However, the equalization realization in practical OTFS systems is a great challenge when the non-ideal rectangular waveforms are adopted. In this paper, first of all, we theoretically prove that the effective channel matrix under rectangular waveforms holds the block-circulant property and the special Fourier transform structure with time-domain channel. Then, by exploiting the proved property and structure, we further propose the corresponding low-complexity algorithms for two mainstream linear equalization methods, i.e., zero-forcing (ZF) and minimum mean square error (MMSE). Compared with the existing direct-matrix-inversion-based equalization, the complexities can be reduced by a few thousand times for ZF and a few hundred times for MMSE without any performance loss, when the numbers of symbols and subcarriers are both 32 in OTFS systems.
more | pdf | html
None.
###### Tweets
mathITbot: Wenjun Xu, Tingting Zou, Hui Gao, Zhisong Bie, Zhiyong Feng, Zhiguo Ding : Low-Complexity Linear Equalization for OTFS Systems with Rectangular Waveforms https://t.co/DD540Wz6s5 https://t.co/3Oz0XEjjGt
None.
None.
###### Other stats
Sample Sizes : None.
Authors: 6
Total Words: 0
Unqiue Words: 0

Assert is a website where the best academic papers on arXiv (computer science, math, physics), bioRxiv (biology), BITSS (reproducibility), EarthArXiv (earth science), engrXiv (engineering), LawArXiv (law), PsyArXiv (psychology), SocArXiv (social science), and SportRxiv (sport research) bubble to the top each day.

Papers are scored (in real-time) based on how verifiable they are (as determined by their Github repos) and how interesting they are (based on Twitter).

To see top papers, follow us on twitter @assertpub_ (arXiv), @assert_pub (bioRxiv), and @assertpub_dev (everything else).

To see beautiful figures extracted from papers, follow us on Instagram.

Tracking 225,779 papers.

###### Search
Sort results based on if they are interesting or reproducible.
Interesting
Reproducible
Online
###### Stats
Tracking 225,779 papers.