Top 5 Arxiv Papers Today in Distributed, Parallel, And Cluster Computing


2.032 Mikeys
#1. OverSketched Newton: Fast Convex Optimization for Serverless Systems
Vipul Gupta, Swanand Kadhe, Thomas Courtade, Michael W. Mahoney, Kannan Ramchandran
Motivated by recent developments in serverless systems for large-scale machine learning as well as improvements in scalable randomized matrix algorithms, we develop OverSketched Newton, a randomized Hessian-based optimization algorithm to solve large-scale smooth and strongly-convex problems in serverless systems. OverSketched Newton leverages matrix sketching ideas from Randomized Numerical Linear Algebra to compute the Hessian approximately. These sketching methods lead to inbuilt resiliency against stragglers that are a characteristic of serverless architectures. We establish that OverSketched Newton has a linear-quadratic convergence rate, and we empirically validate our results by solving large-scale supervised learning problems on real-world datasets. Experiments demonstrate a reduction of ~50% in total running time on AWS Lambda, compared to state-of-the-art distributed optimization schemes.
more | pdf | html
Figures
Tweets
jasondavies: @Underfox3 Wrong link: I think you meant “OverSketched Newton: Fast Convex Optimization for Serverless Systems” https://t.co/iZ9JUPxk7o ?
arxivml: "OverSketched Newton: Fast Convex Optimization for Serverless Systems", Vipul Gupta, Swanand Kadhe, Thomas Courtade… https://t.co/rbRa3wSlvn
Underfox3: Researchers have developed a randomized Hessian-based optimization algorithm to solve large-scale smooth and strongly-convex problems in serverless systems. https://t.co/VgFpbE5U2a https://t.co/i6v0wn0z59
arxiv_cs_LG: OverSketched Newton: Fast Convex Optimization for Serverless Systems. Vipul Gupta, Swanand Kadhe, Thomas Courtade, Michael W. Mahoney, and Kannan Ramchandran https://t.co/4wuf9qICBQ
Memoirs: OverSketched Newton: Fast Convex Optimization for Serverless Systems. https://t.co/V7piTvms0k
Github

This repo implements OverSketched Newton and other algorithms that can be used for fast large-scale convex optimization on serverless systems

Repository: OverSketchedNewton
User: vvipgupta
Language: Python
Stargazers: 0
Subscribers: 0
Forks: 1
Open Issues: 0
Youtube
None.
Other stats
Sample Sizes : None.
Authors: 5
Total Words: 10263
Unqiue Words: 2652

2.001 Mikeys
#2. MP net as Abstract Model of Communication for Message-passing Applications
Martin Šurkovský
MP net is a formal model specifically designed for the field of parallel applications that use a message passing interface. The main idea is to use MP net as a comprehensible way of presenting the actual structure of communication within MPI applications. The goal is to provide users with the kind of feedback that can help them to check quickly whether or not the actual communication within their application corresponds to the intended one. This paper introduces MP net that focuses on the communication part of parallel applications and emphasizes its spatial character, which is rather hidden in sequential (textual) form.
more | pdf | html
Figures
Tweets
arxiv_org: MP net as Abstract Model of Communication for Message-passing Applications. https://t.co/cbL4zLdLK3 https://t.co/Gl5WGg5kY9
ComputerPapers: MP net as Abstract Model of Communication for Message-passing Applications. https://t.co/bclM3FsLPS
Github
None.
Youtube
None.
Other stats
Sample Sizes : None.
Authors: 1
Total Words: 7433
Unqiue Words: 2157

2.0 Mikeys
#3. Distributed Transactional Systems Cannot Be Fast
Diego Didona, Panagiota Fatourou, Rachid Guerraoui, Jingjing Wang, Willy Zwaenepoel
We prove that no fully transactional system can provide fast read transactions (including read-only ones that are considered the most frequent in practice). Specifically, to achieve fast read transactions, the system has to give up support of transactions that write more than one object. We prove this impossibility result for distributed storage systems that are causally consistent, i.e., they do not require to ensure any strong form of consistency. Therefore, our result holds also for any system that ensures a consistency level stronger than causal consistency, e.g., strict serializability. The impossibility result holds even for systems that store only two objects (and support at least two servers and at least four clients). It also holds for systems that are partially replicated. Our result justifies the design choices of state-of-the-art distributed transactional systems and insists that system designers should not put more effort to design fully-functional systems that support both fast read transactions and ensure causal or...
more | pdf | html
Figures
Tweets
ComputerPapers: Distributed Transactional Systems Cannot Be Fast. https://t.co/qJPR0KGhsn
Github
None.
Youtube
None.
Other stats
Sample Sizes : None.
Authors: 5
Total Words: 23872
Unqiue Words: 2883

2.0 Mikeys
#4. An Energy-Efficient Resource Management System for a Mobile Ad Hoc Cloud
Sayed Chhattan Shah
Recently, mobile ad hoc clouds have emerged as a promising technology for mobile cyber-physical system applications, such as mobile intelligent video surveillance and smart homes. Resource management plays a key role in maximizing resource utilization and application performance in mobile ad hoc clouds. Unlike resource management in traditional distributed computing systems, such as clouds, resource management in a mobile ad hoc cloud poses numerous challenges owing to the node mobility, limited battery power, high latency, and the dynamic network environment. The real-time requirements associated with mobile cyber-physical system applications make the problem even more challenging. Currently, existing resource management systems for mobile ad hoc clouds are not designed to support mobile cyber-physical system applications and energy-efficient communication between application tasks. In this paper, we propose a new energy-efficient resource management system for mobile ad hoc clouds. The proposed system consists of two layers: a...
more | pdf | html
Figures
Tweets
ComputerPapers: An Energy-Efficient Resource Management System for a Mobile Ad Hoc Cloud. https://t.co/9vfVmLs1Kk
Github
None.
Youtube
None.
Other stats
Sample Sizes : None.
Authors: 1
Total Words: 10013
Unqiue Words: 2482

2.0 Mikeys
#5. Multi-hop Byzantine Reliable Broadcast Made Practical
Silvia Bonomi, Giovanni Farina, Sébastien Tixeuil
We revisit Byzantine tolerant reliable broadcast algorithms in multi-hop networks. To tolerate up to f Byzantine nodes, previous solutions require a factorial number of messages to be sent over the network if the messages are not authenticated (e.g. digital signatures are not available). We propose optimizations that preserve the safety and liveness properties of the original unauthenticated protocols, while highly decreasing their observed message complexity when simulated on several classes of graph topologies.
more | pdf | html
Figures
Tweets
ComputerPapers: Multi-hop Byzantine Reliable Broadcast Made Practical. https://t.co/YCLN2v7AMP
Github
None.
Youtube
None.
Other stats
Sample Sizes : [150, 200, 150, 200]
Authors: 3
Total Words: 10149
Unqiue Words: 2288

About

Assert is a website where the best academic papers on arXiv (computer science, math, physics), bioRxiv (biology), BITSS (reproducibility), EarthArXiv (earth science), engrXiv (engineering), LawArXiv (law), PsyArXiv (psychology), SocArXiv (social science), and SportRxiv (sport research) bubble to the top each day.

Papers are scored (in real-time) based on how verifiable they are (as determined by their Github repos) and how interesting they are (based on Twitter).

To see top papers, follow us on twitter @assertpub_ (arXiv), @assert_pub (bioRxiv), and @assertpub_dev (everything else).

To see beautiful figures extracted from papers, follow us on Instagram.

Tracking 99,586 papers.

Search
Sort results based on if they are interesting or reproducible.
Interesting
Reproducible
Categories
All
Astrophysics
Cosmology and Nongalactic Astrophysics
Earth and Planetary Astrophysics
Astrophysics of Galaxies
High Energy Astrophysical Phenomena
Instrumentation and Methods for Astrophysics
Solar and Stellar Astrophysics
Condensed Matter
Disordered Systems and Neural Networks
Mesoscale and Nanoscale Physics
Materials Science
Other Condensed Matter
Quantum Gases
Soft Condensed Matter
Statistical Mechanics
Strongly Correlated Electrons
Superconductivity
Computer Science
Artificial Intelligence
Hardware Architecture
Computational Complexity
Computational Engineering, Finance, and Science
Computational Geometry
Computation and Language
Cryptography and Security
Computer Vision and Pattern Recognition
Computers and Society
Databases
Distributed, Parallel, and Cluster Computing
Digital Libraries
Discrete Mathematics
Data Structures and Algorithms
Emerging Technologies
Formal Languages and Automata Theory
General Literature
Graphics
Computer Science and Game Theory
Human-Computer Interaction
Information Retrieval
Information Theory
Machine Learning
Logic in Computer Science
Multiagent Systems
Multimedia
Mathematical Software
Numerical Analysis
Neural and Evolutionary Computing
Networking and Internet Architecture
Other Computer Science
Operating Systems
Performance
Programming Languages
Robotics
Symbolic Computation
Sound
Software Engineering
Social and Information Networks
Systems and Control
Economics
Econometrics
General Economics
Theoretical Economics
Electrical Engineering and Systems Science
Audio and Speech Processing
Image and Video Processing
Signal Processing
General Relativity and Quantum Cosmology
General Relativity and Quantum Cosmology
High Energy Physics - Experiment
High Energy Physics - Experiment
High Energy Physics - Lattice
High Energy Physics - Lattice
High Energy Physics - Phenomenology
High Energy Physics - Phenomenology
High Energy Physics - Theory
High Energy Physics - Theory
Mathematics
Commutative Algebra
Algebraic Geometry
Analysis of PDEs
Algebraic Topology
Classical Analysis and ODEs
Combinatorics
Category Theory
Complex Variables
Differential Geometry
Dynamical Systems
Functional Analysis
General Mathematics
General Topology
Group Theory
Geometric Topology
History and Overview
Information Theory
K-Theory and Homology
Logic
Metric Geometry
Mathematical Physics
Numerical Analysis
Number Theory
Operator Algebras
Optimization and Control
Probability
Quantum Algebra
Rings and Algebras
Representation Theory
Symplectic Geometry
Spectral Theory
Statistics Theory
Mathematical Physics
Mathematical Physics
Nonlinear Sciences
Adaptation and Self-Organizing Systems
Chaotic Dynamics
Cellular Automata and Lattice Gases
Pattern Formation and Solitons
Exactly Solvable and Integrable Systems
Nuclear Experiment
Nuclear Experiment
Nuclear Theory
Nuclear Theory
Physics
Accelerator Physics
Atmospheric and Oceanic Physics
Applied Physics
Atomic and Molecular Clusters
Atomic Physics
Biological Physics
Chemical Physics
Classical Physics
Computational Physics
Data Analysis, Statistics and Probability
Physics Education
Fluid Dynamics
General Physics
Geophysics
History and Philosophy of Physics
Instrumentation and Detectors
Medical Physics
Optics
Plasma Physics
Popular Physics
Physics and Society
Space Physics
Quantitative Biology
Biomolecules
Cell Behavior
Genomics
Molecular Networks
Neurons and Cognition
Other Quantitative Biology
Populations and Evolution
Quantitative Methods
Subcellular Processes
Tissues and Organs
Quantitative Finance
Computational Finance
Economics
General Finance
Mathematical Finance
Portfolio Management
Pricing of Securities
Risk Management
Statistical Finance
Trading and Market Microstructure
Quantum Physics
Quantum Physics
Statistics
Applications
Computation
Methodology
Machine Learning
Other Statistics
Statistics Theory
Feedback
Online
Stats
Tracking 99,586 papers.