Motivated by recent developments in serverless systems for large-scale
machine learning as well as improvements in scalable randomized matrix
algorithms, we develop OverSketched Newton, a randomized Hessian-based
optimization algorithm to solve large-scale smooth and strongly-convex problems
in serverless systems. OverSketched Newton leverages matrix sketching ideas
from Randomized Numerical Linear Algebra to compute the Hessian approximately.
These sketching methods lead to inbuilt resiliency against stragglers that are
a characteristic of serverless architectures. We establish that OverSketched
Newton has a linear-quadratic convergence rate, and we empirically validate our
results by solving large-scale supervised learning problems on real-world
datasets. Experiments demonstrate a reduction of ~50% in total running time on
AWS Lambda, compared to state-of-the-art distributed optimization schemes.

more |
pdf
| html
jasondavies:
@Underfox3 Wrong link: I think you meant “OverSketched Newton: Fast Convex Optimization for Serverless Systems” https://t.co/iZ9JUPxk7o ?

arxivml:
"OverSketched Newton: Fast Convex Optimization for Serverless Systems",
Vipul Gupta, Swanand Kadhe, Thomas Courtade…
https://t.co/rbRa3wSlvn

Underfox3:
Researchers have developed a randomized Hessian-based optimization algorithm to solve large-scale smooth and strongly-convex problems in serverless systems.
https://t.co/VgFpbE5U2a https://t.co/i6v0wn0z59

arxiv_cs_LG:
OverSketched Newton: Fast Convex Optimization for Serverless Systems. Vipul Gupta, Swanand Kadhe, Thomas Courtade, Michael W. Mahoney, and Kannan Ramchandran https://t.co/4wuf9qICBQ

Memoirs:
OverSketched Newton: Fast Convex Optimization for Serverless Systems. https://t.co/V7piTvms0k

This repo implements OverSketched Newton and other algorithms that can be used for fast large-scale convex optimization on serverless systems

Stargazers: 0

Subscribers: 0

Subscribers: 0

Forks: 1

Open Issues: 0

Open Issues: 0

None.

Sample Sizes : None.

Authors: 5

Total Words: 10263

Unqiue Words: 2652

MP net is a formal model specifically designed for the field of parallel
applications that use a message passing interface. The main idea is to use MP
net as a comprehensible way of presenting the actual structure of communication
within MPI applications. The goal is to provide users with the kind of feedback
that can help them to check quickly whether or not the actual communication
within their application corresponds to the intended one. This paper introduces
MP net that focuses on the communication part of parallel applications and
emphasizes its spatial character, which is rather hidden in sequential
(textual) form.

more |
pdf
| html
arxiv_org:
MP net as Abstract Model of Communication for Message-passing Applications. https://t.co/cbL4zLdLK3 https://t.co/Gl5WGg5kY9

ComputerPapers:
MP net as Abstract Model of Communication for Message-passing Applications. https://t.co/bclM3FsLPS

None.

None.

Sample Sizes : None.

Authors: 1

Total Words: 7433

Unqiue Words: 2157

We prove that no fully transactional system can provide fast read
transactions (including read-only ones that are considered the most frequent in
practice). Specifically, to achieve fast read transactions, the system has to
give up support of transactions that write more than one object. We prove this
impossibility result for distributed storage systems that are causally
consistent, i.e., they do not require to ensure any strong form of consistency.
Therefore, our result holds also for any system that ensures a consistency
level stronger than causal consistency, e.g., strict serializability. The
impossibility result holds even for systems that store only two objects (and
support at least two servers and at least four clients). It also holds for
systems that are partially replicated. Our result justifies the design choices
of state-of-the-art distributed transactional systems and insists that system
designers should not put more effort to design fully-functional systems that
support both fast read transactions and ensure causal or...

more |
pdf
| html
ComputerPapers:
Distributed Transactional Systems Cannot Be Fast. https://t.co/qJPR0KGhsn

None.

None.

Sample Sizes : None.

Authors: 5

Total Words: 23872

Unqiue Words: 2883

Recently, mobile ad hoc clouds have emerged as a promising technology for
mobile cyber-physical system applications, such as mobile intelligent video
surveillance and smart homes. Resource management plays a key role in
maximizing resource utilization and application performance in mobile ad hoc
clouds. Unlike resource management in traditional distributed computing
systems, such as clouds, resource management in a mobile ad hoc cloud poses
numerous challenges owing to the node mobility, limited battery power, high
latency, and the dynamic network environment. The real-time requirements
associated with mobile cyber-physical system applications make the problem even
more challenging. Currently, existing resource management systems for mobile ad
hoc clouds are not designed to support mobile cyber-physical system
applications and energy-efficient communication between application tasks. In
this paper, we propose a new energy-efficient resource management system for
mobile ad hoc clouds. The proposed system consists of two layers: a...

more |
pdf
| html
ComputerPapers:
An Energy-Efficient Resource Management System for a Mobile Ad Hoc Cloud. https://t.co/9vfVmLs1Kk

None.

None.

Sample Sizes : None.

Authors: 1

Total Words: 10013

Unqiue Words: 2482

We revisit Byzantine tolerant reliable broadcast algorithms in multi-hop
networks. To tolerate up to f Byzantine nodes, previous solutions require a
factorial number of messages to be sent over the network if the messages are
not authenticated (e.g. digital signatures are not available). We propose
optimizations that preserve the safety and liveness properties of the original
unauthenticated protocols, while highly decreasing their observed message
complexity when simulated on several classes of graph topologies.

more |
pdf
| html
ComputerPapers:
Multi-hop Byzantine Reliable Broadcast Made Practical. https://t.co/YCLN2v7AMP

None.

None.

Sample Sizes : [150, 200, 150, 200]

Authors: 3

Total Words: 10149

Unqiue Words: 2288

Assert is a website where the best academic papers on arXiv (computer science, math, physics), bioRxiv (biology), BITSS (reproducibility), EarthArXiv (earth science), engrXiv (engineering), LawArXiv (law), PsyArXiv (psychology), SocArXiv (social science), and SportRxiv (sport research) bubble to the top each day.

Papers are scored (in real-time) based on how verifiable they are (as determined by their Github repos) and how interesting they are (based on Twitter).

To see top papers, follow us on twitter @assertpub_ (arXiv), @assert_pub (bioRxiv), and @assertpub_dev (everything else).

To see beautiful figures extracted from papers, follow us on Instagram.

*Tracking 99,586 papers.*

Sort results based on if they are interesting or reproducible.

Interesting

Reproducible