Singular value decomposition (SVD) is a standard matrix factorization
technique that produces optimal low-rank approximations of matrices. It has
diverse applications, including machine learning, data science and signal
processing. However, many common problems involve very large matrices that
cannot fit in the main memory of commodity computers, making it impractical to
use standard SVD algorithms that assume fast random access or large amounts of
space for intermediate calculations. To address this issue, we have implemented
an out-of-core (external memory) randomized SVD solution that is fully scalable
and efficiently parallelizable. This solution factors both dense and sparse
matrices of arbitrarily large size within arbitrarily small memory limits,
efficiently using out-of-core storage as needed. It uses an innovative
technique for partitioning matrices that lends itself to out-of-core and
parallel processing, as well as memory and I/O use planning, automatic load
balancing, performance tuning, and makes possible a number of...

more |
pdf
| html
None.

None.

Sample Sizes : None.

Authors: 3

Total Words: 6212

Unqiue Words: 1896

Assert is a website where the best academic papers on arXiv (computer science, math, physics), bioRxiv (biology), BITSS (reproducibility), EarthArXiv (earth science), engrXiv (engineering), LawArXiv (law), PsyArXiv (psychology), SocArXiv (social science), and SportRxiv (sport research) bubble to the top each day.

Papers are scored (in real-time) based on how verifiable they are (as determined by their Github repos) and how interesting they are (based on Twitter).

To see top papers, follow us on twitter @assertpub_ (arXiv), @assert_pub (bioRxiv), and @assertpub_dev (everything else).

To see beautiful figures extracted from papers, follow us on Instagram.

*Tracking 158,360 papers.*

Sort results based on if they are interesting or reproducible.

Interesting

Reproducible