There has been an explosion of multimodal content generated on social media
networks in the last few years, which has necessitated a deeper understanding
of social media content and user behavior. We present a novel
content-independent content-user-reaction model for social multimedia content
analysis. Compared to prior works that generally tackle semantic content
understanding and user behavior modeling in isolation, we propose a generalized
solution to these problems within a unified framework. We embed users, images
and text drawn from open social media in a common multimodal geometric space,
using a novel loss function designed to cope with distant and disparate
modalities, and thereby enable seamless three-way retrieval. Our model not only
outperforms unimodal embedding based methods on cross-modal retrieval tasks but
also shows improvements stemming from jointly solving the two tasks on Twitter
data. We also show that the user embeddings learned within our joint multimodal
embedding model are better at predicting user...

more |
pdf
| html
BrundageBot:
Deep Unified Multimodal Embeddings for Understanding both Content and Users in Social Media Networks. Karan Sikka, Lucas Van Bramer, and Ajay Divakaran https://t.co/RNacKvdBdm

arxiv_cscv:
Deep Unified Multimodal Embeddings for Understanding both Content and Users in Social Media Networks https://t.co/4R7L9logsp

arxiv_cscl:
Deep Unified Multimodal Embeddings for Understanding both Content and Users in Social Media Networks https://t.co/4kfcEd2SJS

SRoyLee:
Deep Unified Multimodal Embeddings for Understanding both Content and Users in Social Media Networks - https://t.co/XOPbLIlfWS

DanielAdamec5:
Deep Unified Multimodal Embeddings for Understanding both Content and Users in Social Media Networks. https://t.co/TdynVDeU87

None.

None.

Sample Sizes : None.

Authors: 3

Total Words: 15136

Unqiue Words: 3396

This paper targets to a novel but practical recommendation problem named
exact-K recommendation. It is different from traditional top-K recommendation,
as it focuses more on (constrained) combinatorial optimization which will
optimize to recommend a whole set of K items called card, rather than ranking
optimization which assumes that "better" items should be put into top
positions. Thus we take the first step to give a formal problem definition, and
innovatively reduce it to Maximum Clique Optimization based on graph. To tackle
this specific combinatorial optimization problem which is NP-hard, we propose
Graph Attention Networks (GAttN) with a Multi-head Self-attention encoder and a
decoder with attention mechanism. It can end-to-end learn the joint
distribution of the K items and generate an optimal card rather than rank
individual items by prediction scores. Then we propose Reinforcement Learning
from Demonstrations (RLfD) which combines the advantages in behavior cloning
and reinforcement learning, making it sufficient-...

more |
pdf
| html
arxiv_cs_LG:
Exact-K Recommendation via Maximal Clique Optimization. Yu Gong, Yu Zhu, Lu Duan, Qingwen Liu, Ziyu Guan, Fei Sun, Wenwu Ou, and Kenny Q. Zhu https://t.co/DqKsj3WvWp

None.

None.

Sample Sizes : [50, 20, 50, 20, 50, 50, 20, 20, 20]

Authors: 8

Total Words: 9546

Unqiue Words: 2722

Memory-based collaborative filtering methods like user or item k-nearest
neighbors (kNN) are a simple yet effective solution to the recommendation
problem. The backbone of these methods is the estimation of the empirical
similarity between users/items. In this paper, we analyze the spectral
properties of the Pearson and the cosine similarity estimators, and we use
tools from random matrix theory to argue that they suffer from noise and
eigenvalues spreading. We argue that, unlike the Pearson correlation, the
cosine similarity naturally possesses the desirable property of eigenvalue
shrinkage for large eigenvalues. However, due to its zero-mean assumption, it
overestimates the largest eigenvalues. We quantify this overestimation and
present a simple re-scaling and noise cleaning scheme. This results in better
performance of the memory-based methods compared to their vanilla counterparts.

more |
pdf
| html
None.

arxiv_cs_LG:
Cleaned Similarity for Better Memory-Based Recommenders. Farhan Khawar and Nevin L. Zhang https://t.co/Jstq7PwKzG

None.

None.

Sample Sizes : None.

Authors: 2

Total Words: 0

Unqiue Words: 0

Assert is a website where the best academic papers on arXiv (computer science, math, physics), bioRxiv (biology), BITSS (reproducibility), EarthArXiv (earth science), engrXiv (engineering), LawArXiv (law), PsyArXiv (psychology), SocArXiv (social science), and SportRxiv (sport research) bubble to the top each day.

Papers are scored (in real-time) based on how verifiable they are (as determined by their Github repos) and how interesting they are (based on Twitter).

To see top papers, follow us on twitter @assertpub_ (arXiv), @assert_pub (bioRxiv), and @assertpub_dev (everything else).

To see beautiful figures extracted from papers, follow us on Instagram.

*Tracking 128,327 papers.*

Sort results based on if they are interesting or reproducible.

Interesting

Reproducible