Predicting Long-Term Skeletal Motions by a Spatio-Temporal Hierarchical Recurrent Network
The primary goal of skeletal motion prediction is to generate future motion by observing a sequence of 3D skeletons. A key challenge in motion prediction is the fact that a motion can often be performed in several different ways, with each consisting of its own configuration of poses and their spatio-temporal dependencies, and as a result, the predicted poses often converge to the motionless poses or non-human like motions in long-term prediction. This leads us to define a hierarchical recurrent network model that explicitly characterizes these internal configurations of poses and their local and global spatio-temporal dependencies. The model introduces a latent vector variable from the Lie algebra to represent spatial and temporal relations simultaneously. Furthermore, a structured stack LSTM-based decoder is devised to decode the predicted poses with a new loss function defined to estimate the quantized weight of each body part in a pose. Empirical evaluations on benchmark datasets suggest our approach significantly outperforms the state-of-the-art methods on both short-term and long-term motion prediction.
NurtureToken New!

Token crowdsale for this paper ends in

Buy Nurture Tokens

Authors

Are you an author of this paper? Check the Twitter handle we have for you is correct.

Junfeng Hu (edit)
Zhencheng Fan (add twitter)
Jun Liao (edit)
Li Liu (edit)
Ask The Authors

Ask the authors of this paper a question or leave a comment.

Read it. Rate it.
#1. Which part of the paper did you read?

#2. The paper contains new data or analyses that is openly accessible?
#3. The conclusion is supported by the data and analyses?
#4. The conclusion is of scientific interest?
#5. The result is likely to lead to future research?

Github
User:
Stargazers:
3
Forks:
0
Open Issues:
0
Network:
0
Subscribers:
0
Language:
Python
pytorch version of Generating Recognizable Long-term Articulated Objects Motion via Spatio-Temporal Hierarchical Recurrent Network
Youtube
Link:
None (add)
Views:
0
Likes:
0
Dislikes:
0
Favorites:
0
Comments:
0
Other
Sample Sizes (N=):
Inserted:
Words Total:
Words Unique:
Source:
Abstract:
None
11/06/19 06:02PM
6,927
2,227
Tweets
func_hs: RT @arxiv_cscv: Predicting Long-Term Skeletal Motions by a Spatio-Temporal Hierarchical Recurrent Network https://t.co/ckxswK9Xd9
yitabashi: RT @arxiv_cscv: Predicting Long-Term Skeletal Motions by a Spatio-Temporal Hierarchical Recurrent Network https://t.co/ckxswK9Xd9
arxiv_cs_cv_pr: Predicting Long-Term Skeletal Motions by a Spatio-Temporal Hierarchical Recurrent Network. Junfeng Hu, Zhencheng Fan, Jun Liao, and Li Liu https://t.co/kzvxLApt3W
arxiv_cscv: Predicting Long-Term Skeletal Motions by a Spatio-Temporal Hierarchical Recurrent Network https://t.co/ckxswK9Xd9
Feldman1Michael: RT @roadrunning01: Predicting Long-Term Skeletal Motions by a Spatio-Temporal Hierarchical Recurrent Network pdf: https://t.co/BI8NO87mD3 a…
arxivml: "Predicting Long-Term Skeletal Motions by a Spatio-Temporal Hierarchical Recurrent Network", Junfeng Hu, Zhencheng … https://t.co/v59GvhbUXE
subhobrata1: RT @roadrunning01: Predicting Long-Term Skeletal Motions by a Spatio-Temporal Hierarchical Recurrent Network pdf: https://t.co/BI8NO87mD3 a…
sguada: RT @roadrunning01: Predicting Long-Term Skeletal Motions by a Spatio-Temporal Hierarchical Recurrent Network pdf: https://t.co/BI8NO87mD3 a…
arxiv_cscv: Predicting Long-Term Skeletal Motions by a Spatio-Temporal Hierarchical Recurrent Network https://t.co/ckxswK9Xd9
MassBassLol: RT @roadrunning01: Predicting Long-Term Skeletal Motions by a Spatio-Temporal Hierarchical Recurrent Network pdf: https://t.co/BI8NO87mD3 a…
MishakinSergey: RT @roadrunning01: Predicting Long-Term Skeletal Motions by a Spatio-Temporal Hierarchical Recurrent Network pdf: https://t.co/BI8NO87mD3 a…
Pol09122455: RT @roadrunning01: Predicting Long-Term Skeletal Motions by a Spatio-Temporal Hierarchical Recurrent Network pdf: https://t.co/BI8NO87mD3 a…
BrundageBot: Predicting Long-Term Skeletal Motions by a Spatio-Temporal Hierarchical Recurrent Network. Junfeng Hu, Zhencheng Fan, Jun Liao, and Li Liu https://t.co/pvDydLAbnU
EricSchles: RT @roadrunning01: Predicting Long-Term Skeletal Motions by a Spatio-Temporal Hierarchical Recurrent Network pdf: https://t.co/BI8NO87mD3 a…
syoyo: RT @roadrunning01: Predicting Long-Term Skeletal Motions by a Spatio-Temporal Hierarchical Recurrent Network pdf: https://t.co/BI8NO87mD3 a…
roadrunning01: Predicting Long-Term Skeletal Motions by a Spatio-Temporal Hierarchical Recurrent Network pdf: https://t.co/BI8NO87mD3 abs: https://t.co/pD6v0SVHF2 github: https://t.co/1BE11WN7eC project page: https://t.co/1k6STMwQTf https://t.co/gatVWERoMY
Images
Related