3D Human Pose Estimation from Deep Multi-View 2D Pose
Human pose estimation - the process of recognizing a human's limb positions and orientations in a video - has many important applications including surveillance, diagnosis of movement disorders, and computer animation. While deep learning has lead to great advances in 2D and 3D pose estimation from single video sources, the problem of estimating 3D human pose from multiple video sensors with overlapping fields of view has received less attention. When the application allows use of multiple cameras, 3D human pose estimates may be greatly improved through fusion of multi-view pose estimates and observation of limbs that are fully or partially occluded in some views. Past approaches to multi-view 3D pose estimation have used probabilistic graphical models to reason over constraints, including per-image pose estimates, temporal smoothness, and limb length. In this paper, we present a pipeline for multi-view 3D pose estimation of multiple individuals which combines a state-of-art 2D pose detector with a factor graph of 3D limb constraints optimized with belief propagation. We evaluate our results on the TUM-Campus and Shelf datasets for multi-person 3D pose estimation and show that our system significantly out-performs the previous state-of-the-art with a simpler model of limb dependency.
NurtureToken New!

Token crowdsale for this paper ends in

Buy Nurture Tokens

Authors

Are you an author of this paper? Check the Twitter handle we have for you is correct.

Steven Schwarcz (add twitter)
Thomas Pollard (add twitter)
Ask The Authors

Ask the authors of this paper a question or leave a comment.

Read it. Rate it.
#1. Which part of the paper did you read?

#2. The paper contains new data or analyses that is openly accessible?
#3. The conclusion is supported by the data and analyses?
#4. The conclusion is of scientific interest?
#5. The result is likely to lead to future research?

Github
User:
None (add)
Repo:
None (add)
Stargazers:
0
Forks:
0
Open Issues:
0
Network:
0
Subscribers:
0
Language:
None
Youtube
Link:
None (add)
Views:
0
Likes:
0
Dislikes:
0
Favorites:
0
Comments:
0
Other
Sample Sizes (N=):
Inserted:
Words Total:
Words Unique:
Source:
Abstract:
None
02/10/19 06:05PM
5,339
1,845
Tweets
arxivml: "3D Human Pose Estimation from Deep Multi-View 2D Pose", Steven Schwarcz, Thomas Pollard https://t.co/oc51WkwZZz
arxiv_cscv: 3D Human Pose Estimation from Deep Multi-View 2D Pose https://t.co/GC4xmGKkz7
shubh_300595: RT @arxiv_org: 3D Human Pose Estimation from Deep Multi-View 2D Pose. https://t.co/Uv9UfpHQwC https://t.co/FVj9HpZQ6e
robotic_hands: RT @arxiv_org: 3D Human Pose Estimation from Deep Multi-View 2D Pose. https://t.co/Uv9UfpHQwC https://t.co/FVj9HpZQ6e
syoyo: RT @arxiv_org: 3D Human Pose Estimation from Deep Multi-View 2D Pose. https://t.co/Uv9UfpHQwC https://t.co/FVj9HpZQ6e
arxiv_org: 3D Human Pose Estimation from Deep Multi-View 2D Pose. https://t.co/Uv9UfpHQwC https://t.co/FVj9HpZQ6e
jastner109: RT @arxiv_cscv: 3D Human Pose Estimation from Deep Multi-View 2D Pose https://t.co/GC4xmGKkz7
arxiv_cscv: 3D Human Pose Estimation from Deep Multi-View 2D Pose https://t.co/GC4xmGKkz7
BrundageBot: 3D Human Pose Estimation from Deep Multi-View 2D Pose. Steven Schwarcz and Thomas Pollard https://t.co/w5uBGoNnBC
Images
Related