Learning from Demonstration in the Wild
Learning from demonstration (LfD) is useful in settings where hand-coding behaviour or a reward function is impractical. It has succeeded in a wide range of problems but typically relies on artificially generated demonstrations or specially deployed sensors and has not generally been able to leverage the copious demonstrations available in the wild: those that capture behaviour that was occurring anyway using sensors that were already deployed for another purpose, e.g., traffic camera footage capturing demonstrations of natural behaviour of vehicles, cyclists, and pedestrians. We propose video to behaviour (ViBe), a new approach to learning models of road user behaviour that requires as input only unlabelled raw video data of a traffic scene collected from a single, monocular, uncalibrated camera with ordinary resolution. Our approach calibrates the camera, detects relevant objects, tracks them through time, and uses the resulting trajectories to perform LfD, yielding models of naturalistic behaviour. We apply ViBe to raw videos of a traffic intersection and show that it can learn purely from videos, without additional expert knowledge.
Authors

Are you an author of this paper? Check the Twitter handle we have for you is correct.

Feryal Behbahani (add twitter)
Kyriacos Shiarlis (edit)
Xi Chen (edit)
Vitaly Kurin (add twitter)
Sudhanshu Kasewa (add twitter)
Ciprian Stirbu (add twitter)
João Gomes (edit)
Supratik Paul (add twitter)
Frans A. Oliehoek (edit)
João Messias (add twitter)
Shimon Whiteson (edit)
Ask The Authors

Ask the authors of this paper a question or leave a comment.

Read it. Rate it.
#1. Which part of the paper did you read?

#2. The paper contains new data or analyses that is openly accessible?
#3. The conclusion is supported by the data and analyses?
#4. The conclusion is of scientific interest?
#5. The result is likely to lead to future research?

Github
User:
None (add)
Repo:
None (add)
Stargazers:
0
Forks:
0
Open Issues:
0
Network:
0
Subscribers:
0
Language:
None
Youtube
Link:
None (add)
Views:
0
Likes:
0
Dislikes:
0
Favorites:
0
Comments:
0
Other
Sample Sizes (N=):
Inserted:
Words Total:
Words Unique:
Source:
Abstract:
None
11/08/18 06:02PM
6,376
2,079
Tweets
shvechikov_p: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
Krishna_DN94: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
ShumonLahiri: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
arxiv_pop: 2018/11/08 投稿 1位 LG(Machine Learning) Learning from Demonstration in the Wild https://t.co/PIO0fukoqO 4 Tweets 35 Retweets 107 Favorites
pieroleo: Video to behaviors. Interesting field and paper when you have to learn from real examples collected from the wild such us CCTV for self drive cars. https://t.co/pooWPOtG7g
medipixel1: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
IgorCarron: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
ParisMLgroup: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
michellexyeo: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
yegSchoolofAI: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
MARTINSARABIA16: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
nimblel: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
Nick_Mahon: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
faoliehoek: @roxarad nice presentation yesterday! Check out our paper https://t.co/j9LijPphUA for the pointers I mentioned. Let me know if you want to discuss. Cheers!
ComputerPapers: Learning from Demonstration in the Wild. https://t.co/MebwD5xJVo
shreyasgite: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
thenamessayan: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
SoloGen: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
afagarap: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
avijit9d: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
montrealdotai: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
fadsjhfa: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
dennybritz: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
_ashish_m: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
eturner303: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
Miles_Brundage: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
omnidelic: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
alfcnz: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
ReedRoof: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
yogthos: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
PerthMLGroup: RT @Miles_Brundage: "Learning from Demonstration in the Wild," @FeryalMP et al.: https://t.co/kJsftWGKMv
ericjang11: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
olgaiv39: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
ayirpelle: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
chiefaiofficers: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
UweAimeVan: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
CMRLW: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
markkula: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
kastnerkyle: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
russell_lliu: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
HubBucket: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
Montreal_IA: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
Quebec_AI: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
ceobillionaire: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
awjuliani: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
farhanhubble: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
Nour_Alcivilian: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
milesj6: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
cghosh_: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
seriousssam: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
olivercameron: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
olivercameron: 🚨 Cool paper alert: "Learning from Demonstration in the Wild" by the @Latent_Logic team. They attempt to infer human driving behavior from raw CCTV footage, and plan to inject these behaviors into AV simulators. https://t.co/OJEB7SPkBi https://t.co/txArizE13e
deeplearning4j: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
tyrell_turing: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
BlyNotes: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
AlexGuoHan: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
janexwang: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
d_kangin: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
Montreal_AI: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
PatrickOmid: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
heghbalz: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
AssistedEvolve: RT @Miles_Brundage: "Learning from Demonstration in the Wild," @FeryalMP et al.: https://t.co/kJsftWGKMv
n_aulakh: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
schwarzjn_: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
kraken_2309: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
_rockt: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
ElectronNest: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
alapite: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
pczzy: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
ankurhandos: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
kuanchen22: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
AlisonBLowndes: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
devnag: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
JeanMarcJAzzi: RT @Miles_Brundage: "Learning from Demonstration in the Wild," @FeryalMP et al.: https://t.co/kJsftWGKMv
boelger: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
y0b1byte: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
eleurent: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
mat_kelcey: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
sennraf: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
KaiLashArul: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
JeanMarcJAzzi: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
KyriacosShiarli: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
whi_rl: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
teenvan1995: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
Azhag: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
hardmaru: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
luisa_zintgraf: RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte…
FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte @faoliehoek @shimon8282 and others. TLDR video with behaviours: https://t.co/Lq5LjEQATy
y0b1byte: RT @Miles_Brundage: "Learning from Demonstration in the Wild," @FeryalMP et al.: https://t.co/kJsftWGKMv
arxivml: "Learning from Demonstration in the Wild", Feryal Behbahani, Kyriacos Shiarlis, Xi Chen, Vitaly Kurin, Sudhanshu Ka… https://t.co/Mc78LwwnFu
BrundageBot: Learning from Demonstration in the Wild. Feryal Behbahani, Kyriacos Shiarlis, Xi Chen, Vitaly Kurin, Sudhanshu Kasewa, Ciprian Stirbu, João Gomes, Supratik Paul, Frans A. Oliehoek, João Messias, and Shimon Whiteson https://t.co/9qhsOifQbV
robotic_hands: RT @Miles_Brundage: "Learning from Demonstration in the Wild," @FeryalMP et al.: https://t.co/kJsftWGKMv
Miles_Brundage: "Learning from Demonstration in the Wild," @FeryalMP et al.: https://t.co/kJsftWGKMv
Images
Related