Skip to main content
placeholder image

Learning a pose lexicon for semantic action recognition

Conference Paper


Download full-text (Open Access)

Abstract


  • This paper presents a novel method for learning a pose lexicon comprising semantic poses defined by textual instructions and their associated visual poses defined by visual features. The proposed method simultaneously takes two input streams, semantic poses and visual pose candidates, and statistically learns a mapping between them to construct the lexicon. With the learned lexicon, action recognition can be cast as the problem of finding the maximum translation probability of a sequence of semantic poses given a stream of visual pose candidates. Experiments evaluating pre-trained and zero-shot action recognition conducted on MSRC-12 gesture and WorkoutSu-10 exercise datasets were used to verify the efficacy of the proposed method.

Publication Date


  • 2016

Citation


  • Zhou, L., Li, W. & Ogunbona, P. (2016). Learning a pose lexicon for semantic action recognition. 2016 IEEE International Conference on Multimedia and Expo (ICME) (pp. 1-6). United States: IEEE.

Scopus Eid


  • 2-s2.0-84987638068

Ro Full-text Url


  • http://ro.uow.edu.au/cgi/viewcontent.cgi?article=7068&context=eispapers

Ro Metadata Url


  • http://ro.uow.edu.au/eispapers/6038

Start Page


  • 1

End Page


  • 6

Abstract


  • This paper presents a novel method for learning a pose lexicon comprising semantic poses defined by textual instructions and their associated visual poses defined by visual features. The proposed method simultaneously takes two input streams, semantic poses and visual pose candidates, and statistically learns a mapping between them to construct the lexicon. With the learned lexicon, action recognition can be cast as the problem of finding the maximum translation probability of a sequence of semantic poses given a stream of visual pose candidates. Experiments evaluating pre-trained and zero-shot action recognition conducted on MSRC-12 gesture and WorkoutSu-10 exercise datasets were used to verify the efficacy of the proposed method.

Publication Date


  • 2016

Citation


  • Zhou, L., Li, W. & Ogunbona, P. (2016). Learning a pose lexicon for semantic action recognition. 2016 IEEE International Conference on Multimedia and Expo (ICME) (pp. 1-6). United States: IEEE.

Scopus Eid


  • 2-s2.0-84987638068

Ro Full-text Url


  • http://ro.uow.edu.au/cgi/viewcontent.cgi?article=7068&context=eispapers

Ro Metadata Url


  • http://ro.uow.edu.au/eispapers/6038

Start Page


  • 1

End Page


  • 6