Skip to main content
placeholder image

Skeleton Optical Spectra-Based Action Recognition Using Convolutional Neural Networks

Journal Article


Abstract


  • © 2016 IEEE. This letter presents an effective method to encode the spatiotemporal information of a skeleton sequence into color texture images, referred to as skeleton optical spectra, and employs convolutional neural networks (ConvNets) to learn the discriminative features for action recognition. Such spectrum representation makes it possible to use a standard ConvNet architecture to learn suitable 'dynamic' features from skeleton sequences without training millions of parameters afresh and it is especially valuable when there is insufficient annotated training video data. Specifically, the encoding consists of four steps: mapping of joint distribution, spectrum coding of joint trajectories, spectrum coding of body parts, and joint velocity weighted saturation and brightness. Experimental results on three widely used datasets have demonstrated the efficacy of the proposed method.

UOW Authors


  •   Hou, Yonghong (external author)
  •   Li, Zhaoyang (external author)
  •   Wang, Pichao (external author)
  •   Li, Wanqing

Publication Date


  • 2018

Citation


  • Hou, Y., Li, Z., Wang, P. & Li, W. (2018). Skeleton Optical Spectra-Based Action Recognition Using Convolutional Neural Networks. IEEE Transactions on Circuits and Systems for Video Technology, 28 (3), 807-811.

Scopus Eid


  • 2-s2.0-85042922293

Ro Metadata Url


  • http://ro.uow.edu.au/eispapers1/1354

Has Global Citation Frequency


Number Of Pages


  • 4

Start Page


  • 807

End Page


  • 811

Volume


  • 28

Issue


  • 3

Place Of Publication


  • United States

Abstract


  • © 2016 IEEE. This letter presents an effective method to encode the spatiotemporal information of a skeleton sequence into color texture images, referred to as skeleton optical spectra, and employs convolutional neural networks (ConvNets) to learn the discriminative features for action recognition. Such spectrum representation makes it possible to use a standard ConvNet architecture to learn suitable 'dynamic' features from skeleton sequences without training millions of parameters afresh and it is especially valuable when there is insufficient annotated training video data. Specifically, the encoding consists of four steps: mapping of joint distribution, spectrum coding of joint trajectories, spectrum coding of body parts, and joint velocity weighted saturation and brightness. Experimental results on three widely used datasets have demonstrated the efficacy of the proposed method.

UOW Authors


  •   Hou, Yonghong (external author)
  •   Li, Zhaoyang (external author)
  •   Wang, Pichao (external author)
  •   Li, Wanqing

Publication Date


  • 2018

Citation


  • Hou, Y., Li, Z., Wang, P. & Li, W. (2018). Skeleton Optical Spectra-Based Action Recognition Using Convolutional Neural Networks. IEEE Transactions on Circuits and Systems for Video Technology, 28 (3), 807-811.

Scopus Eid


  • 2-s2.0-85042922293

Ro Metadata Url


  • http://ro.uow.edu.au/eispapers1/1354

Has Global Citation Frequency


Number Of Pages


  • 4

Start Page


  • 807

End Page


  • 811

Volume


  • 28

Issue


  • 3

Place Of Publication


  • United States