Skip to main content
placeholder image

Human Action Segmentation Based on a Streaming Uniform Entropy Slice Method

Journal Article


Abstract


  • Segmentation of human actions is a major research problem in video understanding. A number of existing approaches demonstrate that performing action segmentation before action recognition results in better recognition performance. In this paper, we address the problem of action segmentation in an online manner. We first extend the clustering-based image segmentation approach into a temporal one, where hierarchical supervoxel levels for action segmentation are generated accordingly. We then propose a streaming approach to flatten the hierarchical levels into one based on Uniform Entropy Slice (UES), in order to preserve important information in the video. The flattened level contains the silhouette of a huamn with the structure of body parts labelled in different labels. We then combine the human structure information and the original video frames to & #x201C;strengthen & #x201D; the action in a video, which paves the way for accurate action recognition. The experimental results show that our online approach achieves satisfactory performance regarding action segmentation or recognition on various publicly available datasets, including the DAVIS dataset, the UCF Sports dataset,and the KTH dataset.

UOW Authors


  •   Peng, Cheng (external author)
  •   Lo, Sio-Long (external author)
  •   Huang, Jie (external author)
  •   Tsoi, Ah Chung

Publication Date


  • 2018

Citation


  • Peng, C., Lo, S., Huang, J. & Tsoi, A. (2018). Human Action Segmentation Based on a Streaming Uniform Entropy Slice Method. IEEE Access, 6 16958-16971.

Scopus Eid


  • 2-s2.0-85040068462

Number Of Pages


  • 13

Start Page


  • 16958

End Page


  • 16971

Volume


  • 6

Place Of Publication


  • United States

Abstract


  • Segmentation of human actions is a major research problem in video understanding. A number of existing approaches demonstrate that performing action segmentation before action recognition results in better recognition performance. In this paper, we address the problem of action segmentation in an online manner. We first extend the clustering-based image segmentation approach into a temporal one, where hierarchical supervoxel levels for action segmentation are generated accordingly. We then propose a streaming approach to flatten the hierarchical levels into one based on Uniform Entropy Slice (UES), in order to preserve important information in the video. The flattened level contains the silhouette of a huamn with the structure of body parts labelled in different labels. We then combine the human structure information and the original video frames to & #x201C;strengthen & #x201D; the action in a video, which paves the way for accurate action recognition. The experimental results show that our online approach achieves satisfactory performance regarding action segmentation or recognition on various publicly available datasets, including the DAVIS dataset, the UCF Sports dataset,and the KTH dataset.

UOW Authors


  •   Peng, Cheng (external author)
  •   Lo, Sio-Long (external author)
  •   Huang, Jie (external author)
  •   Tsoi, Ah Chung

Publication Date


  • 2018

Citation


  • Peng, C., Lo, S., Huang, J. & Tsoi, A. (2018). Human Action Segmentation Based on a Streaming Uniform Entropy Slice Method. IEEE Access, 6 16958-16971.

Scopus Eid


  • 2-s2.0-85040068462

Number Of Pages


  • 13

Start Page


  • 16958

End Page


  • 16971

Volume


  • 6

Place Of Publication


  • United States