Unsupervised video object segmentation by spatiotemporal graphical model
详细信息 查看全文
- 作者：Lijun Guo ; Tingting Cheng ; Yuanjie Huang ; Jieyu Zhao…
- 关键词：Unsupervised ; Spatiotemporal smoothness ; Supervoxel ; Conditional random field
- 刊名：Multimedia Tools and Applications
- 出版年：2017
- 出版时间：January 2017
- 年：2017
- 卷：76
- 期：1
- 页码：1037-1053
- 全文大小：
- 刊物类别：Computer Science
- 刊物主题：Multimedia Information Systems; Computer Communication Networks; Data Structures, Cryptology and Information Theory; Special Purpose and Application-Based Systems;
- 出版者：Springer US
- ISSN：1573-7721
- 卷排序：76
文摘
We propose a novel spatiotemporal graphical model for unsupervised video object segmentation. The core of our model is a layered-CRF (conditional random field) that contains two layers, i.e., pixel layer and supervoxel layer. First, the heat diffusion based segmentation and salient region detection is integrated to obtain the segmentation results of the first frame. The results are used as input seeds to train dual probabilistic models of each object class. In the spatiotemporal layered-CRF framework we extend binary segmentation to multiple object segmentation. We add intra-frame spatial matching potential and inter-frame temporal supervoxels consistent potential to link the pixel layer and the supervoxel layer. This improves the spatiotemporal smoothing throughout the video sequence in the proposed model. The proposed unsupervised method lightens the burden of labeling training samples and obtains a smooth and accurate object boundary in video segmentation. The experiments on two public datasets demonstrate that our method outperforms several state-of-the-art methods in both single and multiple foreground cases.