Sparse regularization for semi-supervised classification

详细信息    查看全文

• 作者：Mingyu Fan^a ; ^{fanminyu@amss.ac.cn} ; Nannan Gu^b ; ^{gunannan@gmail.com} ; Hong Qiao^b ; ^{hong.qiao@ia.ac.cn} ; Bo Zhang^a ; ^{b.zhang@amt.ac.cn} [Author vitae]
• 关键词：Regularization theory ; Semi-supervised learning ; Regularized least square classification ; Dimensionality reduction
• 刊名：Pattern Recognition
• 出版年：2011
• 出版时间：August 2011
• 年：2011
• 卷：44
• 期：8
• 页码：1777-1784
• 全文大小：518 K

文摘

Manifold regularization (MR) is a promising regularization framework for semi-supervised learning, which introduces an additional penalty term to regularize the smoothness of functions on data manifolds and has been shown very effective in exploiting the underlying geometric structure of data for classification. It has been shown that the performance of the MR algorithms depends highly on the design of the additional penalty term on manifolds. In this paper, we propose a new approach to define the penalty term on manifolds by the sparse representations instead of the adjacency graphs of data. The process to build this novel penalty term has two steps. First, the best sparse linear reconstruction coefficients for each data point are computed by the l¹-norm minimization. Secondly, the learner is subject to a cost function which aims to preserve the sparse coefficients. The cost function is utilized as the new penalty term for regularization algorithms. Compared with previous semi-supervised learning algorithms, the new penalty term needs less input parameters and has strong discriminative power for classification. The least square classifier using our novel penalty term is proposed in this paper, which is called the Sparse Regularized Least Square Classification (S-RLSC) algorithm. Experiments on real-world data sets show that our algorithm is very effective.