Adaptive edge weighting for graph-based learning algorithms

详细信息    查看全文

• 作者：Masayuki Karasuyama ; Hiroshi Mamitsuka
• 关键词：Graph ; based learning ; Manifold assumption ; Edge weighting ; Semi ; supervised learning ; Clustering
• 刊名：Machine Learning
• 出版年：2017
• 出版时间：February 2017
• 年：2017
• 卷：106
• 期：2
• 页码：307-335
• 全文大小：
• 刊物类别：Computer Science
• 刊物主题：Artificial Intelligence (incl. Robotics); Control, Robotics, Mechatronics; Computing Methodologies; Simulation and Modeling; Language Translation and Linguistics;
• 出版者：Springer US
• ISSN：1573-0565
• 卷排序：106

文摘

Graph-based learning algorithms including label propagation and spectral clustering are known as the effective state-of-the-art algorithms for a variety of tasks in machine learning applications. Given input data, i.e. feature vectors, graph-based methods typically proceed with the following three steps: (1) generating graph edges, (2) estimating edge weights and (3) running a graph based algorithm. The first and second steps are difficult, especially when there are only a few (or no) labeled instances, while they are important because the performance of graph-based methods heavily depends on the quality of the input graph. For the second step of the three-step procedure, we propose a new method, which optimizes edge weights through a local linear reconstruction error minimization under a constraint that edges are parameterized by a similarity function of node pairs. As a result our generated graph can capture the manifold structure of the input data, where each edge represents similarity of each node pair. To further justify this approach, we also provide analytical considerations for our formulation such as an interpretation as a cross-validation of a propagation model in the feature space, and an error analysis based on a low dimensional manifold model. Experimental results demonstrated the effectiveness of our adaptive edge weighting strategy both in synthetic and real datasets.