Parallel ensemble of online sequential extreme learning machine based on MapReduce

详细信息    查看全文

• 作者：Shan Huang ^{huangshan.neu@gmail.com" class="auth_mail" title="E-mail the corresponding author}Author Vitae ; Botao Wang ; ^{wangbotao@ise.neu.edu.cn" class="auth_mail" title="E-mail the corresponding author}Author Vitae ; Junhao Qiu ^{lqqiujunhao@163.com" class="auth_mail" title="E-mail the corresponding author}Author Vitae ; Jitao Yao ^{tao00800@126.com" class="auth_mail" title="E-mail the corresponding author}Author Vitae ; Guoren Wang ^{wanggr@ise.neu.edu.cn" class="auth_mail" title="E-mail the corresponding author}Author Vitae ; Ge Yu ^{yuge@ise.neu.edu.cn" class="auth_mail" title="E-mail the corresponding author}Author Vitae
• 关键词：Parallel learning ; Ensemble ; Extreme learning machine ; MapReduce ; Sequential learning
• 刊名：Neurocomputing
• 出版年：2016
• 出版时间：22 January 2016
• 年：2016
• 卷：174
• 期：part_PA
• 页码：352-367
• 全文大小：1659 K

文摘

In this era of big data, analyzing large scale data efficiently and accurately has become a challenging problem. As one of the ELM variants, online sequential extreme learning machine (OS-ELM) provides a method to analyze incremental data. Ensemble methods provide a way to learn from data more accurately. MapReduce, which provides a simple, scalable and fault-tolerant framework, can be utilized for large scale learning. In this paper, we first propose an ensemble OS-ELM framework which supports any combination of bagging, subspace partitioning and cross validation. Then we design a parallel ensemble of online sequential extreme learning machine (PEOS-ELM) algorithm based on MapReduce for large scale learning. PEOS-ELM algorithm is evaluated with real and synthetic data with the maximum number of training data 5120K and the maximum number of attributes 512. The speedup of this algorithm reaches as high as 40 on a cluster with maximum 80 cores. The accuracy of PEOS-ELM algorithm is at the same level as that of ensemble OS-ELM executing on a single machine, which is higher than that of the original OS-ELM.