Markov cross-validation for time series model evaluations
详细信息 查看全文
- 作者：Gaoxia Jiang jianggaoxia@sxu.edu.cn" class="auth_mail" title="E-mail the corresponding author ; Wenjian Wang ; wjwang@sxu.edu.cn" class="auth_mail" title="E-mail the corresponding author
- 关键词：Model evaluation ; Markov cross-validation ; Time series
- 刊名：Information Sciences
- 出版年：2017
- 出版时间：1 January 2017
- 年：2017
- 卷：375
- 期：Complete
- 页码：219-233
- 全文大小：728 K
文摘
Cross-validation (CV) is a simple and universal tool to estimate generalization ability, however, existing CVs do not work well for periodicity, overlapping or correlation of series. The corresponding three criteria aimed at describing these properties are presented. Based on them, we put forward a novel Markov cross-validation (M-CV), whose data partition can be seen as a Markov process. The partition ensures that samples in each subset are neither too close nor too far. In doing so, overfitting model or information loss of series, which may result in underestimation or overestimation of the error, can be avoided. Furthermore, subsets from M-CV partition could well represent the original series, and it may be extended to time series or stream data sampling. Theoretical analysis shows that M-CV is the unique one which meets all of above criteria among current CVs. In addition, the error estimation on subsets is proved to have less variance than that on original series, therefore it ensures the stability of M-CV. Experimental results demonstrate that the proposed M-CV has lower bias, variance and time consumption than other CVs.