Parallel online time warping for real-time audio-to-score alignment in multi-core systems

详细信息    查看全文

• 作者：Pedro Alonso ; Raquel Cortina ; F. J. Rodríguez-Serrano…
• 关键词：Audio ; to ; score alignment ; Dynamic time warping (DTW) ; Score following ; Parallel computing ; Xeon Phi ; ARM
• 刊名：The Journal of Supercomputing
• 出版年：2017
• 出版时间：January 2017
• 年：2017
• 卷：73
• 期：1
• 页码：126-138
• 全文大小：
• 刊物类别：Computer Science
• 刊物主题：Programming Languages, Compilers, Interpreters; Processor Architectures; Computer Science, general;
• 出版者：Springer US
• ISSN：1573-0484
• 卷排序：73

文摘

The audio-to-score framework consists of two separate stages: preprocessing and alignment. The alignment is commonly solved through offline dynamic time warping (DTW), which is a method to find the path over the distortion matrix with the minimum cost to determine the relation between the performance and the musical score times. In this work we propose a parallel online DTW solution based on a client–server architecture. The current version of the application has been implemented for multi-core architectures (\(\times \)86, \(\times \)64 and ARM), thus covering either powerful systems or mobile devices. An extensive experimentation has been conducted to validate the software. The experiments also show that our framework allows to achieve a good score alignment within the real-time window using parallel computing techniques.