Particle Flow SMC-PHD Filter for Audio-Visual Multi-speaker Tracking

详细信息    查看全文

• 关键词：Audio ; visual tracking ; PHD filter ; SMC implementation ; Multi ; speaker tracking
• 刊名：Lecture Notes in Computer Science
• 出版年：2017
• 出版时间：2017
• 年：2017
• 卷：10169
• 期：1
• 页码：344-353
• 丛书名：Latent Variable Analysis and Signal Separation
• ISBN：978-3-319-53547-0
• 卷排序：10169

文摘

Sequential Monte Carlo probability hypothesis density (SMC-PHD) filtering has been recently exploited for audio-visual (AV) based tracking of multiple speakers, where audio data are used to inform the particle distribution and propagation in the visual SMC-PHD filter. However, the performance of the AV-SMC-PHD filter can be affected by the mismatch between the proposal and the posterior distribution. In this paper, we present a new method to improve the particle distribution where audio information (i.e. DOA angles derived from microphone array measurements) is used to detect new born particles and visual information (i.e. histograms) is used to modify the particles with particle flow (PF). Using particle flow has the benefit of migrating particles smoothly from the prior to the posterior distribution. We compare the proposed algorithm with the baseline AV-SMC-PHD algorithm using experiments on the AV16.3 dataset with multi-speaker sequences.