Phrase Filtering for Content?Words in Hierarchical Phrase-Based Model

详细信息    查看全文

• 作者：Xing Wang (21)
  Jun Xie (22)
  Linfeng Song (22)
  Yajuan Lv (22)
  Jianmin Yao (21)
  
• 关键词：hierarchical phrase ; based model ; content words ; phrase filtering
• 刊名：Lecture Notes in Computer Science
• 出版年：2013
• 出版时间：2013
• 年：2013
• 卷：8229
• 期：1
• 页码：499-507
• 全文大小：286KB
• 作者单位：Xing Wang (21)
  Jun Xie (22)
  Linfeng Song (22)
  Yajuan Lv (22)
  Jianmin Yao (21)
  
  21. School of Computer Science &Technology, Soochow University, Suzhou, China
  22. Key Laboratory of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China
  
• ISSN：1611-3349

文摘

When hierarchical phrase-based statistical machine translation systems are used for language translation, sometimes the translations?content words were lost: source-side content words is empty when translated into target texts during decoding. Although the translations?BLEU score is very high, it is difficult to understand the translations because of the loss of the content words. In this paper, we propose a basic and efficient method for phrase filtering, with which the phrase?content words translation are checked to decide whether to use the phrase in decoding or not. The experimental results show that the proposed method alleviates the problem of the loss content words?and improves the BLEU scores.