Data movement optimizations for independent MPI I/O on the Blue Gene/Q

详细信息    查看全文

• 作者：Preeti Malakar ; ^{pmalakar@anl.gov} ; ^{malakar.preeti@gmail.com} ; Venkatram Vishwanath ^{venkat@anl.gov}
• 关键词：Independent I/O ; Data movement ; Intra-node data aggregation ; Interconnect routing ; File write
• 刊名：Parallel Computing
• 出版年：2017
• 出版时间：January 2017
• 年：2017
• 卷：61
• 期：Complete
• 页码：35-51
• 全文大小：2447 K
• 卷排序：61

文摘

We propose algorithm to route data to closer IO nodes and reduce network congestion. Developed a route-aware strategy to modify existing bridge node assignments in BG/Q. Our algorithm reduces write times by 60% on average than default independent I/O. The default independent MPI I/O routes 1.4x more I/O messages than our approach. By intra-node aggregation, our modified independent I/O obtains 10.5 GB/s bandwidth.