SLA-aware data migration in a shared hybrid storage cluster

详细信息    查看全文

• 作者：Jianzhe Tai ; Bo Sheng ; Yi Yao ; Ningfang Mi
• 关键词：Data migration ; Resource allocation ; Service level agreement (SLA) ; Bursty workloads ; Hybrid storage clusters
• 刊名：Cluster Computing
• 出版年：2015
• 出版时间：December 2015
• 年：2015
• 卷：18
• 期：4
• 页码：1581-1593
• 全文大小：856 KB
• 参考文献：1.Anderson, E., Hall, J., Hartline, J., Hobbs, M., Karlin, A.R., Saia, J., Swaminathan, R., Wilkes, J.: An experimental study of data migration algorithms. In: Proceedings of the Workshop on Algorithm Engineering, pp. 145-58. Springer, London (2001)
  2.Elmore, A.J., Das, S., Agrawal, D., El Abbadi, A.: Zephyr: live migration in shared nothing databases for elastic cloud platforms. In: Proceedings of the 2011 ACM SIGMOD International Conference on Management of data, pp. 301-12. ACM, New York (2011)
  3.Emc, FAST. http://?www.?emc.?com/?products/?launch/?fast/-/span>
  4.Guerra, J., Pucha, H., Glider, J., Belluomini, W., Rangaswami, R.: Cost effective storage using extent based dynamic tiering. In: Proceedings of the 9st USENIX Conference on FAST-1, pp. 20-0. ACM, San Jose, CA (2011)
  5.HP 3PAR Adaptive Optimization Software. http://?h18006.?www1.?hp.?com/?storage/?software/-par/?aos/?index.?html
  6.IBM DS8000. http://?www-03.?ibm.?com/?systems/?storage/?disk/?ds8000/-/span>
  7.Karlsson, M., Karamanolis, C., Zhu, X.: Triage: performance isolation and differentiation for storage systems. In: Proceedings of the Twelfth IEEE International Workshop on Quality of Service, Palo Alto, CA, pp. 67-4. IEEE (2004)
  8.Khuller, S., Kim, Y., Wan, Y.: Algorithms for data migration with cloning. In: Proceedings of the Twenty-Second ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems, pp. 27-6. ACM, San Diego, CA (2003)
  9.Laliberte, B.: Automate and Optimize a Tiered Storage Environment-FAST! White Paper (2009). http://?www.?emc.?com/?collateral/?analyst-reports/?esg-20091208-fast.?pdf
  10.Little, J.D.C.: A proof for the queuing formula: \(\text{ L }=\text{ w }\) . Oper. Res. 9(3), 383-87 (1961)MathSciNet CrossRef
  11.Lu, C., Alvarez, G.A., Wilkes, J.: Aqueduct: online data migration with performance guarantees. In: Proceedings of the 1st USENIX Conference on FAST-2, pp. 219-30. ACM, Monterey, CA (2002)
  12.Lundell, B., Gahm, J., McKnight, J.: 2011 IT Spending Intentions Survey. Research Report (2011). http://?www.?enterprisestrate?gygroup.?com/-011/-1/-011-it-spending-intentions-survey/-/span>
  13.Narayanan, D., Donnelly, A., Rowstron, A.: Write off-loading: practical power management for enterprise storage. ACM Trans. Storage 4(3), 10:1-0:23 (2008)CrossRef
  14.Riska, A., Riedel, E.: Long-range dependence at the disk drive level. In: Proceedings of theThird International Conference on Quantitative Evaluation of Systems, QEST 2006, pp. 41-0. IEEE (2006)
  15.Seo, B., Zimmermann, R.: Efficient disk replacement and data migration algorithms for large disk subsystems. ACM Trans. Storage 1(3), 316-45 (2005)CrossRef
  16.Sundaram, V., Shenoy, P.: Efficient data migration in self-managing storage systems. In: Proceedings of the IEEE International Conference on Autonomic Computing, Dublin, pp. 297-00 (2006)
  17.VMware vCenter Server. http://?www.?vmware.?com/?products/?vcenter-server/?overview.?html
  18.Wang, K., Lin, M., Ciucu, F.: Characterizing the impact of the workload on the value of dynamic resizing in data centers. Perform. Eval. Rev. 40(1), 405-06 (2014)CrossRef
  19.Zhang, G., Chiu, L., Liu, L.: Adaptive data migration in multi-tiered storage based cloud environment. In: Proceedings of the IEEE 3rd International Conference on Cloud Computing, Miami, FL, pp. 148-55. IEEE (2010)
  
• 作者单位：Jianzhe Tai (1)
  Bo Sheng (2)
  Yi Yao (1)
  Ningfang Mi (1)
  
  1. Northeastern University, Boston, MA, USA
  2. University of Massachusetts Boston, Boston, MA, USA
  
• 刊物类别：Computer Science
• 刊物主题：Processor Architectures
  Operating Systems
  Computer Communication Networks
  
• 出版者：Springer Netherlands
• ISSN：1573-7543

文摘

Data volume in today’s world has been tremendously increased. Large-scaled and diverse data sets are raising new big challenges of storage, process, and query. Particularly, real-time data analysis becomes more and more frequently. Multi-tiered, hybrid storage architectures, which provide a solid way to combine solid-state drives with hard disk drives (HDDs), therefore become attractive in enterprise data centers for achieving high performance and large capacity simultaneously. However, from service provider’s perspective, how to efficiently manage all the data hosted in data center in order to provide high quality of service (QoS) is still a core and difficult problem. The modern enterprise data centers often provide the shared storage resources to a large variety of applications which might demand for different service level agreements (SLAs). Furthermore, any user query from a data-intensive application could easily trigger a scan of a gigantic data set and inject a burst of disk I/Os to the back-end storage system, which will eventually cause disastrous performance degradation. Therefore, in the paper, we present a new approach for automated data movement in multi-tiered, hybrid storage clusters, which lively migrates the data among different storage media devices, aiming to support multiple SLAs for applications with dynamic workloads at the minimal cost. Detailed trace-driven simulations show that this new approach significantly improves the overall performance, providing higher QoS for applications and reducing the occurrence of SLA violations. Sensitivity analysis under different system environments further validates the effectiveness and robustness of the approach. Keywords Data migration Resource allocation Service level agreement (SLA) Bursty workloads Hybrid storage clusters