Fast cross-datacenter virtual machine migration algorithm based on duplication

LIU Shengzhuo; JIANG Jinlei; YANG Guangwen

PDF(1102 KB)

Journal of Tsinghua University(Science and Technology) ›› 2015, Vol. 55 ›› Issue (5) : 579-584.

COMPUTER SCIENCE AND TECHNOLOGY

Fast cross-datacenter virtual machine migration algorithm based on duplication

{{article.zuoZhe_EN}}

Author information +

History +

Abstract

Live migration of virtual machines (VM) over wide-area networks (WAN) is key to cloud computing operations in a multi-datacenter environment. Compared with the migration over a local-area network (LAN), the live migration over a WAN faces more technical challenges due to the limited bandwidth. A live cross-datacenter VM migration infrastructure was developed in a fast live image migration cross-datacenters (FlimCD) method, which makes full use of dirty blocks deduplication, block pre-fetching and hot-area scheduled transmissions to reduce the overall migration time and the impact of the VM migration on the performance. Tests show that, for moderately I/O intensive workloads, the migration time is reduced by 64.3% compared with that of the pre-copy algorithm. The current optimization mechanisms reduce the block miss rate by 49% in the post-copy phase.

Key words

virtual machine / wide-area migration / live storage migration / deduplication / multi-datacenter

Cite this article

EndNote

Ris (Procite)

Bibtex

Download Citations

LIU Shengzhuo, JIANG Jinlei, YANG Guangwen. Fast cross-datacenter virtual machine migration algorithm based on duplication[J]. Journal of Tsinghua University(Science and Technology). 2015, 55(5): 579-584

References

[1] Mahalingam M, Dutt D, Duda K, et al. VXLAN: A Framework for Overlaying Virtualized Layer 2 Networks over Layer 3 Networks [S/OL]. [2015-01-25]. https://tools.ietf.org/html/draft-mahalingam-dutt-dcops-vxlan-00.
[2] Farinacci D, Fuller V, Meyer D, et al. The Locator/ID Separation Protocol (LISP) [S/OL]. [2015-01-25]. http://tools.ietf.org/html/rfc6830.
[3] Clark C, Fraser K, Hand S, et al. Live migration of virtual machines [C]//Proc of NSDI 2005. Berkeley, CA, USA: USENIX Association, 2005: 273-286.
[4] Nelson M, Lim B H, Hutchins G. Fast transparent migration for virtual machines [C]//Proceedings of the Annual Conference on USENIX Annual Technical Conference. Berkeley, CA, USA: USENIX Association, 2005: 391-394.
[5] Hines M R, Deshpande U, Gopalan K. Post-copy live migration of virtual machines [C]//Proc of SIGOPS'09. Montana, USA: Association for Computing Machinery Special Interest Group on Operating Systems, 2009: 14-26.
[6] Bradford R, Kotsovinos E, Feldmann A, et al. Live wide-area migration of virtual machines including local persistent state [C]//Proc of VEE'07. New York, NY, USA: ACM, 2007: 169-179.
[7] Mashtizadeh A, Celebi E, Garfinkel T, et al. The design and evolution of live storage migration in VMware ESX [C]//Proceedings of the 2011 USENIX Conference on USENIX Annual Technical Conference. Berkeley, CA, USA: USENIX Association, 2011: 14-14.
[8] Hirofuchi T, Nakada H, Ogawa H, et al. A live storage migration mechanism over wan and its performance evaluation [C]//Proc of VTDC'09. New York, NY, USA: ACM, 2009: 67-74.
[9] Hirofuchi T, Ogawa H, Nakada H, et al. A live storage migration mechanism over WAN for relocatable virtual machine services on clouds [C]//Proceedings of the 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, 2009. Washington DC, USA: IEEE Computer Society, 2009: 460-465.
[10] Luo Y, Zhang B, Wang X, et al., Live and incremental whole-system migration of virtual machines using block-bitmap [C]//2008 IEEE International Conference on Cluster Computing. Tsukuba, Japan: IEEE Computer Society, 2008: 99-106.
[11] Zheng J, Ng T S E, Sripanidkulchai K. Workload-aware live storage migration for clouds [C]//Proceedings of the 7th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments. New York, NY, USA: ACM, 2011: 133-144.
[12] FIU. FIU IODedup mail server trace [Z/OL]. [2015-01-05]. http://iotta.snia.org/traces/391.
[13] Takahashi K, Sasada K, Hirofuchi T. A fast virtual machine storage migration technique using data deduplication [C]//Proc of CLOUD COMPUTING 2012. Nice, France: IARIA, 2012: 57-64.
[14] Zhao X, Zhang Y, Wu Y, et al. Liquid: A scalable deduplication file system for virtual machine images [J]. IEEE Trans Parallel Distrib Syst, 2014, 25: 1257-1266.
[15] Rivest R. The MD5 Message-Digest Algorithm [S/OL]. [2015-01-25]. https://www.ietf.org/rfc/rfc1321.txt.
[16] KVM Forum. QEMU/KVM [R/OL]. [2015-01-25]. http://www.linux-kvm.org/page/Main_Page.
[17] Intel Corporation. Iometer [R/OL]. [2015-01-25]. http://www.iometer.org/.