Fast cross-datacenter virtual machine migration algorithm based on duplication

Download: PDF(1102 KB)
Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks

Abstract Live migration of virtual machines (VM) over wide-area networks (WAN) is key to cloud computing operations in a multi-datacenter environment. Compared with the migration over a local-area network (LAN), the live migration over a WAN faces more technical challenges due to the limited bandwidth. A live cross-datacenter VM migration infrastructure was developed in a fast live image migration cross-datacenters (FlimCD) method, which makes full use of dirty blocks deduplication, block pre-fetching and hot-area scheduled transmissions to reduce the overall migration time and the impact of the VM migration on the performance. Tests show that, for moderately I/O intensive workloads, the migration time is reduced by 64.3% compared with that of the pre-copy algorithm. The current optimization mechanisms reduce the block miss rate by 49% in the post-copy phase.

Keywords virtual machine wide-area migration live storage migration deduplication multi-datacenter

ZTFLH:

TP316.1

Issue Date: 15 May 2015

	Service

	E-mail this article
	E-mail Alert
	RSS
	Articles by authors

	LIU Shengzhuo
	JIANG Jinlei
	YANG Guangwen

Cite this article:

LIU Shengzhuo,JIANG Jinlei,YANG Guangwen. Fast cross-datacenter virtual machine migration algorithm based on duplication[J]. Journal of Tsinghua University(Science and Technology), 2015, 55(5): 579-584.

URL:

http://jst.tsinghuajournals.com/EN/ OR http://jst.tsinghuajournals.com/EN/Y2015/V55/I5/579

[1]	Mahalingam M, Dutt D, Duda K, et al. VXLAN: A Framework for Overlaying Virtualized Layer 2 Networks over Layer 3 Networks [S/OL]. [2015-01-25]. https://tools.ietf.org/html/draft-mahalingam-dutt-dcops-vxlan-00.
[2]	Farinacci D, Fuller V, Meyer D, et al. The Locator/ID Separation Protocol (LISP) [S/OL]. [2015-01-25]. http://tools.ietf.org/html/rfc6830. url: http://tools.ietf.org/html/rfc6830.
[3]	Clark C, Fraser K, Hand S, et al. Live migration of virtual machines [C]//Proc of NSDI 2005. Berkeley, CA, USA: USENIX Association, 2005: 273-286.
[4]	Nelson M, Lim B H, Hutchins G. Fast transparent migration for virtual machines [C]//Proceedings of the Annual Conference on USENIX Annual Technical Conference. Berkeley, CA, USA: USENIX Association, 2005: 391-394.
[5]	Hines M R, Deshpande U, Gopalan K. Post-copy live migration of virtual machines [C]//Proc of SIGOPS'09. Montana, USA: Association for Computing Machinery Special Interest Group on Operating Systems, 2009: 14-26.
[6]	Bradford R, Kotsovinos E, Feldmann A, et al. Live wide-area migration of virtual machines including local persistent state [C]//Proc of VEE'07. New York, NY, USA: ACM, 2007: 169-179.
[7]	Mashtizadeh A, Celebi E, Garfinkel T, et al. The design and evolution of live storage migration in VMware ESX [C]//Proceedings of the 2011 USENIX Conference on USENIX Annual Technical Conference. Berkeley, CA, USA: USENIX Association, 2011: 14-14.
[8]	Hirofuchi T, Nakada H, Ogawa H, et al. A live storage migration mechanism over wan and its performance evaluation [C]//Proc of VTDC'09. New York, NY, USA: ACM, 2009: 67-74.
[9]	Hirofuchi T, Ogawa H, Nakada H, et al. A live storage migration mechanism over WAN for relocatable virtual machine services on clouds [C]//Proceedings of the 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, 2009. Washington DC, USA: IEEE Computer Society, 2009: 460-465.
[10]	Luo Y, Zhang B, Wang X, et al., Live and incremental whole-system migration of virtual machines using block-bitmap [C]//2008 IEEE International Conference on Cluster Computing. Tsukuba, Japan: IEEE Computer Society, 2008: 99-106.
[11]	Zheng J, Ng T S E, Sripanidkulchai K. Workload-aware live storage migration for clouds [C]//Proceedings of the 7th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments. New York, NY, USA: ACM, 2011: 133-144.
[12]	FIU. FIU IODedup mail server trace [Z/OL]. [2015-01-05]. http://iotta.snia.org/traces/391. url: http://iotta.snia.org/traces/391.
[13]	Takahashi K, Sasada K, Hirofuchi T. A fast virtual machine storage migration technique using data deduplication [C]//Proc of CLOUD COMPUTING 2012. Nice, France: IARIA, 2012: 57-64.
[14]	Zhao X, Zhang Y, Wu Y, et al. Liquid: A scalable deduplication file system for virtual machine images [J]. IEEE Trans Parallel Distrib Syst, 2014, 25: 1257-1266. url: http://dx.doi.org/10.1109/TPDS.2013.173
[15]	Rivest R. The MD5 Message-Digest Algorithm [S/OL]. [2015-01-25]. https://www.ietf.org/rfc/rfc1321.txt.
[16]	KVM Forum. QEMU/KVM [R/OL]. [2015-01-25]. http://www.linux-kvm.org/page/Main_Page. url: http://www.linux-kvm.org/page/main_page.
[17]	Intel Corporation. Iometer [R/OL]. [2015-01-25]. http://www.iometer.org/. url: http://www.iometer.org/.