[libvirt] Live migration woes
Hi, is anyone using libvirt-git and qemu-kvm post-0.11 and can live migrate VMs successfully for- and backwards? qemu-kvm-0.11 seems to be the latest release were live migration works, and I'm trying to figure out if its a kvm or libvirt problem, since there were other things (balloon parameter f.e.) that were changed with qemu-kvm-0.12 and caused troubles when using libvirt. thx,t
Quoting Thomas Treutner <thomas@scripty.at>:
Hi,
is anyone using libvirt-git and qemu-kvm post-0.11 and can live migrate VMs successfully for- and backwards? qemu-kvm-0.11 seems to be the latest release were live migration works, and I'm trying to figure out if its a kvm or libvirt problem, since there were other things (balloon parameter f.e.) that were changed with qemu-kvm-0.12 and caused troubles when using libvirt.
Yes. I'm using the virt-preview repo (rawhide) and I just noticed, today, after re-upgrading to 0.12.2-5 (since -4 has a rather nasty IO problem for virtio devices against raw image files) that my live-migrations fail with the following error message on the destination system (i.e. the system the I'm trying to migrate to): /var/log/libvirt/qemu/<guest>.log: Unknown savevm section -2038417646 load of migration failed Also, in the same log file, I'm seeing: Warning: vlan 0 with no nics Option 'ipv4': Use 'on' or 'off' Failed to parse "yes" for "dummy.ipv4" But that may not be related to the migration failing. // Thomas ---------------------------------------------------------------- This message was sent using IMP, the Internet Messaging Program.
On Friday 05 February 2010 21:21:32 Thomas Sjolshagen wrote:
Quoting Thomas Treutner <thomas@scripty.at>:
Hi,
is anyone using libvirt-git and qemu-kvm post-0.11 and can live migrate VMs successfully for- and backwards? qemu-kvm-0.11 seems to be the latest release were live migration works, and I'm trying to figure out if its a kvm or libvirt problem, since there were other things (balloon parameter f.e.) that were changed with qemu-kvm-0.12 and caused troubles when using libvirt.
Yes.
I'm using the virt-preview repo (rawhide) and I just noticed, today, after re-upgrading to 0.12.2-5 (since -4 has a rather nasty IO problem for virtio devices against raw image files) that my live-migrations fail with the following error message on the destination system (i.e. the system the I'm trying to migrate to):
/var/log/libvirt/qemu/<guest>.log: Unknown savevm section -2038417646 load of migration failed
I don't see that in the logs. My migrations "succeed", but at the dst, the VM immediately crashes, with no chance of getting some useful debug output so far.
Also, in the same log file, I'm seeing: Warning: vlan 0 with no nics Option 'ipv4': Use 'on' or 'off' Failed to parse "yes" for "dummy.ipv4"
But that may not be related to the migration failing.
Yeah, that's familiar to me: 22:09:40.409: debug : qemuSecurityDACSetProcessLabel:411 : Dropping privileges of VM to 0:0 char device redirected to /dev/pts/3 Warning: vlan 0 with no nics Option 'ipv4': Use 'on' or 'off' Failed to parse "yes" for "dummy.ipv4" -t
On Friday 05 February 2010 22:39:04 Thomas Treutner wrote:
Yeah, that's familiar to me:
22:09:40.409: debug : qemuSecurityDACSetProcessLabel:411 : Dropping privileges of VM to 0:0 char device redirected to /dev/pts/3 Warning: vlan 0 with no nics Option 'ipv4': Use 'on' or 'off' Failed to parse "yes" for "dummy.ipv4"
I just found out that migrating from A to B seems to work, but then, back from B to A won't. After A->B, the VM has a huge timetrift, although A+B have ntp running and clocksource is kvm-clock: http://tt.scripty.at/tmp/kvm_clocksource_ts_unstable.png A is a PhenomII X4, B is a AthlonII X2, /proc/cpuinfo flags are identical. -t
On Friday 05 February 2010 21:21:32 Thomas Sjolshagen wrote:
Quoting Thomas Treutner <thomas@scripty.at>:
Hi,
is anyone using libvirt-git and qemu-kvm post-0.11 and can live migrate VMs successfully for- and backwards? qemu-kvm-0.11 seems to be the latest release were live migration works, and I'm trying to figure out if its a kvm or libvirt problem, since there were other things (balloon parameter f.e.) that were changed with qemu-kvm-0.12 and caused troubles when using libvirt.
Yes.
I'm using the virt-preview repo (rawhide) and I just noticed, today, after re-upgrading to 0.12.2-5 (since -4 has a rather nasty IO problem for virtio devices against raw image files) that my live-migrations fail with the following error message on the destination system (i.e. the system the I'm trying to migrate to):
I now switched back to 0.11 and disabled Enhanced C1 of my PhenomII and AthlonII (I think the MSI BIOS calls it just C1), which makes things better, but migrations are not completely stable yet.
From http://tinyurl.com/yaacdtu: "In addition, we have C-states, in the case of the Phenom, it is the C0 and C1 state with the C1 state being enabled if there are no outstanding IPCs and resulting in a clock divider of 1/128. If there is no cache activity either or outstanding memory requests, then the CPU can go into the enhanced C1 state, that is the C1e state where the shared cache and memory controllers are clock gated back to 1/16 of the original frequency."
So, currently, it seems to be a KVM-bug related to power saving features. -t
On Fri, Feb 05, 2010 at 03:21:32PM -0500, Thomas Sjolshagen wrote:
Quoting Thomas Treutner <thomas@scripty.at>:
Hi,
is anyone using libvirt-git and qemu-kvm post-0.11 and can live migrate VMs successfully for- and backwards? qemu-kvm-0.11 seems to be the latest release were live migration works, and I'm trying to figure out if its a kvm or libvirt problem, since there were other things (balloon parameter f.e.) that were changed with qemu-kvm-0.12 and caused troubles when using libvirt.
Yes.
I'm using the virt-preview repo (rawhide) and I just noticed, today, after re-upgrading to 0.12.2-5 (since -4 has a rather nasty IO problem for virtio devices against raw image files) that my live-migrations fail with the following error message on the destination system (i.e. the system the I'm trying to migrate to):
/var/log/libvirt/qemu/<guest>.log: Unknown savevm section -2038417646 load of migration failed
This looks like a new QEMU bug to me
Also, in the same log file, I'm seeing: Warning: vlan 0 with no nics Option 'ipv4': Use 'on' or 'off' Failed to parse "yes" for "dummy.ipv4"
All of these messages are harmless & can be ignored. Daniel -- |: Red Hat, Engineering, London -o- http://people.redhat.com/berrange/ :| |: http://libvirt.org -o- http://virt-manager.org -o- http://ovirt.org :| |: http://autobuild.org -o- http://search.cpan.org/~danberr/ :| |: GnuPG: 7D3B9505 -o- F3C9 553F A1DA 4AC2 5648 23C1 B3DF F742 7D3B 9505 :|
participants (3)
-
Daniel P. Berrange -
Thomas Sjolshagen -
Thomas Treutner