[libvirt] Xen: Domain.migrate() causes invalid listDomains() output
Hi, I'm using Xen 3.2 (Debian Lenny) and libvirt 0.7.1. When I use Domain.migrate() from libvirt-java 0.3.0, a following Connect.listDomains() gives wrong DomainIDs (they seem to be the ones before the migration) and therefore DomainLookupByID() fails because of a nonexistent ID. Restarting libvirtd and/or xend doesn't help. xm list etc. output is still correct, but anything that uses libvirt (like virt-top) is having troubles. The migration itself is working without glitches, the domains are up&running and responsive. But at this point, libvirt is completely mistaken about the running domains and their IDs. There are some quite similar bug reports and mails here, but they are rather old. Shall I provide more debug output? tia&kr, thomas
And some more interesting behaviour: When I do node01:~# xm migrate -l wp02 node02 after libvirt has lost track of wp01, it reappears again at node02! node02:~# xm list Name ID Mem VCPUs State Time(s) Domain-0 0 192 2 r----- 74.1 wp01 3 512 2 -b---- 1.8 wp02 4 512 2 -b---- 0.0 But now, wp02 is not seen by libvirt. And I can push it further: node02:~# xm create wp03.cfg Using config file "/etc/xen/wp03.cfg". Started domain wp03 node02:~# xm list Name ID Mem VCPUs State Time(s) Domain-0 0 192 2 r----- 80.5 wp01 3 512 2 -b---- 2.2 wp02 4 512 2 -b---- 0.4 wp03 5 512 2 -b---- 5.2 Now guess, wp02 reappears, but wp03 is missing. It seems to me that the domain with the highest ID is missing. node02:~# xm create wp04.cfg Using config file "/etc/xen/wp04.cfg". Error: I need 524288 KiB, but dom0_min_mem is 262144 and shrinking to 262144 KiB would leave only 200712 KiB free. node02:~# Now, wp03 shortly pops up, but is then lost again. # xm shutdown wp03 Now wp02 is lost again! # xm shutdown wp02 and now, wp01.
On Wed, Oct 07, 2009 at 11:20:11AM +0200, Thomas Treutner wrote:
And some more interesting behaviour:
When I do
node01:~# xm migrate -l wp02 node02
after libvirt has lost track of wp01, it reappears again at node02!
node02:~# xm list Name ID Mem VCPUs State Time(s) Domain-0 0 192 2 r----- 74.1 wp01 3 512 2 -b---- 1.8 wp02 4 512 2 -b---- 0.0
But now, wp02 is not seen by libvirt. And I can push it further:
What is the output of 'xenstore-ls' on each host machine at this time ? Daniel -- |: Red Hat, Engineering, London -o- http://people.redhat.com/berrange/ :| |: http://libvirt.org -o- http://virt-manager.org -o- http://ovirt.org :| |: http://autobuild.org -o- http://search.cpan.org/~danberr/ :| |: GnuPG: 7D3B9505 -o- F3C9 553F A1DA 4AC2 5648 23C1 B3DF F742 7D3B 9505 :|
On Wednesday 07 October 2009 11:38:31 Daniel P. Berrange wrote:
What is the output of 'xenstore-ls' on each host machine at this time ?
http://tt.scripty.at/tmp/node01-xenstore-ls.txt.gz http://tt.scripty.at/tmp/node02-xenstore-ls.txt.gz node01:~# xm list Name ID Mem VCPUs State Time(s) Domain-0 0 256 2 r----- 29.1 wp02 2 512 2 -b---- 0.0 node02:~# xm list Name ID Mem VCPUs State Time(s) Domain-0 0 192 2 r----- 34.1 wp01 2 512 2 -b---- 0.0 wp02@node01 is missing! thanks, t
On Wed, Oct 07, 2009 at 11:59:47AM +0200, Thomas Treutner wrote:
On Wednesday 07 October 2009 11:38:31 Daniel P. Berrange wrote:
What is the output of 'xenstore-ls' on each host machine at this time ?
http://tt.scripty.at/tmp/node01-xenstore-ls.txt.gz http://tt.scripty.at/tmp/node02-xenstore-ls.txt.gz
wp02@node01 is missing!
As discussed on IRC, it'd be very helpful if you could try a build with the two patches I've just posted since we're hopeful they'll resolve the problem http://www.redhat.com/archives/libvir-list/2009-October/msg00289.html Daniel -- |: Red Hat, Engineering, London -o- http://people.redhat.com/berrange/ :| |: http://libvirt.org -o- http://virt-manager.org -o- http://ovirt.org :| |: http://autobuild.org -o- http://search.cpan.org/~danberr/ :| |: GnuPG: 7D3B9505 -o- F3C9 553F A1DA 4AC2 5648 23C1 B3DF F742 7D3B 9505 :|
participants (2)
-
Daniel P. Berrange -
Thomas Treutner