Hello, I am using latest version of libvirt: 0.10.0 If I drop unsafe flag I get "error: Unsafe migration: Migration may lead to data corruption if disks use cache != none" "cache=none": I try also to create a VM using virt-install with "-disk ...,cache=none" but I always get error "could not open disk image /media/shared/dd.vdi", "could not open disk image /media/shared/dd.qcow"... Loic -----Message d'origine----- De : Michal Privoznik [mailto:mprivozn@redhat.com] Envoyé : vendredi 22 février 2013 18:02 À : CLOATRE Loïc NRS Cc : libvirt-users@redhat.com Objet : Re: [libvirt-users] error when call migrate function "error: invalid argument: qemuDomainMigratePrepare3: unsupported flags (0x200)" On 22.02.2013 17:02, loic.cloatre@orange.com wrote:

Hello,

I try to migrate a VM and I get this error :

loic@loic-VirtualBox:~/workspace/src/build/bin$ ./virsh --connect qemu:///system migrate --live vmUbuntuPartage2CacheWriteBack qemu+ssh://192.168.10x.2x/system --unsafe loic@192.168.10x.2x's password: error: invalid argument: qemuDomainMigratePrepare3: unsupported flags (0x200)

That means you libvirt doesn't support VIR_MIGRATE_UNSAFE flag. You have to drop --unsafe from virsh migrate command to be able to migrate. Or just upgrade to 0.9.11+. Michal _________________________________________________________________________________________________________________________ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, France Telecom - Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, France Telecom - Orange is not liable for messages that have been modified, changed or falsified. Thank you.

Hello, Good question: - 0.10.0 build - 0.9.3 on other side (with apt-get). So I download and build 0.10.0 on other side and I don't have "error: Unsafe migration: Migration may lead to data corruption if disks use cache != none" anymore. I get now another "error: XML error: missing security model when using multiple labels" Thanks for help, Loïc -----Message d'origine----- De : Michal Privoznik [mailto:mprivozn@redhat.com] Envoyé : lundi 25 février 2013 10:45 À : CLOATRE Loïc NRS Cc : libvirt-users@redhat.com Objet : Re: [libvirt-users] error when call migrate function "error: invalid argument: qemuDomainMigratePrepare3: unsupported flags (0x200)" On 25.02.2013 09:06, loic.cloatre@orange.com wrote:

Hello,

I am using latest version of libvirt: 0.10.0

On both sides?

If I drop unsafe flag I get "error: Unsafe migration: Migration may lead to data corruption if disks use cache != none"

Right. We want to bypass system and qemu cache during migration. Unfortunately, we can't change cache once domain is started.

"cache=none": I try also to create a VM using virt-install with "-disk ...,cache=none" but I always get error "could not open disk image /media/shared/dd.vdi", "could not open disk image /media/shared/dd.qcow"...

Well, this is unusual error message. I suspect qemu as the origin. However, without libvirtd logs I am unable to tell. Michal

Loic

_________________________________________________________________________________________________________________________ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, France Telecom - Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, France Telecom - Orange is not liable for messages that have been modified, changed or falsified. Thank you.

Hello, Thanks for answer, So I try with 1.0.0 and 1.0.2 but I get same message: "error: XML error: missing security model when using multiple labels" Is it possible in configuration to disable security label, or to change value in order to make other tests? Maybe my .configure should use an option...I just use --prefix=/usr --localstatedir=/var sysconfdir=/etc I also change virtualBox with vmware (because cpuinfo flag vmx was not present, and kvm-ok was not good). Loic -----Message d'origine----- De : Jiri Denemark [mailto:jdenemar@redhat.com] Envoyé : mercredi 27 février 2013 11:24 À : CLOATRE Loïc NRS Cc : Michal Privoznik; libvirt-users@redhat.com Objet : Re: [libvirt-users] error when call migrate function "error: invalid argument: qemuDomainMigratePrepare3: unsupported flags (0x200)" On Mon, Feb 25, 2013 at 15:13:21 +0100, loic.cloatre@orange.com wrote:

Hello,

Good question: - 0.10.0 build - 0.9.3 on other side (with apt-get).

So I download and build 0.10.0 on other side and I don't have "error: Unsafe migration: Migration may lead to data corruption if disks use cache != none" anymore.

I get now another "error: XML error: missing security model when using multiple labels"

This looks like a bug in the code that added support for multiple security labels. We had several bugs there in the past and they should already be fixed. Try to use newer libvirt (0.10.0 is quite old). You may also try one of our maintenance releases, where we try to fix bugs present in a particular libvirt release without implementing new features. Jirka _________________________________________________________________________________________________________________________ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, France Telecom - Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, France Telecom - Orange is not liable for messages that have been modified, changed or falsified. Thank you.

________________________________________ De : Jiri Denemark [jdenemar@redhat.com] Date d'envoi : mercredi 27 février 2013 13:36 À : CLOATRE Loïc NRS Cc : Michal Privoznik; libvirt-users@redhat.com Objet : Re: [libvirt-users] error when call migrate function "error: invalid argument: qemuDomainMigratePrepare3: unsupported flags (0x200)" On Wed, Feb 27, 2013 at 11:51:52 +0100, loic.cloatre@orange.com wrote:

Hello,

Thanks for answer, So I try with 1.0.0 and 1.0.2 but I get same message:

Did you upgrade both hosts, right? [loic] Yes, both ubuntu host (wich are VM created with vmware on windows 7) reply this: loic@ubuntu:~$ virsh --version 1.0.2 [/loic]

"error: XML error: missing security model when using multiple labels"

Interesting. Could you send the output of virsh dumpxml --migratable DOMAIN [loic] loic@ubuntu:~$ virsh --connect qemu:///system dumpxml --migratable ubuntuShared5 error: unsupported flags (0x8) in function virDomainDefFormatInternal more informations about "ubuntuShared5" that I try to migrate, I used this command for creation: sudo virt-install -n ubuntuShared5 -r 2047 --disk path=/mnt/hgfs/vmware/ubuntuShared5.img,bus=virtio,size=3 -c /mnt/hgfs/ubuntu2/saveComm/ubuntu-12.04.1-server-i386.iso --network network=default,model=virtio --vnc -v And exact error: loic@ubuntu:~$ virsh --connect qemu:///system migrate --live ubuntuShared5 qemu+ssh://192.168.X.X/system --unsafe loic@192.168.X.X's password: error: XML error: missing security model when using multiple labels [/loic] Jirka _________________________________________________________________________________________________________________________ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, France Telecom - Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, France Telecom - Orange is not liable for messages that have been modified, changed or falsified. Thank you.

Hello, Forget my previous mail, I reboot my VM and I get now answer for "virsh dumpxml --migratable DOMAIN" I also avoir old error to another one: great! loic@ubuntu:~$ virsh --connect qemu:///system migrate --live ubuntuShared5 qemu+ssh://192.168.X.X/system --unsafe loic@192.168.X.X's password: error: authentication failed: polkit: polkit\56retains_authorization_after_challenge=1 Authorization requires authentication but no agent is available. --> loic@ubuntu:~$ virsh --connect qemu:///system dumpxml --migratable ubuntuShared5<domain type='kvm' id='1'> <name>ubuntuShared5</name> <uuid>71f15bd9-0ba2-e047-73eb-39af6001317c</uuid> <memory unit='KiB'>2096128</memory> <currentMemory unit='KiB'>2096128</currentMemory> <vcpu placement='static'>1</vcpu> <os> <type arch='i686' machine='pc-1.0'>hvm</type> <boot dev='hd'/> </os> <features> <acpi/> <apic/> <pae/> </features> <clock offset='utc'/> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>restart</on_crash> <devices> <emulator>/usr/bin/kvm</emulator> <disk type='file' device='disk'> <driver name='qemu' type='raw'/> <source file='/mnt/hgfs/vmware/ubuntuShared5.img'/> <target dev='vda' bus='virtio'/> <alias name='virtio-disk0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/> </disk> <disk type='block' device='cdrom'> <driver name='qemu' type='raw'/> <target dev='hdc' bus='ide'/> <readonly/> <alias name='ide0-1-0'/> <address type='drive' controller='0' bus='1' target='0' unit='0'/> </disk> <controller type='ide' index='0'> <alias name='ide0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/> </controller> <interface type='network'> <mac address='52:54:00:ed:06:a7'/> <source network='default'/> <target dev='vnet0'/> <model type='virtio'/> <alias name='net0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/> </interface> <serial type='pty'> <source path='/dev/pts/3'/> <target port='0'/> <alias name='serial0'/> </serial> <console type='pty' tty='/dev/pts/3'> <source path='/dev/pts/3'/> <target type='serial' port='0'/> <alias name='serial0'/> </console> <input type='mouse' bus='ps2'/> <graphics type='vnc' port='5900' autoport='yes' listen='127.0.0.1'> <listen type='address' address='127.0.0.1'/> </graphics> <video> <model type='cirrus' vram='9216' heads='1'/> <alias name='video0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/> </video> <memballoon model='virtio'> <alias name='balloon0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/> </memballoon> </devices> <seclabel type='none'/> </domain> ________________________________________ De : Jiri Denemark [jdenemar@redhat.com] Date d'envoi : mercredi 27 février 2013 13:36 À : CLOATRE Loïc NRS Cc : Michal Privoznik; libvirt-users@redhat.com Objet : Re: [libvirt-users] error when call migrate function "error: invalid argument: qemuDomainMigratePrepare3: unsupported flags (0x200)" On Wed, Feb 27, 2013 at 11:51:52 +0100, loic.cloatre@orange.com wrote:

Hello,

Thanks for answer, So I try with 1.0.0 and 1.0.2 but I get same message:

Did you upgrade both hosts, right?

"error: XML error: missing security model when using multiple labels"

Interesting. Could you send the output of virsh dumpxml --migratable DOMAIN Jirka _________________________________________________________________________________________________________________________ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, France Telecom - Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, France Telecom - Orange is not liable for messages that have been modified, changed or falsified. Thank you.

Yes I forget to change my libvirtd.conf, I uncomment these lines: unix_sock_group = "libvirtd" unix_sock_rw_perms = "0770" auth_unix_ro = "none" auth_unix_rw = "none" and this one because I get "error: internal error Attempt to migrate guest to the same host" host_uuid = "6452c8fe-297b-4be7-8a48-9457ad32b62e" (output of the 'uuidgen' differents on both host) These changes are made on both host, and are reboot: I still get loic@ubuntu:~$ virsh --connect qemu:///system migrate --live ubuntuShared5 qemu+ssh://192.168.X.X/system --unsafe loic@192.168.X.X's password: error: internal error Attempt to migrate guest to the same host ubuntu Strange because uuid are differents: loic@ubuntu:~$ sudo dmidecode -s system-uuid 564DD52D-5B13-D29E-5587-21698DE7C788 loic@ubuntu:~$ sudo dmidecode -s system-uuid 564DCBD3-022C-8EAF-C1BC-943BB22EE9B5 loic@ubuntu:~$ virsh capabilities | grep uuid <uuid>c77e0086-6108-0160-c543-a460de7f68a0</uuid> loic@ubuntu:~$ virsh capabilities | grep uuid <uuid>8aa7c641-711c-82c1-a60e-4d8d424b0555</uuid> And to reply for a previous question: loic@ubuntu:~$ virsh --connect qemu:///system --version 1.0.2 Loic ________________________________________ De : Michal Privoznik [mprivozn@redhat.com] Date d'envoi : mercredi 27 février 2013 14:01 À : CLOATRE Loïc NRS Cc : Jiri Denemark; libvirt-users@redhat.com Objet : Re: RE : [libvirt-users] error when call migrate function "error: invalid argument: qemuDomainMigratePrepare3: unsupported flags (0x200)" On 27.02.2013 13:50, loic.cloatre@orange.com wrote:

Hello,

Forget my previous mail, I reboot my VM and I get now answer for "virsh dumpxml --migratable DOMAIN"

I also avoir old error to another one: great!

loic@ubuntu:~$ virsh --connect qemu:///system migrate --live ubuntuShared5 qemu+ssh://192.168.X.X/system --unsafe loic@192.168.X.X's password: error: authentication failed: polkit: polkit\56retains_authorization_after_challenge=1 Authorization requires authentication but no agent is available.

Do you have 'auth_unix_rw="polkit"' set in /etc/libvirt/libvirtd.conf (on dst, but check src as well)? You should either install & configure polkit or switch to something you already have up & running (sasl, none). Michal _________________________________________________________________________________________________________________________ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, France Telecom - Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, France Telecom - Orange is not liable for messages that have been modified, changed or falsified. Thank you.

________________________________________ De : Jiri Denemark [jdenemar@redhat.com] Date d'envoi : mercredi 27 février 2013 14:52 À : CLOATRE Loïc NRS Cc : Michal Privoznik; libvirt-users@redhat.com Objet : Re: RE : RE : [libvirt-users] error when call migrate function "error: invalid argument: qemuDomainMigratePrepare3: unsupported flags (0x200)" On Wed, Feb 27, 2013 at 14:26:08 +0100, loic.cloatre@orange.com wrote:

These changes are made on both host, and are reboot: I still get loic@ubuntu:~$ virsh --connect qemu:///system migrate --live ubuntuShared5 qemu+ssh://192.168.X.X/system --unsafe loic@192.168.X.X's password: error: internal error Attempt to migrate guest to the same host ubuntu

Strange because uuid are differents: loic@ubuntu:~$ sudo dmidecode -s system-uuid 564DD52D-5B13-D29E-5587-21698DE7C788 loic@ubuntu:~$ sudo dmidecode -s system-uuid 564DCBD3-022C-8EAF-C1BC-943BB22EE9B5

The hostname for both hosts is "ubuntu", which is why it fails. You should assign distinct hostnames to both hosts. And ideally, both hostnames should be resolvable from both hosts and lead to the corresponding IP address. See http://wiki.libvirt.org/page/Migration_fails_with_%22Unable_to_resolve_addre... [loic] Success!!! I change hostname of my target (sudo hostname ubuntu40) And I modify my command as in link above. --> virsh --connect qemu:///system migrate --live ubuntuShared5 qemu+ssh://192.168.X.X/system tcp://192.168.X.X--unsafe --verbose loic@192.168.X.X's password: Migration: [100 %] And on target VM, I see migrated vm: loic@ubuntu:~$ virsh --connect qemu:///system list Id Name State ---------------------------------------------------- 2 ubuntuShared5 running Thanks a lot for help, I hope this topic will help others! I use libvirt-1.0.2.

And to reply for a previous question: loic@ubuntu:~$ virsh --connect qemu:///system --version 1.0.2

Michal asked for "version" command rather than "--version". Jirka _________________________________________________________________________________________________________________________ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, France Telecom - Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, France Telecom - Orange is not liable for messages that have been modified, changed or falsified. Thank you.