- Users - libvirt List Archives

[libvirt-users] What is the best virtual network for my case?
by Pasquale Dir 02 Mar '14

02 Mar '14

I have an openvswitch switch controlled by a controller. I want to have a group of virtual machines which can be on different nodes but sharing the same ip address thus having the illusion of being on the same network. So, each vm I start gets an ip (I was thinking about something like 192.168.y.x 255.255.0.0 where y would be the node and x the vm, this way each node can have its own dhcp server) which is virtual and belongs to the same network of the others. Throught openvswitch I would take care of the communication between different machines if they belong to different phisical networks. So, what is the best network configuration according to you?

1 0

[libvirt-users] Mouse events
by lukass.vacek＠seznam.cz 01 Mar '14

01 Mar '14

Hello, I would like to ask if is there any way how to send mouse event to running domain. I am looking for something like a method for handling keyboard events(virDomainSendKey method). Is it implemented yet or is it future todo item(when It will be released?)? Thank for your answer

2 1

[libvirt-users] bridge / ubuntu / no arp reply
by François Chenais 28 Feb '14

28 Feb '14

Hello I'm trying to setup a bridged guest on an ubuntu 13.10 but it doesn't work. (Everything is ok with NAT) Network sniffing shows that arp replies don't come back to the guest. Test 1 ------ Guest : ping host_bridge_ip (ok) Test 2 ------ Guest: ping other_lan_host (KO) other_lan_host - receives arp who-is request - sends arp reply - arp -a shows the guest macaddr => Guest doesn't receive reply Test 3 ------ other_lan_host ping the Guest (KO) - arp -a shows "incomplete" addr - Guest receives nothing On Host ------- network tcpdump on bridge or vnet interfaces shows request but no reply ... Thanks in advance for help or ideas François

3 4

[libvirt-users] POOL of SRIOV networks with multiple PFs
by john fisher 28 Feb '14

28 Feb '14

We are using an Intel 82599 chip that allows 4 PFs ( eth0..3) per VM. I am able to manually start VMs using the hostdev definition for the four network connections, but I'd like to start using the pool approach. Ubuntu 12.04 libvirt 1.0.0 Following: http://wiki.libvirt.org/page/Networking#Assignment_from_a_pool_of_SRIOV_VFs… I can get a pool working with one network- <network> <name>passthrough_eth0</name> <forward mode='hostdev' managed='yes'> <pf dev='eth0'/> </forward> </network> and I can get the four networks started using similar xml. Using one stanza of network type passthrough, I can get a pool on one PF. But when I try to create the VM using four stanzas of network definition, <interface type='network'> <source network='passthrough_eth0'/> </interface> <interface type='network'> <source network='passthrough_eth1'/> </interface> <interface type='network'> <source network='passthrough_eth2'/> </interface> <interface type='network'> <source network='passthrough_eth3'/> </interface> I get this error: "error: Failed to create domain from ./vm0.xml error: internal error Process exited while reading console log output: kvm: -device pci-assign,host=01:10.1,id=hostdev0,configfd=47,bus=pci.0,addr=0x8: Duplicate ID 'hostdev0' for device " Ideas? -- John Fisher

3 3

[libvirt-users] Problem starting VM
by junkmail 28 Feb '14

28 Feb '14

I am having a problem starting a VM and seem to be unable to determine what the problem is. I get the following lines in my log files. Feb 26 06:32:31 yours dbus[14359]: [system] Activating service name='org.freedesktop.machine1' (using servicehelper) 2014-02-26 06:32:31.914+0000: 14451: error : virDBusCallMethod:1205 : Launch helper exited with unknown return code 1 Feb 26 06:32:31 yours dbus[14359]: [system] Activated service 'org.freedesktop.machine1' failed: Launch helper exited with unknown return code 1 This is running on Gentoo using dbus 1.6.18 Libvirt 1.2.1 qemu 1.5.3 Kernel 3.10.7 Let me know what else I can provide. Thanks

2 2

[libvirt-users] VirtFS accessmode
by Lanati, Matteo 27 Feb '14

27 Feb '14

Hi all, I'm trying to share a folder between a host and a guest using VirtFS. The source is NAS mounted on the host and QEMU runs as unprivileged user. The only way for me to use the folder inside the guest is to set the access mode to 'squash' but all file operations are performed by the user running QEMU. If I ran QEMU as root, the passthrough mode works as expected. Is there the possibility to configure the passthrough access also for non-root users? Thanks, Matteo Matteo Lanati Distributed Resources Group Leibniz-Rechenzentrum (LRZ) Boltzmannstrasse 1 85748 Garching b. München (Germany) Phone: +49 89 35831 8724

3 3

[libvirt-users] VM Creation Timestamp
by Tony Atkinson 27 Feb '14

27 Feb '14

Hello, Is there any way to query libvirt, ideally through virsh CLI utility or similar, to get a timestamp of when a VM was created. Or to put it another way, a timestamp of when a domain's UUID was allocated. Many thanks, -- Tony Atkinson

2 3

[libvirt-users] libvirt lxc /dev/null
by Nerijus Baliunas 27 Feb '14

27 Feb '14

Hello, I created lxc container on F19 with virt-manager and it starts OK. The only problem is that sshd does not run complaining "/dev/null is not a character device". # ls -l /dev/null -rw-r--r-- 1 root root 0 2014-02-25 22:39 /dev/null /sys/fs/cgroup/devices/machine/VM_NAME.libvirt-lxc/devices.list has "c 1:3 rwm" line, but I cannot create /dev/null: # mknod /dev/nulll c 1 3 mknod: `/dev/nulll': Operation not permitted Thanks, Nerijus

2 2

[libvirt-users] Problems with tls connection when ran with user privileges
by Pasquale Dir 27 Feb '14

27 Feb '14

I set up my certificates, ca client and server, as described in your documentation: http://wiki.libvirt.org/page/TLSCreateServerCerts. I followed it step by step so it must be ok. However, when I run virsh -c qemu://192.168.1.2/system and I try a command like list --all I get: error: impossible connect to the hypervisor errore: no valid connection errore: Unable to set x509 CA certificate: /etc/pki/CA/cacert.pem: Error while reading file. If I run the same command with root privileges: virsh -c qemu://192.168.1.2/system everything works, anyway I get this warning too: 2014-02-26 13:03:25.035+0000: 10825: info : libvirt version: 1.1.1 2014-02-26 13:03:25.035+0000: 10825: warning : virNetTLSContextCheckCertKeyPurpose:364 : Certificate /etc/pki/libvirt/clientcert.pem purpose does not allow use for with a TLS client I don't know if it is a problem, I need to live migrate machines... Anyway, main problem is that I don't want to run virsh with root privileges. Where the problem is?

1 1

[libvirt-users] libvirt iSCSI target discovery
by Sijo Jose 26 Feb '14

26 Feb '14

Hi, Is it possible to discover iSCSI targets using libvirt API..? OR is it possible to get the similar results of below commands using libvirtAPI..? iscsiadm --mode discovery --type sendtargets --portal server1.example.com sudo iscsiadm -m discovery -t st -p 192.168.0.10 Regards Sijo

2 1

[libvirt-users] assigning a single IP to the guest with "typical" hosting provider
by Tomasz Chmielewski 25 Feb '14

25 Feb '14

I have a server with a hosting company, Hetzner. The servers at this hosting company have a public IP, let's say, A.B.C.D/255.255.255.x. Additionally, one can order extra IPs like below: 1) additional subnet (let's say X.Y.Z.0 / 28) 2) single IP (let's say, E.F.G.H) With additional subnet, assigning the IP to libvirt guest is simple: - assign X.Y.Z.1 on the host - assign X.Y.Z.2 to the guest, with X.Y.Z.1 gateway - done, works fine. However, I'm having problems assigning a single IP to the guest (when there is no extra subnet on the host, but just an extra IP): - if I assign E.F.G.H/255.255.255.255 to the host, the IP is reachable from the internet - if I assign E.F.G.H to the guest (with a proper gateway), the guest is not able to communicate with the internet. Which networking mode should I use in this setup? Bridge, macvtap? I've tried both, without success (i.e. in macvtap mode, arp who-has are passed from the guest to the gateway, replies received on the host, but they are not passed to the guest). Has anyone ever set libvirt with a "typical" hosting provider, when only an extra IP, from a non-host subnet, is available for a guest? -- Tomasz Chmielewski http://wpkg.org

3 3

[libvirt-users] Rhel7 snap6 -- SR-IOV
by Murali Krishna 25 Feb '14

25 Feb '14

Hi, This is regarding SRIOV in Rhel7. I have added intel_iommu=on in grub.cfg file. When I attach Virtual Function to VM and I try to poweron the VM, I get the below error: [root@Dell-Rhel7 ~]# virsh start rhel64x64GA error: Failed to start domain rhel64x64GA error: internal error: early end of file from monitor: possible problem: qemu-kvm: -device vfio-pci,host=42:10.2,id=hostdev0,bus=pci.0,addr=0x8: vfio: failed to open /dev/vfio/vfio: Permission denied qemu-kvm: -device vfio-pci,host=42:10.2,id=hostdev0,bus=pci.0,addr=0x8: vfio: failed to setup container for group 47 qemu-kvm: -device vfio-pci,host=42:10.2,id=hostdev0,bus=pci.0,addr=0x8: vfio: failed to get group 47 qemu-kvm: -device vfio-pci,host=42:10.2,id=hostdev0,bus=pci.0,addr=0x8: Device initialization failed. qemu-kvm: -device vfio-pci,host=42:10.2,id=hostdev0,bus=pci.0,addr=0x8: Device 'vfio-pci' could not be initialized We are facing this problem with both Emulex and Intel adapters. Please help me to resolve this issue. Thanks, Murali.

2 1

Re: [libvirt-users] event-test.py cannot detects domain shutdown
by Kim Larry 21 Feb '14

21 Feb '14

2014년 2월 11일 오후 10:00에 Eric Blake <eblake(a)redhat.com> 작성: On 02/11/2014 12:20 AM, Kim Larry wrote: libvirtd version is 1.1.4 and using Xen for hypervisor. I'm not as familiar with the xen hypervisor as with qemu; it may just be the case that no one has coded the xen driver to send a shutdown event. At any rate, I can confirm that with the qemu driver, shutdown events are delivered. It is a bit weird that all except shutdown event are coded... If it is true, do I have to just wait? https://rwmj.wordpress.com/2010/11/08/want-help-dont-email-me-directly/ Or you could look into the source code and provide a patch; but discussing this on the list is a better way to get a reaction from someone familiar with the xen code. -- Eric Blake eblake redhat com +1-919-301-3266 Libvirt virtualization library http://libvirt.org Ah, I forgot to add libvirt-users in Cc... sorry. The thing I found today is that if libvirt uses xend driver, shutdown events are delivered, but if libvirt uses libxl drvier, doesn't show up anything. It seems there are bugs on shutdown event, so I did dig into the libvirt source briefly, but I couldn't find where libxl driver calls event callback. Any help will be greatly appreciated. Especially someone who is familiar with xen code.

3 5

[libvirt-users] Problems with qemu-system-arm and isa-serial
by Niccolo Rigacci 21 Feb '14

21 Feb '14

Hi, I'm trying to use libvirt for an armel virtual machine hosted into an x86_64 box. I know the command line to start qemu-system-arm directly, but I cannot figure a proper .xml configuration file to let libvirt do this job. The main problem is that I want a serial console attached via telnet, this is the Qemu incantation: -serial telnet::4000,server,nowait,nodelay Wahtever I do in libvirt, I get this paramter added: -device isa-serial which causes Qemu to fail: qemu-system-arm -M versatileab -device isa-serial \ -kernel vmlinuz-2.6.32-5-versatile qemu-system-arm: -device isa-serial: No 'ISA' bus found for device 'isa-serial' How can I instead have -device pl011, or just have the default devices provided by qemu-system-arm, i.e. to prevent libvirt from adding the -nodefaults switch? Thank you! -- Niccolo Rigacci - http://www.rigacci.net/ Campi Bisenzio - Firenze - Italy Tel. Office: +39-055-9331021, Mobile: +39-327-5619352

3 8

[libvirt-users] libvirt_lxc namespace and umount in global namespace
by Olivier Nicaise 21 Feb '14

21 Feb '14

Hi, I am currently having an issue with the libvirt_lxc binary that is launched when starting a lxc instance using libvirt. This process seems to have its own namespace for mounts. What happens is that if I umount something in the global namespace, it stays mounted in the libvirt_lxc namespace. I'm working with drbd, and after unmounting the mount point, I want to change the state of the drbd resource as Secondary. But if fails. Indeed, libvirt_lxc has still the resource which is mounted in its namespace. Currently, I wanted to test the setns tool to enter the namespace and umount the mount point. But I am currently on Ubuntu 12.04 with a 3.2.0-59 kernel which does not have /proc/[pid]/ns/mnt I can't upgrade to 3.8 (which have the proc mnt file) as the drbd tools are not compatible. Do you have an idea of what I could try ? Here I the steps I do to reproduce the issue: - Mount a drbd file system - Start a lxc instance with libvirt - Umount the drbd file system - Set the drbd resource as secondary. => Does not work

2 2

[libvirt-users] problem with nwfilter direction='out'
by Stephan Sachse 20 Feb '14

20 Feb '14

i test the following simple filter <filter name='nwfilter-test-fedora2' chain='root'> <uuid>ccbd255f-4be5-4f0f-8835-770ea40cb2c9</uuid> <rule action='accept' direction='out' priority='500'> <tcp dstipaddr='10.1.24.0' dstipmask='24' comment='test test test'/> </rule> </filter> but i get strange results (look at the attached output of iptables-save) for me it looks like the direction='out' filters are attached to every chain for this domain. additional there are wrong conntrack, state and ctdir matches. is this a bug or my fault? /stephan -- Software is like sex, it's better when it's free!

1 1

[libvirt-users] Networkfilters in Routed setup
by h0rst 20 Feb '14

20 Feb '14

Hello! Since i could not find any information on the internet about this subject, i'm going to try my luck on this list. I'm trying to setup network-filter on a routed setup. I have a root-server at Hetzner, a german hosting provider. Along with my server i ordered a (/28) subnet to be able to setup dedicated IPs for my virtual machines (KVM). My Server is running Ubuntu 12.04 with libvirt 0.9.8 . Since Hetzner does not allow any bridged traffic, i had to setup a routed network. Currently my (via libvirt) defined network looks like this: (lets assume my subnet is 1.2.3.64/28): <network> <name>hetzner-subnet-v4</name> <forward dev='eth0' mode='route'> <interface dev='eth0'/> </forward> <bridge name='route-br0' stp='off' delay='0' /> <mac address='52:54:00:F0:D0:AA'/> <ip address='1.2.3.65' netmask='255.255.255.240'></ip> </network> The network definition for all running VMs looks like this: <interface type='network'> <mac address='52:54:00:00:00:##'/> <source network='hetzner-subnet-v4'/> </interface> Without using Network-Filters, this setup is running as expected. All traffic is correctly forwarded to my virtual machines connected to "route-br0" and the following iptables-rules are created in the FORWARD Chain: Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) target prot opt in out source destination ACCEPT all -- eth0 route-br0 0.0.0.0/0 1.2.3.64/28 ACCEPT all -- route-br0 eth0 1.2.3.64/28 0.0.0.0/0 ACCEPT all -- route-br0 route-br0 0.0.0.0/0 0.0.0.0/0 REJECT all -- * route-br0 0.0.0.0/0 0.0.0.0/0 reject-with icmp-port-unreachable REJECT all -- route-br0 * 0.0.0.0/0 0.0.0.0/0 reject-with icmp-port-unreachable When i try to setup a network-filter for a VM (a modified version of http://libvirt.org/formatnwfilter.html last example): <filter name='server-x' chain='root'> <filterref filter='clean-traffic'/> <rule action='accept' direction='in' priority='500'> <all state='ESTABLISHED'/> </rule> <rule action='accept' direction='out' priority='500'> <all state='ESTABLISHED,RELATED'/> </rule> <rule action='accept' direction='in' priority='500'> <tcp state='NEW' dstportstart='22'/> </rule> <rule action='accept' direction='out' priority='500'> <all state='NEW'/> </rule> <rule action='drop' direction='inout' priority='500'> <all/> </rule> </filter> and adding the filter to my interface-definition of a VM using the following syntax: <filterref filter='server-x'> <parameter name='IP' value='1.2.3.70'/> </filterref> additional iptable-rules are getting created. The problematic rule seems to be the following: -A libvirt-out -m physdev --physdev-out vnetX -g FO-vnetX which should trigger the following rules: -A FO-vnetX -p all -m state --state ESTABLISHED -j ACCEPT -A FO-vnetX -p tcp --dport 22 -m state --state NEW -j ACCEPT But this actually never happens. The FO-vnetX Chain never sees any packets and my syslog says: xt_physdev: using --physdev-out in the OUTPUT, FORWARD and POSTROUTING chains for non-bridged traffic is not supported anymore Am i doing something wrong? I hope i did not write too much useless stuff here. I'm tried to figure it all out by myself, but im currently stuck. Lets hope some wise guys can help me out here. Maybe there is some documentation i have missed? Thanks! kind regards, Sebastian

3 6

[libvirt-users] Errors with ESX driver & floppy0.filename
by Phil Mayers 20 Feb '14

20 Feb '14

We're getting the following error with one or two ESX VMs using libvirt; I'm only trying to read the domain config here, not make changes: libvir: error : internal error Invalid or not yet handled value 'Floppy drive 1' for VMX entry 'floppy0.fileName' Is there a way I can tell it to ignore unknown stuff?

1 0

[libvirt-users] Right way to do SAN-based shared storage?
by urgrue 19 Feb '14

19 Feb '14

I'm trying to set up SAN-based shared storage in KVM, key word being "shared" across multiple KVM servers for a) live migration and b) clustering purposes. But it's surprisingly sparsely documented. For starters, what type of pool should I be using?

3 3

[libvirt-users] Error when building from source
by arnaud gaboury 19 Feb '14

19 Feb '14

Hi all, I can not build from source since a few days. Make left me with this error: Making install in tools/wireshark make[1]: Entering directory '/developement/aur/libvirt-git/src/libvirt/tools/wireshark' make[2]: Entering directory '/developement/aur/libvirt-git/src/libvirt/tools/wireshark' make[3]: Entering directory '/developement/aur/libvirt-git/src/libvirt/tools/wireshark' make[3]: Nothing to be done for 'install-exec-am'. make[3]: Nothing to be done for 'install-data-am'. make[3]: Leaving directory '/developement/aur/libvirt-git/src/libvirt/tools/wireshark' make[2]: Leaving directory '/developement/aur/libvirt-git/src/libvirt/tools/wireshark' make[1]: Leaving directory '/developement/aur/libvirt-git/src/libvirt/tools/wireshark' mv: cannot stat ‘/developement/aur/libvirt-git/pkg/libvirt-git/lib/*’: No such file or directory I am on Arch linux and use the AUR mechanism package to build/install packages from source. Here is the build part of the PKGBUILD file : build() { cd "$srcdir/libvirt" export LDFLAGS=-lX11 export RADVD=/usr/bin/radvd ./autogen.sh #./configure --prefix=/usr --libexec=/usr/lib/"$pkgname" --sbindir=/usr/bin \ ./configure --prefix=/usr --libexec=/usr/lib/"${pkgname/-git/}" --sbindir=/usr/bin \ --with-storage-lvm --without-xen --with-udev --without-hal --disable-static \ --with-init-script=systemd --with-audit \ --with-qemu-user=nobody --with-qemu-group=nobody \ --without-netcf --with-interface Thank you for help.

2 1

[libvirt-users] lxc state driver is not active
by Tom Taylor 18 Feb '14

18 Feb '14

So I've followed this tutorial on a vanilla CentOS 6.5 (x64) hardware install ... http://wiki.centos.org/HowTos/LXC-on-CentOS6 (barring the name and location of the container) I'm getting the following error when trying to intialise the container ... # virt-install --connect lxc:/// --name dns --ram 512 --vcpu 1 --filesystem /srv/lxc/dns,/ --noautoconsole ERROR internal error lxc state driver is not active Does this howto miss a step somewhere? Is something in the CentOS distribution broken? # rpm -qa | egrep 'lxc|libvirt' lxc-0.9.0-2.el6.x86_64 libvirt-python-0.10.2-29.el6_5.3.x86_64 lxc-libs-0.9.0-2.el6.x86_64 libvirt-client-0.10.2-29.el6_5.3.x86_64 libvirt-0.10.2-29.el6_5.3.x86_64 lxc-templates-0.9.0-2.el6.x86_64 Thanks Tom Taylor

1 0

[libvirt-users] libvirtd ssl configuration
by Гусев Павел 18 Feb '14

18 Feb '14

Hi! I found little semantics bug: [13:53:40] root@dedicated-04:~ # LC_ALL=C libvirtd -h libvirtd: invalid option -- 'h' Usage: libvirtd [options] Options: -v | --verbose Verbose messages. -d | --daemon Run as a daemon & write PID file. -l | --listen Listen for TCP/IP connections. -t | --timeout <secs> Exit after timeout period. -f | --config <file> Configuration file. | --version Display version information. -p | --pid-file <file> Change name of PID file. libvirt management daemon: Default paths: Configuration file (unless overridden by -f): /etc/libvirt/libvirtd.conf Sockets: /var/run/libvirt/libvirt-sock /var/run/libvirt/libvirt-sock-ro TLS: CA certificate: /etc/pki/CA/caert.pem Server certificate: /etc/pki/libvirt/servercert.pem Server private key: /etc/pki/libvirt/private/serverkey.pem PID file (unless overridden by -p): /var/run/libvirtd.pid I think that caert.pem should be cacert.pem =) Tnx. С уважением, Гусев Павел Руководитель отдела системного администрирования QSOFT | Ведущий web-интегратор офис 7(495) 771-7363 #110 | моб. 7(926) 850-1108 pgusev(a)qsoft.ru Москва, Авангардная улица, 3 | qsoft.ru San Francisco, 222 Columbus Ave | qsoftus.com

2 2

[libvirt-users] tftp server inside a container ?
by Thomas Elsgaard 16 Feb '14

16 Feb '14

Hi list I am trying to understand the containers in red hat 7, and i have following questions: 1) Would it be possible to run an tftp server inside an container ? 2) Can i have containers binding to vlans on the host, so that i can have containers with overlapping IP networks, but in different vlans ? What i am trying to achieve is 10 containers with an tftp server inside, where the containers are on isolated IP networks via vlans. Thomas

1 0

[libvirt-users] lxc and cgroups
by arnaud gaboury 15 Feb '14

15 Feb '14

Dear list, I am bulding a VM using libvirt and lxc for linux container. I have an issue with my cgroups settings: gabx@hortensia ➤➤ ~ # virsh start dahlia error: Failed to start domain dahlia error: internal error: No valid cgroup for machine dahlia My environement: Host : Arch Linux - systemd 208-11, libvirt 1.2.1-4 guest : Arch Linux , machine name : dahlia , /etc/libvirt/lxc/dahlia.xml , mounted in /machine/dahlia My set up so far : - gabx@hortensia ➤➤ ~ % sudo virsh uri [sudo] password for root: lxc:/// - gabx@hortensia ➤➤ ~ # virsh -c lxc:/// list --all Id Name State ---------------------------------------------------- - dahlia shut off - custom kernel with user space set gabx@hortensia ➤➤ ~ % zgrep USER_NS /proc/config.gz CONFIG_USER_NS=y - /etc/libvirt/lxc/dahlia.xml $ ls -al -rw------- 1 root root 1.1K Feb 15 12:11 /etc/libvirt/lxc/dahlia.xml $ cat <domain type='lxc'> <name>dahlia</name> <uuid>a34b58db-894f-4f4a-81f0-b13d2d5d7732</uuid> <memory unit='KiB'>409600</memory> <currentMemory unit='KiB'>409600</currentMemory> <vcpu placement='static'>1</vcpu> <resource> <partition>/machine/dahlia</partition> </resource> <os> <type arch='x86_64'>exe</type> <init>/bin/init</init> </os> <idmap> <uid start='0' target='1000' count='10'/> <gid start='0' target='1000' count='10'/> </idmap> <clock offset='utc'/> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>destroy</on_crash> <devices> <emulator>/usr/lib/libvirt/libvirt_lxc</emulator> <interface type='network'> <mac address='52:54:00:89:8f:1a'/> <source network='default'/> </interface> <console type='pty'> <target type='lxc' port='0'/> </console> </devices> </domain> - fstab : UUID=f69d032f-c80f-4f2e-84cd-d2328a862818 /machine/dahlia ext4 defaults,relatime,discard 0 1 $ ls -al drwxr-xr-x 17 root root 4.0K Feb 11 21:41 dahlia/ - /etc/cgconfig: group dahlia { perm { # who can manage limits admin { uid = 1000; gid = 1004; } # who can add task task { uid = 1000; gid = 1004; } } # create this group in the controllers cpu { } cpuset { } memory { } devices { } freezer { } net_cls { } blkio { } } - /etc/cgrules is deafult one, so everything is commented. Maybe shall I edit a line ?? - gabx@hortensia ➤➤ ~ # cat /proc/cgroups #subsys_name hierarchy num_cgroups enabled cpuset 3 5 1 cpu 4 4 1 cpuacct 4 4 1 memory 5 5 1 devices 6 4 1 freezer 7 5 1 net_cls 8 5 1 blkio 9 4 1 Something puzzles me. In /sys/fs/cgroup/blkio, I see two dirs: dahlia and machine.slice. Inside machine.slice, I see another dir machine-dahlia. I guess there is something wrong here !! Same for cpuset or other controllers. - gabx@hortensia ➤➤ ~ % systemctl status machine-dahlia.slice machine-dahlia.slice - dahlia VM slice Loaded: loaded (/etc/systemd/system/machine-dahlia.slice; static) Active: active since Sat 2014-02-15 11:53:01 CET; 15min ago Feb 15 11:53:01 hortensia systemd[1]: Starting dahlia VM slice. Feb 15 11:53:01 hortensia systemd[1]: Created slice dahlia VM slice. My systemd unit file machine-dahlia.slice in /etc/systemd/system Apologize for the long post, but I wanted to detail everything. Thank you for help on my cgroup set up.

1 2

[libvirt-users] libvirt crashes with Caught Segmentation violation
by Minami Katsumata 14 Feb '14

14 Feb '14

Hi, I'm having problems with libvirt crashing after a couple hours when a specific domain monitoring program is running. I have pasted below the following: 1. libvirt version 2. qemu-kvm version 3. OS version 4. Kernel version 5. libvirt status post-crash 6. libvirtd.log (info level dump around crash; too long to post everything so just the beginning and end. UTC) 7. custom.log (on what this domain monitoring program was doing around the time of the crash. JST) 8. FYI on the program being executed 9. other related server settings Please, if anyone can look through these and give some insight as to what is causing libvirt to crash, that would be greatly appreciated. 1.) libvirt version: # rpm -q libvirt libvirt-0.9.10-21.el6.x86_64 2.) qemu-kvm version: qemu-kvm-0.12.1.2-3.295.el6.10.x86_64 3.) OS version: # cat /etc/redhat-release CentOS release 6.3 (Final) 4.) Kernel version: # uname -r 2.6.32-279.22.1.el6.x86_64 5.) libvirt status after crash: # service libvirtd status libvirtd dead but pid file exists 6.) libvirtd.log 2014-02-06 10:25:05.173+0000: 1187: info : remoteDispatchAuthList:2091 : Bypass polkit auth for privileged client pid:58626,uid:0 2014-02-06 10:25:05.237+0000: 1184: info : remoteDispatchAuthList:2091 : Bypass polkit auth for privileged client pid:58636,uid:0 2014-02-06 10:25:05.271+0000: 1185: info : remoteDispatchAuthList:2091 : Bypass polkit auth for privileged client pid:58646,uid:0 2014-02-06 10:25:05.301+0000: 1184: info : remoteDispatchAuthList:2091 : Bypass polkit auth for privileged client pid:58648,uid:0 2014-02-06 10:25:05.400+0000: 1184: info : remoteDispatchAuthList:2091 : Bypass polkit auth for privileged client pid:58650,uid:0 Caught Segmentation violation dumping internal log buffer: ====== start of log ===== ^(a)05.412+00001182: debug : virEventPollMakePollFDs:383 : Prepare n=19 w=21, f=32 e=25 d=0 2014-02-06 10:25:05.412+00001182: debug : virEventPollMakePollFDs:383 : Prepare n=20 w=22, f=34 e=25 d=0 2014-02-06 10:25:05.412+00001182: debug : virEventPollMakePollFDs:383 : Prepare n=21 w=23, f=33 e=25 d=0 2014-02-06 10:25:05.412+00001182: debug : virEventPollMakePollFDs:383 : Prepare n=22 w=24, f=36 e=25 d=0 2014-02-06 10:25:05.412+00001182: debug : virEventPollMakePollFDs:383 : Prepare n=23 w=25, f=38 e=25 d=0 2014-02-06 10:25:05.412+00001182: debug : virEventPollMakePollFDs:383 : Prepare n=24 w=26, f=39 e=25 d=0 2014-02-06 10:25:05.412+00001182: debug : virEventPollMakePollFDs:383 : Prepare n=25 w=27, f=41 e=25 d=0 2014-02-06 10:25:05.412+00001182: debug : virEventPollMakePollFDs:383 : Prepare n=26 w=28, f=40 e=25 d=0 (cut out due to length) 2014-02-06 10:25:05.423+00001182: debug : virEventPollDispatchHandles:488 : EVENT_POLL_DISPATCH_HANDLE: watch=2791 events=2 2014-02-06 10:25:05.423+00001182: debug : virNetMessageFree:75 : msg=0x2326a20 nfds=0 cb=(nil) 2014-02-06 10:25:05.423+00001182: debug : virNetServerClientCalculateHandleMode:137 : tls=(nil) hs=-1, rx=0x2266390 tx=(nil) 2014-02-06 10:25:05.423+00001182: debug : virNetServerClientCalculateHandleMode:167 : mode=1 2014-02-06 10:25:05.423+00001182: debug : virEventPollUpdateHandle:151 : EVENT_POLL_UPDATE_HANDLE: watch=2791 events=1 2014-02-06 10:25:05.423+00001182: debug : virEventPollInterruptLocked:702 : Skip interrupt, 1 -1675536288 2014-02-06 10:25:05.423+00001182: debug : virEventPollDispatchHandles:474 : i=33 w=2793 2014-02-06 10:25:05.423+00001182: debug : virEventPollCleanupTimeouts:506 : Cleanup 12 2014-02-06 10:25:05.423+00001182: debug : virEventPollCleanupHandles:554 : Cleanup 34 2014-02-06 10:25:05.423+00001182: debug : virNetServerClientClose:632 : client=0x22e6860 refs=3 2014-02-06 10:25:05.423+00001182: debug : virKeepAliveStop:382 : RPC_KEEPALIVE_STOP: ka=0x225bf20 client=0x22e6860 2014-02-06 10:25:05.423+00001182: debug : virEventPollRemoveTimeout:293 : EVENT_POLL_REMOVE_TIMEOUT: timer=8290 2014-02-06 10:25:05.423+00001182: debug : virEventPollInterruptLocked:702 : Skip interrupt, 0 -1675536288 2014-02-06 10:25:05.423+00001182: debug : virEventPollRemoveTimeout:293 : EVENT_POLL_REMOVE_TIMEOUT: timer=8289 2014-02-06 10:25:05.423+00001182: debug : virEventPollInterruptLocked:702 : Skip interrupt, 0 -1675536288 2014-02-06 10:25:05.423+00001182: debug : virKeepAliveFree:304 : RPC_KEEPALIVE_FREE: ka=0x225bf20 client=0x22e6860 refs=3 2014-02-06 10:25:05.423+00001182: debug : daemonRemoveAllClientStreams:493 : stream=(nil) 2014-02-06 10:25:05.423+00001182: debug : virEventPollRemoveHandle:180 : EVENT_POLL_REMOVE_HANDLE: watch=2791 2014-02-06 10:25:05.423+00001182: debug : virEventPollRemoveHandle:193 : mark delete 32 50 2014-02-06 10:25:05.423+00001182: debug : virEventPollInterruptLocked:702 : Skip interrupt, 0 -1675536288 2014-02-06 10:25:05.423+00001182: debug : virNetMessageFree:75 : msg=0x2266390 nfds=0 cb=(nil) 2014-02-06 10:25:05.423+00001182: debug : virNetSocketFree:722 : RPC_SOCKET_FREE: sock=0x22e66a0 refs=2 2014-02-06 10:25:05.423+00001182: debug : virNetServerClientFree:591 : RPC_SERVER_CLIENT_FREE: client=0x22e6860 refs=3 2014-02-06 10:25:05.423+00001182: debug : virEventRunDefaultImpl:244 : running default event implementation 2014-02-06 10:25:05.423+00001182: debug : virEventPollCleanupTimeouts:506 : Cleanup 12 2014-02-06 10:25:05.423+00001182: debug : virEventPollCleanupTimeouts:519 : EVENT_POLL_PURGE_TIMEOUT: timer=8289 2014-02-06 10:25:05.423+00001182: debug : virKeepAliveFree:304 : RPC_KEEPALIVE_FREE: ka=0x225bf20 client=0x22e6860 refs=2 2014-02-06 10:25:05.423+00001182: debug : virEventPollCleanupTimeouts:519 : EVENT_POLL_PURGE_TIMEOUT: timer=8290 2014-02-06 10:25:05.423+00001182: debug : virKeepAliveFree:304 : RPC_KEEPALIVE_FREE: ka=0x225bf20 client=0x22e6860 refs=1 2014-02-06 10:25:05.423+00001182: debug : virNetServerClientFree:591 : RPC_SERVER_CLIENT_FREE: client=0x22e6860 refs=2 2014-02-06 10:25:05.423+00001182: debug : virEventPollCleanupHandles:554 : Cleanup 34 2014-02-06 10:25:05.423+00001182: debug : virEventPollCleanupHandles:567 : EVENT_POLL_PURGE_HANDLE: watch=2791 2014-02-06 10:25:05.423+00001182: debug : virNetServerClientFree:591 : RPC_SERVER_CLIENT_FREE: client=0x22e6860 refs=1 2014-02-06 10:25:05.423+00001182: debug : virConnectClose:1462 : conn=0x7f1b380c4630 2014-02-06 10:25:05.423+00001182: debug : virUnrefConnect:145 : unref connection 0x7f1b380c4630 1 2014-02-06 10:25:05.423+00001182: debug : virReleaseConnect:94 : release connection 0x7f1b380c4630 ====== end of log ===== 7.) custom.log Feb 6 19:25:05 jp7-rk90000 [authpriv.notice] sudo: zabbix : TTY=unknown ; PWD=/etc/zabbix/sender_scripts/compute ; USER=root ; COMMAND=/usr/bin/virsh domifstat i-8-114-VM Interf ace Feb 6 19:25:05 jp7-rk90000 [authpriv.err] sudo: PAM unable to dlopen(/lib64/security/pam_fprintd.so): /lib64/security/pam_fprintd.so: cannot open shared object file: No such file or directory Feb 6 19:25:05 jp7-rk90000 [authpriv.err] sudo: PAM adding faulty module: /lib64/security/pam_fprintd.so Feb 6 19:25:05 jp7-rk90000 [authpriv.notice] sudo: zabbix : TTY=unknown ; PWD=/etc/zabbix/sender_scripts/compute ; USER=root ; COMMAND=/usr/bin/virsh domifstat i-8-114-VM vnet4 Feb 6 19:25:05 jp7-rk90000 [authpriv.err] sudo: PAM unable to dlopen(/lib64/security/pam_fprintd.so): /lib64/security/pam_fprintd.so: cannot open shared object file: No such file or directory Feb 6 19:25:05 jp7-rk90000 [authpriv.err] sudo: PAM adding faulty module: /lib64/security/pam_fprintd.so Feb 6 19:25:05 jp7-rk90000 [authpriv.notice] sudo: zabbix : TTY=unknown ; PWD=/etc/zabbix/sender_scripts/compute ; USER=root ; COMMAND=/usr/bin/virsh list --all Feb 6 19:25:05 jp7-rk90000 [authpriv.err] sudo: PAM unable to dlopen(/lib64/security/pam_fprintd.so): /lib64/security/pam_fprintd.so: cannot open shared object file: No such file or directory Feb 6 19:25:05 jp7-rk90000 [authpriv.err] sudo: PAM adding faulty module: /lib64/security/pam_fprintd.so Feb 6 19:25:05 jp7-rk90000 [authpriv.notice] sudo: zabbix : TTY=unknown ; PWD=/etc/zabbix/sender_scripts/compute ; USER=root ; COMMAND=/usr/bin/virsh domiflist i-8-114-VM Feb 6 19:25:05 jp7-rk90000 [authpriv.err] sudo: PAM unable to dlopen(/lib64/security/pam_fprintd.so): /lib64/security/pam_fprintd.so: cannot open shared object file: No such file or directory Feb 6 19:25:05 jp7-rk90000 [authpriv.err] sudo: PAM adding faulty module: /lib64/security/pam_fprintd.so Feb 6 19:25:05 jp7-rk90000 [authpriv.notice] sudo: zabbix : TTY=unknown ; PWD=/etc/zabbix/sender_scripts/compute ; USER=root ; COMMAND=/usr/bin/virsh domifstat i-8-114-VM Interf ace Feb 6 19:25:05 jp7-rk90000 [authpriv.err] sudo: PAM unable to dlopen(/lib64/security/pam_fprintd.so): /lib64/security/pam_fprintd.so: cannot open shared object file: No such file or directory Feb 6 19:25:05 jp7-rk90000 [authpriv.err] sudo: PAM adding faulty module: /lib64/security/pam_fprintd.so Feb 6 19:25:05 jp7-rk90000 [authpriv.notice] sudo: zabbix : TTY=unknown ; PWD=/etc/zabbix/sender_scripts/compute ; USER=root ; COMMAND=/usr/bin/virsh domifstat i-8-114-VM vnet4 Feb 6 19:25:05 jp7-rk90000 [authpriv.err] sudo: PAM unable to dlopen(/lib64/security/pam_fprintd.so): /lib64/security/pam_fprintd.so: cannot open shared object file: No such file or directory Feb 6 19:25:05 jp7-rk90000 [authpriv.err] sudo: PAM adding faulty module: /lib64/security/pam_fprintd.so Feb 6 19:25:05 jp7-rk90000 [authpriv.notice] sudo: zabbix : TTY=unknown ; PWD=/etc/zabbix/sender_scripts/compute ; USER=root ; COMMAND=/usr/bin/virsh list --all Feb 6 19:25:05 jp7-rk90000 [authpriv.err] sudo: PAM unable to dlopen(/lib64/security/pam_fprintd.so): /lib64/security/pam_fprintd.so: cannot open shared object file: No such file or directory Feb 6 19:25:05 jp7-rk90000 [authpriv.err] sudo: PAM adding faulty module: /lib64/security/pam_fprintd.so Feb 6 19:25:05 jp7-rk90000 [authpriv.notice] sudo: zabbix : TTY=unknown ; PWD=/etc/zabbix/sender_scripts/compute ; USER=root ; COMMAND=/usr/bin/virsh list --all Feb 6 19:25:05 jp7-rk90000 [authpriv.err] sudo: PAM unable to dlopen(/lib64/security/pam_fprintd.so): /lib64/security/pam_fprintd.so: cannot open shared object file: No such file or directory Feb 6 19:25:05 jp7-rk90000 [authpriv.err] sudo: PAM adding faulty module: /lib64/security/pam_fprintd.so Feb 6 19:25:05 jp7-rk90000 [authpriv.notice] sudo: zabbix : TTY=unknown ; PWD=/etc/zabbix/sender_scripts/compute ; USER=root ; COMMAND=/usr/bin/virsh list --all Feb 6 19:25:05 jp7-rk90000 [authpriv.err] sudo: PAM unable to dlopen(/lib64/security/pam_fprintd.so): /lib64/security/pam_fprintd.so: cannot open shared object file: No such file or directory Feb 6 19:25:05 jp7-rk90000 [authpriv.err] sudo: PAM adding faulty module: /lib64/security/pam_fprintd.so 8.) FYI on this program: This program consists of three main scripts that are run via cron. 2 run every 5 minutes, and 1 runs every minute. The two scripts that are executed every 5 minutes rely heavily on the virsh command. However, it is made so that the simultaneous number of connections to libvirt is not too large; the max number of libvirt-sock connections at any given moment does not go over 6. As it is a domain monitoring program, it only executes the following virsh commands: virsh list --all virsh dominfo virsh domblklist virsh domblkstat virsh domiflist virsh domifstat 9.) other related server settings 9-1) user resource limits [root@ ~]# ulimit -a core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 773493 max locked memory (kbytes, -l) 64 max memory size (kbytes, -m) unlimited open files (-n) 1024 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 10240 cpu time (seconds, -t) unlimited max user processes (-u) 32768 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 9-2) libvirtd.conf The following settings have been changed: #max_clients = 20 max_clients = 250 #max_workers = 20 max_workers = 250 #max_requests = 20 max_requests = 250 Regards, Minami

2 2