- Users - libvirt List Archives

[libvirt-users] libvirt remote connection
by Anastasiya Ruzhanskaya 21 Apr '17

21 Apr '17

Hello, I have some questions about libvirt remote connection. Am I right that internally libvirt uses only tcp ( ssh and tls are only encryption based on this) + ftp ( when working with image itself)? Also I have found that it uses RPC. However, as I know RPC runs above tcp but I cannot capture these packets with wireshark when I am connecting remotely to the host with vm? Is it somehow possible to find out, what data, what messages, in what format are send from my server to the remote libvirt (daemon I suppose?)?

2 3

[libvirt-users] understanding --idmap for containers (v2.5.0)
by mailing lists 20 Apr '17

20 Apr '17

Hello, I'm testing containers on a host machine without selinux so I'm trying use the idmap feature, but I must be missing something because all that I get is a readonly container for the root user. # virsh version --daemon Compiled against library: libvirt 2.5.0 Using library: libvirt 2.5.0 Using API: QEMU 2.5.0 Running hypervisor: QEMU 2.8.1 Running against daemon: 2.5.0 # virsh --connect lxc:/// dumpxml lab-gentoo-01 <domain type='lxc'> <name>lab-gentoo-01</name> <uuid>a9f73091-b716-4b61-95ad-fa1d0c061bef</uuid> <memory unit='KiB'>524288</memory> <currentMemory unit='KiB'>524288</currentMemory> <vcpu placement='static'>2</vcpu> <resource> <partition>/machine</partition> </resource> <os> <type arch='x86_64'>exe</type> <init>/bin/sh</init> </os> <idmap> <uid start='0' target='900' count='10'/> <gid start='0' target='900' count='10'/> </idmap> <features> <privnet/> </features> <cpu mode='host-model'> <model fallback='allow'/> </cpu> <clock offset='utc'/> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>destroy</on_crash> <devices> <emulator>/usr/libexec/libvirt_lxc</emulator> <filesystem type='mount' accessmode='passthrough'> <source dir='/media/containers/lab-gentoo-01/'/> <target dir='/'/> </filesystem> <interface type='bridge'> <mac address='00:16:3e:c8:13:14'/> <source bridge='bridge-01'/> </interface> <console type='pty'> <target type='lxc' port='0'/> </console> </devices> </domain> # ls -l /media/containers/lab-gentoo-01/ total 36 drwxr-xr-x 2 root root 4096 Apr 13 07:33 bin drwxr-xr-x 2 root root 18 Apr 13 03:28 boot drwxr-xr-x 7 root root 4096 Apr 18 12:45 dev drwxr-xr-x 31 root root 4096 Apr 18 12:49 etc drwxr-xr-x 2 root root 18 Apr 13 03:28 home lrwxrwxrwx 1 root root 5 Apr 13 06:13 lib -> lib64 drwxr-xr-x 2 root root 4096 Apr 13 06:14 lib32 drwxr-xr-x 9 root root 4096 Apr 13 07:33 lib64 drwxr-xr-x 2 root root 18 Apr 13 03:28 media drwxr-xr-x 2 root root 18 Apr 13 03:28 mnt drwxr-xr-x 2 root root 18 Apr 13 03:28 opt drwxr-xr-x 2 root root 6 Apr 13 03:18 proc drwx------ 2 root root 18 Apr 13 03:28 root drwxr-xr-x 2 root root 31 Apr 13 07:32 run drwxr-xr-x 2 root root 4096 Apr 13 07:36 sbin drwxr-xr-x 2 root root 18 Apr 13 03:28 sys drwxrwxrwt 2 root root 18 Apr 13 07:36 tmp drwxr-xr-x 13 root root 4096 Apr 18 12:49 usr drwxr-xr-x 9 root root 102 Apr 13 03:28 var # virsh --connect lxc:/// start --console lab-gentoo-01 Domain lab-gentoo-01 started Connected to domain lab-gentoo-01 Escape character is ^] sh-4.3# /usr/bin/id uid=0(root) gid=0(root) groups=0(root) sh-4.3# pwd / sh-4.3# touch asdf touch: cannot touch 'asdf': Permission denied sh-4.3# indeed the container is using the idmap feature because the efective uid/gid map (900/900) is not allowing writes in the filesystem, but it doesn't seems very usefull. is it possible to have read/write containers while using idmap?

2 2

[libvirt-users] VHPC at ISC extension - Papers due May 2
by VHPC 17 18 Apr '17

18 Apr '17

==================================================================== CALL FOR PAPERS 12th Workshop on Virtualization in High-Performance Cloud Computing (VHPC '17) held in conjunction with the International Supercomputing Conference - High Performance, June 18-22, 2017, Frankfurt, Germany. (Springer LNCS Proceedings) ==================================================================== Date: June 22, 2017 Workshop URL: http://vhpc.org Paper Submission Deadline: May 2, 2017 (extended), Springer LNCS, rolling abstract submission Abstract/Paper Submission Link: https://edas.info/newPaper.php?c=23179 Keynotes: Satoshi Matsuoka, Professor of Computer Science, Tokyo Institute of Technology and John Goodacre, Professor in Computer Architectures University of Manchester, Director of Technology and Systems ARM Ltd. Research Group and Chief Scientific Officer Kaleao Ltd. Call for Papers Virtualization technologies constitute a key enabling factor for flexible resource management in modern data centers, and particularly in cloud environments. Cloud providers need to manage complex infrastructures in a seamless fashion to support the highly dynamic and heterogeneous workloads and hosted applications customers deploy. Similarly, HPC environments have been increasingly adopting techniques that enable flexible management of vast computing and networking resources, close to marginal provisioning cost, which is unprecedented in the history of scientific and commercial computing. Various virtualization technologies contribute to the overall picture in different ways: machine virtualization, with its capability to enable consolidation of multiple underutilized servers with heterogeneous software and operating systems (OSes), and its capability to live-migrate a fully operating virtual machine (VM) with a very short downtime, enables novel and dynamic ways to manage physical servers; OS-level virtualization (i.e., containerization), with its capability to isolate multiple user-space environments and to allow for their coexistence within the same OS kernel, promises to provide many of the advantages of machine virtualization with high levels of responsiveness and performance; I/O Virtualization allows physical NICs/HBAs to take traffic from multiple VMs or containers; network virtualization, with its capability to create logical network overlays that are independent of the underlying physical topology and IP addressing, provides the fundamental ground on top of which evolved network services can be realized with an unprecedented level of dynamicity and flexibility; the increasingly adopted paradigm of Software-Defined Networking (SDN) promises to extend this flexibility to the control and data planes of network paths. Publication Accepted papers will be published in a Springer LNCS proceedings volume. Topics of Interest The VHPC program committee solicits original, high-quality submissions related to virtualization across the entire software stack with a special focus on the intersection of HPC and the cloud. Major Topics - Virtualization in supercomputing environments, HPC clusters, HPC in the cloud and grids - OS-level virtualization and containers (Docker, rkt, Singularity, Shifter, i.a.) - Lightweight/specialized operating systems, unikernels - Optimizations of virtual machine monitor platforms and hypervisors - Hypervisor support for heterogenous resources (GPUs, co-processors, FPGAs, etc.) - Virtualization support for emerging memory technologies - Virtualization in enterprise HPC and microvisors - Software defined networks and network virtualization - Management, deployment of virtualized environments and orchestration (Kubernetes i.a.), - Workflow-pipeline container-based composability - Performance measurement, modelling and monitoring of virtualized/cloud workloads - Virtualization in data intensive computing and Big Data processing - HPC convergence - Adaptation of HPC technologies in the cloud (high performance networks, RDMA, etc.) - ARM-based hypervisors, ARM virtualization extensions - I/O virtualization and cloud based storage systems - GPU, FPGA and many-core accelerator virtualization - Job scheduling/control/policy and container placement in virtualized environments - Cloud reliability, fault-tolerance and high-availability - QoS and SLA in virtualized environments - IaaS platforms, cloud frameworks and APIs - Large-scale virtualization in domains such as finance and government - Energy-efficient and power-aware virtualization - Container security - Configuration management tools for containers (including CFEngine, Puppet, i.a.) - Emerging topics including multi-kernel approaches and,NUMA in hypervisors The Workshop on Virtualization in High-Performance Cloud Computing (VHPC) aims to bring together researchers and industrial practitioners facing the challenges posed by virtualization in order to foster discussion, collaboration, mutual exchange of knowledge and experience, enabling research to ultimately provide novel solutions for virtualized computing systems of tomorrow. The workshop will be one day in length, composed of 20 min paper presentations, each followed by 10 min discussion sections, plus lightning talks that are limited to 5 minutes. Presentations may be accompanied by interactive demonstrations. Important Dates Rolling Abstract Submission May 2, 2017 - Paper submission deadline (extended) May 30, 2017 - Acceptance notification June 22, 2017 - Workshop Day July 18, 2017 - Camera-ready version due Chair Michael Alexander (chair), scaledinfra technologies, Austria Anastassios Nanos (co-chair), NTUA, Greece Balazs Gerofi (co-chair), RIKEN Advanced Institute for Computational Science, Japan Program committee Stergios Anastasiadis, University of Ioannina, Greece Jakob Blomer, CERN, Europe Ron Brightwell, Sandia National Laboratories, USA Eduardo César, Universidad Autonoma de Barcelona, Spain Julian Chesterfield, OnApp, UK Stephen Crago, USC ISI, USA Christoffer Dall, Columbia University, USA Patrick Dreher, MIT, USA Robert Futrick, Cycle Computing, USA Maria Girone, CERN, Europe Kyle Hale, Northwestern University, USA Romeo Kinzler, IBM, Switzerland Brian Kocoloski, University of Pittsburgh, USA Nectarios Koziris, National Technical University of Athens, Greece John Lange, University of Pittsburgh, USA Che-Rung Lee, National Tsing Hua University, Taiwan Giuseppe Lettieri, University of Pisa, Italy Qing Liu, Oak Ridge National Laboratory, USA Nikos Parlavantzas, IRISA, France Kevin Pedretti, Sandia National Laboratories, USA Amer Qouneh, University of Florida, USA Carlos Reaño, Technical University of Valencia, Spain Thomas Ryd, CFEngine, Norway Na Zhang, VMWare, USA Borja Sotomayor, University of Chicago, USA Craig Stewart, Indiana University, USA Anata Tiwari, San Diego Supercomputer Center, USA Kurt Tutschku, Blekinge Institute of Technology, Sweden Yasuhiro Watashiba, Osaka University, Japan Nicholas Wright, Lawrence Berkeley National Laboratory, USA Chao-Tung Yang, Tunghai University, Taiwan Paper Submission-Publication Papers submitted to the workshop will be reviewed by at least two members of the program committee and external reviewers. Submissions should include abstract, key words, the e-mail address of the corresponding author, and must not exceed 10 pages, including tables and figures at a main font size no smaller than 11 point. Submission of a paper should be regarded as a commitment that, should the paper be accepted, at least one of the authors will register and attend the conference to present the work. Accepted papers will be published in a Springer LNCS volume. . The format must be according to the Springer LNCS Style. Initial submissions are in PDF; authors of accepted papers will be requested to provide source files. Format Guidelines: ftp://ftp.springer.de/pub/tex/latex/llncs/latex2e/llncs2e.zip Abstract, Paper Submission Link: https://edas.info/newPaper.php?c=23179 Lightning Talks Lightning Talks are non-paper track, synoptical in nature and are strictly limited to 5 minutes. They can be used to gain early feedback on ongoing research, for demonstrations, to present research results, early research ideas, perspectives and positions of interest to the community. Submit abstract via the main submission link. General Information The workshop is one day in length and will be held in conjunction with the International Supercomputing Conference - High Performance (ISC) 2017, June 18-22, Frankfurt, Germany.

1 0

[libvirt-users] Libvirt and libssh2 with openauth
by spiperac 16 Apr '17

16 Apr '17

Hi all, i have same question as this one https://www.redhat.com/archives/libvirt-users/2014-March/msg00158.html. ( Only im using python) Is there any new follow-up on this? Thanks

2 1

[libvirt-users] Windows Guest Server 2016, bad performance of whole virtualisation system
by Marko Weber | 8000 13 Apr '17

13 Apr '17

hello , i did a kvm guest with virt-manager and installed windows server 2016. performance settings for the disk: hypervisor default for cache & io mode i added a 2nd disk to the guest , also with hypervisor default settings on cache & io mode Under disk settings in windows server 2016 i set "format whole disk NTFS" i did not choose the "quick format" option. when windows is formatting this 1TB drive the performance on the virtualisation host goes down loging via ssh take ages, top take 2 mins to start up. the physical disks are connected to a raid controller LSI and FS on virtualisation server where the qcow2 files are is XFS. DO i have to set another options for "performance options" as "hypervisor default" to keep the system performant on formatting the disk? thanks for any hints. marko -- zbfmail - Mittendrin statt nur Datei!

1 0

[libvirt-users] Windows Guest Server 2016, bad performance of whole virtualisation system
by Marko Weber | 8000 12 Apr '17

12 Apr '17

hello list, i did a kvm guest with virt-manager and installed windows server 2016. performance settings for the disk: hypervisor default for cache & io mode i added a 2nd disk to the guest , also with hypervisor default settings on cache & io mode Under disk settings in windows server 2016 i set "format whole disk NTFS" i did not choose the "quick format" option. when windows is formatting this 1TB drive the performance on the virtualisation host goes down loging via ssh take ages, top take 2 mins to start up. the physical disks are connected to a raid controller LSI and FS on virtualisation server where the qcow2 files are is XFS. DO i have to set another options for "performance options" as "hypervisor default" to keep the system performant on formatting the disk? thanks for any hints. marko -- zbfmail - Mittendrin statt nur Datei!

1 0

[libvirt-users] Cannot save domain
by Tony Arnold 06 Apr '17

06 Apr '17

I have a domain running a Windows 10 system on an Ubuntu 16.10 host system. The domain has 4096MiB of memory. When I try to save the domain, or managedsave the domain, I get an error when it's about 96% complete. The terminal session looks like this: virsh # save Windows10 windows10-20170402.save --bypass-cache --verbose Save: [ 95 %]error: Failed to save domain Windows10 to windows10- 0170402.save error: operation failed: domain is not running It seems the domain closes before the save has completed. libvirt is at version 2.1.0 Should I submit this as a bug, or is there something I can change to fix this? Regards, Tony. -- Tony Arnold MBCS, CITP | Senior IT Security Analyst | Directorate of IT Services | G64, Kilburn Building | The University of Manchester | Manchester M13 9PL | T: +44 161 275 6093 | M: +44 773 330 0039

2 1

[libvirt-users] creating a lxc image to be used with libvirt-lxc
by Spike 05 Apr '17

05 Apr '17

Dear all, I'm moving my first baby steps with libvirt-lxc trying to convert over from an LXD installation and one of the hurdles is putting together an image. All the examples I found about libvirt-lxc refer to running /bin/sh in a container, almost as if it was docker, as opposed to run a "full system" like I've been doing with lxd. Also virt-install, often referred in libvirt docs, seems to be specific/only for kvm. Can anybody point me to any documentation to achieve the same as you'd do with lxd? would it even just work to use those images ( https://cloud-images.ubuntu.com/) with libvirt? Last but not least, is there any way to "publish" a modified image so that I could make changes to any of the above and then reuse the modified one as a base for other containers? thank you, spike

2 4

[libvirt-users] libvirt-lxc: good for production?
by Spike 03 Apr '17

03 Apr '17

Dear all, I'm a happy lxc (lxd) user with a need to add a bunch of KVM images to the mix. More importantly I need to have some simple frontend to give users the ability to quickly run some VMs for testing. Researching the topic brought me to virt-manager and from there libvirt. I've had however a hard time to answer a few questions that I hope this list can help me with: 1) is the libvirt-lxc driver actively developed? there's been a lot of upgrades to lxc and there seems to be relatively little activity on the lxc driver 2) is libvirt-lxc to be used in production to begin with? every single guide I found about libvirt pretty much points to KVM usage, with simple /bin/sh examples with lxc. Furthermore stuff like virt-install seems to be exclusively catered to full os/KVM images creation, with no obvious way to create a container image. thanks for any input, even just docs I missed that explain the avove would be most helpful. Spike

2 2

[libvirt-users] (Live) Migration safe vs. unsafe
by Michael Hierweck 03 Apr '17

03 Apr '17

Hi all, virsh checks whether a (live) migration is safe or unsafe. When a migration is considered to be unsafe it is rejected unless the --unsafe option is prodivided. As a part of those checks virsh considers the cache settings for the underlying storage resources. In this context only cache="none" is considered to be safe. I wonder why cache="directsync" might be harmfull as it bypasses the host page cache completely. Regards, Michael

2 1