8:46 a.m.
Hi,
Is there any way to get host OS information and host Storage in formations
using libvirt API...?
Rgds
-Sijo
2:58 p.m.
New subject: [libvirt] [libvirt-users] Host OS, Storage Info
Sijo,
*Pertaining to virt-manager and virsh sluggish behaviour after a clone
operation:*
Thanks for your response.
Honestly I do not know what "host Storage in formations using libvirt API"
means. Sorry.
I use virt-manager and virsh to do everything within KVM. If there is
something better or
another product/app that will enable me to drill down into the system...let
me know...
However, perhaps this can help:
We are running *CentOS 6 (Update 5) 64 bit* - patched as of 11 April 2014.
I create the virtual machines with the virt-install command using the*
--file* switch and lay the system images of the vm's on the RAID5.
The RAID5 uses ext4. The I/O to that volume is nice. We currently are
running twenty-six (26) VM's. There is no I/O wait. The system
has been up for thirteen (13) days. The load index (top) is between 1 and
3.
Also, I have the following kernel tweak in /etc/sysctl.conf:
vm.drop_caches = 3
NOTE: Writing to this will cause the kernel to drop clean caches, dentries
and inodes from memory, causing that memory to become free;
this helps to mitigate dipping into swap.
Thanks in advance for everything,
Tom
On Thu, May 22, 2014 at 2:46 AM, Sijo Jose <mailtosijojose(a)gmail.com> wrote:
Hi,
Is there any way to get host OS information and host Storage in formations
using libvirt API...?
Rgds
-Sijo
_______________________________________________
libvirt-users mailing list
libvirt-users(a)redhat.com
https://www.redhat.com/mailman/listinfo/libvirt-users
3:16 p.m.
On Thu, May 22, 2014 at 12:16:17PM +0530, Sijo Jose wrote:
Hi,
Is there any way to get host OS information and host Storage in formations
using libvirt API...?
Rgds
-Sijo
Check virsh help (most of the commands you probably want start with
'node' or 'vol'/'pool') or have a look at our hvsupport page [1]
for
virNode* and virStorage* functions.
If this isn't what you're looking for, specify your question in a
better way.
Martin
[1] http://libvirt.org/hvsupport.html
7:31 p.m.
New subject: [libvirt] [libvirt-users] Host OS, Storage Info
Martin, et al,
Sorry for the lag in response.
So I started playing with the various virsh commands. Awesome.
Been doing some reading and I believe I have some things configured not so
well.
As I stated earlier in the thread, we have all of the VM image files on one
RAID5. Very fast machine.
When using top, the load average is a stable "5.xx". No I/O wait. GB's of
free memory. Swap has not been touched.
Using vmstat, I am writing to the RAID5 volume at a constant 150MB/s and
reading at a constant 275MB/s.
With all of that said, here are some results from virsh commands:
# virsh pool-list --all
Name State Autostart
------------------------------------------------------
default active yes
# virsh pool-info default
Name: default
UUID: xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
State: running
Persistent: yes
Autostart: yes
Capacity: 30.76 GiB
Allocation: 2.10 GiB
Available: 28.66 GiB
Now, is that ok to have all of the VM's using a default pool?
Or should a pool be created for each VM instance.
I honestly am not even sure what a pool references...?...
The more I read, the more I am moving away from thinking something in the
OS is the cause of my sluggishness.
Suggestions?
Many thanks in advance,
Tom
On Thu, May 22, 2014 at 9:16 AM, Martin Kletzander <mkletzan(a)redhat.com>
wrote:
On Thu, May 22, 2014 at 12:16:17PM +0530, Sijo Jose wrote:
> Hi,
> Is there any way to get host OS information and host Storage in formations
> using libvirt API...?
> Rgds
> -Sijo
>
Check virsh help (most of the commands you probably want start with
'node' or 'vol'/'pool') or have a look at our hvsupport page [1]
for
virNode* and virStorage* functions.
If this isn't what you're looking for, specify your question in a
better way.
Martin
[1] http://libvirt.org/hvsupport.html
_______________________________________________
libvirt-users mailing list
libvirt-users(a)redhat.com
https://www.redhat.com/mailman/listinfo/libvirt-users
11:12 a.m.
New subject: [libvirt] [libvirt-users] Host OS, Storage Info
On Thu, May 29, 2014 at 01:31:13PM -0400, Ainsworth, Thomas wrote:
Martin, et al,
Sorry for the lag in response.
So I started playing with the various virsh commands. Awesome.
Been doing some reading and I believe I have some things configured not so
well.
As I stated earlier in the thread, we have all of the VM image files on one
RAID5. Very fast machine.
When using top, the load average is a stable "5.xx". No I/O wait. GB's of
free memory. Swap has not been touched.
Using vmstat, I am writing to the RAID5 volume at a constant 150MB/s and
reading at a constant 275MB/s.
With all of that said, here are some results from virsh commands:
# virsh pool-list --all
Name State Autostart
------------------------------------------------------
default active yes
# virsh pool-info default
Name: default
UUID: xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
State: running
Persistent: yes
Autostart: yes
Capacity: 30.76 GiB
Allocation: 2.10 GiB
Available: 28.66 GiB
Now, is that ok to have all of the VM's using a default pool?
Or should a pool be created for each VM instance.
I honestly am not even sure what a pool references...?...
Pool is a set of volumes of the same type (iscsi, LVs, files in a
folder, etc.) in the same place. Example is the default pool which is,
by default, in /var/lib/libvirt/images and volumes there are files
(pool type is "dir"). If you want to have all the domain disks in
that place and all the disks (volumes) should be files then default
pool is enough.
The more I read, the more I am moving away from thinking something in
the
OS is the cause of my sluggishness.
I haven't read your previous mail before, so I've found that now. How
often are you dropping those caches? That won't help you not to use
swap. Having memory occupied by buffers and caches is good if you
read/write from/to disks. Even when the reads/writes are as fast as
you mentioned, reading/writing from/to RAM is way faster and until
there's some free memory, why not use that?
Martin
1:31 p.m.
New subject: [libvirt] [libvirt-users] Host OS, Storage Info
Martin,
Thanks for the information. That makes sense. I *believe* we are good
there.
I noticed something weird yesterday. After a clone (via the virt-manager
GUI) it seems libvirtd locked up. A force quit pop up appeared - I had to
kill it. Then I restarted libvirtd. Then I did a "ps -edf | grep libvirt"
and there were three (3) libvirtd --daemon processes. Then any virsh
commands or virt-manager GUI (when it finally would come up) was very
sluggish. By the end of the day I had four (4) of the processes running.
Keep in mind, whilst all of this is going on the VM's were just cranking
along fine. I could not find any dead PID files elated to the processes to
kill...
...we rebooted the server at the end of the day. It should be fine until
the next time I attempt a clone operation - which I am hesitant to do for
obvious reasons...
Any ideas?
Thanks,
Tom
On Fri, May 30, 2014 at 5:12 AM, Martin Kletzander <mkletzan(a)redhat.com>
wrote:
On Thu, May 29, 2014 at 01:31:13PM -0400, Ainsworth, Thomas wrote:
> Martin, et al,
>
> Sorry for the lag in response.
>
> So I started playing with the various virsh commands. Awesome.
> Been doing some reading and I believe I have some things configured not so
> well.
> As I stated earlier in the thread, we have all of the VM image files on
> one
> RAID5. Very fast machine.
>
> When using top, the load average is a stable "5.xx". No I/O wait. GB's
of
> free memory. Swap has not been touched.
> Using vmstat, I am writing to the RAID5 volume at a constant 150MB/s and
> reading at a constant 275MB/s.
>
> With all of that said, here are some results from virsh commands:
>
> # virsh pool-list --all
> Name State Autostart
> ------------------------------------------------------
> default active yes
>
>
> # virsh pool-info default
> Name: default
> UUID: xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
> State: running
> Persistent: yes
> Autostart: yes
> Capacity: 30.76 GiB
> Allocation: 2.10 GiB
> Available: 28.66 GiB
>
>
> Now, is that ok to have all of the VM's using a default pool?
> Or should a pool be created for each VM instance.
> I honestly am not even sure what a pool references...?...
>
>
Pool is a set of volumes of the same type (iscsi, LVs, files in a
folder, etc.) in the same place. Example is the default pool which is,
by default, in /var/lib/libvirt/images and volumes there are files
(pool type is "dir"). If you want to have all the domain disks in
that place and all the disks (volumes) should be files then default
pool is enough.
The more I read, the more I am moving away from thinking something in the
> OS is the cause of my sluggishness.
>
>
I haven't read your previous mail before, so I've found that now. How
often are you dropping those caches? That won't help you not to use
swap. Having memory occupied by buffers and caches is good if you
read/write from/to disks. Even when the reads/writes are as fast as
you mentioned, reading/writing from/to RAM is way faster and until
there's some free memory, why not use that?
Martin
4:11 p.m.
New subject: [libvirt] [libvirt-users] Host OS, Storage Info
On Fri, May 30, 2014 at 07:31:28AM -0400, Ainsworth, Thomas wrote:
Martin,
Thanks for the information. That makes sense. I *believe* we are good
there.
I noticed something weird yesterday. After a clone (via the virt-manager
GUI) it seems libvirtd locked up. A force quit pop up appeared - I had to
kill it. Then I restarted libvirtd. Then I did a "ps -edf | grep libvirt"
and there were three (3) libvirtd --daemon processes. Then any virsh
commands or virt-manager GUI (when it finally would come up) was very
sluggish. By the end of the day I had four (4) of the processes running.
Keep in mind, whilst all of this is going on the VM's were just cranking
along fine. I could not find any dead PID files elated to the processes to
kill...
...we rebooted the server at the end of the day. It should be fine until
the next time I attempt a clone operation - which I am hesitant to do for
obvious reasons...
Any ideas?
I'd definitely try looking at the debug logs to see what the daemon is
doing, when there are more processes I'd try looking what the others
are doing by attaching with strace/gdb/whatever.
As a way out you can always stop the daemon, (kill all remaining ones
in your case) and start the daemon again.
Martin
Thanks,
Tom
On Fri, May 30, 2014 at 5:12 AM, Martin Kletzander <mkletzan(a)redhat.com>
wrote:
> On Thu, May 29, 2014 at 01:31:13PM -0400, Ainsworth, Thomas wrote:
>
>> Martin, et al,
>>
>> Sorry for the lag in response.
>>
>> So I started playing with the various virsh commands. Awesome.
>> Been doing some reading and I believe I have some things configured not so
>> well.
>> As I stated earlier in the thread, we have all of the VM image files on
>> one
>> RAID5. Very fast machine.
>>
>> When using top, the load average is a stable "5.xx". No I/O wait.
GB's of
>> free memory. Swap has not been touched.
>> Using vmstat, I am writing to the RAID5 volume at a constant 150MB/s and
>> reading at a constant 275MB/s.
>>
>> With all of that said, here are some results from virsh commands:
>>
>> # virsh pool-list --all
>> Name State Autostart
>> ------------------------------------------------------
>> default active yes
>>
>>
>> # virsh pool-info default
>> Name: default
>> UUID: xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
>> State: running
>> Persistent: yes
>> Autostart: yes
>> Capacity: 30.76 GiB
>> Allocation: 2.10 GiB
>> Available: 28.66 GiB
>>
>>
>> Now, is that ok to have all of the VM's using a default pool?
>> Or should a pool be created for each VM instance.
>> I honestly am not even sure what a pool references...?...
>>
>>
> Pool is a set of volumes of the same type (iscsi, LVs, files in a
> folder, etc.) in the same place. Example is the default pool which is,
> by default, in /var/lib/libvirt/images and volumes there are files
> (pool type is "dir"). If you want to have all the domain disks in
> that place and all the disks (volumes) should be files then default
> pool is enough.
>
>
> The more I read, the more I am moving away from thinking something in the
>> OS is the cause of my sluggishness.
>>
>>
> I haven't read your previous mail before, so I've found that now. How
> often are you dropping those caches? That won't help you not to use
> swap. Having memory occupied by buffers and caches is good if you
> read/write from/to disks. Even when the reads/writes are as fast as
> you mentioned, reading/writing from/to RAM is way faster and until
> there's some free memory, why not use that?
>
> Martin
>
--
libvir-list mailing list
libvir-list(a)redhat.com
https://www.redhat.com/mailman/listinfo/libvir-list
3762
days inactive
3770
days old
6 comments
3 participants
participants (3)
-
Ainsworth, Thomas -
Martin Kletzander -
Sijo Jose