
Hi guys. Is glusterFS/libgfapi support removed (permanently) too? In CentOS 9 Stream. thanks, L.

On Thu, Dec 09, 2021 at 08:45:52PM +0000, lejeczek wrote:
Hi guys.
Is glusterFS/libgfapi support removed (permanently) too? In CentOS 9 Stream.
Correct, the in-QEMU glusterfs client has been removed from builds of the qemu-kvm RPM in CentOS-9 / RHEL-9. If storing VM disk on gluster you will have to resort to using the in-kernel glusterfs client to mount the disks locally, whereupon QEMU can access them as plain files Regards, Daniel -- |: https://berrange.com -o- https://www.flickr.com/photos/dberrange :| |: https://libvirt.org -o- https://fstop138.berrange.com :| |: https://entangle-photo.org -o- https://www.instagram.com/dberrange :|

On 10/12/2021 11:08, Daniel P. Berrangé wrote:
On Thu, Dec 09, 2021 at 08:45:52PM +0000, lejeczek wrote:
Hi guys.
Is glusterFS/libgfapi support removed (permanently) too? In CentOS 9 Stream. Correct, the in-QEMU glusterfs client has been removed from builds of the qemu-kvm RPM in CentOS-9 / RHEL-9.
If storing VM disk on gluster you will have to resort to using the in-kernel glusterfs client to mount the disks locally, whereupon QEMU can access them as plain files
Guys, @redhat and all the others responsible - Official (but also blogs, changelogs, man pages, etc) docs have begun to form - https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/9-bet... Please put all those _critical_ changes everywhere and admin might go first to read for what's new & different, make it underscored + in-bold I'd suggest. many thanks, L.

On Fri, Dec 10, 2021 at 11:18:16AM +0000, lejeczek wrote:
On 10/12/2021 11:08, Daniel P. Berrangé wrote:
On Thu, Dec 09, 2021 at 08:45:52PM +0000, lejeczek wrote:
Hi guys.
Is glusterFS/libgfapi support removed (permanently) too? In CentOS 9 Stream. Correct, the in-QEMU glusterfs client has been removed from builds of the qemu-kvm RPM in CentOS-9 / RHEL-9.
If storing VM disk on gluster you will have to resort to using the in-kernel glusterfs client to mount the disks locally, whereupon QEMU can access them as plain files
Guys, @redhat and all the others responsible - Official (but also blogs, changelogs, man pages, etc) docs have begun to form - https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/9-bet... Please put all those _critical_ changes everywhere and admin might go first to read for what's new & different, make it underscored + in-bold I'd suggest.
I would ultimately expect this kind of thing to be documented in the release notes, under some kind of heading like "incompatible changes" or similar. We're only at 9.0-beta though, so docs are not all fully fleshed out yet. Regards, Daniel -- |: https://berrange.com -o- https://www.flickr.com/photos/dberrange :| |: https://libvirt.org -o- https://fstop138.berrange.com :| |: https://entangle-photo.org -o- https://www.instagram.com/dberrange :|

On Fri, Dec 10, 2021 at 11:28:29AM +0000, Daniel P. Berrangé wrote:
On Fri, Dec 10, 2021 at 11:18:16AM +0000, lejeczek wrote:
Guys, @redhat and all the others responsible - Official (but also blogs, changelogs, man pages, etc) docs have begun to form - https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/9-bet... Please put all those _critical_ changes everywhere and admin might go first to read for what's new & different, make it underscored + in-bold I'd suggest.
I would ultimately expect this kind of thing to be documented in the release notes, under some kind of heading like "incompatible changes" or similar. We're only at 9.0-beta though, so docs are not all fully fleshed out yet.
The document you're looking for is https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/9-bet... and the part specific to virtualization is https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/9-bet... The removal of SPICE is mentioned, but that of glusterfs isn't. If you look at https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/9-bet... you'll see that the qemu-kvm-block-gluster and libvirt-daemon-driver-storage-gluster packages have been dropped, but it's questionable whether this is prominent enough for people to actually notice. -- Andrea Bolognani / Red Hat / Virtualization

On 10/12/2021 13:13, Andrea Bolognani wrote:
On Fri, Dec 10, 2021 at 11:28:29AM +0000, Daniel P. Berrangé wrote:
On Fri, Dec 10, 2021 at 11:18:16AM +0000, lejeczek wrote:
Guys, @redhat and all the others responsible - Official (but also blogs, changelogs, man pages, etc) docs have begun to form - https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/9-bet... Please put all those _critical_ changes everywhere and admin might go first to read for what's new & different, make it underscored + in-bold I'd suggest. I would ultimately expect this kind of thing to be documented in the release notes, under some kind of heading like "incompatible changes" or similar. We're only at 9.0-beta though, so docs are not all fully fleshed out yet. The document you're looking for is
https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/9-bet...
and the part specific to virtualization is
https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/9-bet...
The removal of SPICE is mentioned, but that of glusterfs isn't. If you look at
https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/9-bet...
you'll see that the qemu-kvm-block-gluster and libvirt-daemon-driver-storage-gluster packages have been dropped, but it's questionable whether this is prominent enough for people to actually notice.
really?? That was one of the most useful & practical bits - having libvirt&qemu to make use of GlusterFS without having to "expose" GF volumes to the filesystem. (everybody who do virt+glusterfs I know, do have it that way) thanks, L.

10.12.2021 18:27, lejeczek пишет:
really?? That was one of the most useful & practical bits - having libvirt&qemu to make use of GlusterFS without having to "expose" GF volumes to the filesystem. (everybody who do virt+glusterfs I know, do have it that way)
I guess this will be available only in RHEV :-) or in-kernel glusterfs client... what is it? I know only about fuse.

On Fri, Dec 10, 2021 at 09:03:55PM +0400, Dmitry Melekhov wrote:
10.12.2021 18:27, lejeczek пишет:
really?? That was one of the most useful & practical bits - having libvirt&qemu to make use of GlusterFS without having to "expose" GF volumes to the filesystem. (everybody who do virt+glusterfs I know, do have it that way)
I guess this will be available only in RHEV :-)
RHEV is based on RHEL-8, so changes in RHEL-9 don't impact it. Regards, Daniel -- |: https://berrange.com -o- https://www.flickr.com/photos/dberrange :| |: https://libvirt.org -o- https://fstop138.berrange.com :| |: https://entangle-photo.org -o- https://www.instagram.com/dberrange :|

10.12.2021 21:10, Daniel P. Berrangé пишет:
On Fri, Dec 10, 2021 at 09:03:55PM +0400, Dmitry Melekhov wrote:
10.12.2021 18:27, lejeczek пишет:
really?? That was one of the most useful & practical bits - having libvirt&qemu to make use of GlusterFS without having to "expose" GF volumes to the filesystem. (everybody who do virt+glusterfs I know, do have it that way)
I guess this will be available only in RHEV :-) RHEV is based on RHEL-8, so changes in RHEL-9 don't impact it.
I'm sure next RHEV will be based on 9 :-)

On Fri, Dec 10, 2021 at 7:18 PM Dmitry Melekhov <dm@belkam.com> wrote:
10.12.2021 21:10, Daniel P. Berrangé пишет:
On Fri, Dec 10, 2021 at 09:03:55PM +0400, Dmitry Melekhov wrote:
10.12.2021 18:27, lejeczek пишет:
really?? That was one of the most useful & practical bits - having libvirt&qemu to make use of GlusterFS without having to "expose" GF volumes to the filesystem. (everybody who do virt+glusterfs I know, do have it that way)
I guess this will be available only in RHEV :-) RHEV is based on RHEL-8, so changes in RHEL-9 don't impact it.
I'm sure next RHEV will be based on 9 :-)
There will be no RHV on RHEL 9, but we work on porting oVirt to Centos Stream 9, so it should work on RHEL 9. Since native Gluster support was removed in qemu and libvirt, oVirt will not be able to support it in 9. You can ask on devel@ovirt.org if you need more info. Nir

On Sun, Dec 12, 2021 at 12:51 AM Nir Soffer <nsoffer@redhat.com> wrote:
On Fri, Dec 10, 2021 at 7:18 PM Dmitry Melekhov <dm@belkam.com> wrote:
10.12.2021 21:10, Daniel P. Berrangé пишет:
On Fri, Dec 10, 2021 at 09:03:55PM +0400, Dmitry Melekhov wrote:
10.12.2021 18:27, lejeczek пишет:
really?? That was one of the most useful & practical bits - having libvirt&qemu to make use of GlusterFS without having to "expose" GF volumes to the filesystem. (everybody who do virt+glusterfs I know, do have it that way)
I guess this will be available only in RHEV :-) RHEV is based on RHEL-8, so changes in RHEL-9 don't impact it.
I'm sure next RHEV will be based on 9 :-)
There will be no RHV on RHEL 9, but we work on porting oVirt to Centos Stream 9, so it should work on RHEL 9. Since native Gluster support was removed in qemu and libvirt, oVirt will not be able to support it in 9.
You can ask on devel@ovirt.org if you need more info.
Please see https://access.redhat.com/support/policy/updates/rhev

12.12.2021 02:51, Nir Soffer пишет:
There will be no RHV on RHEL 9, but we work on porting oVirt to Centos Stream 9, so it should work on RHEL 9. Since native Gluster support was removed in qemu and libvirt, oVirt will not be able to support it in 9.
well, ok, thank you. so, we need to move to somewhere else after end of 8 :-) fuse is not an option...

On Fri, Dec 10, 2021 at 7:07 PM Dmitry Melekhov <dm@belkam.com> wrote:
10.12.2021 18:27, lejeczek пишет:
really?? That was one of the most useful & practical bits - having libvirt&qemu to make use of GlusterFS without having to "expose" GF volumes to the filesystem. (everybody who do virt+glusterfs I know, do have it that way)
I guess this will be available only in RHEV :-)
Even in RHV (RHEV was renamed to RHV a few years ago) native Gluster disk was never fully supported...
or
in-kernel glusterfs client... what is it? I know only about fuse.
... and fuse is the only fully supported way in RHV. Nir

12.12.2021 02:46, Nir Soffer пишет:
Even in RHV (RHEV was renamed to RHV a few years ago) native Gluster disk was never fully supported...
very interesting, thank you. it is supported in centos 7 build of qemu from RHEV, though, this is why I did this mistake :-( anyway, as I said before, we had some problems with fuse glusterfs client including memory leaks, don't remember about performance, so we'll stick with rhel 8 derivatives for several years. being optimistic I hope this will be for our life time ;-)
participants (5)
-
Andrea Bolognani
-
Daniel P. Berrangé
-
Dmitry Melekhov
-
lejeczek
-
Nir Soffer