I joined this mailing list after I googled and found this thread.

https://www.redhat.com/archives/libvir-list/2015-June/msg00583.html

Part of this thread read:

>So, further digging led me to [2], which in essence was the section of the libvirtd wiki page that the page claimed >was obsolete. Creating the .pkla authorization file finally enabled non-root privileged user management of a remote > >KVM host.

I was having this same problem, and I believe that what was needed was just the last usermod that added the non-root user to the libvirt group.  I did just that one line and things seemed to be much happier.