2017-05-04 14:49 GMT+03:00 Daniel P. Berrange <berrange(a)redhat.com>:
So I think it is reasonable to simply increase the buffer size as
we have done before.
That said, we should bear this problem in mind before adding more
"bulk query" APIs, as it isn't sensible to carry on increasing
RPC message size forever. As somepoint we have to consider that
serializing 100's of MB of data into an RPC message is an
inherantly inefficient design, and consider alternative API
designs without this.
For bulk stats query we could do something totally radical and
have the facility for the client to send us a shared memory
region which we asynchronously populate with stats, avoiding the
RPC layer entirely. Obviously only works for local connections,
but I get the impression that most mgmt apps have a node-local
agent talking to libvirtd anyway.
Does it possible to compress/uncompress data before/after transmission?
I think that stats data can be efficient compressed...
--
Vasiliy Tolstov,
e-mail: v.tolstov(a)selfip.ru