Re: Migration with "--p2p --tunnelled" hanging in v6.9.0

On Wed, Nov 25, 2020 at 05:20:41PM +0000, Daniel P. Berrangé wrote: > On Wed, Nov 25, 2020 at 05:00:20PM +0000, Daniel P. Berrangé wrote: > > On Wed, Nov 25, 2020 at 04:36:39PM +0000, Daniel P. Berrangé wrote: > > > On Wed, Nov 25, 2020 at 04:49:14PM +0100, Christian Ehrhardt wrote: > > > > I found that the same vol-download vs 127.0.0.1 gives the same results. > > > > That in turn makes it easier to gather results as we only need one system. > > > > > > Yep, that's useful, I'm able to reproduce this problem myself too > > > now. Will do some local tests and report back... > > > > Sigh, the problem is way too many reallocs, repeatedly growing and shrinking > > the buffer we use for I/O. > > > > I guess we never noticed this awfulness in the virsh console code it was > > copied from, as the data volumes are lower. > > > > Switching to a fixed size buffer makes it massively faster. I'll prep a > > patch asap. > > Actually, it is also important to have a bigger buffer. Using a 1 MB buffer > makes all the difference in throughput. I've sent two patches to improve the performance and managed to test vol-download with our ssh helper to beat netcat. I've not had a chance to test with tunnelled migration yet though, so if you want to try the patches with your migration test scenario, that'd be useful confirmation

Regards, Daniel -- |: https://berrange.com -o- https://www.flickr.com/photos/dberrange :| |: https://libvirt.org -o- https://fstop138.berrange.com :| |: https://entangle-photo.org -o- https://www.instagram.com/dberrange :|