[libvirt-users] git repository access via HTTPS
Hi, I've just tried to do a fresh checkout (git clone) with libvirt sources tree and had no luck because it seems to be inaccessible/non-existent at all. Is this temporary situation or I have to only use git:// proto? I'm asking because I'm sitting behind rather restrictive corporate proxy which does not allow anything but a little set of protocols such as HTTP(S). Thanks.
于 2011年01月20日 22:55, Fyodor Kupchik 写道:
Hi,
I've just tried to do a fresh checkout (git clone) with libvirt sources tree and had no luck because it seems to be inaccessible/non-existent at all. Is this temporary situation or I have to only use git:// proto? I'm asking because I'm sitting behind rather restrictive corporate proxy which does not allow anything but a little set of protocols such as HTTP(S).
http://libvirt.org/downloads.html Regards Osier
On 21/01/2011, at 1:55 AM, Fyodor Kupchik wrote:
Hi,
I've just tried to do a fresh checkout (git clone) with libvirt sources tree and had no luck because it seems to be inaccessible/non-existent at all. Is this temporary situation or I have to only use git:// proto? I'm asking because I'm sitting behind rather restrictive corporate proxy which does not allow anything but a little set of protocols such as HTTP(S).
Just checked the server setup here, and it doesn't look like there's any way other than git://. Not even http://. Sorry. :(
On 21/01/2011, at 7:15 PM, Justin Clift wrote:
On 21/01/2011, at 1:55 AM, Fyodor Kupchik wrote:
Hi,
I've just tried to do a fresh checkout (git clone) with libvirt sources tree and had no luck because it seems to be inaccessible/non-existent at all. Is this temporary situation or I have to only use git:// proto? I'm asking because I'm sitting behind rather restrictive corporate proxy which does not allow anything but a little set of protocols such as HTTP(S).
Just checked the server setup here, and it doesn't look like there's any way other than git://. Not even http://.
Sorry. :(
Oh, there is one other possibility, briefly mentioned on the downloads page Osier pointed you to. Depending upon what you're needs are, the hourly source code snapshot (tarball) might work for you: http://libvir.org/sources/libvirt-git-snapshot.tar.gz But, if you really do need the proper git repo cloned, that's going to be tricky. :(
On Fri, Jan 21, 2011 at 07:25:06PM +1100, Justin Clift wrote:
On 21/01/2011, at 7:15 PM, Justin Clift wrote:
On 21/01/2011, at 1:55 AM, Fyodor Kupchik wrote:
Hi,
I've just tried to do a fresh checkout (git clone) with libvirt sources tree and had no luck because it seems to be inaccessible/non-existent at all. Is this temporary situation or I have to only use git:// proto? I'm asking because I'm sitting behind rather restrictive corporate proxy which does not allow anything but a little set of protocols such as HTTP(S).
Just checked the server setup here, and it doesn't look like there's any way other than git://. Not even http://.
Sorry. :(
Oh, there is one other possibility, briefly mentioned on the downloads page Osier pointed you to.
Last possibility use the gitorious clone repo, it seems available via http http://www.gitorious.net/libvirt?page=3 Daniel -- Daniel Veillard | libxml Gnome XML XSLT toolkit http://xmlsoft.org/ daniel@veillard.com | Rpmfind RPM search engine http://rpmfind.net/ http://veillard.com/ | virtualization library http://libvirt.org/
On 21/01/2011, at 7:32 PM, Daniel Veillard wrote:
On Fri, Jan 21, 2011 at 07:25:06PM +1100, Justin Clift wrote:
On 21/01/2011, at 7:15 PM, Justin Clift wrote:
On 21/01/2011, at 1:55 AM, Fyodor Kupchik wrote:
Hi,
I've just tried to do a fresh checkout (git clone) with libvirt sources tree and had no luck because it seems to be inaccessible/non-existent at all. Is this temporary situation or I have to only use git:// proto? I'm asking because I'm sitting behind rather restrictive corporate proxy which does not allow anything but a little set of protocols such as HTTP(S).
Just checked the server setup here, and it doesn't look like there's any way other than git://. Not even http://.
Sorry. :(
Oh, there is one other possibility, briefly mentioned on the downloads page Osier pointed you to.
Last possibility use the gitorious clone repo, it seems available via http http://www.gitorious.net/libvirt?page=3
Interesting. That one looks workable.
I've had to use the hourly snapshot because I also cannot get to the git protocol. How is the gitorious clone repo kept in sync? Is this native git functionality (sync repos) or is it some special sauce on top of that? -jb On Fri, Jan 21, 2011 at 3:39 AM, Justin Clift <jclift@redhat.com> wrote:
On Fri, Jan 21, 2011 at 07:25:06PM +1100, Justin Clift wrote:
On 21/01/2011, at 7:15 PM, Justin Clift wrote:
On 21/01/2011, at 1:55 AM, Fyodor Kupchik wrote:
Hi,
I've just tried to do a fresh checkout (git clone) with libvirt
I'm asking because I'm sitting behind rather restrictive corporate
Just checked the server setup here, and it doesn't look like there's
any way other than git://. Not even http://.
Sorry. :(
Oh, there is one other possibility, briefly mentioned on the downloads
On 21/01/2011, at 7:32 PM, Daniel Veillard wrote: sources tree and had no luck because it seems to be inaccessible/non-existent at all. Is this temporary situation or I have to only use git:// proto? proxy which does not allow anything but a little set of protocols such as HTTP(S). page Osier pointed you to.
Last possibility use the gitorious clone repo, it seems available via
http
Interesting. That one looks workable.
_______________________________________________ libvirt-users mailing list libvirt-users@redhat.com https://www.redhat.com/mailman/listinfo/libvirt-users
thank you, guys for quick replies and suggestions but I still can't access repo on gitorius with the HTTP 403 error HTTPS didn't work as well with"operation now in progress" error do I need any special creds for anonymous access? 2011/1/21 James Barkley <james.barkley@gmail.com>
I've had to use the hourly snapshot because I also cannot get to the git protocol. How is the gitorious clone repo kept in sync? Is this native git functionality (sync repos) or is it some special sauce on top of that?
-jb
On Fri, Jan 21, 2011 at 3:39 AM, Justin Clift <jclift@redhat.com> wrote:
On Fri, Jan 21, 2011 at 07:25:06PM +1100, Justin Clift wrote:
On 21/01/2011, at 7:15 PM, Justin Clift wrote:
On 21/01/2011, at 1:55 AM, Fyodor Kupchik wrote:
Hi,
I've just tried to do a fresh checkout (git clone) with libvirt
I'm asking because I'm sitting behind rather restrictive corporate
Just checked the server setup here, and it doesn't look like there's
any way other than git://. Not even http://.
Sorry. :(
Oh, there is one other possibility, briefly mentioned on the downloads
On 21/01/2011, at 7:32 PM, Daniel Veillard wrote: sources tree and had no luck because it seems to be inaccessible/non-existent at all. Is this temporary situation or I have to only use git:// proto? proxy which does not allow anything but a little set of protocols such as HTTP(S). page Osier pointed you to.
Last possibility use the gitorious clone repo, it seems available via
http
Interesting. That one looks workable.
_______________________________________________ libvirt-users mailing list libvirt-users@redhat.com https://www.redhat.com/mailman/listinfo/libvirt-users
On 22/01/2011, at 3:52 AM, Fyodor Kupchik wrote: thank you, guys for quick replies and suggestions but I still can't access repo on gitorius with the HTTP 403 error
HTTPS didn't work as well with"operation now in progress" error
do I need any special creds for anonymous access?
2011/1/21 James Barkley <james.barkley@gmail.com> I've had to use the hourly snapshot because I also cannot get to the git protocol. How is the gitorious clone repo kept in sync? Is this native git functionality (sync repos) or is it some special sauce on top of that?
-jb
Yeah, it's definitely not working here for me either. The clone operation is just hanging for me: $ git clone http://git.gitorious.org/libvirt/libvirt.git Cloning into libvirt... (and that's it. Left it running for 1/2 hour, no change) I don't have a gitorious account either, so will get a free one and see if that helps.
On 22/01/2011, at 7:55 AM, Justin Clift wrote:
On 22/01/2011, at 3:52 AM, Fyodor Kupchik wrote: thank you, guys for quick replies and suggestions but I still can't access repo on gitorius with the HTTP 403 error
HTTPS didn't work as well with"operation now in progress" error
do I need any special creds for anonymous access?
2011/1/21 James Barkley <james.barkley@gmail.com> I've had to use the hourly snapshot because I also cannot get to the git protocol. How is the gitorious clone repo kept in sync? Is this native git functionality (sync repos) or is it some special sauce on top of that?
-jb
Yeah, it's definitely not working here for me either. The clone operation is just hanging for me:
$ git clone http://git.gitorious.org/libvirt/libvirt.git Cloning into libvirt... (and that's it. Left it running for 1/2 hour, no change)
I don't have a gitorious account either, so will get a free one and see if that helps.
Something seems to be wrong with the gitorius end of things: $ git clone git://gitorious.org/libvirt/libvirt.git Cloning into libvirt... remote: Counting objects: 51387, done. fatal: The remote end hung up unexpectedly fatal: early EOF fatal: index-pack failed $ Using a browser to go to the http:// URL above from before just gives a "Not Found" error too. I'll email them and see if they have any idea of what's wrong.
I can make a checkout from https://github.org and there exist several repos with the libvirt sources but I don't know if I can safely use them. Unfortunately I can't use snapshot since I'm using scripted installation procedure. Yes, I can rewrite the script but it is not convenient to me because I want to automate update and compilation of sources and maintaining the patches for the bootstrap script looks painful to me. Can anyone from the official team create a repo on github server and configure mirroring the sources tree? Of course the best way it to have HTTPS on the official libvirt.org site. 2011/1/22 Justin Clift <jclift@redhat.com>
On 22/01/2011, at 3:52 AM, Fyodor Kupchik wrote: thank you, guys for quick replies and suggestions but I still can't access repo on gitorius with the HTTP 403 error
HTTPS didn't work as well with"operation now in progress" error
do I need any special creds for anonymous access?
2011/1/21 James Barkley <james.barkley@gmail.com> I've had to use the hourly snapshot because I also cannot get to the git
On 22/01/2011, at 7:55 AM, Justin Clift wrote: protocol. How is the gitorious clone repo kept in sync? Is this native git functionality (sync repos) or is it some special sauce on top of that?
-jb
Yeah, it's definitely not working here for me either. The clone operation is just hanging for me:
$ git clone http://git.gitorious.org/libvirt/libvirt.git Cloning into libvirt... (and that's it. Left it running for 1/2 hour, no change)
I don't have a gitorious account either, so will get a free one and see if that helps.
Something seems to be wrong with the gitorius end of things:
$ git clone git://gitorious.org/libvirt/libvirt.git Cloning into libvirt... remote: Counting objects: 51387, done. fatal: The remote end hung up unexpectedly fatal: early EOF fatal: index-pack failed $
Using a browser to go to the http:// URL above from before just gives a "Not Found" error too. I'll email them and see if they have any idea of what's wrong.
On 24/01/2011, at 11:06 PM, Fyodor Kupchik wrote:
I can make a checkout from https://github.org and there exist several repos with the libvirt sources but I don't know if I can safely use them.
Unfortunately I can't use snapshot since I'm using scripted installation procedure. Yes, I can rewrite the script but it is not convenient to me because I want to automate update and compilation of sources and maintaining the patches for the bootstrap script looks painful to me.
Can anyone from the official team create a repo on github server and configure mirroring the sources tree? Of course the best way it to have HTTPS on the official libvirt.org site.
Hey Daniel, where is the git mirroring to gitorious done? Is it a script or something that pushes from the libvirt.org servers, or something that pulls from gitorious, or something else? Was thinking of setting up an equivalent for GitHub, as gitorious has problems with http:// and https:// access. Regards and best wishes, Justin Clift
On Mon, Jan 24, 2011 at 11:33:28PM +1100, Justin Clift wrote:
On 24/01/2011, at 11:06 PM, Fyodor Kupchik wrote:
I can make a checkout from https://github.org and there exist several repos with the libvirt sources but I don't know if I can safely use them.
Unfortunately I can't use snapshot since I'm using scripted installation procedure. Yes, I can rewrite the script but it is not convenient to me because I want to automate update and compilation of sources and maintaining the patches for the bootstrap script looks painful to me.
Can anyone from the official team create a repo on github server and configure mirroring the sources tree? Of course the best way it to have HTTPS on the official libvirt.org site.
Hey Daniel, where is the git mirroring to gitorious done?
Is it a script or something that pushes from the libvirt.org servers, or something that pulls from gitorious, or something else?
Was thinking of setting up an equivalent for GitHub, as gitorious has problems with http:// and https:// access.
Err, http:// access works fine with gitorious. I think you simply didn't wait long enough. GIT's HTTP access mechanism is seriously inefficient, and doesn't appear to give you ongoing progress feedback like the git:// protocol, so expect to wait a while. I've verified I can clone the main GIT repo over http in about 2 minutes using: git clone http://git.gitorious.org/libvirt/libvirt.git Regards, Daniel
still no luck with it :( I precede git command by proxychains one since git does not respect any kind of proxy settings (nor system wide or those I set via git config http.proxy) and it only works in such way. ============================================================================== ProxyChains-3.1 (http://proxychains.sf.net) Initialized empty Git repository in /home/teo/prj/archipel/Archipel/Libvirt/.gnulib/.git/ git.sv.gnu.org[0: 140.186.70.72]: errno=Connection refused fatal: unable to connect a socket (Connection refused) Clone of 'git://git.sv.gnu.org/gnulib.git' into submodule path '.gnulib' failed Failed to recurse into submodule path 'Libvirt' Unable to initialize submodules ============================================================================== I suspect it still tries to use git proto somehow... here's the output from another libvirt repo ============================================================================== time proxychains git clone https://github.com/marcusk/libvirt.git ProxyChains-3.1 (http://proxychains.sf.net) Initialized empty Git repository in /home/teo/prj/libvirt/.git/ remote: Counting objects: 50464, done. remote: Compressing objects: 100% (8268/8268), done. remote: Total 50464 (delta 42261), reused 50257 (delta 42058) Receiving objects: 100% (50464/50464), 51.74 MiB | 177 KiB/s, done. Resolving deltas: 100% (42261/42261), done. real 7m42.509s user 0m13.210s sys 0m1.140s ============================================================================== 2011/1/24 Daniel P. Berrange <berrange@redhat.com>
On 24/01/2011, at 11:06 PM, Fyodor Kupchik wrote:
I can make a checkout from https://github.org and there exist several repos with the libvirt sources but I don't know if I can safely use them.
Unfortunately I can't use snapshot since I'm using scripted installation procedure. Yes, I can rewrite the script but it is not convenient to me because I want to automate update and compilation of
On Mon, Jan 24, 2011 at 11:33:28PM +1100, Justin Clift wrote: sources and maintaining the patches for the bootstrap script looks painful to me.
Can anyone from the official team create a repo on github server and
configure mirroring the sources tree? Of course the best way it to have HTTPS on the official libvirt.org site.
Hey Daniel, where is the git mirroring to gitorious done?
Is it a script or something that pushes from the libvirt.org servers, or something that pulls from gitorious, or something else?
Was thinking of setting up an equivalent for GitHub, as gitorious has problems with http:// and https:// access.
Err, http:// access works fine with gitorious. I think you simply didn't wait long enough. GIT's HTTP access mechanism is seriously inefficient, and doesn't appear to give you ongoing progress feedback like the git:// protocol, so expect to wait a while. I've verified I can clone the main GIT repo over http in about 2 minutes using:
git clone http://git.gitorious.org/libvirt/libvirt.git
Regards, Daniel
On Mon, Jan 24, 2011 at 03:20:47PM +0200, Fyodor Kupchik wrote:
still no luck with it :( I precede git command by proxychains one since git does not respect any kind of proxy settings (nor system wide or those I set via git config http.proxy) and it only works in such way. ============================================================================== ProxyChains-3.1 (http://proxychains.sf.net) Initialized empty Git repository in /home/teo/prj/archipel/Archipel/Libvirt/.gnulib/.git/ git.sv.gnu.org[0: 140.186.70.72]: errno=Connection refused fatal: unable to connect a socket (Connection refused) Clone of 'git://git.sv.gnu.org/gnulib.git' into submodule path '.gnulib' failed Failed to recurse into submodule path 'Libvirt' Unable to initialize submodules
This shows that the initial libvirt checkover over HTTP worked fine. What in fact failed was the attempt to checkout the GNULIB submodule, which is still using git:// protocol. I don't believe there is any way to change the protocol used for submodules during initial checkout. Regards, Daniel
On 24/01/2011, at 11:42 PM, Daniel P. Berrange wrote: <snip>
Err, http:// access works fine with gitorious. I think you simply didn't wait long enough. GIT's HTTP access mechanism is seriously inefficient, and doesn't appear to give you ongoing progress feedback like the git:// protocol, so expect to wait a while. I've verified I can clone the main GIT repo over http in about 2 minutes using:
Thanks Daniel. Tried http again (first time today) and this time it worked: $ time git clone http://git.gitorious.org/libvirt/libvirt.git Cloning into libvirt... real 9m57.209s user 0m11.130s sys 0m5.670s $ ~10 mins, but still, at least it worked. For the gnulib submodule, I'm thinking it might be possible to use a tarball as a workaround. Fyodor, are you ok to try something? If you can grab this tarball (41MB): http://justinclift.fedorapeople.org/gnulib_commit_2f41af65.tar.bz2 Extract it somewhere (ie /tmp/gnulib), then set the GNULIB_SRCDIR environment variable to point to it prior to doing the libvirt pieces. $ export GNULIB_SRCDIR=/tmp/gnulib $ git clone http://git.gitorious.org/libvirt/libvirt.git $ cd libvirt $ ./autogen.sh That *might* work. Not for sure, but probably worth trying. + Justin
Unfortunately that didn't work (i mean the tarball download/unpack and exporting env var)... I can make it to work as the installation is described by several simple python scripts but this is not right solution. Thank you guys for help, it seems to me that the only way is to ask our sysadmins to open git ports for several opensource git repositories. I hope they won't refuse. Thank you again! 2011/1/24 Justin Clift <jclift@redhat.com>
On 24/01/2011, at 11:42 PM, Daniel P. Berrange wrote: <snip>
Err, http:// access works fine with gitorious. I think you simply didn't wait long enough. GIT's HTTP access mechanism is seriously inefficient, and doesn't appear to give you ongoing progress feedback like the git:// protocol, so expect to wait a while. I've verified I can clone the main GIT repo over http in about 2 minutes using:
Thanks Daniel. Tried http again (first time today) and this time it worked:
$ time git clone http://git.gitorious.org/libvirt/libvirt.git Cloning into libvirt...
real 9m57.209s user 0m11.130s sys 0m5.670s $
~10 mins, but still, at least it worked.
For the gnulib submodule, I'm thinking it might be possible to use a tarball as a workaround.
Fyodor, are you ok to try something?
If you can grab this tarball (41MB):
http://justinclift.fedorapeople.org/gnulib_commit_2f41af65.tar.bz2
Extract it somewhere (ie /tmp/gnulib), then set the GNULIB_SRCDIR environment variable to point to it prior to doing the libvirt pieces.
$ export GNULIB_SRCDIR=/tmp/gnulib $ git clone http://git.gitorious.org/libvirt/libvirt.git $ cd libvirt $ ./autogen.sh
That *might* work. Not for sure, but probably worth trying.
+ Justin
On Fri, Jan 21, 2011 at 07:15:46PM +1100, Justin Clift wrote:
On 21/01/2011, at 1:55 AM, Fyodor Kupchik wrote:
Hi,
I've just tried to do a fresh checkout (git clone) with libvirt sources tree and had no luck because it seems to be inaccessible/non-existent at all. Is this temporary situation or I have to only use git:// proto? I'm asking because I'm sitting behind rather restrictive corporate proxy which does not allow anything but a little set of protocols such as HTTP(S).
Just checked the server setup here, and it doesn't look like there's any way other than git://. Not even http://.
Sorry. :(
Well, right now there are still: - hourly snapshots extracted from git available via http and FTP ftp://libvirt.org/libvirt/ http://libvirt.org/sources/ - the git interface at http://libvirt.org/git/?p=libvirt.git;a=summary allows to extract snapshots but git though HTTP is not configured, in general it's fairly inefficient. Daniel -- Daniel Veillard | libxml Gnome XML XSLT toolkit http://xmlsoft.org/ daniel@veillard.com | Rpmfind RPM search engine http://rpmfind.net/ http://veillard.com/ | virtualization library http://libvirt.org/
participants (6)
-
Daniel P. Berrange -
Daniel Veillard -
Fyodor Kupchik -
James Barkley -
Justin Clift -
Osier Yang