31 May
2018
31 May
'18
8:21 a.m.
Hi there!
Sorry to step in the devs's room but I'm seeking information about git
uses to clone the TDE repository.
Yesterday I applyed the method displayed in the wiki, namely:
- git clone https://mirror.git.trinitydesktop.org/cgit/tde
- cd tde
- git submodule init -- scripts
- git submodule update -- scripts
- ./scripts/switch_all_submodules_to_head_and_clean anonymous
After more than 6 hours of downloading (at an average of 70 kib/s) the
connexion stopped and wouldn't restart properly.
I don't think I can fetch the entire project history in those
conditions, this would take days...I guess!
Is there a way to shorten the cloning in order to get the last code?
I tryed with "--depth=1" but I was rather unsuccessfull on the matter.
Regards
gregory
31 May
31 May
5:36 p.m.
New subject: [trinity-devel] trouble with git - TDE repo
On Thursday 31 of May 2018 10:21:24 gregory guy wrote:
Hi there!
Sorry to step in the devs's room but I'm seeking information about git
uses to clone the TDE repository.
Yesterday I applyed the method displayed in the wiki, namely:
- git clone https://mirror.git.trinitydesktop.org/cgit/tde
- cd tde
- git submodule init -- scripts
- git submodule update -- scripts
- ./scripts/switch_all_submodules_to_head_and_clean anonymous
After more than 6 hours of downloading (at an average of 70 kib/s) the
connexion stopped and wouldn't restart properly.
I don't think I can fetch the entire project history in those
conditions, this would take days...I guess!
Is there a way to shorten the cloning in order to get the last code?
I tryed with "--depth=1" but I was rather unsuccessfull on the matter.
Regards
gregory
Hi Gregory,
this is strange behavior. VPS for hosting mirror.git.trinitydesktop.org is
on a 300 Mbps bandwidth. Therefore, I do not suppose there should be a
problem with the speed of this server.
Please, can you check what the urls for the submodules are in
tde/.git/config? Are these urls correctly replaced to
mirror.git.trinitydesktop.org or stay referenced to the
scm.trinitydesktop.org (master server)?
Cheers
--
Slávek
6:12 p.m.
New subject: [trinity-devel] trouble with git - TDE repo
On Thursday 31 of May 2018 19:36:06 Slávek Banko wrote:
On Thursday 31 of May 2018 10:21:24 gregory guy
wrote:
Ok, now I've tried to measure the first step with two different services
on the same server:
$ time git clone https://mirror.git.trinitydesktop.org/cgit/tde
Cloning into 'tde'...
real 0m59.683s
user 0m27.600s
sys 0m2.452s
$ time git clone https://mirror.git.trinitydesktop.org/gitea/TDE/tde
Cloning into 'tde'...
remote: Counting objects: 60857, done.
remote: Compressing objects: 100% (22885/22885), done.
remote: Total 60857 (delta 39752), reused 56119 (delta 36438)
Receiving objects: 100% (60857/60857), 30.45 MiB | 23.63 MiB/s, done.
Resolving deltas: 100% (39752/39752), done.
real 0m5.512s
user 0m3.168s
sys 0m0.720s
This was a repeated measurement - at the first measurement times were
doubled. The second measurements apparently benefited from the cache on
the server. However, it is clear that Gitea gives better results while
providing standard output during cloning.
Subsequently, I tested cloning the entire repository from Gitea:
$ time ./scripts/switch_all_submodules_to_head_and_clean anonymous
real 22m6.332s
user 10m34.756s
sys 0m53.580s
Please also try using Gitea instead of the CGit interface.
It looks like Gitea could be an advantage!
Cheers
--
Slávek
Hi there!
Sorry to step in the devs's room but I'm seeking information about
git uses to clone the TDE repository.
Yesterday I applyed the method displayed in the wiki, namely:
- git clone https://mirror.git.trinitydesktop.org/cgit/tde
- cd tde
- git submodule init -- scripts
- git submodule update -- scripts
- ./scripts/switch_all_submodules_to_head_and_clean anonymous
After more than 6 hours of downloading (at an average of 70 kib/s)
the connexion stopped and wouldn't restart properly.
I don't think I can fetch the entire project history in those
conditions, this would take days...I guess!
Is there a way to shorten the cloning in order to get the last code?
I tryed with "--depth=1" but I was rather unsuccessfull on the
matter.
Regards
gregory
Hi Gregory,
this is strange behavior. VPS for hosting mirror.git.trinitydesktop.org
is on a 300 Mbps bandwidth. Therefore, I do not suppose there should be
a problem with the speed of this server.
Please, can you check what the urls for the submodules are in
tde/.git/config? Are these urls correctly replaced to
mirror.git.trinitydesktop.org or stay referenced to the
scm.trinitydesktop.org (master server)?
Cheers
1 Jun
1 Jun
9:01 a.m.
New subject: [trinity-devel] trouble with git - TDE repo
Le Thu, 31 May 2018 20:12:53 +0200,
Slávek Banko <slavek.banko(a)axis.cz> a écrit :
On Thursday 31 of May 2018 19:36:06 Slávek Banko
wrote:
Oh my gosh, gitea is so much faster!
Each submodule usually tops my broadband at 1.5MIB/s.
Slavek, thank you for the dodge and everyone for their input on the
matter.
Regards.
gregory
On Thursday 31 of May 2018 10:21:24 gregory guy
wrote:
Ok, now I've tried to measure the first step with two different
services on the same server:
$ time git clone https://mirror.git.trinitydesktop.org/cgit/tde
Cloning into 'tde'...
real 0m59.683s
user 0m27.600s
sys 0m2.452s
$ time git clone https://mirror.git.trinitydesktop.org/gitea/TDE/tde
Cloning into 'tde'...
remote: Counting objects: 60857, done.
remote: Compressing objects: 100% (22885/22885), done.
remote: Total 60857 (delta 39752), reused 56119 (delta 36438)
Receiving objects: 100% (60857/60857), 30.45 MiB | 23.63 MiB/s, done.
Resolving deltas: 100% (39752/39752), done.
Please also try using Gitea instead of the CGit interface.
It looks like Gitea could be an advantage!
Cheers Hi there!
Sorry to step in the devs's room but I'm seeking information about
git uses to clone the TDE repository.
Yesterday I applyed the method displayed in the wiki, namely:
- git clone https://mirror.git.trinitydesktop.org/cgit/tde
- cd tde
- git submodule init -- scripts
- git submodule update -- scripts
- ./scripts/switch_all_submodules_to_head_and_clean anonymous
After more than 6 hours of downloading (at an average of 70 kib/s)
the connexion stopped and wouldn't restart properly.
I don't think I can fetch the entire project history in those
conditions, this would take days...I guess!
Is there a way to shorten the cloning in order to get the last
code? I tryed with "--depth=1" but I was rather unsuccessfull on
the matter.
Regards
gregory
Hi Gregory,
this is strange behavior. VPS for hosting
mirror.git.trinitydesktop.org is on a 300 Mbps bandwidth.
Therefore, I do not suppose there should be a problem with the
speed of this server.
Please, can you check what the urls for the submodules are in
tde/.git/config? Are these urls correctly replaced to
mirror.git.trinitydesktop.org or stay referenced to the
scm.trinitydesktop.org (master server)?
Cheers
1:27 p.m.
New subject: [trinity-devel] trouble with git - TDE repo
Dne pá 1. června 2018 gregory guy napsal(a):
Le Thu, 31 May 2018 20:12:53 +0200,
Slávek Banko <slavek.banko(a)axis.cz> a écrit :
I thank both for performing tests and confirming the results. It seems
like a good idea to set in the cgit configuration to display a cloning
url referring to Gitea. What do you think?
Cheers
--
Slávek
On Thursday 31 of May 2018 19:36:06 Slávek Banko
wrote:
Oh my gosh, gitea is so much faster!
Each submodule usually tops my broadband at 1.5MIB/s.
Slavek, thank you for the dodge and everyone for their input on the
matter.
Regards.
gregory
On Thursday 31 of May 2018 10:21:24 gregory guy
wrote:
Ok, now I've tried to measure the first step with two different
services on the same server:
$ time git clone https://mirror.git.trinitydesktop.org/cgit/tde
Cloning into 'tde'...
real 0m59.683s
user 0m27.600s
sys 0m2.452s
$ time git clone https://mirror.git.trinitydesktop.org/gitea/TDE/tde
Cloning into 'tde'...
remote: Counting objects: 60857, done.
remote: Compressing objects: 100% (22885/22885), done.
remote: Total 60857 (delta 39752), reused 56119 (delta 36438)
Receiving objects: 100% (60857/60857), 30.45 MiB | 23.63 MiB/s, done.
Resolving deltas: 100% (39752/39752), done.
Please also try using Gitea instead of the CGit interface.
It looks like Gitea could be an advantage!
Cheers Hi there!
Sorry to step in the devs's room but I'm seeking information
about git uses to clone the TDE repository.
Yesterday I applyed the method displayed in the wiki, namely:
- git clone https://mirror.git.trinitydesktop.org/cgit/tde
- cd tde
- git submodule init -- scripts
- git submodule update -- scripts
- ./scripts/switch_all_submodules_to_head_and_clean anonymous
After more than 6 hours of downloading (at an average of 70
kib/s) the connexion stopped and wouldn't restart properly.
I don't think I can fetch the entire project history in those
conditions, this would take days...I guess!
Is there a way to shorten the cloning in order to get the last
code? I tryed with "--depth=1" but I was rather unsuccessfull on
the matter.
Regards
gregory
Hi Gregory,
this is strange behavior. VPS for hosting
mirror.git.trinitydesktop.org is on a 300 Mbps bandwidth.
Therefore, I do not suppose there should be a problem with the
speed of this server.
Please, can you check what the urls for the submodules are in
tde/.git/config? Are these urls correctly replaced to
mirror.git.trinitydesktop.org or stay referenced to the
scm.trinitydesktop.org (master server)?
Cheers 
1:34 p.m.
New subject: [trinity-devel] trouble with git - TDE repo
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512
> I thank both for performing tests and confirming the results. It seems like a good
idea to set in the cgit
> configuration to display a cloning url referring to Gitea. What do you think?
> Cheers
Sounds good to me.
Cheers
Michele
-----BEGIN PGP SIGNATURE-----
iQIzBAEBCgAdFiEEjhl1z5vbYB3YbFTiKnW3yore1c8FAlsRS2sACgkQKnW3yore
1c8ZkBAAhYfVAFcKP/wef9Dx7nMW7kpnk/IaG4a0DRmvtu5ZnnwL4r7VZ1q8jWJ2
vL0MpPy0+Q4Zf25y3dHZ2HEC/AVQOIe1Z4F2CKUl87N/pwudrOlMIbtuwukRi9N0
8Jee8zBVeh8/1097xPBOqHGcMBBPKF4JVKgOEmzXHhY2RSNgy6XGsLbKUMDLCZAr
3Q+++ylyiX+Du2UQvaxLe2o80cQQb8I7a/+3E3yO8FI94ZhXmEM0bAe6JFSvfn6+
fAgPqNSFzqLkbTbuFVuF3lzgkEZnQsjKqw4CPbsyK5wGjsrgjPmxpwl4f3qxqQ4d
+Y6YVHBZMyips7ikPliM30W9ajdOdR5Jvtz++k3SqWsuTNjrLEVlWBcnnyG7LKy/
k3/gePEuXLx2qPqL5bnzRtu5Fcm4CHi3uKBO5uibCSiOtlFSihnOmouAqdPXWeqy
maXgFF8R76A3jXLGY43gt+WIrpWMDOro5bQtWWTym3gEyBc8g0xJQt0w69Uici26
hz07K23ZVWUeWfQD8l9hnW143tUhHtB4X+o1a+9KQB0JPy46aEAuAu7lLJBjhOBt
UK33+rvDu1XZf/rTcRw81dH8nvFNhXV6HhJWCsjPuLE6+sYvFM4C/E04V/I//qj9
9XfZoXyWJ+voKiq/PpXibF1+bmzekTnAvJRG/YOs7GdwmXyhfQw=
=lnkn
-----END PGP SIGNATURE-----
1:36 p.m.
New subject: [trinity-devel] trouble with git - TDE repo
Dne pá 1. června 2018 Michele Calgaro napsal(a):
Done :)
Cheers
--
Slávek
I thank both
for performing tests and confirming the results. It
seems like a good idea to set in the cgit configuration to display a
cloning url referring to Gitea. What do you think?
Cheers
Sounds good to me.
Cheers
Michele
31 May
31 May
6:22 p.m.
New subject: [trinity-devel] trouble with git - TDE repo
On Thu May 31 2018 10:36:06 Slávek Banko wrote:
this is strange behavior. VPS for hosting
mirror.git.trinitydesktop.org is
on a 300 Mbps bandwidth. Therefore, I do not suppose there should be a
problem with the speed of this server.
Hi Slávek,
I just ran git clone https://mirror.git.trinitydesktop.org/cgit/tde for
a few minutes on three VPSs in data centers in Texas, California, and
Washington State. In each case there was a high initial transfer rate
around 35Mbps. After less than a minute transfer rate dropped drastically
or even zeroed before bouncing around and finally settling near 200kbps.
When I tested transfers from Washington State to Texas I was able to
sustain around 47Mbps. Transfers from the TDE UK mirror to Texas started
around 170Mbps before bouncing around wildly but averaged 90Mbps over
several minutes.
I doubt this is an artifact of disk caching. I suspect something is
limiting mirror.git.trinitydesktop.org bandwidth despite the 300Mbps
connection.
--Mike
6:36 p.m.
New subject: [trinity-devel] trouble with git - TDE repo
On Thursday 31 of May 2018 20:22:36 Mike Bird wrote:
On Thu May 31 2018 10:36:06 Slávek Banko wrote:
Hi Mike,
I watched your activity on cgit during my test with Gitea :)
You can try the same cloning using Gitea's url.
If you want to test line speed without affecting by the application server
(either cgit or Gitea), you can download the iso for Slax with Trinity:
http://mirror.ppa.trinitydesktop.org/trinity-sb/cdimages/slax/
Cheers
--
Slávek
this is strange behavior. VPS for hosting
mirror.git.trinitydesktop.org is on a 300 Mbps bandwidth. Therefore,
I do not suppose there should be a problem with the speed of this
server.
Hi Slávek,
I just ran git clone https://mirror.git.trinitydesktop.org/cgit/tde for
a few minutes on three VPSs in data centers in Texas, California, and
Washington State. In each case there was a high initial transfer rate
around 35Mbps. After less than a minute transfer rate dropped
drastically or even zeroed before bouncing around and finally settling
near 200kbps.
When I tested transfers from Washington State to Texas I was able to
sustain around 47Mbps. Transfers from the TDE UK mirror to Texas
started around 170Mbps before bouncing around wildly but averaged
90Mbps over several minutes.
I doubt this is an artifact of disk caching. I suspect something is
limiting mirror.git.trinitydesktop.org bandwidth despite the 300Mbps
connection.
--Mike
7:06 p.m.
New subject: [trinity-devel] trouble with git - TDE repo
On Thu May 31 2018 11:36:04 Slávek Banko wrote:
I watched your activity on cgit during my test with
Gitea :)
You can try the same cloning using Gitea's url.
17s with gitea versus 389s with cgit.
If you want to test line speed without affecting by
the application server
(either cgit or Gitea), you can download the iso for Slax with Trinity:
http://mirror.ppa.trinitydesktop.org/trinity-sb/cdimages/slax/
Bytes not bits now: 3.93MBps to Texas, and 4.90MBps with https. (Single
test of each so difference is not meaningful.)
You're right. Cgit is not performing well here.
--Mike
2408
days inactive
2409
days old
9 comments
4 participants
participants (4)
-
gregory guy -
Michele Calgaro -
Mike Bird -
Slávek Banko