20 Dec
2020
20 Dec
'20
8:28 p.m.
On Sunday 20 December 2020 01:34:29 pm Slávek Banko via tde-users wrote:
Dne Sunday 20 of December 2020 18:12:25 Michael via
tde-users napsal(a):
I'm glad you're interested in the details.
Current size and occupied space of the partition:
/dev/mapper/lvm1-tde_data 400G 336G 65G 84% /srv/tde
A subset of this volume is synchronized to the mirror system. First to the
primary mirror, from which the other mirrors are then synchronized. This
synchronization usually takes place several times a day, with pauses of 3
hours between the individual synchronizations.
The size always decreases significantly at the moment of release, when the
contents of the official repository and PSB are identical. The size of the
repository is now constantly growing again as the packages in PSB are
built for R14.0.10~pre. Such an increase can be almost 100 GiB. At the
same time, there is a gradual increase in volume when adding support for
new distributions.
During the outage, which I announced in early December, I replaced my home
server's hardware with slightly newer components, including the purchase
of new, larger disks. So now I have a sufficient reserve of disk capacity
again.
The specified partition is on two disks (RAID1). In addition to these
disks, I make a regular daily local backup on an external usb disk. The
backup disk requires significantly more capacity, as the daily differences
can be large - from hundreds of MiBs to tens of GiBs. Next to this, I'm
making a copy of the archive on my next machine in a remote location (two
disks in RAID1). Copying to this remote location is not regular yet.
Hi Slávek,
Lol, interesting, but TMI ;)
- What’s the max size you’ve ever needed?
- How many unique backups do you want? *
- Rsync fine? Push? Pull?(what are the paths and creds?) **
- cron every 4 hours okay?
It’ll take half an hour to setup, and I guess we can stop spamming the rest of
the list, so just send to me personally for the rest...
Best,
Michael
michael@
* I’ll do one here at home off of one of my servers as well.
** I prefer pull, but just from a security issue of not giving people access
to my servers.
PS: I’ll send you a copy of my final script so you can automate the remote
location you were talking about too.
On Sunday 20 December 2020 12:02:26 am Michele
Calgaro via tde-users
wrote:
On
2020/12/20 04:00 AM, Slávek Banko via tde-users wrote:
In that vein (away from possible one-person-dependant services):
- How big is the archive? (<250GB? ~4TB?)
- How simple is it to back it up? (a few rsync’s? tarball?)
I have no issues storing a copy, or two, of the archive on one of my
backup servers (which are in hosting centers). We may consider placing the primary archive in a
hosting center -
for example, by purchasing larger disks for tde-box or by increasing
the space provided for tde-vps. However, it will probably be a good
idea to consider such changes only after we are able to manage the
project funds and accept donations.
This is defintely something we will need to do in future, to move away
from possible one-person-dependant services. I agree with you we need
to figure out how to handle donations and project funds, then we can
relook at this.