23 Dec
2020
23 Dec
'20
4:35 p.m.
On Tuesday 22 December 2020 09:02:31 pm Michele Calgaro via tde-users wrote:
Thanks Mike and Michael for the excellent contribution
and discussion. It
will be good to have a full mirror (and maybe more than one) of the TDE
archive on Slavek machine.
Hello All TDE Developers,
This started out as a discussion about a TDE archive, then it morphed into a
discussion about a TDE mirror. I believe I know what the difference is, and
I’m willing to do both, but possibly one of the TDE Dev’s should give us
users an ‘official’ definition of each? Just so everyone knows what is what.
Archive Definition:
Mirror Definition:
Why? A full up VPS, or webhosting service, is less than $100/year[1], which
I, and I’m sure several others on this user’s list, have no issue either
outright ‘donating’, or adding funds for, to TDE[2]. It also completely
solves:
the point
of "moving away from a single person structure" is that we need the archive
(and all TDE tools) on public machines accessible from more than one
person.
But at this point I am completely and utterly frustrated [3], as I have asked
repeatedly what the requirements for each are and have not been given a
concrete answer. If we (the users) don’t know what the requirements are, we
can’t help you (the dev’s).
Just to put everyone on the same page and not having anyone guessing, a ‘my
best guess at Archive needs’ for an example (see prior post for my guess at
Mirror):
Requirements for Archive:
Time frame good for: 24 Months
HD: 2TB (max)
Data: 3TB / month (max)
Pipe: 15 Mbps (min)
CPU: 1 (min)
Software: SSH, rsync (plus standard Linux stack, cron, bash, tar, etc.)
Number of unique Backups w/ time frames:
==Raw data==
1 raw rsync, synced once per day (2 AM)
==Tarballs==
Daily: 1 for ea of last 4 days (2 AM)
Weekly: 1 for ea of last 3 weeks (2 AM Sunday)
Monthly: 1 for ea of last 3 months (2 AM, 1st of Month)
Yearly: 1 for ea of last 2 years (2 AM, Jan 1)
(don’t like tarballs? Fill in the Software requirement above with whatever
floats your boat...)
# # #
Now, PLEASE!, fill in the blanks... (Do add a criteria if I’ve missed it)
Requirements for Archive:
Time frame good for:
HD:
Data:
Pipe:
CPU:
Software:
Number of unique Backups w/ time frames:
Requirements for Mirror:
Time frame good for:
HD:
Data:
Pipe:
CPU:
Software:
# # #
Okay, that’s it from me. If I can get something concrete to work from, I can
help you, otherwise, not so much.
May everyone have a Happy & Merry holiday season!
Best Regards All,
Michael
[1] Yes you have to know how to dig these up, as you won’t find them ‘retail.’
[2] I could give a rats ass about a non-profit donation receipt.
[3] This discussion time alone has ‘cost’ me 5-10x in time of just straight up
buying and donating a 3 year VPS to the ‘cause.’
PS: My source for bulk ~$15 / 3TB SAS2 drives had a warehouse fire, so that
alternative is off the table atm. I really didn’t want a 1U airplane in an
upstairs closet anyway (sour grapes)...