On a sunny day (Fri, 8 Apr 2022 16:47:00 -0000 (UTC)) it happened Doc O'Leary
, <droleary@2017usenet1.subsume.com> wrote in <t2pou4$n66$1@dont-email.me>:

I’ve tried a few “common” packages, they all seem to fall down for me. I
have 500K+ files to warehouse, ranging in sizes from tiny up to 10G+. The >biggest problem seems to be RAM usage, and I’d like to have something that >works on a 3B, and ideally a 0W.

Does anyone have something that still scales up when scaling down to an RPi?

Thanks.

I have 3.4 TB USb harddisks connected to my Pi4
Shows up as /dev/sda
Made a partition sda2 formatted with ext4 file system
and directories I normally work with (root that is in my case)
Every now and then I copy all data with cp -rp or cp -urp to that sda2 directory
also wrote a script to backup mail to it.
Or backup from the laptop with scp -p
Never a problem.

Backups go to both Pi4 harddisks, so even if you drop one USB harddisk you still have your data.
scripting is a good idea, prevents typing errors.

--- SoupGate-Win32 v1.05
* Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)

I’ve tried a few “common” packages, they all seem to fall down for me. I have 500K+ files to warehouse, ranging in sizes from tiny up to 10G+. The biggest problem seems to be RAM usage, and I’d like to have something that works on a 3B, and ideally a 0W.

Does anyone have something that still scales up when scaling down to an RPi?

Thanks.

--- SoupGate-Win32 v1.05
* Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)

On Fri, 8 Apr 2022 16:47:00 -0000 (UTC)
Doc O'Leary , <droleary@2017usenet1.subsume.com> wrote:

I’ve tried a few “common” packages, they all seem to fall down for me. I
have 500K+ files to warehouse, ranging in sizes from tiny up to 10G+.
The biggest problem seems to be RAM usage, and I’d like to have something that works on a 3B, and ideally a 0W.

Does rsync not get the job done ?

--
Steve O'Hara-Smith
Odds and Ends at http://www.sohara.org/

--- SoupGate-Win32 v1.05
* Origin: Agency HUB, Dunedin - New Zealand | Fido<>Usenet Gateway (3:770/3)

Re: What do you use for RPi backups?
By: Doc O'Leary , to All on Fri Apr 08 2022 04:47 pm

I’ve tried a few “common” packages, they all seem to fall down for me. I hav
files to warehouse, ranging in sizes from tiny up to 10G+. The biggest problem see
to be RAM usage, and I’d like to have something that works on a 3B, and ideally a

Does anyone have something that still scales up when scaling down to an RPi?

Thanks.

Not necessarily a Pi specific solution, but I find rsync to be fine.

Using tar with a pipe should not be very taxing to your resources, but big tar files
are not very manageable.

Definetively try the rsync time machine desribed in Linux Magazine #258 (which basically means you do $ rsync -a Source_Dir First_Backup the first time you take a
backup, and then $ rsync -a --link-dest=First_Backup Source Second_Backup for the next
ones. That way the first backup will take long, but the next ones will be very quick.

--
gopher://gopher.richardfalken.com/1/richardfalken
--- SBBSecho 3.15-Linux
* Origin: Palantir * palantirbbs.ddns.net * Pensacola, FL * (1:123/115)