Thursday, August 11, 2022

[fedora-arm] Re: RPi (or something similar) cluster and GlusterFS - feedback?

On Thu, Aug 11, 2022 at 5:49 AM Philip Rhoades <phil@pricom.com.au> wrote:
People,

More recently I have been thinking about building an ARM cluster with
Gluster that would hold all the data for both the WS and the main server
and any other WSs or servers I might need to run from time to time.  I
would still make use of an off-site backup anyway but I like the idea of
just being able to add another ARM device + SATA drive to the cluster to
create more data space.  I also thought I would go back to making use of
WSs that were basically just X-servers that booted from some sort of USB
stick but got the OS image from the cluster - this might be complicated
by the fact I now use Sway rather than X - but one problem at a time . .

Has anyone here set up a cluster something like this?  Have people any
suggestions about specific Fedora web pages / docs to look at?

I have been tracking CEPH for some time and while it looks interesting,
it seems overkill for what I am thinking of doing and more technically
difficult to support / debug etc.  I am thinking of starting the
exercise with 4 RPis each with an 8Tb SATA drive.

Sounds like a fun project but fairly complicated. 

My main backups are on a SFF PC in my "data closet" (i.e., the closet of the home office) running CentOS 8 Stream and BackupPC with a 1TB drive. It backs up, pools, and deduplicates /home for everyone's computer in the house. It works quite nicely for that. I currently have 6.36TB only taking up 675GB. This has been in place for years but if I were to do it over, I would do something more like the below.

I have my media library on a BTRFS RAID 1 array using 4 3.5" 4TB drives (CMR, not SMR) on a spare X86 computer running Fedora. One of the cool features of BTRFS is if it gets full and I'm willing to take the risk I can convert to RAID 5 on the fly.

Thanks,
Richard

No comments:

Post a Comment