Remote storage solution ?

douglasg14b, 10 months ago

And here I am running NFS as the backing storage on an R720xd for 4 other M630 VM hosts.

Connected via SFP+ DAC. I get max bandwidth saturation, and ~65k IOPS!! NFS is great 😅

You could use things like AWS S3 or similar offerings from other providers like digitalocean. They have plenty of documentation that guide you through how they work.

wgs, 10 months ago

My main issue with NFS is that it’s been unreliable in my case (multiple servers connected over wireguard, over internet). Which cause locks and latency for the applications that read/write to it (Matrix server, distributed repository, …).

Of course if you can afford connecting the NFS server directly to the servers, that’s perfect but I’m more on the worst case scenario ^^

mbi, 10 months ago

Time4vps will get you a full vps with a 1tb disk for ~50 euro/year. (Or ~ 5€/month if billed monthly)

I’ve had a couple of those for years, they’re ok but don’t expect stellar performance from the vps itself.

wgs, 10 months ago

That’s cheap indeed. Is it possible to install a different OS than those listed on their website ?

mbi, 10 months ago

Nope, the options I get are: AlmaLinux 8, CentOS 7, Debian 10-11, Ubuntu 14.04 - 22.04.

fry, 10 months ago (edited 10 months ago)

NFS kinda sucks and I’m looking for alternative solution

Rsync + cron? If you just need to backup some files/directories.

Edit: ah, saw that you will read/write a lot. Do you really need to do that over the network? Why not upload a .tar, a snapshot or whatever of the changes?

If you could be a bit more specific then maybe we could give some better advice.

Use a seedbox if you’re downloading stuff and dont have enough disk space.

wgs, 10 months ago

The best example would be a running an email or chat server. The spool/media directories can go large pretty quick as users share pictures, gifs, … So I would like to mount it from a remote location because the matrix server itself only has a 20G SSD for the whole OS. Rsync won’t cut it there as I have a specific process writing to a location.

fry, 10 months ago

Ah, I see.

Perhaps sshfs could be an alternative. Not sure of the performance out of the box, but it is possible to tweak a bit.

https://www.ports.to/path/sysutils/sshfs-fuse.html

wgs, 10 months ago

I’ll look more into FUSE based remote storage more generally because it seems to be my only option besides NFS. I’ve heard great feedback from SSHFS so I’ll bench it eventually and see how it goes.

7777AKA, 10 months ago

I use Digital Ocean Spaces (S3 Bucket) costs $5 / 250 GB / month

wgs, 10 months ago

How do you use them ? Do you mount the bucket locally on the server ?

7777AKA, 10 months ago (edited 10 months ago)

Well i just connect directly to bucket, You can mount it too

wgs, 10 months ago

How do you mount it ?

7777AKA, 10 months ago

I used s3fs:

nakivo.com/…/mount-amazon-s3-as-a-drive-how-to-gu…

wgs, 10 months ago

Ok thanks, so it’s similar to rclone mount, just with another tool.

PlexSheep, 10 months ago

Selfhosting storage is pretty good to, if you’re into that.

wgs, 10 months ago

I’d like to avoid that as I don’t consider my home network reliable enough for such a critical task.

PlexSheep, 10 months ago

Understandable. Sadly, really reliable storage is pretty pricey.

wildbus8979, 10 months ago

buyvm.net

rambos, 10 months ago

Google and dropbox are ~10€ a month for 2 TB. Idk is that solution for you, but I would consider building NAS at home. I mean…this is selfhosted channel :)

For backup I use backblaze, but thats cheap only if you dont download a lot, also not sure can it be used for your case. Sry, not rly helpful (:

wgs, 10 months ago

I’m never going with Google/Dropbox ^^ the goal is to be in control of my data. Backblaze could be an option, but I expect too many read/writee for it to be cheap.

I considered the NAS at home but my home net is not reliable enough.

TBH I’m still looking for a better option to share storage between servers other than NFS. There has to be something better in 2023!

MangoPenguin, 10 months ago

Hetzner has their storage boxes which are very cheap, might be an option.

Alternatively use an external S3 provider like Wasabi or Backblaze.

wgs, 10 months ago

I ise backblaze for backups already. But is an S3 backend any good for mounting locally and doing many read/write ? What are my options to mount it besides rclone ?

GregoryTheGreat, 10 months ago

Fuse

wgs, 10 months ago

I didn’t know about their storage box. That’s interesting, thanks !