So, SourceHut is not hosted in anyone's cloud. I own all of the hardware outright and colocate most of it in a local datacenter.
I just built a new server for git.sr.ht, and boy is she a beat. It cost me about $5.5K as a one-time upfront cost, and now I just pay for power, bandwidth, and space, which runs about $650/mo for *all* of my servers (10+).
Ran back of the napkin numbers with AWS's price estimator for a server of equivalent specs, and without even considering bandwidth usage it'd cost me almost TEN GRAND PER MONTH to host JUST that server alone on AWS.
AWS is how techbro startups pile up and BURN their investor money.
@sir That's crazy. I've been contemplating hosting my Fediverse servers on a bunch of Raspberry Pi's to cut hosting costs. Unclear how feasible it would be yet, but clearly a different scale!
@alex you should do this if you're prepared to lose all of your data when all of your SD cards fail
@alex friends don't let friends store important data on SD cards
@sir Yeah I was just thinking about I/O speed too. I'd dedicate one Pi to the database and connect a proper SSD to it. The rest of the nodes could be configured to fall back to other ones if they fail.
@alex then one rpi acting as a load balancer? Tbh I feel like this is definitely going to end in tears
@sir Yeah that's what I was thinking. It's similar to the setup I'm already using in my cloud host: 1 load balancer, 1 db server, and a bunch of disposable app servers. If the load balancer or db node fail it would be very painful. Maybe I could use a more reliable machine for just those nodes.
@alex tbh I don't trust raspberry pis with anything close to production workloads and I don't let them within sight of important data
@sir @6a62 @alex I have been running my Pi 3 4 node cluster using Docker swarm and NFS for all data storage for about a year and a half without having any SD card failure. All for personal use though not public. So far so good.
But I most definitely have had data corruption issues in the past. Maybe it's just me but for over a decade now I have held the opinion that SD cards are some of the most unreliable storage I have ever used. And I used zip disks...
@sir Fair, I've had Pis burn out several times. But they're cheap AF. It would be really awesome if these little single board computers could be legitimately used for production, it would level the playing field.
We're working on our own cluster of RockPro64 boards to power our infrastructure. Something like this might become available in the future.
In the meantime, we have the SOPine Clusterboard: https://store.pine64.org/?product=clusterboard-with-7-sopine-compute-module-slots. 28 cores and 14GB of RAM in a compact package for just barely over $300. :)
We're planning to have the bigger of our two clusters available for use as a compilation box for developers. 😊
To be fair, the hardware architecture of our cluster(s) isn't that complex. It's basically a whole lot of RP64 boards connected together by Ethernet, and data being accessed from a NAS setup. There's some custom fabrication to fit it in a 2U case, but that's not necessary if you're not putting it in a data center.
The rackmount case is likely to stay a one-off for us. There's not really enough market of people wanting to put together $1000+ ARM cluster setups to justify the manufacturing/setup costs to sell them. The network backplane board could be something which may be sold if people want it.
@alex What's your opinion of the PICO cluster?
This is a x10 Pi4 edition, but there are others with different boards and a different number of boards.
The social network of the future: No ads, no corporate surveillance, ethical design, and decentralization! Own your data with Mastodon!