This project would never end and I will never get to share it! So here we go ๐ I got three switches. Two from ubiquiti(aggregate & 500w POE 48port) and one 100g mikrotik switch. Running most of my servers on 25G and primary nas/server on 100G. I even ran a fiber to my desktop for that sweet 25G laser bits. I got 4 servers. All running V4 Xeon with different levels of horse power. Two dedicated Pfsense boxes on redundant configuration. I use Proxmox as my hypervisor, then I run truenas, k3s on top of it. All of this consumes about 700w. I know it's alot and main server consumes half of it. POE switch takes 100w. Other three servers and the pfsense only consumes 300w. My next project going to getting rid of the monster but I need ton of PCI and 12bays for drive ๐ธ. Maybe I'll invest on solar instead ๐ . Feel free to ask any questions.
They are all the same. Running K3s. Bottom 1u dedicated for pfsense. Server with 12 bays and 8 days running truenas within proxmox. They double their duty as a k3s node as well. One with 12 bays got 32 cores(64 logical), so it got some horsepower. Two truenas systems replicate with each other for extra redundancy, and one got 6x20tb, and the other got 12x10tb drives. I wish there is a way to cluster truenas systems. At least for NFS and ISCSI ๐ญ