Below is what I wanted to do and a few of the steps I documented towards this goal, here is where I revisited this project with a much different approach. I would read this first anyway before reading the revisited version.
If you don’t try you’ll never know, right?
So I’ve had this problem for a while since moving out, but I excuse it because, well, she gave birth to me. My mother calls me constantly asking me to fix stuff or implement something new in my old home which I am fine with but sometimes it feels extremely tedious as I could have sworn I fixed that same issue not 1 month ago…
The latest problem I’m facing is photo storage. My family have a few MacBooks with very limited storage onboard which they seem to fill up quite fast. Upgrade the storage? Sure, but that’s short term and not exactly safe, not in my eyes anyway. My solution? The following…
So I decided to create them a storage server for their home, but this has also been my plan for a while since I also have a fuckton of photos to store (4TB+) so I thought to myself, how can I get this done without breaking the bank? Microservers. Two of them.
The plan is to have them replicate between themselves (rsync), one being in my house and the other in my family’s. I would do the whole crashplan thing but if I ever do need a full restore I don’t fancy waiting years for my data or paying for them to send me a hard drive, and so having an offsite, accessible backup is the best solution. I found that I could get a HP MicroServer GEN8 for £120 after cashback, awesome. I ordered two and started the planning.
The plan is to use the microservers as vmware hosts for management and flexibility purposes, the CPUs are rather weak but should hold up with this workload.* On the microserver at my mother’s house I would also run a PfSense VM to setup a PTP link with my physical PfSense firewall box, this should also let me troubleshoot their frequent internet issues (running on a highend TP-LINK router/AP on DD-WRT) in the future, which is a win-win. FreeNAS is my storage management of choice as I like what ZFS has to offer and FreeNAS has yet to fail me. Rsync will be setup on both boxes to sync between each other over the PTP link. I designed a high level diagram for myself to ensure I wasn’t going to forget/fuck anything up.
Initially I was looking for anyway to make this system work without Vt-d, when I stumbled upon vmware’s RDM (Raw Device Mapping). It seemed like a sure fire way to get it to work as FreeNAS would be presented with RAW disks which it could use. Upon further reading it turns out that this method is not the way to do things, at all. Apparently things can go tits up very fast and in some cases leading to absolute data loss with no culprit, scary stuff. My solution to this, is the same for every problem I face; try to research as much as I can to find another McGiver fix or like in this case, throw some £££ at the problem. I’ve opted to upgrade MUFFHOST04 to a more powerful CPU that supports all the virtualization technology I require, this will allow me to give FreeNAS the MS raid controller (B210i) which will present FreeNAS with the disks without vmware in the middle. I will still be keeping MUFFHOST03 using RDM, I’m not too worried as I will have a safe copy of all the data on MUFFHOST04 that will be configured correctly, I plan to update that box to a xeon too somewhere down the line and reconfigure with passthrough also. The CPU I will be using is this E3-1220v2.
This post will be broken up into multiple chunks, from setting up the MicroServers, to the installation and setting up of the software. It will be less tutorial and more explaining what I’ve done, but I will try and put as much detail as I can be bothered to. Enjoy!~~
- The plan.
- Preparing and upgrading the Microservers.
- Installing and configuring VmWare ESXI (Archive).
- Installing virtual machines (Archive).
- Failure/Revisiting MicroServer Gen8 storage & Syncronisation across the internet.