Until recently, and for well over the past decade, my wife and I have been nomads. Moving from the Caribbean to Miami, New York, Las Vegas, Vancouver, and now back home. This has meant that for many of those years, my home office basically comprised of a few laptops and screens.
Last week, after a short trip to Antigua, I had a brief meeting with a tech friend of mine, Yves Ephraim. He was an Engineer with Cable & Wireless for 20 years (until 2003). Yves left C&W shortly before I started there in 2004. He’s a champion of the internet and technological developments in Antigua & Barbuda.
We sat in his home office where he told me a bit about his current projects; as well as his dabbling’s with IPv6, web hosting, mail, BGP4, among other things. Most of which he does via his very capable home lab.
What is a Home Lab?
My current Home lab in a 12u rack as of May 2020
Think of a home lab as a place where you can fail in the privacy of your own home. As Thomas A. Edison said: “I have not failed. I’ve just found 10,000 ways that won’t work.” I consider myself an expert at failure. But seriously, I would like to fail a lot more and a home lab will create endless opportunities for me to fail. Of course, all the while seeking success, but you got that already.
In general, a lab is a place where you can safely perform experiments. Most of you reading this article are techies and sysadmins. As you know, trying out new things on production equipment never ends well. Shush… it’s OK, I know, I know, you didn’t think that one command would take everything offline. This risk is the reason why we build ourselves a sandbox environment to dabble, test and fail in, all from the comfort of our own homes.
To date I host my test labs on servers in North America and Europe. I’m creating a customized network and server home lab; to fill those areas where I would like to become more familiar. I will also be using my home lab for remote backups, network monitoring and alerting of remote servers, and to setup wired UAP APs, among other things.
May we inspire each other to great home labs
As I told Yves, our chat had me revisiting the idea. In fact, I think my exact words were, “Yves, I see your home lab and I’ll raise you mine”. As always, I’m certain there’s a lot more to learn through discussion. In light of this fact, I wanted to share this journey with you, starting with the selection process of the hardware for my home lab.
Of course, over the years, I’ve had equipment lying around, but that stops today. Well sort of. So, if you have ever been interested in building a home lab or if you already have one, then let’s mingle, share and dabble together.
Where do we begin? Not to sound cliché, but let’s start from the ground up, or wall forward. What I’m trying to say is, we need storage space, physical storage space; for our new home lab.
Home lab location, it’s all about location
Location, Location, Location. It’s all about location! Please excuse the lack of originality – i’m a sysadmin, not a writer. I’ll try my best to get you to the end of this article.
Location is critical for a number of reasons. The choice between the home office, living room, closet, attic, basement or garage all depends on a range of important variables. These include room temperature and ventilation, workable space around your equipment, ease and distance of network cable runs, foot traffic, 24-hour ease of access, power, noise levels from your home lab, and more.
Here’s a quick list of Pros vs Cons I’ve compiled, to get us thinking about all the possible home lab locations. Choose wisely:
- Pros: Proximity to work area/desk/devices, fewer cable runs, and you can watch lights flash all day.
- Cons: no home office or you already spend too much time in your home office.
- Pros: Usually cool, lots of space/setup options, blinky-blinky sci-fi movie nights, and counts as family time.
- Cons: divorce, foot traffic, could get damaged, or damaged during the divorce.
- Pros: Easily accessible, stealthy, and you get to say: “Look at what I have hiding in my closet”
- Cons: Poor ventilation (excess heat), lack of space, and one less closet = unhappy wife.
- Pros: Usually cooler temps, and volunteering to do laundry (maybe con?).
- Cons: don’t have a basement, flooding, spiders, or no access when injured.
- Pros: Less noise, easier cable runs.
- Cons: can get hot depending on where you live, roof leaks, humidity/condensation, and creepy at night.
- Pros: Less noise in the house, completely out of sight, wife won’t even notice.
- Cons: A Bug’s Life in your lab, excess heat (if no AC), dust, could require longer cables, or gets wrecked when parking the car.
For my lab, I’m going to build it out in my home office. In my office I have laptops, a desktop, a server and other devices so this location will require shorter cable runs. When selecting your location, also consider the coolest area of the room/space, avoid direct sunlight and consider reserving space for future expansion.
It’s wise if you draw/sketch out a home network diagram or use network design software. Keep in mind your floor plan and how you will accomplish the cable runs. For example, most of the homes on this island have 6″ concrete interior walls. Think about these things before, not after. In other words, map everything out, make notes and create lists.
Network vs. Server Racks vs. Cabinets?
Next, we need to decide how we will store the equipment (modems, routers, switches, servers, patch panels, UPS systems, power strips, cooling fans, etc.).
Network cabinets and racks, are often confused with Server cabinets and racks. Routers, switches, patch panels, and the like, are usually much shallower than servers. As such, Network Cabinets and Racks are usually not as deep as Server Cabinets and Racks. Also, networking devices often produces less heat than servers. You will find some network cabinets will have glass doors that may not leave enough ventilation for servers.
After deciding the depth and ventilation requirements for your home lab, there are a couple of other things to consider. A cabinet is an enclosed space with door(s) and/or removable sides, whereas a rack is a semi or fully open (4 sides open) frame. To help you decide whether to use a cabinet or rack, consider the following:
- If you are installing large, heavy servers, then the extra stability of cabinets or four sided racks should be considered.
- If you need frequent access to the sides or rear of equipment, then an open rack or cabinet with removable sides would work well.
- If your equipment requires extra cooling, an enclosed cabinet will need more attention when it comes to cooling and ventilation.
- If the room is prone to dust, the extra protection of a cabinet will go a long way in keeping it out of your equipment.
- If you are installing in a general living area frequented by house guests, consider an enclosed cabinet that can often look neater in appearance when locked. However, a well-maintained open rack with tidy power and network cable runs can look just as neat!
- If restricted access/security is required, many enclosed cabinets often offer lock and key access control for better security.
Recommended Home Lab Hardware
Now that you have already measured the maximum depth of your equipment and considered all the above advice, it’s time to buy your first piece of hardware. Or not. You could have probably skipped to this section if you prefer more em’, creative methods for hosting your home lab. However, most of the above advice applies even if you plan to setup your home lab in your existing living room cabinet, on a bookshelf, under your desk, or in a cardboard box. No, seriously…
Image: Fancy cardboard box cabinet.
As a reminder, in some countries you can get most of the equipment listed below via Craigslist, Universities and other local second-hand options. Prices on this page reflect Amazon’s current pricing, which is subject to change. If links to manufacturer pages become broken over time, please let me know, as it seems to always happen. Let’s move on to the recommended home lab hardware.
To replace or not to replace: ISP Cable Modem
Before we delve a bit deeper into my home lab recommendations, if you are a beginner to switching and routing, then a lot of the hardware below may seem to be a bit of an overkill. You can get your feet wet by merely replacing your ISP’s cable modem (ISP or Internet Service Provider), you know, that thing with all the flashing lights that you constantly have to unplug to reset to regain internet access. Yup, that one, the mini heater in your living room.
Most US ISPs charge monthly rental for that thing. Buying your own could make some financial sense. As well as, giving better performance, reliability and security. Bet you were already sold with the financial bit eh? But it gets better; most of these modems provided by ISPs are usually of poor quality, used, and lack features. Lastly, your ISPs Modem/Router combos often cannot independently update firmware versions as new exploits emerge. Which means you are at the mercy of your ISP to push new patched firmware.
Now, if you have a great ISP and this does not apply to you, then stick with your modem. The only reason to replace it in such circumstances will be if you want to have access to additional network features and to create a home lab where you can test away! I replaced the modem/router combo from my ISP. I went with the Motorola MB7420 16×4 Cable Modem.
If you would like to keep things simple then go with a Modem + Wi-Fi router combo. Otherwise continue if you would like to build out a home lab to manage Firewall, NAS storage, VPN, VLANs, PoE (Power over Ethernet), Virtualization, remote network infrastructure monitoring/alerting, wired APs, web servers, backup servers, the list goes on.
Update: This modem, similar to most I’ve used, gives off quite a bit of heat. Something to consider when deciding placement, I would suggest toward the top, or leave space below and above. That said, I love this modem! Unlike the ISP’s modem it shows the quality of your connection including Freq. (MHz), Pwr (dBmV), SNR (dB), corrected and uncorrected, and even allows manual downstream frequency setting if needed by your ISP.
Selecting Your Home Lab Rack
A rack unit (abbreviated U or RU) is a unit of measure defined as 1 3⁄4 inches (or 44.45 mm). It’s the unit of measurement for the height of 19-inch and 23-inch rack frames and the height of the equipment. The height of the frame/equipment is expressed as multiples of rack units. A typical full-size rack is 42U high. Racks and cabinets are then listed as 1U, 2U, 3U, 4U, and so on.
Here’s an example below of a 6U rack (labeled):
- StarTech 12U Wall Mount Rack – 13.5″ Deep / 19″ wide / 125lbs Capacity – $118 (specs) – During my search for a wall mounted rack, I almost purchased the 6U version of this rack, then at the last minute I switched to the 12U version for possible future expansion.
- Samson SRK-12 Universal Equipment Rack Stand – $230 (specs) – This was my first choice, this is an audio equipment rack that is fully compatible with shallow-mount equipment. One advantage is that it’s supported on wheels, so you don’t have to fix it to a wall or floor. However, I’m 6’2″ and I want to mount my rack about 4′ off the ground, so as you will see, I have also purchased a 2U cooling fan (intake) which I will place at or to the bottom of my setup. If your room is air conditioned 24/7 and you don’t mind the low-to-floor setup, then this may be the rack for you. Here’s a great example of how clean this Rack can look when setup.
- NavePoint 9U Basic IT Wall Mount Network Rack Locking Glass Door – $135 (specs) – This is a very beautiful looking Network Cabinet. The issue for me is that I only use the AC in my office in the summer, and I don’t want the heat ever to be an issue, thus for my home setup, an enclosed cabinet wasn’t right for me.
Update: This is a very solid wall mount rack. I can confirm that what you see, is what you get. No issues to report. It does exactly what it’s supposed to.
Home Lab UPS (Uninterruptible Power Supply)
At home, we have a backup generator that runs on propane. It can run for up to a week which is useful in the tropics. Other than hurricane season, power cuts are extremely rare here. So far for 2020 we have had one outage that was due to a lightning strike on a nearby electrical post.
It takes a minute or so to fail over to the backup generator. So the rack mount UPS solution I’m looking for is something that will be able to support between 100W and 200W for a couple of minutes. Long enough to fail-over to the backup gen or to shut down all the equipment cleanly. In the future, I may expand this with larger batteries but with no way of returning anything I purchase, I’m a bit wary on investing in a larger backup battery only to find out it’s a dud. Will test for a year first and so here’s what I decided on:
- CyberPower OR500LCDRM1U UPS, 500VA/300W, 6 Outlets, AVR, 1U Rackmount – $175 (specs) – A small 1U rack mount UPS coming in at 20lbs which should give me around 10 to 15 minutes of runtime.
Ultimately, you will have to decide whether you even require uninterruptible power supply at home. From experience, UPS batteries are almost always a disappointment and this is largely because of the cost vs return. If you really need to have a UPS, you could spend thousands just to have a long enough runtime. If you work form home or host critical services hosted from home – you probably shouldn’t – then it may by worthwhile. My advice, get a UPS which provides just enough runtime for everything to shutdown cleanly and only use the UPS for the most essential and efficient devices in your home lab. With all things considered, I’ll have to circle back to this section before recommending any other UPS models.
Update: Surprisingly, the battery performance of this UPS so far, is above my expectation. I ran it down to around 50% and that gave me just over 30 mins of run time which also included powering 2 PoE APs and a 27″ monitor. As mentioned later in this article, pay attention to your power consumption. This was something I considered and it’s paid off thus far. The APs for example, max power consumption is just 6.5W per AP. The max load is currently about 20% to 30% of UPS capacity.
Universal Home Lab Rack Shelf
Did you notice that the CyberPower 1U UPS does not have rack mounts? Of course, you could rest it on top of other equipment; however, I wouldn’t recommend that because we should keep the batteries as cool as possible and leave space between equipment to reduce the amount of trapped heat. Lastly, for this setup, it will look more professional if placed on a ventilated 1U rack shelf:
- AC Infinity Vented Cantilever 1U Universal Rack Shelf, 10″ Deep, for 19” – $25 (specs) – These shelves are available from 6″ to 16″ deep. The backup battery is 9.5″. Pay attention to the depth of your rack/cabinet and equipment before deciding what you need.
Update: Very sturdy, great for keeping equipment cool and cable management thanks to the vents and slots.
Rack Mount Home Lab Power supply
The aforementioned CyberPower UPS comes with six outlets – four backup /w surge + two surge only. Currently under my desk I’m using seven outlets, and this is before ordering a replacement ISP modem, router, switch, servers and does not consider any future expansion. Right above the UPS I will be mounting the following:
- ADJ Products AC POWER STRIP (PC-100A) – $ (specs / alternative) – will plug this into the 1U CyberPower UPS.
Update: This is very convenient piece of hardware. It plugs direct into the UPS and allows easy on/off switching of other equipment and devices.
Rack Mount Home Lab Cooling Fans
Maintaining an optimal temperature for rack-mounted equipment prevents overheating, ensures consistent performance and extends their lifespan. The plan is to mount an intake fan at the bottom rack unit position (remember hot air rises). Then after testing, I will decide whether I’ll need an exhaust fan at the very top of the rack.
- AC Infinity CLOUDPLATE T7-N, Rack Mount Fan Panel 2U, Intake for 19” Racks – $110 (specs) – an intelligent cooling fan system providing quiet high airflow cooling. The system is housed in a solid aluminum 2U case that’s less than 4 inches deep. It includes a thermostat for automatic fan speed during varying temperatures. A max airflow rating of 220 CFM will provide useful cooling to server, network, and other equipment.
- AC Infinity CLOUDPLATE T1-N, Rack Mount Fan Panel 1U, Intake for 19” Racks – $120 (specs) – A more compact 1U design which moves less air (up to 60 CFM) if you are low on free rack units.
- AC Infinity CLOUDPLATE T2, Rack Mount Fan Panel 1U, Top Exhaust for 19″ racks – $120 (specs) – This 1U top exhaust cooling fan can move up to 300 CFM. At 13.5″ deep it will be either a tight squeeze or will need modification for my rack. So I have not ordered this until I can examine closer.
Update: At the lowest fan speed, this cools rack temps by about 2 to 3 degrees Fahrenheit. I’ll update my thoughts again in the summer.
Home Lab Routers and switches
After many weeks of research, online comparisons, reading reviews, watching YouTube videos and countless hours spent on /r/homelab, I can safely say that the following three companies’ devices will fully cover all of your routing and switching needs: Cisco > Ubiquiti > TP-Link. Sorry TP, nothing personal you are just 3rd, but not last, is that better?
For my setup I’m going more small-business than home office, as far as equipment goes. I’d like to be able to have future access to more features. I plan to circle back to this section and post another article with my new network setup. The following were my selections, followed by the runner ups.
- Enterprise features: Ubiquiti EdgeRouter ER-10X, 10 Port Gigabit Router with PoE Flexibility – $110 (specs) – (10) Gigabit RJ45 Ports, PoE Passthrough on Port 10, Dual-Core, 880 MHz, MIPS1004Kc Processor, 512 MB DDR3 RAM, 512 MB NAND Flash Storage, Internal Switch, Serial Console Port.
- Enterprise Proven: Cisco RV160 VPN Router with 4 Gigabit Ethernet (GbE) Wired Ports – $150 (specs) – 1 Gigabit WAN +4 Gigabit LAN Ports, Dual-Core, NAT throughput: 600 Mbps.
- Home lab Value: TP-Link Safestream Multi WAN VPN Router (TL-R600VPN) – $60 (specs) – 1 Gigabit WAN +3 Gigabit WAN/LAN +1 Gigabit LAN Port | IPsec/L2TP/PPTP VPN Supported | SPI Firewall | DoS Defense | Lightning Protection
- Enterprise features: Ubiquiti EdgeSwitch ES-10XP, Managed 10-Port Gigabit Switch with PoE – $115 (specs) – (8) Gigabit RJ45 Ports, (2) SFP ports, 24V passive PoE output on all RJ45 ports, 10 Gbps Total Non-Blocking Throughput, 20 Gbps Switching Capacity.
- Enterprise Proven: Cisco SG250-08HP-K9-NA Smart Switch 8-Port Gigabit with 45W PoE – $150 (specs) – (8) Gigabit, VLANs, QoS, Voice VLAN, GVRP, MSTP, and IGMP Snooping, Access Control List, 802.1X / RADIUS, SSH/SSL.
- Home lab Value: TP-Link 8-Port Gigabit Ethernet Easy Smart Switch (TL-SG108E) – $40 (specs) Unmanaged Pro, Plug and Play, Shielded Ports.
There’s also Netgear, pfSense, and many, many, other options but you want me to complete this article, don’t you? Of course, this means that you will still have to research the recommendations on your own, as not all of my picks may fit your requirements.
Update: Just what I needed. The router runs modified Debian. How cool! Its packed with enterprise features. I’m excited to learn full command line management.
Home Lab Patch Panels and Network Cables
With hindsight, I should have gone with the 24 port patch panel. Instead, I went with this 16 port patch panel because, well, I liked how centered and less-busy it looked. I know. I don’t wanna hear it. But look at that thing! If it isn’t already obvious by the 16 ports, it’s the image just above.
The fastest internet plan available from my ISP is 160Mbps down / 30Mbps up. Thankfully, you do get what you pay for, and kudos to them! For my home lab I probably won’t be needing CAT8 or CAT7 anytime soon and I don’t have the need for high LAN traffic. So I purchased 250′ of regular CAT6 reel and some different lengths Cat6 as I’m ok with the 1000Mbps limit. Yeah, I also like my coffee black. If you want smoother network traffic then by all means, go for at least CAT6a. However, make sure you go with a shielded patch panel. Going CAT7 cable or Cat6a is a waste of money if your RJ45 connectors and patch panels don’t support it. “Keep it simple stupid!” No, I’m not talking to you, that was me speaking to myself while selecting patch panel and cables.
Update: High quality! Easy to punch down. All my patch connections worked on the first try.
Home Lab Servers
For the purpose of this article, I won’t recommend any specific servers because this will vary a ton depending on what you will be hosting. NAS storage, VMs, web servers, backup servers, mail servers, ad blocker, and all the rest. For my requirements I purchased a ThinkCentre M73 and ThinkCentre M715q both used off eBay. As far as full fledged servers go, some good options are Dell, HP, Cisco and Lenovo. For home labs, these are often best purchased used from Craigslist or Ebay. You can use Wikipedia to search the specs of older generations for example, Dell PowerEdge model history.
Update: AMD has really raised the bar. I’m most impressed with the CPU performance of the M715q. They both run quiet and cool, with Ubuntu server and Windows 10.
Summary and Conclusion
Image: your setup, should be your setup. As traditional or as custom as you’d like!
When writing this guide I tried my best to convey my passion, thoughts, and considerations throughout the selection process. It’s important that you find your passion when it comes to building your home lab. What will you use it for? How will it benefit you and others?
If you have a plan, and if your lab is going to be something you enjoy learning, failing and succeeding with, then it will pay for itself in one way or another. That said, be careful with the power consumption! You don’t want to end up with… mortgage $1,100, power bill $1,200, the feeling when walking into your home lab… NOT priceless.
Plan with room to expand and feel free to start small. You don’t have to start with a rack, cabinet, patch panels and all the other gear. Get your feet wet, replace your ISP modem, then build from there. Avoid making rash decisions on hardware, instead, sleep on it. While you sleep, post a question or two in /r/homelab to get valuable feedback from other techies and sysadmins. You will find that the more you research, it will open up additional ways to get things just right, or very wrong. More importantly, have fun! Share your home lab goals with your spouse, colleagues, kids and that neighbor across the street who still only waves after five years.
I hope that this article was an enjoyable read, inspiring and that it opens a dialog between us. Feel free to contact me. I love hearing, supporting and learning from you guys!
Update 1 – March 10th 2020:
As of today, I’ve almost completed setup of my new Home lab and it’s now fully functional. I’m pleased with all of the items purchased. For this update, I’ve added to the article some highlights, tips and findings below each hardware item in italics.
One thing I missed in the original article and Home lab setup was the coaxial cable. The existing cable turned out to be about three feet shorter than required. Tomorrow I’ll replace with a longer cable. As you can see I’ve also replaced the ISP modem with the Motorola model listed below.
Unfortunately, the Ubiquiti EdgeRouter and EdgeSwitch turned out to be about an inch too wide. This was something I failed to consider because I measured their combined width, then compared that measurement to the rack’s interior width, instead of the width of the rack shelf. Oops! Now, so that the switch doesn’t remain sitting on the router, I’ve just ordered two Ubiquiti rack mounts. Better cooling and aesthetics, but also the rack mounts will allow positioning the router and switch directly below the 16 port patch panel pictured below. Check back in a week or two for another update.
My Home lab – a work in progress (everything pictured is listed below)
Update 2 – March 25th 2020: Will follow up with details and feedback shortly. Here’s an updated status photo:
Update 3 – April 19th 2020.
Over the past few weeks, I’ve added a few things.
- A Netgear 4G LTE modem (and antenna) for internet auto fail-over from ISP1 (cable internet) to ISP2 (4G internet).
- 1U Blanking Panels to improve the efficiency of the cooling fans.
- The previous two vented 1U blanks are now at the top of the rack. Will be used to mount a monitor. (see to do’s below)
- Quick access 1u mess cover to prevent accidental power switch toggling.
- Rack mount kits for the EdgeRouter ER-10X and EdgeSwitch ES-10XP.
- Cleaned up all wires and cables. Labeled network cables but didn’t label the patch panel, of course!
- Added VLANs, restricted bandwidth of guest devices as well as some other home devices, hardened firewall.
- Installed Zabbix server for additional monitoring of 150+ remote servers.
- Added a domain to static IP. Which has a couple of public facing subdomains.
- Removed or smoked-out’ some of the logos and text for a cleaner look. (aka. OCD)
- Added x2 UAPs and x2 beacons.
- Outlet savers so I could make use of all available power outlets.
- Added push notification for when ISP1 goes down since switching to backup ISP2 is completely seamless.
- Add a separate 21″ monitor to display Zabbix hosts/dashboard.
- Dabble with psfense. Reset everything to defaults and reconfigure with lessons learned.
- Add indoor PoE surveillance cameras (currently only outdoor cams).
- Setup KVM desktop switch to be able to switch easier between the two servers and desktop.
- Check rack temperatures from June to August to determine if setup is as cooling efficient as planned.
Latest home lab photo:
Update 4 – May 1st 2020:
- Added separate 21″ monitor to display remote hosts/dashboard using Raspberry Pi and Zabbix.
Update 4 – June 7th 2020:
- Added keyboard and mouse for walk-by access to Zabbix UI.
- Swapped out mesh security cover with tinted plexiglass.
- At this point my home lab is complete. Is it ever? :)
Related reading: Finding Linux Compatible Printers