WilliamLam.com

Thunderbolt Ethernet Adapter in Apple Mac Mini on ESXi 5

by // 27 Comments

If you followed Apple's recent announcement at their WWDC conference then you would know that they just released a Thunderbolt to Gigabit Ethernet adapter. So, why am I talking about this? Well if you are running ESXi 5 on an Apple Mac Mini like me, then you are probably wondering if you can get another network interface on the Mini as it only has a single network adapter. The answer is YES!

To get ESXi 5 to recognize the Thunderbolt adapter, you will need to download and install an additional Broadcom driver (tg3 3.123b.v50.1) or you can create a customized ISO with the driver built in using the steps outlined here for a new installation.

UPDATE (12/21): A custom ESXi ISO is no longer needed, you can use ESXi 5.0 Update 2 which includes the necessary driver to support Thunderbolt Ethernet adapter. Please take a look at this article here for the details.

If you are just installing the driver on an existing ESXi 5 installation, extract the offline bundle and upload to your ESXi host and run the following command:

esxcli software vib install -d /vmfs/volumes/mini-local-datastore-1/tg3-3.123b.v50.1-offline_bundle-682322.zip

Here is the output from ESXCLI on how ESXi sees the Thunderbolt adapter:

As you can see, it shows up with no description for the device and this is the same when running lspci, it just shows up as a network controller from Broadcom. This is not a big deal, but I assume this has something to do with the high numbering of the vmnic instead of being vmnic1 it's vmnic32.

I also performed some basic network testing by yanking the ethernet cable on the onboard network adapter and ensured traffic continued to flow and vice versa with the other Thunderbolt adapter. Everything works beautifully and now you can have some network redundancy built into your Mac Mini or if you need the throughput for all those VMs you plan on running 😉

Big thanks to Randy K. for hooking me up with a Thunderbolt adapter!

 

That's so cool! Running ESXi 5.0 & 5.1 on Apple Mac Mini

by // 39 Comments

Those of you who follow me on twitter should know that I recently got my hands on an Apple Mac Mini Server (Thanks Randy K.) and are probably thinking I would install Apple OSX on the Mini. Nope! I am actually running vSphere ESXi 5.0 or 5.1 on the Mac Mini!

UPDATE (12/21): Yo no longer need to create a customized ESXi ISO for Apple Mac Mini, the necessary drivers are now included in the new ESXi 5.0 Update 2 and will work out of the box. Please take a look at this article for more details.

UPDATE (01/18): To run ESXi 5.1 on Mac Mini 5,1 or 5,3 please follow the same steps outlined below but for an ESXi 5.1 ISO image. If you are trying to run ESXi 5.0 or 5.1 on the new 2012 Apple Mac Mini 6,2 please refer to this blog post for the instructions.

Disclaimer: This is not officially supported by VMware. Use at your own risk.

Note: I did not have a spare monitor at home and luckily the Mac Mini has a DVI output which I was able to connect to my 46" TV. Nothing like ESXi on the big screen 🙂

Even though this is not officially supported by VMware, it is still a very cool solution and the Mac Mini is great form factor for a vSphere home lab. I also want to mention that this was only possible with the research from the folks over at Paraguin Consulting who initially blogged about the process needed to get ESXi 5 running on a Mac Mini. I would highly recommend you check out their blog post which provides additional details as well as a step by step installation guide including screenshots for each step.

I did not have access to an Apple Super Drive which is what the Paraguin folks used in their installation guide, as they thought formatting a USB key would have taken too long ... and who has a CD burner these days? 😉 There is also an additional step that is needed to get network connectivity which requires the user to manually install a network driver on the ESXi host.

I decided to go down the route of using a USB key to perform the installation and using a spare 1GB USB key, I created a custom ESXi installation that included the network driver which allows for network connectivity during and after the installation.

What you will need:

Step 1 - Extract the offline bundle "tg3-3.120h.v50.2-offline_bundle-547149.zip" from Broadcom zip file

Step 2 - Use Image Builder to add the Broadcom driver and create a custom ESXi 5 ISO (steps taken from this VMware KB article)

# Add the ESXi 5.0 Update 1 Offline Bundle

Add-EsxSoftwareDepot "C:\VMware-ESXi-5.0.0-623860-depot.zip"

# Add the Broadcom Offline VIB

Add-EsxSoftwareDepot "C:\tg3-3.120h.v50.2-offline_bundle-547149.zip"

# Create a new Image Profile (in example, I'm using the full version w/tools)

New-EsxImageProfile -CloneProfile "ESXi-5.0.0-623860-standard" -name "ESXi50u1-Custom"

# Add the broadcom driver to our Image Profile

Add-EsxSoftwarePackage -ImageProfile "ESXi50u1-Custom" -SoftwarePackage "net-tg3"

# Create an ISO from our custom Image Profile

Export-EsxImageProfile -ImageProfile "ESXi50u1-Custom" -ExportToISO -filepath C:\VMware-ESXi-5.0u1-Custom.iso

Step 3 - Plug in a USB key into your system and run UNetbootin which will take the custom ISO we just created and make it bootable on the USB key

Step 4 - Finally, power on your Mac Mini and plug in the USB key. You can either hold the "Alt/Option" key while the system is booting and select the EFI volume OR just plug the USB key and the ESXi installer should automatically start up.

After a few minutes, you should now have ESXi 5 running on your Mac Mini, here is my setup:

Note: If you wish to add a custom kickstart file so it automatically installs and configures the host, take a look at this blog post for the details. If you want the Mac Mini to automatically boot from USB without having to press the "Alt/Option" key after installation, you can set the default boot device by following this article here.

Since you are running ESXi on Apple hardware, you can also create Mac OSX Virtual Machines (10.5 Server and 10.6 Server) and with the latest release of vSphere 5.0 Update 1, OSX 10.7 (Lion) is now officially supported. To install OSX 10.7 as a VM, make sure you follow the instructions here.

Here is a screenshot of running OSX Lion 64bit as a VM running on ESXi 5 running on a Mac Mini 😀

If you are looking to refresh your vSphere home lab, definitely consider looking at the Mac Mini, which can get up to a max of 16GB of memory. Also if you are wondering if other people are doing this, I would recommend you check out Christopher Well's vSamarai blog here which details his experience using the Mac Mini as well as voting for his VMworld CFP which will also include topic about running ESXi on Mac Mini.

I want to thank Randy K. again for lending me the Mac Mini, you rock dude! Hopefully this will not be the last article about the Mac Mini 😉

Additional Resources:

When Can I Run Apple OSX on vSphere 5?

by // 9 Comments

There was a recent post from the famous Scott Drummonds about Running Apple OSX Lion on vSphere 5 and Scott provided his interpretation/opinion of Apple's EULA on virtualizing Apple OSX. Though the EULA can be somewhat confusing, it is true that with the release of vSphere 5, you now can run OSX 10.7 (Lion), 10.6 (Snow Leopard) and 10.5 (Leopard) as a supported guestOS in ESXi 5.

...but there is a catch (there's always a catch)

UPDATE: As of vSphere 5.1, the Apple Mac Pro is now fully supported on running on ESXi 5.1, to get more details, please take a look at this article.

The caveat is that in allowing VMware to run OSX as a virtual machine on vSphere 5, the physical hardware that ESXi 5 is running on MUST be Apple hardware and specifically the XServe 3.1. For those of you who do not follow Apple's hardware closely, the XServe line was recently EOL as of January 31, 2011 and that brings up an interesting problem. If you wanted to virtualize Apple OSX, you would have had to have purchased XServes prior to January 31st or start looking on Ebay with your corporate card 😉

Now, the Apple EULA is not the only thing that is regulating this requirement, in addition, VMware had to implement a software check within ESXi 5 to ensure that the physical hardware is in fact Apple hardware before allowing you to properly boot up an OSX virtual machine. The check looks for the SMC (System Management Controller) when an OSX virtual machine is being powered on and if this check fails, you will get an error and the virtual machine will be powered off automatically. The presence of the SMC is a new property that is exposed in the vSphere 5 API under "hardware" section of the ESXi host.

The property will either return true or false on whether SMC is present. You can easily check your ESXi 5 host by using the vSphere MOB and pointing your browser to the following URL:

https://[esxi5-hostname]/mob/?moid=ha-host&doPath=hardware


Now you can easily determine whether or not your physical host can support running Apple OSX VMs.

As I understand from the beta, only XServer 3.1 will be officially supported and you will not be able to install ESXi 5 on older versions of the hardware. I have also heard mixed results on folks being able to install ESXi 5 on Mac Mini's and Mac Pro's. At this point, hopefully Apple has a change of heart and will update their EULA to allow ESXi 5 to run on "currently available" Apple hardware such as Mac Mini and Mac Pro.