WilliamLam.com

How to Install VMware VSA with Running VMs

by // 1 Comment

For those of you who want to quickly test out the new VMware VSA (vSphere Storage Appliance) will notice that you can not just throw a few ESXi 5 hosts that have running virtual machines on them. If you try to proceed with the VSA installation, you will see an error message regarding the presence of virtual machines whether they are running or not.

This can make it difficult to evaluate or test the new VSA if you do not have additional hosts that can be easily re-deployed as vanilla ESXi 5 installations. While working on the previous article How to Install VMware VSA in Nested ESXi 5 Host Using the GUI, I decided to test out the behavior of a few other configuration variables found in the dev.properties file for the VSA Manager. It turns out that you can actually disable the host audit check which includes the validation of running virtual machines by changing the host.audit variable from "true" to "false" using the same trick documented here. You will need to restart the VSA Manager and then the vCenter Server service for the change to go into effect.

**** DISCLAIMER: This is not supported by VMware and there maybe specific checks that are now bypassed by disabling the host.audit parameter. Please use at your own risk and test before deploying on actual systems **** 

One interesting observation made while testing this in a nested ESXi configuration is that even though there is a message warning the user that any data found on the local VMFS volumes will be deleted, I did not see any process that was kicked off to do so. This does not mean this was not the original intention, but there was no reformatting of the local VMFS or removal or powering off of the running virtual machines. While testing both a "supported" and "ghetto" installation of the VSA, I found that several advanced settings were updated as part of the VSA installation, you should see the same if you look in the vmkernel.log of one of the ESXi 5 hosts:

2011-09-23T17:36:33.030Z cpu0:3475)Config: 346: "HostLocalSwapDirEnabled" = 0, Old Value: 0, (Status: 0x0)
2011-09-23T17:38:00.971Z cpu0:3258)Config: 346: "HeartbeatPanicTimeout" = 60, Old Value: 900, (Status: 0x0)
2011-09-23T17:38:07.069Z cpu1:2851)Config: 346: "EnableSVAVMFS" = 1, Old Value: 0, (Status: 0x0)
2011-09-23T17:38:07.090Z cpu1:2851)Config: 346: "VmkStressEnable" = 0, Old Value: 1, (Status: 0x0)
2011-09-23T17:44:22.163Z cpu1:3477)Config: 346: "SIOControlFlag2" = 1, Old Value: 0, (Status: 0x0)

One that sparked my curiosity is EnableSVAVMFS which is a hidden setting found on the ESXi host but one can view it using vsish. Per the limited documentation found in vsish, this parameter is to enable some sort of optimization with the local VMFS volume.

Thanks to @VMwareStorage (Cormac Hogan, VMware Technical Marketing for Storage) for the quick answer to my question on twitter, it looks like this parameter does the following:

"Forces linear allocation of VMDKs on local VMFS for VSA. Improves mirroring performance across VSAs apparently" 

There was nothing in the vmkernel.log that would indicate the local VMFS was reformatted or files had to be delete to support the VSA installation. I can understand why VMware wanted a vanilla installation which included no running VMs to simplify the installation process. Another reason that I can think of is by having some initial storage consumption, it can offset the amount of "available" storage that needs to be setup on VSA cluster. The amount of available storage per host must be equal on all two or three node cluster, to ensure there is sufficient space for replication. As long as you understand by having running virtual machines on one or more ESXi nodes, the node with the smallest amount of free physical storage is what the rest of the VSA nodes will be configured to.

You potentially may also find yourself in a chicken and the egg problem if VSA installation fails to install and reverts it's changes, which includes putting the ESXi host into maintenance mode. This will cause it to fail on the node that is running the vCenter Server and VSA Manager, another reason you would want to run the management system outside of the VSA cluster.

Without further ado, I recorded a quick 6minute video demonstrating the installation of the new VMware VSA on ESXi 5 hosts that has running virtual machines which includes the vCenter Server and VSA Manager running on one of the nodes (video is awesome when you bump up the audio):

Installing VMware VSA with Running VMs from lamw on Vimeo.

Not only is this not supported, but it is also NOT a best practice to run the vCenter Server and VSA Manager within the VSA cluster because you may potentially have issues with replication if vCenter and VSA Manager goes down. In my testing, I found that I could take down vCenter and VSA Manager and the NFS volumes continue to function and the cluster continues to churn away. Any virtual machines running on the VSA volumes will automatically be restarted by vSphere HA. Once the VSA manager has recovered, it'll automatically ensure the volumes have all synchronized and re-protect the VSA cluster.

Note: It is important to understand that even though you can install the VMware VSA with running virtual machines using the hack above, the requirement of a vanilla ESXi 5 installation is still 100% mandatory. You MUST still have only a single vSwitch (vSwitch0) with only a single vmnic (vmnic0) connected to the vSwitch with only two default portgruops that must exists: "VM Network" and "Management Network", there is no workaround for this requirement. If you you have a host that you plan on running VMs prior to VSA installation, make sure they are on the "VM Network" portgroup as additional portgroups are not supported prior to installation of the VSA.

I am hoping that some of these requirements are relaxed in a future release of the VMware VSA and possibly a version that would work with the vCVA (vCenter Virtual Appliance). For now if have limited hardware or would like to use existing ESXi 5 host with running virtual machines (needs to be configured like a vanilla installation of ESXi 5) then you can run everything on either a two or three node cluster, just be aware of the caveats.

For more in-depth information and details about the new VSA, please check out the VMware Storage Blog - vSphere Storage Appliance Links and be sure to follow Cormac Hogan on twitter at @VMwareStorage

How to Install VMware VSA in Nested ESXi 5 Host Using the GUI

by // 13 Comments

We upgraded the ghettoDatacenter to vSphere 5 this weekend and one of the things I wanted to play with was the new VMware VSA (vSphere Storage Appliance). Since we only have a single host, running nested ESXi would be our only option and this would allow us to easily deploy three vESXi 5.0 hosts and vCenter to tinker with the new VMware VSA.

UPDATE (09/16/12): You can use the same process outlined in this article to run the new VMware VSA 5.1 (vSphere Storage Appliance) in a nested ESXi configuration. Below is a screenshot of running VSA 5.1 in Nested ESXi 5.1.

One caveat in using vESXi hosts to test the VSA is during the selection of your ESXi hosts, VSA expects the hosts to be EVC capable. The VSA will create a vSphere Cluster and automatically enable EVC baseline based on your cpus. As you may or may not know, EVC can not be supported in a vESXi host and this would prevent you from selecting these hosts.

Luckily this issue was solved by a Vijay in his blog post here. There is a configuration file called dev.properties located in C:\Program Files\VMware\Infrastructure\tomcat\webapps\VSAManager\WEB-INF\classes which contains a line specifying whether or not EVC should be configured "evc.config". This configuration file appears to be used by VMware internally for some type of development but by changing the parameter from true to false, the VSA will support non-EVC capable hosts and not enable EVC for the VSA vSphere cluster.

Note: This is most likely not supported by VMware, please use at your own risk along with modifying any other values within this file.

Now, you might wonder if Vijay had already documented this process in his blog, why am I repeating it? Well the issue that Vijay had identified by tweaking this configuration file was that the VSA GUI installer did not detect the change and had to rely on an alternative method of installation using the commandline. Though not ideal, this method does work but for first time evaluators of the VMware VSA, the various commandline options can overwhelm or confuse users. It would be great if one could using the VSA GUI to perform the installation which is much more intuitive and that is reason for this article.

For the VSA to detect the new changes, you will need to restart the VMware VSA and then the vCenter Service under the Windows Services utility. I am not sure why both services need to be restarted, but I guess the VSA extension is not updated when just the VSA is restarted which is unfortunate. 

Once both services have started up, open a new vSphere Client session to your vCenter Server and proceed with the VSA installation. During the selection of the hosts, you will now have the option of selecting your vESXi 5 hosts and a warning message is presented stating "Unsupported Hardware" but the installer will allow you to continue on. 

After you have selected either two or three of your vESXi hosts, you will be prompted once more that this configuration is not supported nor in the VMware HCL, go ahead and click OK.

After this, you will be able to go through the rest of the VSA installation as long as meet the default requirements of the VMware VSA noted in the documentation.

So if you have some interests in the new VMware VSA and do not have physical hardware to test with, you should consider deploying a couple of vESXi hosts and kick the tires with the new VSA.

How to Run Windows 8 on vSphere 5

by // 17 Comments

There's been a lot of hype/talk about Windows 8 and if you wanted to test drive the new OS, you might consider using the latest release of VMware Fusion 4.0.1 or VMware Workstation 8 as Windows 8 is an officially supported guestOS. Though what if you wanted to run it in your vSphere 5 environment? Well you can with a small hack.

Even though it's not listed as a supported guestOS, you can manually tweak the .vmx configuration to get ESXi 5 host to recognize the guestOS type. You just need to create a generic Windows 2008 system and then from the commandline or by exporting the .vmx using the datastore browser and then edit the configuration file. You will need to make the following change to the guestOS paramater:

guestOS = "windows8srv-32"
guestOS = "windows8srv-64"

One you have made this change, you will need to re-register the virtual machine or reload the configuration using vim-cmd vmsvc/reload operation.

Another method just using the vSphere Client without any modifications to the .vmx is to just create a virtual machine and select any guestOS type. Once the virtual machine has been created, there is actually an option in the guestOS to select Windows 8 32 or 64bit that can be selected. If you wish to automate through the commandline, then you can use the method above or you can just use the vSphere Client.

Note: This is not officially supported from VMware of course, use at your own risk.

UPDATE1: It looks like when Windows 8 64bit is booting up for installation, the virtual machine core dumps with the following error:

vcpu-0| MONITOR PANIC: vcpu-0:NOT_IMPLEMENTED vmcore/vmm/intr/apic.c:1804

Something similar occurs with Windows 8 32bit that gets past the panic but an error message is thrown on the screen regarding HAL initialization failure. Currently there are no workarounds and I've reached out to some of the folks at VMware to see if there's any tweaks that can be made to support this. As I mentioned earlier, this is an unsupported OS/hack, so it may not work at all. Sorry to get everyone's hope up, the new Fusion 4.01 and Workstation 8 might still be your best bet to test out the new Windows 8.

UPDATE2: VMware has released a KB article http://kb.vmware.com/kb/2006859 regarding Windows 8 and vSphere 5 support. You can subscribe to the KB article for the latest update on running Windows 8 on ESXi 5.

UPDATE3:  I recently saw a tweet by Raphael Schitz and it looks like you actually CAN run Windows 8 on ESXi 5. Raphael was able to run Windows 8 by first running Xenserver as a virtual machine and then creating a Windows 8 VM that would run as a nested guestOS within Xenserver virtual machine (pESXi 5 -> Xenserver VM -> Windows 8 VM).

Note: You may need to reboot the system one additional time if it does not automatically load.

Here is a screen shot of Windows 8 64bit running on the latest release of Xenserver 6 running on ESXi 5: