WilliamLam.com

NVMe Tiering with Nested Virtualization in VCF 9.0

by // Leave a Comment

The NVMe Tiering feature was first previewed with the release of vSphere 8.0 Update 3 and the feature is now officially supported with the release of VMware Cloud Foundation (VCF) 9.0! 🎉

Since the original tech preview, all major limitations and unsupported workload profiles that would prevent an organization from deploying NVMe Tiering in production has been resolved as part of the VCF 9.0 release.

Although Nested Virtualization is NOT officially supported, many users rely on Nested ESXi for testing, development, and learning purposes. With that said, if you have NVMe Tiering enabled on an ESXi 9.0 host and you attempt to power on a Nested ESXi VM or VM that is configured with Virtual Hardware-Assisted Virtualization (VHV), it will fail to power on with the following error message as shown in the screenshot below.


While it was possible to use Nested ESXi with the tech preview of NVMe Tiering, it was just not in scope as part of productizing NVMe Tiering for VCF 9.0.

All hope is not lost, while Nested Virtualization is still NOT officially supported by Broadcom, it is a very useful feature not just for our users but also for internal development purposes and after speaking with the tech lead for NVMe Tiering, this is something that will be addressed in a future update of VCF and this is just a short term limitation for now if you intend to run Nested ESXi workloads.

NVMe Tiering with AMD Ryzen CPU workaround for VCF 9.0

by // 2 Comments

If you have an AMD Ryzen processor and you are planning on use the NVMe Tiering feature with either VMware vSphere Foundation (VVF) or VMware Cloud Foundation (VCF) 9.0, you will need to apply the following workaround for your VMs to properly boot.

Note: This workaround is only required on AMD Ryzen (Consumer) CPU with NVMe Tiering enabled and does not affect AMD EPYC, Intel Xeon or Intel  Core (Consumer) CPUs with our without NVMe Tiering.

On an AMD Ryzen CPU that has NVMe Tiering enabled, when powering on a VM, you might notice the operating system does not fully boot and the VM console may become unresponsive. After spending some time debugging with Engineering, it looks like there are some issues with specific AMD Ryzen CPU instructions that is causing the VM to behave this way when NVMe Tiering is enabled.

[Read more...]

Crowdsourced Lab Hardware for ESXi 9.0 Dashboard

by // 1 Comment

For a major new vSphere release, it can be challenging to understand whether your existing hardware will continue to work or if you need to upgrade.

During the development of VMware Cloud Foundation (VCF) 9.0, I had put together a survey that would crowdsource from internal users who have successfully installed ESXi 9.0, so that it can be used as a reference for the community. We have almost 50 submissions, including details about the hardware platform but the also the different key I/O devices across networking, storage and graphics! I would like to give a big thanks to all the VMware/Broadcom employees who contributed to the initial dataset and I hope to see this grow as our users start to play with VCF 9.0 in their lab envionments

You can view the dashboard results by visiting: https://lamw.github.io/community-lab-hardware-for-esxi9/

If you would like to contribute your own system that has NOT already been submitted, please fill out this form here: https://forms.gle/dXbzpTz4JpwP8bXr7