WilliamLam.com

  • About
    • About
    • Privacy
  • VMware Cloud
  • Tanzu
    • Application Modernization
    • Tanzu services
    • Tanzu Community Edition
    • Tanzu Kubernetes Grid
    • vSphere with Tanzu
  • Home Lab
  • Nested Virtualization
  • Apple
You are here: Home / ESXi / Virtual NVMe and Nested ESXi 6.5?

Virtual NVMe and Nested ESXi 6.5?

10.26.2016 by William Lam // 4 Comments

After publishing my Nested ESXi enhancements for vSphere 6.5 article, I had received a number of questions on whether the new Virtual NVMe (vNVMe) capability introduced in the upcoming vSphere 6.5 release would also work with a Nested ESXi VM? The answer is yes, similiar to PVSCSI and VMXNET3, we also have an NVMe driver for ESXi running in VM.

Disclaimer: Nested ESXi and Nested Virtualization is not officially supported by VMware, please use at your own risk.

To consume the new vNVMe for a Nested ESXi VM, you will need to use the latest ESXi 6.5 and later compatibility (vHW 13). Once that has been done, you can then add the a new NVMe Controller to your Nested ESXi VM and then assign that to one of the virtual disks as shown in the screenshot below.

nested-esxi-65-nvme-1
Next, you would install ESXi 6.5 as you normally would and the NVMe controller will automatically be detected and driver will be loaded. In the example below, you can see I only have a single disk which ESXi itself is installed on and it is backed by the NVMe Controller.

nested-esxi-65-nvme-0
One of the biggest benefit of using an NVMe interface over the traditional SCSI is that it can significantly reduce the amount of overhead compared to the SCSI protocol which in turn consumes less CPU cycles as well as reducing the overall amount of IO latency for your VM workloads. Obviously, when using it inside of a Nested ESXi VM, YMMV but hopefully you should also see an improvement there as well. For those who plan to give this a try in their environment, it would be good to hear what type of use cases you might have in mind for this and if you have any feedback (good/bad), feel free to leave a comment.

More from my site

  • Nested ESXi Enhancements in vSphere 6.5
  • Updated Nested ESXi 6.0u3 & 6.5d Virtual Appliances
  • Automated vSphere Lab Deployment for vSphere 6.x
  • Deploying Nested ESXi is even easier now with the ESXi Virtual Appliance
  • Enabling vSAN 8 Express Storage Architecture (ESA) using Nested ESXi

Categories // ESXi, Home Lab, Not Supported, vSphere 6.5 Tags // nested, Nested ESXi, nested virtualization, NVMe, vSphere 6.5

Comments

  1. Hilko Lantinga says

    11/07/2016 at 3:16 am

    Very cool, I'll try and see if I can test the performance. Another thing I've been thinking about for a while is to create a VIB for the SR-IOV companion driver. But maybe you've got a build system (for USB driver?) already and can do it more easily:

    https://downloadcenter.intel.com/download/18700/Network-Adapter-Virtual-Function-Driver-for-Intel-10-Gigabit-Ethernet-Network-Connection

    Reply
    • Hilko Lantinga says

      11/07/2016 at 3:27 am

      One more thing, did you see my post on SC on the Intel Passthrough VIB? That might be worth an article too, you can use my VIB or modify it.

      Reply
  2. ali says

    02/24/2017 at 11:49 pm

    Working in nested virtualisation environment . A win-2012VM having an external hard disk with nvme controller, backup of the VM was successful , unfortunately the recopvery failed with an error mentioning In -valid controller.

    So the question is does it detect and takes backup with the same controller but unable to recover ?

    Reply
  3. kondrich says

    03/15/2018 at 8:29 am

    Shold we now prefer NVMe virtual storage adapter over pvscsi, if the physical hardware is not an NVMe device? Does NVMe adapter introduce any drawbacks or is it safe to use it as new default storage adapter (whatever physical storage is currently in use or will be used in the future)?

    Reply

Thanks for the comment! Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Search

Author

William Lam is a Senior Staff Solution Architect working in the VMware Cloud team within the Cloud Infrastructure Business Group (CIBG) at VMware. He focuses on Cloud Native technologies, Automation, Integration and Operation for the VMware Cloud based Software Defined Datacenters (SDDC)

Connect

  • Email
  • GitHub
  • LinkedIn
  • RSS
  • Twitter
  • Vimeo

Recent

  • How to disable the Efficiency Cores (E-cores) on an Intel NUC? 03/24/2023
  • Changing the default HTTP(s) Reverse Proxy Ports on ESXi 8.0 03/22/2023
  • NFS Multi-Connections in vSphere 8.0 Update 1 03/20/2023
  • Quick Tip - How to download ESXi ISO image for all releases including patch updates? 03/15/2023
  • SSD with multiple NVMe namespaces for VMware Homelab 03/14/2023

Advertisment

Privacy & Cookies: This site uses cookies. By continuing to use this website, you agree to their use.
To find out more, including how to control cookies, see here: Cookie Policy

Copyright WilliamLam.com © 2023

 

Loading Comments...