WilliamLam.com

  • About
    • About
    • Privacy
  • VMware Cloud
  • Tanzu
    • Application Modernization
    • Tanzu services
    • Tanzu Community Edition
    • Tanzu Kubernetes Grid
    • vSphere with Tanzu
  • Home Lab
  • Nested Virtualization
  • Apple
You are here: Home / ESXi / Quick Tip - How to enable vGPU vMotion in vSphere 6.7 Update 1

Quick Tip - How to enable vGPU vMotion in vSphere 6.7 Update 1

10.19.2018 by William Lam // 10 Comments

Since this question has come up a few times this week, I thought it is worth a quick blog post on how to enable the new vGPU vMotion feature which is now available in latest vSphere 6.7 Update 1 release. If you try to vMotion a VM that has been configured with a vGPU, you see the following message stating vGPU hot migration is not enabled.

To enable vGPU vMotion, you just need to update the following vCenter Server Advanced Setting vgpu.hotmigrate.enabled to true using the vSphere UI. The change will go into effect immediately and you will now be able to vMotion a VM configured with vGPU. This setting is actually documented in the official vSphere documentation here, but from all the folks I spoke with, it looks like it never came up or it must have been missed.


In addition to vMotion support, you can also perform Storage vMotion & Cross vMotion (Compute & Storage) for vGPU enabled VMs. Make sure that both your vCenter Server and ESXi hosts have been upgraded to vSphere 6.7 Update 1 and that you have NVIDIA GRID hardware and VIB installed on ESXi host. For folks interested in learning more about the new vMotion features in vSphere 6.7 Update 1, be sure to check out the VMworld 2018 session What's New in vMotion Technical Deep Dive.

Lastly, for those that prefer to automate this configuration change, here is a quick PowerCLI snippet for enabling vGPU vMotion:

Get-AdvancedSetting -Entity $global:DefaultVIServer -Name vgpu.hotmigrate.enabled | Set-AdvancedSetting -Value $true -Confirm:$false

More from my site

  • History of Cross vCenter Workload Migration Utility and its productization in vSphere 7.0 Update 1c (p02)
  • Heads Up - Apple Mac Pro 6,1 fails to boot after upgrading to ESXi 6.7 Update 1
  • All vSphere 6.7 Update 1 release notes & download links
  • Automating new Cloud Motion with vSphere Replication using Hybrid Cloud Extension (HCX) API
  • vMotion across different VDS version between onPrem and VMC

Categories // ESXi, vSphere Tags // vGPU, vgpu.hotmigrate.enabled, vmotion, vSphere 6.7 Update 1

Comments

  1. haibing says

    10/28/2018 at 7:30 am

    I have install the nv driver(410.68) on esxi host, but i still can't find the setting on advanced setting

    Reply
    • William Lam says

      10/28/2018 at 10:41 am

      As the article stated, the setting is a vCenter Server setting and NOT an ESXi host setting 🙂

      Reply
      • haib says

        12/12/2018 at 8:00 pm

        Thanks for support me , It works!

        Reply
  2. haibing says

    10/28/2018 at 7:31 am

    +-----------------------------------------------------------------------------+
    | NVIDIA-SMI 410.68 Driver Version: 410.68 CUDA Version: N/A |
    |-------------------------------+----------------------+----------------------+
    | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
    | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
    |===============================+======================+======================|
    | 0 Tesla P4 On | 00000000:AF:00.0 Off | Off |
    | N/A 32C P8 11W / 75W | 27MiB / 8191MiB | 0% Default |
    +-------------------------------+----------------------+----------------------+

    +-----------------------------------------------------------------------------+
    | Processes: GPU Memory |
    | GPU PID Type Process name Usage |
    |=============================================================================|
    | No running processes found |
    +-----------------------------------------------------------------------------+

    Reply
    • Jason Sinclair says

      10/29/2018 at 1:41 pm

      I updated the driver to version 410.68, enabled the 'vgpu.hotmigrate.enabled' option, but I keep getting "A required migration feature is not supported on the "Source" host"

      I have other non-vGPU vms in this cluster that work fine with vmotion, so it's not a network issue. I have M10's in all 5 of my hosts. Just checking to see if there's something else that I might be missing...

      Thanks!

      Reply
      • Jason Sinclair says

        10/29/2018 at 1:54 pm

        Sorry...meant to post as a new thread. Didn't mean to hijack yours.

        Reply
      • Jason Sinclair says

        10/30/2018 at 3:04 pm

        I found the issue. I accidentally used the "security only" update profile when upgrading from 6.5 to 6.7 up1. I reapplied the correct profile and it's working now.

        Reply
  3. Vincent Esposito says

    11/08/2018 at 2:26 am

    This is a great enhancement, cool tech! I wonder however, since I could not find it in the documentation: would it be possible to vMotion a VM with vGPU between ESXi hosting different GPU cards? (like migrate from an NVIDIA M6 to an NVIDIA P6).

    Reply
    • Jeremy Main says

      11/12/2018 at 12:12 am

      It is not possible to migrate VMs between hosts with different GPU types

      Reply
    • Raj says

      11/28/2018 at 8:06 pm

      HI,
      Can any one assist me to get drivers for vsphere 6.7 NVidia GP 104GL tesla p6

      Reply

Thanks for the comment! Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Search

Author

William Lam is a Senior Staff Solution Architect working in the VMware Cloud team within the Cloud Infrastructure Business Group (CIBG) at VMware. He focuses on Cloud Native, Automation, Integration and Operation for the VMware Cloud based Software Defined Datacenters (SDDC) across Private, Hybrid and Public Cloud

Connect

  • Email
  • GitHub
  • LinkedIn
  • RSS
  • Twitter
  • Vimeo

Recent

  • Will this Arm SoC work with ESXi-Arm? 06/02/2023
  • Converting VirtualBox VDI (Virtual Disk Image) to VMDK for use with ESXi 8.x 05/31/2023
  • Quick Tip - How to monitor when ESXi filesystem and partitions are filling up? 05/30/2023
  • DDR5 SODIMM capable kits for ESXi 05/30/2023
  • ESXi on ASUS PN64-E1 05/24/2023

Advertisment

Privacy & Cookies: This site uses cookies. By continuing to use this website, you agree to their use.
To find out more, including how to control cookies, see here: Cookie Policy

Copyright WilliamLam.com © 2023

 

Loading Comments...