With the release of VMware Cloud Foundation (VCF) 5.1.1, customers can now take advantage of the new VMware Private AI Foundation with NVIDIA (PAIF-N) solution, providing an optimized and validated platform by NVIDIA for running modern AL/ML workloads on VCF. To learn more about the PAIF-N solution for VCF, there is a comprehensive PAIF-N Guide that includes the full software build-of-materials (BOM) as well as a step-by-step implementation guide for deploying the solution.
If you are interested in exploring the new PAIF-N solution, I recently came to learn the PowerCLI team have created some really useful PowerCLI scripts which fully automates the deployment of PAIF-N and makes setting up the environment a breeze!
There are 4 PowerCLI scripts that is included in the PAIF-N automation:
- 02-install-nvidia-driver-vlcm.ps1 - This script is responsible for importing the NVIDIA AI Enterprise vGPU driver and NVIDIA GPU Management Daemon offline bundle into vSphere Lifecycle Manager (vLCM) and then installed on ESXi hosts within VCF Workload Domain.
- 04-enable-wcp.ps1 - This script is responsible for enabling and configuring the Supervisor Cluster (vSphere with Tanzu) within the VCF Workload Domain, which also includes setting up the new PAIF-N Deep Learning VM Image Content Library and enabling users to quickly deploy AI/ML workloads into an environment that contains popular pre-configured AI/ML runtimes.
I assume there is no way to run this in the Holodeck nested ESXi hosts?
See https://williamlam.com/2023/05/gpu-passthrough-with-nested-esxi.html 🙂