WilliamLam.com

MS-A2 VCF 9.0 Lab: Installing VMware Private AI Services (PAIS)

by // Leave a Comment

Over the past couple of months, I have used my minimal VMware Cloud Foundation (VCF) 9.0 lab to explore nearly every major VCF 9.0 capability including NVMe Tiering, vSAN ESA, NSX VPC, vSphere Supervisor Services like vSphere Kubernetes Service (VKS), VM Service & ArgoCD, VCF Operations (VCFO), VCF Automation (VCFA), VMware AVI Load Balancer, Data Services Manager (DSM) and the list goes on and on! 😅

One area that I have been interested in diving deeper into is with our Private AI offerings and with the announcement of VMware Private AI Services (PAIS) now included as part of VMware Cloud Foundation (VCF), it gave me that additional motivation to see if I could also run PAIS in my lab!

As part of my exploration, I will be documenting my experience in a mini-blog series on installing and configuring PAIS to deploy an AI Agent using an NVIDIA GPU with DirectPath I/O. Since NVIDIA vGPU requires an NVIDIA AI for Enterprise (NVAIE) license, this approach can especially be useful for lab and learning purposes.

Requirements:

[Read more...]

Using vSphere 9.0 API to retrieve vGPU & DirectPath Profiles

by // Leave a Comment

VMware Cloud Foundation (VCF) 9.0 has introduced a number of enhancements when consuming vGPU and DirectPath Profiles, which are available in both the vSphere UI and vSphere API for automation purposes. While answering some vSphere API questions from a colleague regarding vGPU and DirectPath Profiles, I figured it would be useful to share the vSphere API specifics in how to use the API to retrieve these resources and better yet, some code that you can use immediately!
[Read more...]

Quick Tip - When using self-signed TLS Certificates with VCF Private AI Services (PAIS)

by // Leave a Comment

Like many of our users, I was excited to hear that VMware Private AI Services (PAIS) will now be included as part of VMware Cloud Foundation (VCF), I already had some ideas brewing in my head and I definitely needed to get some hands on!

While setting up some of the requirements for PAIS, I ran into a couple of issues that revolved around the use of self-signed TLS certificates, which is probably common for many of  you, especially in a lab/proof of concept environment.

I spent good chunk of the day debugging the issues, which was not even the worse part, but it was the error messages that we saw. The error messages was not from the product code, but rather the underlying libraries that it relies upon and if you try to interpret the message as-is, you could go down a rabbit hole.

PAIS Engineering is already aware of the issues I ran into, so these will be enhanced in future updates but I did want to share the scenarios in case you run into them while deploying PAIS in your environment.

[Read more...]