WilliamLam.com

Hybrid (x86 and Arm) Kubernetes clusters using Tanzu Community Edition (TCE) and ESXi-Arm

by // Leave a Comment

With the recent introduction of Tanzu Community Edition (TCE), users can now easily get first hand experience across VMware's Tanzu portfolio, including VMware's Enterprise Kubernetes (K8s) runtime called Tanzu Kubernetes Grid (TKG), all completely for free. One popular request that frequently comes up from our community is the ability to use TCE with the ESXi-Arm Fling.

Currently, TCE is only supported with x86 hardware platforms which includes ESXi-x86 and there is certainly a desire to be able to use TCE with Arm-based hardware running on top of ESXi-Arm, especially with inexpensive Raspberry Pi for learning and exploration purposes.

I recently came to learn about a really cool project that is being developed as part of VMware's Office of the CTO (OCTO) for a new Cluster API (CAPI) provider where you can Bring Your own Host (BYOH) that is already running Linux. What really intrigued me about their project was not the fact that they could create a TCE Workload Cluster that comprised of physical hosts but the fact that they were actually running on Arm hardware! 🤩

My immediate reaction was to see if this would also work with just Linux VMs? With some trial/error and help from Jixing Jia, one of the project maintainers, I was able to confirm that this indeed does works using Ubuntu VMs running on ESXi-Arm. What was even more impressive was the realization that this not only works for both physical and virtual Arm Linux systems, but that users could also create a hybrid TCE Workload Cluster that consists of BOTH x86 and Arm nodes! 🤯

I can only imagine the possibilities that this could enable in the future where application(s) could potentially span across CPU architecture, virtual and physical worker nodes which exposes different capabilities that can then be delivered based on the requirements of the application such as GPU as an example. It will be interesting to see the types of use cases the BYOH Cluster API Provider will help enable, especially pertaining to Edge computing.

If you are interested in playing with the BYOH Cluster API Provider, check out the detailed instructions below on how to get started. Since this is still currently in Alpha development, there are still a few manual steps and currently there is no native TCE integration. If this is something that is interesting to you, feel free to leave any feedback or better yet, leave comments directly on the Github repo asking for feature enhancements that you would like to see such as native support for TCE 😀

[Read more...]

Considerations for future vSphere Homelabs due to upcoming removal of SD card/USB support for ESXi

by // 16 Comments

In case you have not heard the news, VMware had recently published a new knowledge base article (KB 85685) outlining details for the future removal of SD card/USB as a standalone boot device for ESXi.

If you have not read the KB, please take a few minutes and carefully read the article, especially as you think about future hardware upgrades and purchases.

There has certainly been no shortage of discussions and debates since the publishing of the VMware KB. One topic that I know many of you have been wondering and asking about is what is the impact to vSphere Homelabs? This was something that had already crossed my mind after I first read the KB and I was thinking about this a bit more this week and specifically some of the potential options that are available to customers right now but also some of the considerations you may want to account for in with future homelab upgrades.

Disclaimer: These are my own personal opinions and do not reflect any official guidance or recommendations from VMware.

[Read more...]

Victron Venus OS on ESXi-Arm

by // 10 Comments

Over the weekend I received an interesting inquiry from a customer who had been playing with the ESXi-Arm Fling and wanted to know if it could run Victron Venus OS? I had never heard of Venus OS before, but a quick search online lead me to the company called Victron Energy which produces and sells various types of electrical chargers and they also have their own operating system to manage their software called Venus OS:

Venus OS is the software running on our Cerbo GX monitoring system, as well as its predecessors the Color Control GX, Venus GX and more. Also, it is in the GX versions of our MultiPlus-II  and EasySolar-II inverter/chargers.


Venus OS can be installed on a Raspberry Pi (rPI) and the customer attempted to run it as a VM using ESXi-Arm on rPI using the techniques shared here and here but found that it was unable to boot with a message stating no kernel installed.

Given this was beyond my skillset, I pinged Cyprien, who works on ESXi-Arm at VMware to see if he had any ideas? In less than 30 minutes, he not only found out the reason the previous techniques could not be used but also came up with a quick workaround. Venus OS is a 32-bit OS and is not based on Debian and this is why you can not simply boot using the Debian Installer. The solution requires a custom Arm64 linux kernel that includes UEFI support to be built and installed to be able to boot Venus OS running as a VM on ESXi-Arm. For more information, please see the detailed instructions below and big thanks to Cyprien for his help over the weekend!

[Read more...]