WilliamLam.com

  • About
    • About
    • Privacy
  • VMware Cloud
  • Tanzu
    • Application Modernization
    • Tanzu services
    • Tanzu Community Edition
    • Tanzu Kubernetes Grid
    • vSphere with Tanzu
  • Home Lab
  • Nested Virtualization
  • Apple
You are here: Home / ESXi / Video of ESXi install workaround for Fatal CPU mismatch on feature for Intel 12th Gen CPUs and newer

Video of ESXi install workaround for Fatal CPU mismatch on feature for Intel 12th Gen CPUs and newer

01.09.2023 by William Lam // 10 Comments

I have been noticing more and more users that have acquired hardware that includes the latest Intel 12th Generation CPU (Alder Lake) and even the newest Intel 13th Generation CPU (Raptor Lake) for use with ESXi. Starting with the Intel 12th Generation CPU, Intel has introduced a new hybrid "big.LITTLE" CPU architecture that integrates two types of CPU cores: Performance-cores (P-cores) and Efficiency-cores (E-cores) into the same physical CPU die.

ESXi is currently not aware of this new consumer architecture and it currently expects all cores within a CPU package to have uniform characteristics. If you boot the ESXi installer, it will PSOD (Purple Screen of Death) by default and you will see a message about "Fatal CPU mismatch on feature" which is due to the different CPU properties across both the P-Cores and E-Cores. However, there is a way to workaround the issue by disabling the CPU uniformity check that ESXi performs as part of its boot up.

I initially wrote about the solution back in Feb of 2022 where this new CPU was first introduced in the Intel NUC line with the Intel NUC 12 Extreme (Dragon Canyon) and subsequently, I had also wrote about the solution reviewing both the Intel NUC 12 Pro (Wall Street Canyon) and the Intel NUC 12 Enthusiast (Serpent Canyon).

While the majority of folks have not had any issues applying the workaround, I have started seeing some folks running into challenges, perhaps its familiarity with ESXi or applying kernel options. In any case, I figured it might help to record a video demonstrating the workaround for those that rather visualize the solution along with the written instructions (included below).

Video Instructions

Manual Instructions

Step 1 - During the bootup of the ESXi installer, you will see an option to to append additional ESXi kernel boot settings. Press SHIFT+O and append the following kernel option cpuUniformityHardCheckPanic=FALSE to the command line and the press enter to continue the boot process.

Step 2 - Install ESXi by following the install wizard and once you are prompted to reboot, do not reboot yet. We need to add the kernel option again so that ESXi can successfully boot after the installation. To do so, switch into the ESXi shell by pressing ALT+F1 and login using root and blank password as ESXi has not gone through full reboot and is not using the configured password.

Step 3 - Edit /vmfs/volumes/BOOTBANK1/boot.cfg and append following kernel option cpuUniformityHardCheckPanic=FALSE to existing kernelopt entry, which should look like the following:

kernelopt=weaselInstalled autoPartition=FALSE cpuUniformityHardCheckPanic=FALSE

Save your changes and then change back to the reboot prompt by pressing ALT+F2 and then reboot.

Instead of having to manually append the ESXi kernel option, you will notice that it has been appended due to Step2 and applying the setting in the boot.cfg file.

Step 3 - To permanently configure the ESXi kernel boot setting, in case of updates/upgrades in the future, we can set the kernel setting using ESXCLI. We first need to login to DCUI by pressing F2 and then navigating to Troubleshooting Option and enable ESXi Shell. Switch into the ESXi shell by pressing ALT+F1 and login with root and the password you had configured during installation. Now run the following ESXCLI command to configure the kernel option:

esxcli system settings kernel set -s cpuUniformityHardCheckPanic -v FALSE

More from my site

  • Automated ESXi Installation with a USB Network Adapter using Kickstart
  • ESXi with Intel Arc 750 / 770 GPU
  • How to recover ESXi installed on USB device after disabling vmkusb module?
  • How to replace some of ESXi Kickstart automation with new configstorecli commands?
  • ESXi Advanced & Kernel Settings Reference

Categories // ESXi, vSphere 7.0, vSphere 8.0 Tags // ESXi 7.0, ESXi 8.0

Comments

  1. gbmaryland says

    01/09/2023 at 2:19 pm

    Excellent post man! I noticed a lot of people having this problem and truth be told if you haven’t worked for Vmware color or you haven’t done a bunch of automation for Vmware… You might not be familiar with the OS options. You

    Reply
  2. J says

    01/09/2023 at 7:12 pm

    Does this give you access to the e-cores as well and p-cores?

    Reply
    • William Lam says

      01/09/2023 at 7:16 pm

      Yes

      Reply
  3. MatjahS; says

    01/10/2023 at 12:23 am

    Very helpful. When dealing with keyboard shortcuts at different prompts, a video is a so much easier to follow. 🙂 Thank you!

    Reply
  4. Taha says

    01/10/2023 at 12:37 pm

    How about the scheduler? Because esxi doesn’t aware of the cores, did you see any scheduler related performance issues or power consumption issues like assigning the tasks to wrong core type? In my opinion AMD is golden standard for me since 12th gen intels. Or does it see the core types as different numa nodes? Or are you able to choose core type to assign to the vm. For example little cores for light tasks like dns-dc-automation services etc. and p cores for personal vm , dbs, and more power hunger vms?

    Reply
    • William Lam says

      01/10/2023 at 12:46 pm

      When I say ESXi does not understand the architecture, I'm referring to scheduler.

      In my limited testing in deploying vCenter and other infrastructure including Tanzu Kubernetes Grid (TKG), I've not seen any noticeable difference in behavior. It runs snappier than previous generations (as I'd expect) but again, it may vary based on workloads. Most VMware-based homelabs, the resource that is usually stressed is memory and CPU is generally idle ... so may not make a difference but again, all workload dependent and there's no expected behavior given the ESXi scheduler doesn't see a difference and you could be schedule on either E or P cores. On some Intel systems, you can disable the E-Cores all together, but not something I've seen on the Intel NUCs

      Reply
  5. mtorrijosgtp says

    01/11/2023 at 9:02 am

    Thank you, thank you, thank you, thank you....it works 100%

    Reply
  6. Derran says

    01/11/2023 at 12:57 pm

    Great video. It helped a lot.
    Thanks

    Reply
  7. lovegoodbest says

    01/25/2023 at 6:39 pm

    Thanks for your guide.

    I think the P core hyper threading is not well supported yet on 12th gen.

    My hardware is 1240p, which has 4P cores (total 8 threads in theory) and 8E cores (total 8 threads).
    I can only see 12 cpus in ESXI8, and hyper threading can't be enabled.

    Reply
    • William Lam says

      01/25/2023 at 6:44 pm

      HT is indeed disabled when the cores are non-uniform

      Reply

Thanks for the comment! Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Search

Author

William Lam is a Senior Staff Solution Architect working in the VMware Cloud team within the Cloud Infrastructure Business Group (CIBG) at VMware. He focuses on Cloud Native technologies, Automation, Integration and Operation for the VMware Cloud based Software Defined Datacenters (SDDC)

Connect

  • Email
  • GitHub
  • LinkedIn
  • RSS
  • Twitter
  • Vimeo

Recent

  • Blocking vSphere HTML5 VM Console and allowing only Standalone VM Remote Console (VMRC)? 02/08/2023
  • Quick Tip - Inventory core count for vSphere+, vSAN+ & VCF+ Cloud Service 02/07/2023
  • How to automate adding a license into vCenter Server with custom label?  02/06/2023
  • Automated ESXi Installation with a USB Network Adapter using Kickstart 02/01/2023
  • How to bootstrap ESXi compute only node and connect to vSAN HCI Mesh? 01/31/2023

Advertisment

Privacy & Cookies: This site uses cookies. By continuing to use this website, you agree to their use.
To find out more, including how to control cookies, see here: Cookie Policy

Copyright WilliamLam.com © 2023