WilliamLam.com

Direct playback & download URLs for all VMworld 2018 US Sessions

by // 14 Comments

It has been less than 24 hours since VMworld 2018 has concluded and the awesome VMworld team has already published most, if not all VMworld 2018 US session recordings! Similar to past years, I have put together a nice summary page that contains all the session recordings links separated out by the different  categories which you can find by visiting http://vmwa.re/vmworld2018.

As of writing this, there are a total of 585 sessions with 570 published with recordings. I will check back in a week or so in case more videos and/or PPT decks are posted. Please enjoy, especially for those that were not able to attend VMworld this year.

UPDATE 1 (09/01/18) - It looks after publishing the streaming URLs, folks found that it included a direct download link to the .MP4 file. Thanks to Jorge de la Cruz from the community who was able to extract this from my original github repo. I have gone ahead and also updated my repo to include both the streaming and download URL for folks who just want to download individual sessions. There are a number of ways to "Automate" the download including using wget or Invoke-Webrequest.

UPDATE 2 (09/03/18) - If you try to download the files without going through my github repo (browser or through automation), you may noticed you get a 404 error message. It turns out the client performing the download must include a referer within the request (which is automatically done for you when you click open the link in my github but not the case using wget/cURL or other tools. Below are a few examples on how to include the referer for automated downloads.

Here is wget example:

wget --referer http://www.vmware.com https://s3-us-west-1.amazonaws.com/vmworld-usa-2018/VIN2527BU.mp4

Here is cURL example:

curl --referer http://www.vmware.com https://s3-us-west-1.amazonaws.com/vmworld-usa-2018/VIN2527BU.mp4 -O VIN2527BU.mp4

Here is PowerCLI example:

$headers = @{"referer" = "http://www.vmware.com"}
Invoke-WebRequest -Uri https://s3-us-west-1.amazonaws.com/vmworld-usa-2018/VIN2527BU.mp4 -Headers $headers -Outfile VIN2527BU.mp4

In addition, I have also published us.txt file which contains the name of the session + download URL which can then be used by this quick PowerShell script called downloadSessions.ps1 to automatically download. You can edit the us.txt file to only include sessions you want downloaded (make sure its copied from the original file) since it contains "#" symbol as a delimiter for the title and the download URL.

Quick Tip - Requirements for using Guest Operation APIs (Invoke-VMScript & Copy-VMGuestFile) in VMC

by // 1 Comment

Since this question came up again today, I figure it was worth sharing in case others also had trouble using the vSphere Guest Operations API in VMware Cloud on AWS (VMC), which includes PowerCLI's Invoke-VMScript and Copy-VMGuestFile cmdlet. There are a couple of requirements that you must satisfy both in the GuestOS as well as between your on-prem vSphere environment and VMC.

  1. VMware Tools installed and running, it may seem obvious, but I have had customers trying to use various scripts without realizing this was a requirement. You should also ensure that you are running the latest version of VMware Tools, especially as there bugfixes that may impact Guest Operations APIs.
  2. VPN or Direct Connect (DX) configured between your on-prem vSphere environment and VMC, this is required as you will need access to ESXi hosts which is only available through a VPN or DX
  3. Create a VMC firewall rule to allow access from your on-prem network to VMC's ESXi hosts on port 443 which is used for Guest Operations access including transferring files to and from the GuestOS


The VMC firewall rule is usually the thing that most folks forget about and this simply because for most on-prem environment, access to ESXi over 443 is just sort of a default.

Once you have configured the VMC firewall to allow 443 to ESXi hosts, you will be able to use the Guest Operations API including Invoke-VMScript and Copy-VMGuestFile to a VM running in VMC

Creating a vSphere Content Library directly on Amazon S3

by // 5 Comments

A few years back I had blogged about creating your own 3rd Party vSphere Content Library enabling customers to take advantage of different types of storage backing than just vSphere Datastores. The primary requirement was that the content endpoint was accessible over HTTP(s), which meant that a number of solutions could be used from a simple web server like Nginx to an advanced distributed object store like Amazon S3 for example.

The workflow to create a 3rd Party vSphere Content Library on S3 is fairly straight forward, here is high level summary:

  1. Organize the content on a local system (desktop)
  2. Run a python script to index and generate the Content Library metadata
  3. Upload the Content Library to S3


A disadvantage of the above solution is that each time you need to update or remove content, the entire process would have to be repeated again, including re-uploading the changes. Not only was this time consuming from an operational standpoint but now you also needed to also keep a full copy of all the content locally which can be several hundred gigabytes, if not more.

This topic was recently brought back up again by Gilles Chekroun, an SE in our Networking and Security Business Unit who reached out to see if there was a solution to help his customer who was running into this challenge. Over the last couple of weeks, I had been working with both Gilles and Eric Cao (Content Library Engineer) on how we could enhance the existing Python script which indexes and generates the Content Library metadata to also support running directly on Amazon S3 bucket.

[Read more...]