Kubernetes deployment failure for custom windows image

[ashvindeodhar]

Is this a request for help?:
Yes

Is this an ISSUE or FEATURE REQUEST? (choose one):
ISSUE

What version of acs-engine?:
v0.19.1

Orchestrator and version (e.g. Kubernetes, DC/OS, Swarm)
Orchestrator: Kubernetes
Version: 1.8.13

What happened:

1. I am trying to deploy k8s cluster with custom image with the example under https://github.com/Azure/acs-engine/blob/master/examples/windows/kubernetes-custom-image.json .
2. I have custom image accessible under https://ashvinstorageblob.blob.core.windows.net/blob1/17711.1000.amd64fre.rs_prerelease.180703-1539_server_serverdatacenteracore_en-us_vl.vhd
   Deployment fails with error -

Deployment failed. Correlation ID: bb07115e-33c1-4355-b40a-849313c1adea. {
"error": {
"code": "NotFound",
"message": "The Image '/subscriptions/099b416e-89be-463a-967c-ad4bdec5370e/resourceGroups/ashvincluster15/providers/Microsoft.Compute/images/windowspool2CustomWindowsImage' cannot be found."
}
}

What you expected to happen:
Deployment success

How to reproduce it (as minimally and precisely as possible):

1. upload a custom windows image under azure storage blob and use it in the example template provided by acs-engine to deploy k8s cluster

[CecileRobertMichon]

@ashvindeodhar is your image located in the ashvincluster15 RG with name windowspool2CustomWindowsImage and in the same region? I had the same error earlier today but realized my image was in a different region and changing the region of the deployment to the same region fixed it.

[ashvindeodhar]

Hi Cecil, why is the deployment process searching the image in the cluster that I am trying to deploy. The example says it can be a custom link (https://custom/link/to/windows/image.vhd).

I retried again by creating a storage blob under the cluster. ( ashvincluster19 ) and in the same region.
I see different error now with OperationNotAllowed

Deployment failed. Correlation ID: 9424c279-d592-427d-8b60-ece87c586517. {
"error": {
"code": "OperationNotAllowed",
"message": "The resource '13618k8s9000' cannot be created from Image '/subscriptions/099b416e-89be-463a-967c-ad4bdec5370e/resourceGroups/ashvincluster19/providers/Microsoft.Compute/images/windowspool2CustomWindowsImage' until Image has been successfully created."
}
}

I have the image accessible under https://ashvincluster19blob.blob.core.windows.net/blob1/17711.1000.amd64fre.rs_prerelease.180703-1539_server_serverdatacenteracore_en-us_vl.vhd

[CecileRobertMichon]

Hmm it's unclear where '/subscriptions/099b416e-89be-463a-967c-ad4bdec5370e/resourceGroups/ashvincluster19/providers/Microsoft.Compute/images/windowspool2CustomWindowsImage' is coming from... Assuming your windowsProfile in your apimodel looks like: "windowsProfile": { "adminUsername": "azureuser", "adminPassword": "replacepassword1234$", "WindowsImageSourceUrl": "https://ashvincluster19blob.blob.core.windows.net/blob1/17711.1000.amd64fre.rs_prerelease.180703-1539_server_serverdatacenteracore_en-us_vl.vhd" }, ?

[ashvindeodhar]

That's correct.

[CecileRobertMichon]

So it looks like this was actually never implemented from k8s... #2004. I'm working on something in parallel for using custom VHDs with Linux + k8s, it should be easy to add to Windows + k8s as well.

[msorby]

Any progress on this issue? Running acs-engine 0.22.2 and still not possible to create windows nodes from a custom vhd. Would love to have this working :-)

[CecileRobertMichon]

@msorby I haven't been able to look into this for Windows. If your or someone else would like to open a PR to fix this issue let me know and I'll be happy to offer guidance/review but I won't have cycles to look at this immediately. Adding @PatrickLang in case he knows about custom images + Windows.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contribution. Note that acs-engine is deprecated--see https://github.com/Azure/aks-engine instead.