Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: Add support for vSAN performance service configuration #1726

Merged
merged 2 commits into from
Aug 25, 2022
Merged

feat: Add support for vSAN performance service configuration #1726

merged 2 commits into from
Aug 25, 2022

Conversation

SlimYang
Copy link
Collaborator

@SlimYang SlimYang commented Aug 9, 2022 •
edited by tenthirtyam
Loading

Description

This change enables the configuration for the vSAN performance service via the .tf file. The three parameters supported are to enable/disable vSAN performance service, the support for verbose mode, and network diagnostics mode. In this change, we will also support the enablement for vSAN performance by default with vSAN performance which aligns with the behavior of the vSAN enablement UI.

The related documentation and API command line are also updated in this change.

Acceptance tests

  • Have you added an acceptance test for the functionality being added?
  • Have you run the acceptance tests on this branch?

Output from acceptance testing:

$make testacc TESTARGS='-run=TestAccResourceVSphereComputeCluster_vsanPerfEnabled'
==> Checking that code complies with gofmt requirements...
TF_ACC=1 go test $(go list ./... |grep -v 'vendor') -v -run=TestAccResourceVSphereComputeCluster_vsanPerfEnabled -timeout 240m
?       github.com/hashicorp/terraform-provider-vsphere [no test files]
=== RUN   TestAccResourceVSphereComputeCluster_vsanPerfEnabled
--- PASS: TestAccResourceVSphereComputeCluster_vsanPerfEnabled (96.96s)
PASS
...

Also, we ran manual tests for the code change and it has passed --

$terraform apply
data.vsphere_datacenter.datacenter: Reading...
data.vsphere_datacenter.datacenter: Read complete after 0s [id=datacenter-3]
data.vsphere_host.hosts[2]: Reading...
data.vsphere_host.hosts[0]: Reading...
data.vsphere_host.hosts[1]: Reading...
data.vsphere_host.hosts[0]: Read complete after 0s [id=host-17]
data.vsphere_host.hosts[1]: Read complete after 0s [id=host-11]
data.vsphere_host.hosts[2]: Read complete after 0s [id=host-14]
vsphere_compute_cluster.cluster: Refreshing state... [id=domain-c19]

Terraform used the selected providers to generate the following execution plan. Resource actions are indicated with the following symbols:
  ~ update in-place

Terraform will perform the following actions:

  # vsphere_compute_cluster.cluster will be updated in-place
  ~ resource "vsphere_compute_cluster" "cluster" {
        id                                                    = "domain-c19"
        name                                                  = "test"
        tags                                                  = []
      ~ vsan_enabled                                          = false -> true
      + vsan_network_diagnostic_mode_enabled                  = true
      ~ vsan_performance_enabled                              = false -> true
      ~ vsan_verbose_mode_enabled                             = false -> true
        # (48 unchanged attributes hidden)
    }

Plan: 0 to add, 1 to change, 0 to destroy.

Do you want to perform these actions?
  Terraform will perform the actions described above.
  Only 'yes' will be accepted to approve.

  Enter a value: yes

vsphere_compute_cluster.cluster: Modifying... [id=domain-c19]
vsphere_compute_cluster.cluster: Still modifying... [id=domain-c19, 10s elapsed]
vsphere_compute_cluster.cluster: Still modifying... [id=domain-c19, 20s elapsed]
vsphere_compute_cluster.cluster: Still modifying... [id=domain-c19, 30s elapsed]
vsphere_compute_cluster.cluster: Modifications complete after 32s [id=domain-c19]

Apply complete! Resources: 0 added, 1 changed, 0 destroyed.

Release Note

Release note for CHANGELOG:

`resource/compute_cluster`: Add support for configuring vSAN performance service.

References

Closes: #1727.

@SlimYang
[vSAN] Support the configuration for vSAN performance service.
c029390 
This change enables the configuration for vSAN performance service
via the .tf file. The three parameters supported are to enable/disable
vSAN performance service, the support for verbose mode and network
diagnostics mode. In this change, we will also support the
enablement for vSAN performance by default with vSAN performance
which aligns with the behavior for vSAN enablement UI.

The related documentation and API command line are also updated
in this changeset.
@github-actions github-actions bot added documentation Type: Documentation provider Type: Provider size/l Relative Sizing: Large labels Aug 9, 2022
@SlimYang SlimYang changed the title [vSAN] Support the configuration for vSAN performance service. feat: Support the configuration for vSAN performance service. Aug 9, 2022
@SlimYang SlimYang mentioned this pull request Aug 9, 2022
Closed
4 tasks
@tenthirtyam tenthirtyam added this to the v2.3.0 milestone Aug 9, 2022
@tenthirtyam tenthirtyam self-requested a review August 9, 2022 09:18
@tenthirtyam tenthirtyam changed the title feat: Support the configuration for vSAN performance service. feat: Add support for vSAN performance service configuration Aug 9, 2022
docs: update r/vsphere_compute_cluster docs
e69914a 
Updates `r/vsphere_compute_cluster` documentation.

Signed-off-by: Ryan Johnson <[email protected]>
tenthirtyam
tenthirtyam reviewed Aug 9, 2022
View reviewed changes
Copy link
Collaborator

@tenthirtyam tenthirtyam left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've made a couple of formatting changes to the resource docs to correct characters per row.

Meanwhile, I've tested this with the following configuration on VM Pool: tf-main-vsphereprovider-6nodes-vsan:

terraform {
  required_providers {
    vsphere = {
      source  = "local/hashicorp/vsphere"
      version = "2.3.0"
    }
  }
  required_version = ">= 1.2.5"
}

variable "vsphere_server" {
  default = "10.182.12.76"
}

variable "vsphere_user" {
  default = "[email protected]"
}

variable "vsphere_password" {
  default = "*********"
}

provider "vsphere" {
  user                 = var.vsphere_user
  password             = var.vsphere_password
  vsphere_server       = var.vsphere_server
  allow_unverified_ssl = true
}

variable "hosts" {
  default = [
    "10.182.6.14",
    "10.182.3.166",
    "10.182.8.251",
    "10.182.10.6",
    "10.182.6.111"
  ]
}

data "vsphere_datacenter" "datacenter" {
  name = "vsan-dc"
}

data "vsphere_host" "hosts" {
  count         = length(var.hosts)
  name          = var.hosts[count.index]
  datacenter_id = data.vsphere_datacenter.datacenter.id
}

resource "vsphere_compute_cluster" "cluster" {
  name                                 = "vsan-cluster"
  datacenter_id                        = data.vsphere_datacenter.datacenter.id
  host_system_ids                      = data.vsphere_host.hosts.*.id
  drs_enabled                          = "true"
  drs_automation_level                 = "fullyAutomated"
  ha_enabled                           = false
  vsan_enabled                         = true
  vsan_dedup_enabled                   = true
  vsan_compression_enabled             = true
  vsan_performance_enabled             = true
  vsan_network_diagnostic_mode_enabled = true
  vsan_verbose_mode_enabled            = true
}

Generally, the deployment is successful in the testbed...

❯ TF_LOG=DEBUG TF_LOG_PATH=debug.txt terraform apply -auto-approve
data.vsphere_datacenter.datacenter: Reading...
data.vsphere_datacenter.datacenter: Read complete after 0s [id=datacenter-3]
data.vsphere_host.hosts[0]: Reading...
data.vsphere_host.hosts[2]: Reading...
data.vsphere_host.hosts[4]: Reading...
data.vsphere_host.hosts[1]: Reading...
data.vsphere_host.hosts[3]: Reading...
data.vsphere_host.hosts[0]: Read complete after 1s [id=host-21]
data.vsphere_host.hosts[1]: Read complete after 1s [id=host-9]
data.vsphere_host.hosts[2]: Read complete after 1s [id=host-18]
data.vsphere_host.hosts[3]: Read complete after 1s [id=host-13]
data.vsphere_host.hosts[4]: Read complete after 1s [id=host-12]

Terraform used the selected providers to generate the following execution plan. Resource actions are indicated with the
following symbols:
  + create

Terraform will perform the following actions:

  # vsphere_compute_cluster.cluster will be created
  + resource "vsphere_compute_cluster" "cluster" {
      + datacenter_id                                         = "datacenter-3"
      + dpm_automation_level                                  = "manual"
      + dpm_enabled                                           = false
      + dpm_threshold                                         = 3
      + drs_automation_level                                  = "fullyAutomated"
      + drs_enable_vm_overrides                               = true
      + drs_enabled                                           = true
      + drs_migration_threshold                               = 3
      + drs_scale_descendants_shares                          = "disabled"
      + ha_admission_control_host_failure_tolerance           = 1
      + ha_admission_control_performance_tolerance            = 100
      + ha_admission_control_policy                           = "resourcePercentage"
      + ha_admission_control_resource_percentage_auto_compute = true
      + ha_admission_control_resource_percentage_cpu          = 100
      + ha_admission_control_resource_percentage_memory       = 100
      + ha_admission_control_slot_policy_explicit_cpu         = 32
      + ha_admission_control_slot_policy_explicit_memory      = 100
      + ha_datastore_apd_recovery_action                      = "none"
      + ha_datastore_apd_response                             = "disabled"
      + ha_datastore_apd_response_delay                       = 180
      + ha_datastore_pdl_response                             = "disabled"
      + ha_enabled                                            = false
      + ha_heartbeat_datastore_policy                         = "allFeasibleDsWithUserPreference"
      + ha_host_isolation_response                            = "none"
      + ha_host_monitoring                                    = "enabled"
      + ha_vm_component_protection                            = "enabled"
      + ha_vm_dependency_restart_condition                    = "none"
      + ha_vm_failure_interval                                = 30
      + ha_vm_maximum_failure_window                          = -1
      + ha_vm_maximum_resets                                  = 3
      + ha_vm_minimum_uptime                                  = 120
      + ha_vm_monitoring                                      = "vmMonitoringDisabled"
      + ha_vm_restart_priority                                = "medium"
      + ha_vm_restart_timeout                                 = 600
      + host_cluster_exit_timeout                             = 3600
      + host_system_ids                                       = [
          + "host-12",
          + "host-13",
          + "host-18",
          + "host-21",
          + "host-9",
        ]
      + id                                                    = (known after apply)
      + name                                                  = "vsan-cluster"
      + proactive_ha_automation_level                         = "Manual"
      + proactive_ha_moderate_remediation                     = "QuarantineMode"
      + proactive_ha_severe_remediation                       = "QuarantineMode"
      + resource_pool_id                                      = (known after apply)
      + vsan_compression_enabled                              = true
      + vsan_dedup_enabled                                    = true
      + vsan_enabled                                          = true
      + vsan_network_diagnostic_mode_enabled                  = true
      + vsan_performance_enabled                              = true
      + vsan_verbose_mode_enabled                             = true

      + vsan_disk_group {
          + cache   = (known after apply)
          + storage = (known after apply)
        }
    }

Plan: 1 to add, 0 to change, 0 to destroy.
vsphere_compute_cluster.cluster: Creating...
vsphere_compute_cluster.cluster: Still creating... [10s elapsed]
vsphere_compute_cluster.cluster: Still creating... [20s elapsed]
vsphere_compute_cluster.cluster: Still creating... [30s elapsed]
vsphere_compute_cluster.cluster: Still creating... [40s elapsed]
vsphere_compute_cluster.cluster: Still creating... [50s elapsed]
vsphere_compute_cluster.cluster: Still creating... [1m0s elapsed]
vsphere_compute_cluster.cluster: Still creating... [1m10s elapsed]
vsphere_compute_cluster.cluster: Still creating... [1m20s elapsed]
vsphere_compute_cluster.cluster: Still creating... [1m30s elapsed]
vsphere_compute_cluster.cluster: Creation complete after 1m31s [id=domain-c90]

Apply complete! Resources: 1 added, 0 changed, 0 destroyed.

However, I often see errors when both deduplication and compression are enabled and the performance service configurations are in the same plan on a FRESH testbed instance.

Error:

vsphere_compute_cluster.cluster: Still creating... [1m50s elapsed]
vsphere_compute_cluster.cluster: Still creating... [2m0s elapsed]
╷
│ Error: cannot apply vsan service on cluster: vsan-cluster
│ 
│   with vsphere_compute_cluster.cluster,
│   on main.tf line 51, in resource "vsphere_compute_cluster" "cluster":
│   51: resource "vsphere_compute_cluster" "cluster" {
│

Debug:

2022-08-09T16:51:48.559-0400 [INFO]  Terraform version: 1.2.6
2022-08-09T16:51:48.559-0400 [DEBUG] using github.com/hashicorp/go-tfe v1.0.0
2022-08-09T16:51:48.559-0400 [DEBUG] using github.com/hashicorp/hcl/v2 v2.12.0
2022-08-09T16:51:48.559-0400 [DEBUG] using github.com/hashicorp/terraform-config-inspect v0.0.0-20210209133302-4fd17a0faac2
2022-08-09T16:51:48.559-0400 [DEBUG] using github.com/hashicorp/terraform-svchost v0.0.0-20200729002733-f050f53b9734
2022-08-09T16:51:48.559-0400 [DEBUG] using github.com/zclconf/go-cty v1.10.0
2022-08-09T16:51:48.559-0400 [INFO]  Go runtime version: go1.18.1
2022-08-09T16:51:48.559-0400 [INFO]  CLI args: []string{"terraform", "apply", "-auto-approve"}
2022-08-09T16:51:48.559-0400 [DEBUG] Attempting to open CLI config file: /Users/johnsonryan/.terraformrc
2022-08-09T16:51:48.559-0400 [DEBUG] File doesn't exist, but doesn't need to. Ignoring.
2022-08-09T16:51:48.559-0400 [INFO]  Loading CLI configuration from /Users/johnsonryan/.terraform.d/credentials.tfrc.json
2022-08-09T16:51:48.560-0400 [DEBUG] checking for credentials in "/Users/johnsonryan/.terraform.d/plugins"
2022-08-09T16:51:48.560-0400 [DEBUG] ignoring non-existing provider search directory terraform.d/plugins
2022-08-09T16:51:48.560-0400 [DEBUG] will search for provider plugins in /Users/johnsonryan/.terraform.d/plugins
2022-08-09T16:51:48.560-0400 [WARN]  local provider path "/Users/johnsonryan/.terraform.d/plugins/local/hashicorp/.DS_Store" contains invalid type ".DS_Store"; ignoring
2022-08-09T16:51:48.561-0400 [WARN]  ignoring file "local/hashicorp/vsphere/.DS_Store" as possible package for local/hashicorp/vsphere: filename lacks expected prefix "terraform-provider-vsphere_"
2022-08-09T16:51:48.561-0400 [DEBUG] ignoring non-existing provider search directory /Users/johnsonryan/Library/Application Support/io.terraform/plugins
2022-08-09T16:51:48.561-0400 [DEBUG] ignoring non-existing provider search directory /Library/Application Support/io.terraform/plugins
2022-08-09T16:51:48.561-0400 [INFO]  CLI command args: []string{"apply", "-auto-approve"}
2022-08-09T16:51:48.563-0400 [DEBUG] New state was assigned lineage "390329fa-c5fd-4aa3-a7e4-5b4ff535107a"
2022-08-09T16:51:48.658-0400 [DEBUG] checking for provisioner in "."
2022-08-09T16:51:48.660-0400 [DEBUG] checking for provisioner in "/usr/local/bin"
2022-08-09T16:51:48.660-0400 [DEBUG] checking for provisioner in "/Users/johnsonryan/.terraform.d/plugins"
2022-08-09T16:51:48.661-0400 [INFO]  backend/local: starting Apply operation
2022-08-09T16:51:48.666-0400 [DEBUG] created provider logger: level=debug
2022-08-09T16:51:48.666-0400 [INFO]  provider: configuring client automatic mTLS
2022-08-09T16:51:48.681-0400 [DEBUG] provider: starting plugin: path=.terraform/providers/local/hashicorp/vsphere/2.3.0/darwin_amd64/terraform-provider-vsphere_v2.3.0 args=[.terraform/providers/local/hashicorp/vsphere/2.3.0/darwin_amd64/terraform-provider-vsphere_v2.3.0]
2022-08-09T16:51:48.684-0400 [DEBUG] provider: plugin started: path=.terraform/providers/local/hashicorp/vsphere/2.3.0/darwin_amd64/terraform-provider-vsphere_v2.3.0 pid=79230
2022-08-09T16:51:48.684-0400 [DEBUG] provider: waiting for RPC address: path=.terraform/providers/local/hashicorp/vsphere/2.3.0/darwin_amd64/terraform-provider-vsphere_v2.3.0
2022-08-09T16:51:48.698-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: configuring server automatic mTLS: timestamp=2022-08-09T16:51:48.698-0400
2022-08-09T16:51:48.717-0400 [DEBUG] provider: using plugin: version=5
2022-08-09T16:51:48.717-0400 [DEBUG] provider.terraform-provider-vsphere_v2.3.0: plugin address: address=/var/folders/dw/5mlbs0q50gs1qkqmgyx1g6dr0000gp/T/plugin3957622759 network=unix timestamp=2022-08-09T16:51:48.717-0400
2022-08-09T16:51:48.745-0400 [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = transport is closing"
2022-08-09T16:51:48.746-0400 [DEBUG] provider: plugin process exited: path=.terraform/providers/local/hashicorp/vsphere/2.3.0/darwin_amd64/terraform-provider-vsphere_v2.3.0 pid=79230
2022-08-09T16:51:48.746-0400 [DEBUG] provider: plugin exited
2022-08-09T16:51:48.746-0400 [DEBUG] Building and walking validate graph
2022-08-09T16:51:48.747-0400 [DEBUG] ProviderTransformer: "vsphere_compute_cluster.cluster" (*terraform.NodeValidatableResource) needs provider["local/hashicorp/vsphere"]
2022-08-09T16:51:48.747-0400 [DEBUG] ProviderTransformer: "data.vsphere_datacenter.datacenter" (*terraform.NodeValidatableResource) needs provider["local/hashicorp/vsphere"]
2022-08-09T16:51:48.747-0400 [DEBUG] ProviderTransformer: "data.vsphere_host.hosts" (*terraform.NodeValidatableResource) needs provider["local/hashicorp/vsphere"]
2022-08-09T16:51:48.747-0400 [DEBUG] ReferenceTransformer: "var.vsphere_password" references: []
2022-08-09T16:51:48.747-0400 [DEBUG] ReferenceTransformer: "var.hosts" references: []
2022-08-09T16:51:48.747-0400 [DEBUG] ReferenceTransformer: "var.vsphere_server" references: []
2022-08-09T16:51:48.747-0400 [DEBUG] ReferenceTransformer: "provider[\"local/hashicorp/vsphere\"]" references: [var.vsphere_user var.vsphere_password var.vsphere_server]
2022-08-09T16:51:48.747-0400 [DEBUG] ReferenceTransformer: "vsphere_compute_cluster.cluster" references: [data.vsphere_datacenter.datacenter data.vsphere_host.hosts]
2022-08-09T16:51:48.747-0400 [DEBUG] ReferenceTransformer: "data.vsphere_datacenter.datacenter" references: []
2022-08-09T16:51:48.747-0400 [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-08-09T16:51:48.747-0400 [DEBUG] ReferenceTransformer: "data.vsphere_host.hosts" references: [var.hosts data.vsphere_datacenter.datacenter var.hosts]
2022-08-09T16:51:48.747-0400 [DEBUG] ReferenceTransformer: "var.vsphere_user" references: []
2022-08-09T16:51:48.747-0400 [DEBUG] Starting graph walk: walkValidate
2022-08-09T16:51:48.748-0400 [DEBUG] created provider logger: level=debug
2022-08-09T16:51:48.748-0400 [INFO]  provider: configuring client automatic mTLS
2022-08-09T16:51:48.765-0400 [DEBUG] provider: starting plugin: path=.terraform/providers/local/hashicorp/vsphere/2.3.0/darwin_amd64/terraform-provider-vsphere_v2.3.0 args=[.terraform/providers/local/hashicorp/vsphere/2.3.0/darwin_amd64/terraform-provider-vsphere_v2.3.0]
2022-08-09T16:51:48.769-0400 [DEBUG] provider: plugin started: path=.terraform/providers/local/hashicorp/vsphere/2.3.0/darwin_amd64/terraform-provider-vsphere_v2.3.0 pid=79231
2022-08-09T16:51:48.769-0400 [DEBUG] provider: waiting for RPC address: path=.terraform/providers/local/hashicorp/vsphere/2.3.0/darwin_amd64/terraform-provider-vsphere_v2.3.0
2022-08-09T16:51:48.780-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: configuring server automatic mTLS: timestamp=2022-08-09T16:51:48.780-0400
2022-08-09T16:51:48.799-0400 [DEBUG] provider: using plugin: version=5
2022-08-09T16:51:48.799-0400 [DEBUG] provider.terraform-provider-vsphere_v2.3.0: plugin address: address=/var/folders/dw/5mlbs0q50gs1qkqmgyx1g6dr0000gp/T/plugin3635603565 network=unix timestamp=2022-08-09T16:51:48.799-0400
2022-08-09T16:51:48.829-0400 [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = transport is closing"
2022-08-09T16:51:48.830-0400 [DEBUG] provider: plugin process exited: path=.terraform/providers/local/hashicorp/vsphere/2.3.0/darwin_amd64/terraform-provider-vsphere_v2.3.0 pid=79231
2022-08-09T16:51:48.830-0400 [DEBUG] provider: plugin exited
2022-08-09T16:51:48.830-0400 [INFO]  backend/local: apply calling Plan
2022-08-09T16:51:48.830-0400 [DEBUG] Building and walking plan graph for NormalMode
2022-08-09T16:51:48.830-0400 [DEBUG] ProviderTransformer: "vsphere_compute_cluster.cluster (expand)" (*terraform.nodeExpandPlannableResource) needs provider["local/hashicorp/vsphere"]
2022-08-09T16:51:48.830-0400 [DEBUG] ProviderTransformer: "data.vsphere_datacenter.datacenter (expand)" (*terraform.nodeExpandPlannableResource) needs provider["local/hashicorp/vsphere"]
2022-08-09T16:51:48.830-0400 [DEBUG] ProviderTransformer: "data.vsphere_host.hosts (expand)" (*terraform.nodeExpandPlannableResource) needs provider["local/hashicorp/vsphere"]
2022-08-09T16:51:48.831-0400 [DEBUG] ReferenceTransformer: "provider[\"local/hashicorp/vsphere\"]" references: [var.vsphere_server var.vsphere_password var.vsphere_user]
2022-08-09T16:51:48.831-0400 [DEBUG] ReferenceTransformer: "vsphere_compute_cluster.cluster (expand)" references: [data.vsphere_host.hosts (expand) data.vsphere_datacenter.datacenter (expand)]
2022-08-09T16:51:48.831-0400 [DEBUG] ReferenceTransformer: "data.vsphere_datacenter.datacenter (expand)" references: []
2022-08-09T16:51:48.831-0400 [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-08-09T16:51:48.831-0400 [DEBUG] ReferenceTransformer: "data.vsphere_host.hosts (expand)" references: [var.hosts data.vsphere_datacenter.datacenter (expand) var.hosts]
2022-08-09T16:51:48.831-0400 [DEBUG] ReferenceTransformer: "var.vsphere_server" references: []
2022-08-09T16:51:48.831-0400 [DEBUG] ReferenceTransformer: "var.vsphere_user" references: []
2022-08-09T16:51:48.831-0400 [DEBUG] ReferenceTransformer: "var.vsphere_password" references: []
2022-08-09T16:51:48.831-0400 [DEBUG] ReferenceTransformer: "var.hosts" references: []
2022-08-09T16:51:48.831-0400 [DEBUG] Starting graph walk: walkPlan
2022-08-09T16:51:48.832-0400 [DEBUG] created provider logger: level=debug
2022-08-09T16:51:48.832-0400 [INFO]  provider: configuring client automatic mTLS
2022-08-09T16:51:48.846-0400 [DEBUG] provider: starting plugin: path=.terraform/providers/local/hashicorp/vsphere/2.3.0/darwin_amd64/terraform-provider-vsphere_v2.3.0 args=[.terraform/providers/local/hashicorp/vsphere/2.3.0/darwin_amd64/terraform-provider-vsphere_v2.3.0]
2022-08-09T16:51:48.849-0400 [DEBUG] provider: plugin started: path=.terraform/providers/local/hashicorp/vsphere/2.3.0/darwin_amd64/terraform-provider-vsphere_v2.3.0 pid=79232
2022-08-09T16:51:48.849-0400 [DEBUG] provider: waiting for RPC address: path=.terraform/providers/local/hashicorp/vsphere/2.3.0/darwin_amd64/terraform-provider-vsphere_v2.3.0
2022-08-09T16:51:48.862-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: configuring server automatic mTLS: timestamp=2022-08-09T16:51:48.861-0400
2022-08-09T16:51:48.880-0400 [DEBUG] provider: using plugin: version=5
2022-08-09T16:51:48.880-0400 [DEBUG] provider.terraform-provider-vsphere_v2.3.0: plugin address: network=unix address=/var/folders/dw/5mlbs0q50gs1qkqmgyx1g6dr0000gp/T/plugin792362126 timestamp=2022-08-09T16:51:48.880-0400
2022-08-09T16:51:48.904-0400 [WARN]  ValidateProviderConfig from "provider[\"local/hashicorp/vsphere\"]" changed the config value, but that value is unused
2022-08-09T16:51:48.905-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:48 [DEBUG] Cached SOAP client session data not valid or persistence not enabled, new session necessary: timestamp=2022-08-09T16:51:48.905-0400
2022-08-09T16:51:48.905-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:48 [DEBUG] Creating new SOAP API session on endpoint 10.78.198.89: timestamp=2022-08-09T16:51:48.905-0400
2022-08-09T16:51:49.415-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:49 [DEBUG] SOAP API session creation successful: timestamp=2022-08-09T16:51:49.415-0400
2022-08-09T16:51:49.415-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:49 [DEBUG] VMWare vSphere Client configured for URL: 10.78.198.89: timestamp=2022-08-09T16:51:49.415-0400
2022-08-09T16:51:49.415-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:49 [DEBUG] Setting up REST client: timestamp=2022-08-09T16:51:49.415-0400
2022-08-09T16:51:50.089-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:50 [DEBUG] CIS REST client configuration successful: timestamp=2022-08-09T16:51:50.089-0400
2022-08-09T16:51:50.457-0400 [DEBUG] Resource instance state not found for node "data.vsphere_datacenter.datacenter", instance data.vsphere_datacenter.datacenter
2022-08-09T16:51:50.457-0400 [DEBUG] ReferenceTransformer: "data.vsphere_datacenter.datacenter" references: []
2022-08-09T16:51:50.642-0400 [DEBUG] Resource instance state not found for node "data.vsphere_host.hosts[0]", instance data.vsphere_host.hosts[0]
2022-08-09T16:51:50.643-0400 [DEBUG] Resource instance state not found for node "data.vsphere_host.hosts[1]", instance data.vsphere_host.hosts[1]
2022-08-09T16:51:50.643-0400 [DEBUG] Resource instance state not found for node "data.vsphere_host.hosts[2]", instance data.vsphere_host.hosts[2]
2022-08-09T16:51:50.643-0400 [DEBUG] Resource instance state not found for node "data.vsphere_host.hosts[3]", instance data.vsphere_host.hosts[3]
2022-08-09T16:51:50.643-0400 [DEBUG] Resource instance state not found for node "data.vsphere_host.hosts[4]", instance data.vsphere_host.hosts[4]
2022-08-09T16:51:50.643-0400 [DEBUG] Resource instance state not found for node "data.vsphere_host.hosts[5]", instance data.vsphere_host.hosts[5]
2022-08-09T16:51:50.643-0400 [INFO]  ReferenceTransformer: reference not found: "var.hosts"
2022-08-09T16:51:50.643-0400 [INFO]  ReferenceTransformer: reference not found: "var.hosts"
2022-08-09T16:51:50.643-0400 [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-08-09T16:51:50.643-0400 [DEBUG] ReferenceTransformer: "data.vsphere_host.hosts[1]" references: []
2022-08-09T16:51:50.643-0400 [INFO]  ReferenceTransformer: reference not found: "var.hosts"
2022-08-09T16:51:50.643-0400 [INFO]  ReferenceTransformer: reference not found: "var.hosts"
2022-08-09T16:51:50.643-0400 [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-08-09T16:51:50.643-0400 [DEBUG] ReferenceTransformer: "data.vsphere_host.hosts[2]" references: []
2022-08-09T16:51:50.643-0400 [INFO]  ReferenceTransformer: reference not found: "var.hosts"
2022-08-09T16:51:50.643-0400 [INFO]  ReferenceTransformer: reference not found: "var.hosts"
2022-08-09T16:51:50.643-0400 [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-08-09T16:51:50.643-0400 [DEBUG] ReferenceTransformer: "data.vsphere_host.hosts[3]" references: []
2022-08-09T16:51:50.643-0400 [INFO]  ReferenceTransformer: reference not found: "var.hosts"
2022-08-09T16:51:50.643-0400 [INFO]  ReferenceTransformer: reference not found: "var.hosts"
2022-08-09T16:51:50.643-0400 [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-08-09T16:51:50.643-0400 [DEBUG] ReferenceTransformer: "data.vsphere_host.hosts[4]" references: []
2022-08-09T16:51:50.643-0400 [INFO]  ReferenceTransformer: reference not found: "var.hosts"
2022-08-09T16:51:50.643-0400 [INFO]  ReferenceTransformer: reference not found: "var.hosts"
2022-08-09T16:51:50.643-0400 [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-08-09T16:51:50.643-0400 [DEBUG] ReferenceTransformer: "data.vsphere_host.hosts[5]" references: []
2022-08-09T16:51:50.643-0400 [INFO]  ReferenceTransformer: reference not found: "var.hosts"
2022-08-09T16:51:50.643-0400 [INFO]  ReferenceTransformer: reference not found: "var.hosts"
2022-08-09T16:51:50.643-0400 [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-08-09T16:51:50.643-0400 [DEBUG] ReferenceTransformer: "data.vsphere_host.hosts[0]" references: []
2022-08-09T16:51:52.283-0400 [DEBUG] Resource instance state not found for node "vsphere_compute_cluster.cluster", instance vsphere_compute_cluster.cluster
2022-08-09T16:51:52.283-0400 [INFO]  ReferenceTransformer: reference not found: "data.vsphere_host.hosts"
2022-08-09T16:51:52.284-0400 [DEBUG] ReferenceTransformer: "vsphere_compute_cluster.cluster" references: []
2022-08-09T16:51:52.284-0400 [DEBUG] refresh: vsphere_compute_cluster.cluster: no state, so not refreshing
2022-08-09T16:51:52.288-0400 [WARN]  Provider "local/hashicorp/vsphere" produced an invalid plan for vsphere_compute_cluster.cluster, but we are tolerating it because it is using the legacy plugin SDK.
    The following problems may be the cause of any confusing errors from downstream operations:
      - .ha_admission_control_performance_tolerance: planned value cty.NumberIntVal(100) for a non-computed attribute
      - .ha_host_monitoring: planned value cty.StringVal("enabled") for a non-computed attribute
      - .proactive_ha_moderate_remediation: planned value cty.StringVal("QuarantineMode") for a non-computed attribute
      - .ha_admission_control_host_failure_tolerance: planned value cty.NumberIntVal(1) for a non-computed attribute
      - .dpm_threshold: planned value cty.NumberIntVal(3) for a non-computed attribute
      - .ha_vm_minimum_uptime: planned value cty.NumberIntVal(120) for a non-computed attribute
      - .dpm_automation_level: planned value cty.StringVal("manual") for a non-computed attribute
      - .proactive_ha_automation_level: planned value cty.StringVal("Manual") for a non-computed attribute
      - .proactive_ha_severe_remediation: planned value cty.StringVal("QuarantineMode") for a non-computed attribute
      - .ha_vm_dependency_restart_condition: planned value cty.StringVal("none") for a non-computed attribute
      - .ha_vm_maximum_resets: planned value cty.NumberIntVal(3) for a non-computed attribute
      - .drs_enable_vm_overrides: planned value cty.True for a non-computed attribute
      - .ha_admission_control_resource_percentage_auto_compute: planned value cty.True for a non-computed attribute
      - .ha_vm_failure_interval: planned value cty.NumberIntVal(30) for a non-computed attribute
      - .drs_scale_descendants_shares: planned value cty.StringVal("disabled") for a non-computed attribute
      - .ha_heartbeat_datastore_policy: planned value cty.StringVal("allFeasibleDsWithUserPreference") for a non-computed attribute
      - .ha_datastore_apd_response_delay: planned value cty.NumberIntVal(180) for a non-computed attribute
      - .ha_vm_restart_priority: planned value cty.StringVal("medium") for a non-computed attribute
      - .dpm_enabled: planned value cty.False for a non-computed attribute
      - .ha_vm_monitoring: planned value cty.StringVal("vmMonitoringDisabled") for a non-computed attribute
      - .ha_admission_control_resource_percentage_cpu: planned value cty.NumberIntVal(100) for a non-computed attribute
      - .ha_admission_control_resource_percentage_memory: planned value cty.NumberIntVal(100) for a non-computed attribute
      - .ha_vm_component_protection: planned value cty.StringVal("enabled") for a non-computed attribute
      - .ha_datastore_apd_response: planned value cty.StringVal("disabled") for a non-computed attribute
      - .ha_admission_control_slot_policy_explicit_cpu: planned value cty.NumberIntVal(32) for a non-computed attribute
      - .ha_admission_control_slot_policy_explicit_memory: planned value cty.NumberIntVal(100) for a non-computed attribute
      - .ha_datastore_apd_recovery_action: planned value cty.StringVal("none") for a non-computed attribute
      - .drs_migration_threshold: planned value cty.NumberIntVal(3) for a non-computed attribute
      - .ha_admission_control_policy: planned value cty.StringVal("resourcePercentage") for a non-computed attribute
      - .ha_vm_restart_timeout: planned value cty.NumberIntVal(600) for a non-computed attribute
      - .ha_host_isolation_response: planned value cty.StringVal("none") for a non-computed attribute
      - .ha_datastore_pdl_response: planned value cty.StringVal("disabled") for a non-computed attribute
      - .ha_vm_maximum_failure_window: planned value cty.NumberIntVal(-1) for a non-computed attribute
      - .host_cluster_exit_timeout: planned value cty.NumberIntVal(3600) for a non-computed attribute
      - .vsan_disk_group: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead
2022-08-09T16:51:52.290-0400 [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = transport is closing"
2022-08-09T16:51:52.292-0400 [DEBUG] provider: plugin process exited: path=.terraform/providers/local/hashicorp/vsphere/2.3.0/darwin_amd64/terraform-provider-vsphere_v2.3.0 pid=79232
2022-08-09T16:51:52.292-0400 [DEBUG] provider: plugin exited
2022-08-09T16:51:52.292-0400 [DEBUG] building apply graph to check for errors
2022-08-09T16:51:52.292-0400 [DEBUG] Resource state not found for node "vsphere_compute_cluster.cluster", instance vsphere_compute_cluster.cluster
2022-08-09T16:51:52.292-0400 [DEBUG] ProviderTransformer: "vsphere_compute_cluster.cluster (expand)" (*terraform.nodeExpandApplyableResource) needs provider["local/hashicorp/vsphere"]
2022-08-09T16:51:52.292-0400 [DEBUG] ProviderTransformer: "data.vsphere_datacenter.datacenter (expand)" (*terraform.nodeExpandApplyableResource) needs provider["local/hashicorp/vsphere"]
2022-08-09T16:51:52.292-0400 [DEBUG] ProviderTransformer: "vsphere_compute_cluster.cluster" (*terraform.NodeApplyableResourceInstance) needs provider["local/hashicorp/vsphere"]
2022-08-09T16:51:52.292-0400 [DEBUG] ProviderTransformer: "data.vsphere_host.hosts (expand)" (*terraform.nodeExpandApplyableResource) needs provider["local/hashicorp/vsphere"]
2022-08-09T16:51:52.292-0400 [DEBUG] ReferenceTransformer: "vsphere_compute_cluster.cluster (expand)" references: []
2022-08-09T16:51:52.293-0400 [DEBUG] ReferenceTransformer: "data.vsphere_datacenter.datacenter (expand)" references: []
2022-08-09T16:51:52.293-0400 [DEBUG] ReferenceTransformer: "var.vsphere_user" references: []
2022-08-09T16:51:52.293-0400 [INFO]  ReferenceTransformer: reference not found: "data.vsphere_host.hosts#destroy"
2022-08-09T16:51:52.293-0400 [DEBUG] ReferenceTransformer: "vsphere_compute_cluster.cluster" references: [data.vsphere_host.hosts (expand) data.vsphere_datacenter.datacenter (expand)]
2022-08-09T16:51:52.293-0400 [DEBUG] ReferenceTransformer: "data.vsphere_host.hosts (expand)" references: [var.hosts]
2022-08-09T16:51:52.293-0400 [DEBUG] ReferenceTransformer: "var.vsphere_server" references: []
2022-08-09T16:51:52.293-0400 [DEBUG] ReferenceTransformer: "var.vsphere_password" references: []
2022-08-09T16:51:52.293-0400 [DEBUG] ReferenceTransformer: "var.hosts" references: []
2022-08-09T16:51:52.293-0400 [DEBUG] ReferenceTransformer: "provider[\"local/hashicorp/vsphere\"]" references: [var.vsphere_password var.vsphere_user var.vsphere_server]
2022-08-09T16:51:52.299-0400 [INFO]  backend/local: apply calling Apply
2022-08-09T16:51:52.299-0400 [DEBUG] Building and walking apply graph for NormalMode plan
2022-08-09T16:51:52.299-0400 [DEBUG] Resource state not found for node "vsphere_compute_cluster.cluster", instance vsphere_compute_cluster.cluster
2022-08-09T16:51:52.299-0400 [DEBUG] ProviderTransformer: "vsphere_compute_cluster.cluster (expand)" (*terraform.nodeExpandApplyableResource) needs provider["local/hashicorp/vsphere"]
2022-08-09T16:51:52.299-0400 [DEBUG] ProviderTransformer: "data.vsphere_datacenter.datacenter (expand)" (*terraform.nodeExpandApplyableResource) needs provider["local/hashicorp/vsphere"]
2022-08-09T16:51:52.299-0400 [DEBUG] ProviderTransformer: "data.vsphere_host.hosts (expand)" (*terraform.nodeExpandApplyableResource) needs provider["local/hashicorp/vsphere"]
2022-08-09T16:51:52.299-0400 [DEBUG] ProviderTransformer: "vsphere_compute_cluster.cluster" (*terraform.NodeApplyableResourceInstance) needs provider["local/hashicorp/vsphere"]
2022-08-09T16:51:52.299-0400 [DEBUG] ReferenceTransformer: "var.vsphere_server" references: []
2022-08-09T16:51:52.299-0400 [DEBUG] ReferenceTransformer: "var.vsphere_user" references: []
2022-08-09T16:51:52.299-0400 [DEBUG] ReferenceTransformer: "var.hosts" references: []
2022-08-09T16:51:52.299-0400 [INFO]  ReferenceTransformer: reference not found: "data.vsphere_host.hosts#destroy"
2022-08-09T16:51:52.299-0400 [DEBUG] ReferenceTransformer: "vsphere_compute_cluster.cluster" references: [data.vsphere_datacenter.datacenter (expand) data.vsphere_host.hosts (expand)]
2022-08-09T16:51:52.299-0400 [DEBUG] ReferenceTransformer: "provider[\"local/hashicorp/vsphere\"]" references: [var.vsphere_server var.vsphere_password var.vsphere_user]
2022-08-09T16:51:52.299-0400 [DEBUG] ReferenceTransformer: "vsphere_compute_cluster.cluster (expand)" references: []
2022-08-09T16:51:52.299-0400 [DEBUG] ReferenceTransformer: "data.vsphere_datacenter.datacenter (expand)" references: []
2022-08-09T16:51:52.299-0400 [DEBUG] ReferenceTransformer: "data.vsphere_host.hosts (expand)" references: [var.hosts]
2022-08-09T16:51:52.299-0400 [DEBUG] ReferenceTransformer: "var.vsphere_password" references: []
2022-08-09T16:51:52.300-0400 [DEBUG] Starting graph walk: walkApply
2022-08-09T16:51:52.300-0400 [DEBUG] created provider logger: level=debug
2022-08-09T16:51:52.301-0400 [INFO]  provider: configuring client automatic mTLS
2022-08-09T16:51:52.326-0400 [DEBUG] provider: starting plugin: path=.terraform/providers/local/hashicorp/vsphere/2.3.0/darwin_amd64/terraform-provider-vsphere_v2.3.0 args=[.terraform/providers/local/hashicorp/vsphere/2.3.0/darwin_amd64/terraform-provider-vsphere_v2.3.0]
2022-08-09T16:51:52.337-0400 [DEBUG] provider: plugin started: path=.terraform/providers/local/hashicorp/vsphere/2.3.0/darwin_amd64/terraform-provider-vsphere_v2.3.0 pid=79243
2022-08-09T16:51:52.338-0400 [DEBUG] provider: waiting for RPC address: path=.terraform/providers/local/hashicorp/vsphere/2.3.0/darwin_amd64/terraform-provider-vsphere_v2.3.0
2022-08-09T16:51:52.387-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: configuring server automatic mTLS: timestamp=2022-08-09T16:51:52.386-0400
2022-08-09T16:51:52.410-0400 [DEBUG] provider: using plugin: version=5
2022-08-09T16:51:52.410-0400 [DEBUG] provider.terraform-provider-vsphere_v2.3.0: plugin address: network=unix address=/var/folders/dw/5mlbs0q50gs1qkqmgyx1g6dr0000gp/T/plugin880434931 timestamp=2022-08-09T16:51:52.410-0400
2022-08-09T16:51:52.439-0400 [WARN]  ValidateProviderConfig from "provider[\"local/hashicorp/vsphere\"]" changed the config value, but that value is unused
2022-08-09T16:51:52.439-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:52 [DEBUG] Cached SOAP client session data not valid or persistence not enabled, new session necessary: timestamp=2022-08-09T16:51:52.439-0400
2022-08-09T16:51:52.439-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:52 [DEBUG] Creating new SOAP API session on endpoint 10.78.198.89: timestamp=2022-08-09T16:51:52.439-0400
2022-08-09T16:51:53.017-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:53 [DEBUG] SOAP API session creation successful: timestamp=2022-08-09T16:51:53.017-0400
2022-08-09T16:51:53.017-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:53 [DEBUG] VMWare vSphere Client configured for URL: 10.78.198.89: timestamp=2022-08-09T16:51:53.017-0400
2022-08-09T16:51:53.017-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:53 [DEBUG] Setting up REST client: timestamp=2022-08-09T16:51:53.017-0400
2022-08-09T16:51:53.809-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:53 [DEBUG] CIS REST client configuration successful: timestamp=2022-08-09T16:51:53.809-0400
2022-08-09T16:51:54.197-0400 [WARN]  Provider "local/hashicorp/vsphere" produced an invalid plan for vsphere_compute_cluster.cluster, but we are tolerating it because it is using the legacy plugin SDK.
    The following problems may be the cause of any confusing errors from downstream operations:
      - .ha_admission_control_host_failure_tolerance: planned value cty.NumberIntVal(1) for a non-computed attribute
      - .ha_vm_minimum_uptime: planned value cty.NumberIntVal(120) for a non-computed attribute
      - .dpm_automation_level: planned value cty.StringVal("manual") for a non-computed attribute
      - .dpm_threshold: planned value cty.NumberIntVal(3) for a non-computed attribute
      - .proactive_ha_severe_remediation: planned value cty.StringVal("QuarantineMode") for a non-computed attribute
      - .ha_vm_dependency_restart_condition: planned value cty.StringVal("none") for a non-computed attribute
      - .proactive_ha_automation_level: planned value cty.StringVal("Manual") for a non-computed attribute
      - .drs_enable_vm_overrides: planned value cty.True for a non-computed attribute
      - .ha_vm_maximum_resets: planned value cty.NumberIntVal(3) for a non-computed attribute
      - .drs_scale_descendants_shares: planned value cty.StringVal("disabled") for a non-computed attribute
      - .ha_admission_control_resource_percentage_auto_compute: planned value cty.True for a non-computed attribute
      - .ha_vm_failure_interval: planned value cty.NumberIntVal(30) for a non-computed attribute
      - .ha_heartbeat_datastore_policy: planned value cty.StringVal("allFeasibleDsWithUserPreference") for a non-computed attribute
      - .ha_vm_restart_priority: planned value cty.StringVal("medium") for a non-computed attribute
      - .ha_datastore_apd_response_delay: planned value cty.NumberIntVal(180) for a non-computed attribute
      - .dpm_enabled: planned value cty.False for a non-computed attribute
      - .ha_admission_control_resource_percentage_cpu: planned value cty.NumberIntVal(100) for a non-computed attribute
      - .ha_vm_monitoring: planned value cty.StringVal("vmMonitoringDisabled") for a non-computed attribute
      - .ha_admission_control_resource_percentage_memory: planned value cty.NumberIntVal(100) for a non-computed attribute
      - .ha_vm_component_protection: planned value cty.StringVal("enabled") for a non-computed attribute
      - .ha_datastore_apd_response: planned value cty.StringVal("disabled") for a non-computed attribute
      - .ha_datastore_apd_recovery_action: planned value cty.StringVal("none") for a non-computed attribute
      - .drs_migration_threshold: planned value cty.NumberIntVal(3) for a non-computed attribute
      - .ha_admission_control_slot_policy_explicit_cpu: planned value cty.NumberIntVal(32) for a non-computed attribute
      - .ha_admission_control_slot_policy_explicit_memory: planned value cty.NumberIntVal(100) for a non-computed attribute
      - .ha_admission_control_policy: planned value cty.StringVal("resourcePercentage") for a non-computed attribute
      - .ha_host_isolation_response: planned value cty.StringVal("none") for a non-computed attribute
      - .ha_vm_restart_timeout: planned value cty.NumberIntVal(600) for a non-computed attribute
      - .host_cluster_exit_timeout: planned value cty.NumberIntVal(3600) for a non-computed attribute
      - .ha_datastore_pdl_response: planned value cty.StringVal("disabled") for a non-computed attribute
      - .ha_vm_maximum_failure_window: planned value cty.NumberIntVal(-1) for a non-computed attribute
      - .ha_host_monitoring: planned value cty.StringVal("enabled") for a non-computed attribute
      - .proactive_ha_moderate_remediation: planned value cty.StringVal("QuarantineMode") for a non-computed attribute
      - .ha_admission_control_performance_tolerance: planned value cty.NumberIntVal(100) for a non-computed attribute
      - .vsan_disk_group: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead
2022-08-09T16:51:54.197-0400 [INFO]  Starting apply for vsphere_compute_cluster.cluster
2022-08-09T16:51:54.198-0400 [DEBUG] vsphere_compute_cluster.cluster: applying the planned Create change
2022-08-09T16:51:54.199-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:54 [DEBUG] setting computed for "vsan_disk_group" from ComputedKeys: timestamp=2022-08-09T16:51:54.199-0400
2022-08-09T16:51:54.199-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:54 [DEBUG] vsphere_compute_cluster (ID = <new resource>): Beginning create: timestamp=2022-08-09T16:51:54.199-0400
2022-08-09T16:51:54.199-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:54 [DEBUG] vsphere_compute_cluster (ID = <new resource>): Processing compute cluster creation: timestamp=2022-08-09T16:51:54.199-0400
2022-08-09T16:51:54.483-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:54 [DEBUG] Creating compute cluster "/vsan-dc/host/vsan-cluster": timestamp=2022-08-09T16:51:54.483-0400
2022-08-09T16:51:54.776-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:54 [DEBUG] tagsClientIfDefined: No tags configured, skipping loading of tagging client: timestamp=2022-08-09T16:51:54.776-0400
2022-08-09T16:51:54.776-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:54 [DEBUG] vsphere_compute_cluster (ID = domain-c28): Tags unsupported on this connection, skipping: timestamp=2022-08-09T16:51:54.776-0400
2022-08-09T16:51:54.776-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:54 [DEBUG] vsphere_compute_cluster (ID = domain-c28): Custom attributes unsupported on this connection, skipping: timestamp=2022-08-09T16:51:54.776-0400
2022-08-09T16:51:54.776-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:54 [DEBUG] vsphere_compute_cluster (ID = domain-c28): Processing any necessary host addition/removal operations: timestamp=2022-08-09T16:51:54.776-0400
2022-08-09T16:51:54.776-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:54 [DEBUG] Locating host system ID host-18: timestamp=2022-08-09T16:51:54.776-0400
2022-08-09T16:51:54.870-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:54 [DEBUG] Host system found: host-18: timestamp=2022-08-09T16:51:54.870-0400
2022-08-09T16:51:54.870-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:54 [DEBUG] Locating host system ID host-19: timestamp=2022-08-09T16:51:54.870-0400
2022-08-09T16:51:54.974-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:54 [DEBUG] Host system found: host-19: timestamp=2022-08-09T16:51:54.974-0400
2022-08-09T16:51:54.974-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:54 [DEBUG] Locating host system ID host-9: timestamp=2022-08-09T16:51:54.974-0400
2022-08-09T16:51:55.069-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:55 [DEBUG] Host system found: host-9: timestamp=2022-08-09T16:51:55.069-0400
2022-08-09T16:51:55.069-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:55 [DEBUG] Locating host system ID host-12: timestamp=2022-08-09T16:51:55.069-0400
2022-08-09T16:51:55.162-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:55 [DEBUG] Host system found: host-12: timestamp=2022-08-09T16:51:55.162-0400
2022-08-09T16:51:55.162-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:55 [DEBUG] Locating host system ID host-24: timestamp=2022-08-09T16:51:55.162-0400
2022-08-09T16:51:55.252-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:55 [DEBUG] Host system found: host-24: timestamp=2022-08-09T16:51:55.252-0400
2022-08-09T16:51:55.252-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:55 [DEBUG] Locating host system ID host-15: timestamp=2022-08-09T16:51:55.252-0400
2022-08-09T16:51:55.346-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:55 [DEBUG] Host system found: host-15: timestamp=2022-08-09T16:51:55.346-0400
2022-08-09T16:51:57.615-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:51:57 [DEBUG] Adding hosts into cluster "": 10.78.201.228, 10.78.198.14, 10.78.193.80, 10.78.194.80, 10.78.193.182, 10.78.198.238: timestamp=2022-08-09T16:51:57.615-0400
2022-08-09T16:52:02.197-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:52:02 [DEBUG] vsphere_compute_cluster (ID = domain-c28): Applying cluster configuration: timestamp=2022-08-09T16:52:02.197-0400
2022-08-09T16:52:02.197-0400 [INFO]  provider.terraform-provider-vsphere_v2.3.0: 2022/08/09 16:52:02 [DEBUG] Reconfiguring cluster "": timestamp=2022-08-09T16:52:02.197-0400
2022-08-09T16:53:58.267-0400 [ERROR] vertex "vsphere_compute_cluster.cluster" error: cannot apply vsan service on cluster: vsan-cluster
2022-08-09T16:53:58.291-0400 [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = transport is closing"
2022-08-09T16:53:58.293-0400 [DEBUG] provider: plugin process exited: path=.terraform/providers/local/hashicorp/vsphere/2.3.0/darwin_amd64/terraform-provider-vsphere_v2.3.0 pid=79243
2022-08-09T16:53:58.293-0400 [DEBUG] provider: plugin exited

The only workaround that I have found is to run this first:

resource "vsphere_compute_cluster" "cluster" {
  name                                 = "vsan-cluster"
  datacenter_id                        = data.vsphere_datacenter.datacenter.id
  host_system_ids                      = data.vsphere_host.hosts.*.id
  drs_enabled                          = "true"
  drs_automation_level                 = "fullyAutomated"
  ha_enabled                           = false
  vsan_enabled                         = true
  vsan_dedup_enabled                   = false
  vsan_compression_enabled             = false
  vsan_performance_enabled             = true
  vsan_network_diagnostic_mode_enabled = true
  vsan_verbose_mode_enabled            = true
}

followed by the below to enable dedupe/compression:

resource "vsphere_compute_cluster" "cluster" {
  name                                 = "vsan-cluster"
  datacenter_id                        = data.vsphere_datacenter.datacenter.id
  host_system_ids                      = data.vsphere_host.hosts.*.id
  drs_enabled                          = "true"
  drs_automation_level                 = "fullyAutomated"
  ha_enabled                           = false
  vsan_enabled                         = true
  vsan_dedup_enabled                   = true
  vsan_compression_enabled             = true
  vsan_performance_enabled             = true
  vsan_network_diagnostic_mode_enabled = true
  vsan_verbose_mode_enabled            = true
}

Before approval, can you take a review of this using the same a similar configuration on VM Pool: tf-main-vsphereprovider-6nodes-vsan?

Ryan Johnson
Senior Staff Solutions Architect | Product Engineering @ VMware, Inc.

@tenthirtyam tenthirtyam added the waiting-response Status: Waiting on a Response label Aug 9, 2022
@tenthirtyam
Copy link
Collaborator

After further analysis with the contributor, this race condition is only observed in vSphere .next, but does not manifest in 7.0.x.

This known issue shall be mitigated in a future update of the provider.

Ryan Johnson
Senior Staff Solutions Architect | Product Engineering @ VMware, Inc.

@github-actions github-actions bot removed the waiting-response Status: Waiting on a Response label Aug 25, 2022
tenthirtyam
tenthirtyam approved these changes Aug 25, 2022
View reviewed changes
Copy link
Collaborator

@tenthirtyam tenthirtyam left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! 🚀

@tenthirtyam tenthirtyam merged commit f003737 into hashicorp:main Aug 25, 2022
@SlimYang SlimYang mentioned this pull request Sep 1, 2022
Closed
4 tasks
@SlimYang SlimYang deleted the topic-perf branch September 5, 2022 15:03
@github-actions
Copy link

github-actions bot commented Oct 6, 2022

I'm going to lock this pull request because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues. If you have found a problem that seems related to this change, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.

@github-actions github-actions bot locked as resolved and limited conversation to collaborators Oct 6, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers

@tenthirtyam tenthirtyam tenthirtyam approved these changes

Assignees

@SlimYang SlimYang

Labels
documentation Type: Documentation provider Type: Provider size/l Relative Sizing: Large
Projects
None yet
Milestone
v2.3.0
Development

Successfully merging this pull request may close these issues.

Add support for vSAN performance service configuration
2 participants
@SlimYang @tenthirtyam