Vm doesn't run the job

[aditya-enthu]

Describe the bug
A clear and concise description of what the bug is.

Github actions to Azure Vm runners. The workflow triggers the job and VM get started but after that the workflow keep waiting to connect to the runners.

• Using module 'main' branch as source
• Github actions
• Azure Vms
• Azure location (centralindia)

To Reproduce
Steps to reproduce the behavior:

1. Go to '...'
2. Click on '....'
3. Scroll down to '....'
4. See error

Expected behavior
A clear and concise description of what you expected to happen.

• GHA job should trigger the job and connect to Azure runners and then VMs should stop after job is finished

Additional context
Add any other context about the problem here.

App logs, if someone can provide hint, please

• "code":"GeneralError"}
• "[EventQueue] Process Message: "}
• "[EventQueue] Message failed to process:"}

2023-11-30T15:06:14.395222692Z Hosting environment: Production
2023-11-30T15:06:14.395278592Z Content root path: /app
2023-11-30T15:06:14.395284492Z Now listening on: http://[::]:8081
2023-11-30T15:07:11.863525034Z Updated CA certificates
2023-11-30T15:07:12.676686662Z {"EventId":0,"LogLevel":"Information","Category":"Program","Message":"Entering app startup."}
2023-11-30T15:07:13.785885531Z Hosting environment: Production
2023-11-30T15:07:13.785921932Z Content root path: /app
2023-11-30T15:07:13.785927832Z Now listening on: http://[::]:8081
/home/LogFiles/2023_12_01_lw1ldlwk00012A_default_docker.log  (https://web-app-github-webhook-runner-controller-abc.scm.azurewebsites.net/api/vfs/LogFiles/2023_12_01_lw1ldlwk00012A_default_docker.log)

2023-12-01T17:30:34.773959970Z {"level":50,"time":1701451834773,"pid":1,"hostname":"f370100dab0b","error":{"name":"ServiceBusError","retryable":true,"info":null,"code":"GeneralError"},"errorSource":"receive","entityPath":"sbq-github-webhook-events","fullyQualifiedNamespace":"sb-github-runner-queues-abcsite.servicebus.windows.net","identifier":"sbq-github-webhook-events-b5720704-e4a7-b742-ac13-c9304f15ecca"}
2023-12-01T17:30:34.870151158Z {"level":30,"time":1701451834869,"pid":1,"hostname":"f370100dab0b","error":{"name":"ServiceBusError","retryable":true,"info":null,"code":"GeneralError"},"errorSource":"receive","entityPath":"sbq-github-state","fullyQualifiedNamespace":"sb-github-runner-queues-abcsite.servicebus.windows.net","identifier":"sbq-github-state-635fcb32-3f62-2641-b5bf-944e67778658"}
/home/LogFiles/2023_12_01_lw1ldlwk00012A_docker.log  (https://web-app-github-webhook-runner-controller-abc.scm.azurewebsites.net/api/vfs/LogFiles/2023_12_01_lw1ldlwk00012A_docker.log)
2023-12-01T12:09:58.906Z INFO  -
/home/LogFiles/2023_12_01_lw1ldlwk00012A_msi_docker.log  (https://web-app-github-webhook-runner-controller-abc.scm.azurewebsites.net/api/vfs/LogFiles/2023_12_01_lw1ldlwk00012A_msi_docker.log)

/home/LogFiles/2023_12_02_lw1ldlwk00012A_default_docker.log  (https://web-app-github-webhook-runner-controller-abc.scm.azurewebsites.net/api/vfs/LogFiles/2023_12_02_lw1ldlwk00012A_default_docker.log)

2023-12-02T17:35:34.942833220Z {"level":30,"time":1701538534942,"pid":1,"hostname":"f370100dab0b","error":{"name":"ServiceBusError","retryable":true,"info":null,"code":"GeneralError"},"errorSource":"receive","entityPath":"sbq-github-state","fullyQualifiedNamespace":"sb-github-runner-queues-abcsite.servicebus.windows.net","identifier":"sbq-github-state-635fcb32-3f62-2641-b5bf-944e67778658"}
2023-12-02T17:40:34.878887094Z {"level":50,"time":1701538834878,"pid":1,"hostname":"f370100dab0b","error":{"name":"ServiceBusError","retryable":true,"info":null,"code":"GeneralError"},"errorSource":"receive","entityPath":"sbq-github-webhook-events","fullyQualifiedNamespace":"sb-github-runner-queues-abcsite.servicebus.windows.net","identifier":"sbq-github-webhook-events-b5720704-e4a7-b742-ac13-c9304f15ecca"}
/home/LogFiles/2023_12_02_lw1ldlwk00012A_docker.log  (https://web-app-github-webhook-runner-controller-abc.scm.azurewebsites.net/api/vfs/LogFiles/2023_12_02_lw1ldlwk00012A_docker.log)
2023-12-02T12:09:58.921Z INFO  -
/home/LogFiles/2023_12_02_lw1ldlwk00012A_msi_docker.log  (https://web-app-github-webhook-runner-controller-abc.scm.azurewebsites.net/api/vfs/LogFiles/2023_12_02_lw1ldlwk00012A_msi_docker.log)

/home/LogFiles/2023_12_03_lw1ldlwk00012A_default_docker.log  (https://web-app-github-webhook-runner-controller-abc.scm.azurewebsites.net/api/vfs/LogFiles/2023_12_03_lw1ldlwk00012A_default_docker.log)
2023-12-03T08:13:46.330350994Z {"level":30,"time":1701591226330,"pid":1,"hostname":"f370100dab0b","msg":"[EventQueue] Process Message: "}
2023-12-03T08:13:54.007839339Z {"level":40,"time":1701591234007,"pid":1,"hostname":"f370100dab0b","msg":"[EventQueue] Message failed to process:"}
2023-12-03T08:13:59.549801805Z {"level":40,"time":1701591239549,"pid":1,"hostname":"f370100dab0b","msg":"[EventQueue] Message failed to process:"}
2023-12-03T17:40:35.000116820Z {"level":50,"time":1701625234999,"pid":1,"hostname":"f370100dab0b","error":{"name":"ServiceBusError","retryable":true,"info":null,"code":"GeneralError"},"errorSource":"receive","entityPath":"sbq-github-webhook-events","fullyQualifiedNamespace":"sb-github-runner-queues-abcsite.servicebus.windows.net","identifier":"sbq-github-webhook-events-b5720704-e4a7-b742-ac13-c9304f15ecca"}
2023-12-03T17:45:34.938593831Z {"level":30,"time":1701625534938,"pid":1,"hostname":"f370100dab0b","error":{"name":"ServiceBusError","retryable":true,"info":null,"code":"GeneralError"},"errorSource":"receive","entityPath":"sbq-github-state","fullyQualifiedNamespace":"sb-github-runner-queues-abcsite.servicebus.windows.net","identifier":"sbq-github-state-635fcb32-3f62-2641-b5bf-944e67778658"}
/home/LogFiles/2023_12_03_lw1ldlwk00012A_docker.log  (https://web-app-github-webhook-runner-controller-abc.scm.azurewebsites.net/api/vfs/LogFiles/2023_12_03_lw1ldlwk00012A_docker.log)
2023-12-03T12:09:58.932Z INFO  -
/home/LogFiles/2023_12_03_lw1ldlwk00012A_msi_docker.log  (https://web-app-github-webhook-runner-controller-abc.scm.azurewebsites.net/api/vfs/LogFiles/2023_12_03_lw1ldlwk00012A_msi_docker.log)

/home/LogFiles/2023_12_04_lw1ldlwk00012A_default_docker.log  (https://web-app-github-webhook-runner-controller-abc.scm.azurewebsites.net/api/vfs/LogFiles/2023_12_04_lw1ldlwk00012A_default_docker.log)
2023-12-04T06:30:09.314978670Z {"level":30,"time":1701671409314,"pid":1,"hostname":"f370100dab0b","msg":"Queued Event Received"}
2023-12-04T06:30:09.834035012Z {"level":30,"time":1701671409833,"pid":1,"hostname":"f370100dab0b","msg":"[EventQueue] Process Message: "}
2023-12-04T09:55:03.479791415Z {"level":30,"time":1701683703479,"pid":1,"hostname":"f370100dab0b","msg":"Queued Event Received"}
2023-12-04T09:55:03.860829881Z {"level":30,"time":1701683703860,"pid":1,"hostname":"f370100dab0b","msg":"[EventQueue] Process Message: "}
2023-12-04T10:13:27.063117596Z {"level":40,"time":1701684807062,"pid":1,"hostname":"f370100dab0b","msg":"[EventQueue] Message failed to process:"}
2023-12-04T10:16:19.168906261Z {"level":40,"time":1701684979168,"pid":1,"hostname":"f370100dab0b","msg":"[EventQueue] Message failed to process:"}
/home/LogFiles/2023_12_04_lw1ldlwk00012A_docker.log  (https://web-app-github-webhook-runner-controller-abc.scm.azurewebsites.net/api/vfs/LogFiles/2023_12_04_lw1ldlwk00012A_docker.log)
2023-12-04T12:09:58.911Z INFO  -
/home/LogFiles/2023_12_04_lw1ldlwk00012A_msi_docker.log  (https://web-app-github-webhook-runner-controller-abc.scm.azurewebsites.net/api/vfs/LogFiles/2023_12_04_lw1ldlwk00012A_msi_docker.log)

Ending Log Tail of existing logs ---Starting Live Log Stream ---

[AlexanderBurdenko]

Hello, @aditya-enthu !
I see that you have errors Discarding invalid request. Can you tell me what i'm doing wrong ?
Because i check everything and no errors.
Did i miss something ?
Thank you

[aditya-enthu]

@AlexanderBurdenko thank you for checking this issue.

What tag version is being used at your side, I am using master and have deployed the terraform configs and it error out with above error. It doesn't start the VMs but no jobs are triggered after that.

Any ideas what I am missing or suggestion on what to check to trace the issue?

[AlexanderBurdenko]

@aditya-enthu hello
I'm resolved problem with function app, but now i have two probles:

1. I dont see that function write to service bus queue sbq-github-webhook-events
2. I dont see that it's create a VM with runner
   Did you have same errors ?

My logs inside Web-App:
2024-02-01T12:43:36.156500288Z {"level":30,"time":1706791416140,"pid":1,"hostname":"6caa36257737","msg":"Queued Event Received"}
2024-02-01T12:43:36.548939285Z {"level":30,"time":1706791416544,"pid":1,"hostname":"6caa36257737","msg":"[EventQueue] Process Message: "}

[aditya-enthu]

@AlexanderBurdenko Sorry, I have back logged this issue with some other priority task. For me the runner create but no jobs are triggered. I have not tried again anything after that.

[AlexanderBurdenko]

@aditya-enthu Okay, understood. Thank you.
If i face this problem and resolve it, i let you know

[aditya-enthu]

@AlexanderBurdenko did you manage to run runner and execute the jobs?