Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Memory leak in client #605

Open
gooseleggs opened this issue Jun 11, 2023 · 6 comments
Open

Memory leak in client #605

gooseleggs opened this issue Jun 11, 2023 · 6 comments

Comments

@gooseleggs
Copy link

Last night I noticed that my ZDEW client was consuming a vast amount of memory and was a bit unresponsive. So, I crashed out of it, and then restarted. Tonight I checked back in, and it was back being high again. I have not used the ZDEW for anything. The laptop has been put to sleep a few times, but that is it. Just by watching the Task Manager over 5-10 minutes I can see the memory usage increasing.

image

App version is 2.1.16.0

How can I help to produce any data for this.
@dovholuknf
Copy link
Member

dovholuknf commented Jun 11, 2023 •
edited
Loading

Yikes. Are there any network configuration changes that have happened lately? This just happened out of nowhere? Best thing to do will be to get a set of logs to share, assuming you're comfortable with that and assuming it's reproducible. If it's NOT reproducible, just collect a feedback zip and send to us to inspect.

If you can reproduce the issue:

  • Enable debug level logging
  • Stop zdew
  • Clean up/remove existing log files (you'll have to do this manually)
  • start zdew
  • wait until you see the memory spike up over 500 mb
  • Get a feedback zip file, send to help at OpenZiti.org

@gooseleggs
Copy link
Author

So, I have been doing some investigation. You mentioned if any network changes, so have been doing some experimentation. It seems to go balistic when I have virtual box open.

This is what is repeating in the logs (UI log) when I have Virtual Box machine open

[2023-06-15T09:42:43.205Z] DEBUG	ZitiDesktopEdge.MainWindow	==== ControllerEvent    : action:connected identifier:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json	
[2023-06-15T09:42:43.277Z] TRACE	ZitiDesktopEdge.ServiceClient.DataClient	{"Op":"identity","Action":"added","Fingerprint":"KelvinWorkLaptop","Id":{"Name":"HDC Kelvin Work Laptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","FingerPrint":"KelvinWorkLaptop","Active":true,"Loaded":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443"},"ControllerVersion":"v0.27.9","IdFileStatus":true,"MfaEnabled":false,"MfaNeeded":false,"Metrics":{"Up":0,"Down":0},"MfaMinTimeout":0,"MfaMaxTimeout":0,"MfaMinTimeoutRem":0,"MfaMaxTimeoutRem":0,"MinTimeoutRemInSvcEvent":0,"MaxTimeoutRemInSvcEvent":0,"Deleted":false,"Notified":false}}	
[2023-06-15T09:42:43.277Z]  INFO	ZitiDesktopEdge.Models.ZitiIdentity	Identity: HDC Kelvin Work Laptop updated To {"Name":"HDC Kelvin Work Laptop","FingerPrint":"KelvinWorkLaptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Active":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443","id":null,"configTypes":null},"Status":null,"Services":null,"Metrics":{"TotalBytes":0,"Up":0,"Down":0},"ControllerVersion":"v0.27.9","MfaEnabled":false,"MfaNeeded":false,"MinTimeout":0,"MaxTimeout":0,"MfaLastUpdatedTime":"0001-01-01T00:00:00"}	
[2023-06-15T09:42:43.277Z] DEBUG	ZitiDesktopEdge.MainWindow	==== IdentityEvent    : action:added identifer:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json name:HDC Kelvin Work Laptop 	
[2023-06-15T09:42:43.319Z] DEBUG	ZitiDesktopEdge.MainWindow	IDENTITY EVENT. Action: added identifier: C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json	
[2023-06-15T09:42:43.319Z] TRACE	ZitiDesktopEdge.ServiceClient.DataClient	{"Op":"controller","Action":"disconnected","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Fingerprint":"KelvinWorkLaptop"}	
[2023-06-15T09:42:43.319Z] DEBUG	ZitiDesktopEdge.ServiceClient.DataClient	Controller event received	
[2023-06-15T09:42:43.319Z] DEBUG	ZitiDesktopEdge.MainWindow	==== ControllerEvent    : action:disconnected identifier:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json	
[2023-06-15T09:42:43.524Z] TRACE	ZitiDesktopEdge.ServiceClient.DataClient	{"Op":"identity","Action":"added","Fingerprint":"KelvinWorkLaptop","Id":{"Name":"HDC Kelvin Work Laptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","FingerPrint":"KelvinWorkLaptop","Active":true,"Loaded":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443"},"ControllerVersion":"v0.27.9","IdFileStatus":true,"MfaEnabled":false,"MfaNeeded":false,"Metrics":{"Up":0,"Down":0},"MfaMinTimeout":0,"MfaMaxTimeout":0,"MfaMinTimeoutRem":0,"MfaMaxTimeoutRem":0,"MinTimeoutRemInSvcEvent":0,"MaxTimeoutRemInSvcEvent":0,"Deleted":false,"Notified":false}}	
[2023-06-15T09:42:43.524Z]  INFO	ZitiDesktopEdge.Models.ZitiIdentity	Identity: HDC Kelvin Work Laptop updated To {"Name":"HDC Kelvin Work Laptop","FingerPrint":"KelvinWorkLaptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Active":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443","id":null,"configTypes":null},"Status":null,"Services":null,"Metrics":{"TotalBytes":0,"Up":0,"Down":0},"ControllerVersion":"v0.27.9","MfaEnabled":false,"MfaNeeded":false,"MinTimeout":0,"MaxTimeout":0,"MfaLastUpdatedTime":"0001-01-01T00:00:00"}	
[2023-06-15T09:42:43.524Z] DEBUG	ZitiDesktopEdge.MainWindow	==== IdentityEvent    : action:added identifer:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json name:HDC Kelvin Work Laptop 	
[2023-06-15T09:42:43.552Z] DEBUG	ZitiDesktopEdge.MainWindow	IDENTITY EVENT. Action: added identifier: C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json	
[2023-06-15T09:42:43.552Z] TRACE	ZitiDesktopEdge.ServiceClient.DataClient	{"Op":"controller","Action":"connected","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Fingerprint":"KelvinWorkLaptop"}	
[2023-06-15T09:42:43.552Z] DEBUG	ZitiDesktopEdge.ServiceClient.DataClient	Controller event received	
[2023-06-15T09:42:43.552Z] DEBUG	ZitiDesktopEdge.MainWindow	==== ControllerEvent    : action:connected identifier:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json	
[2023-06-15T09:42:43.564Z] TRACE	ZitiDesktopEdge.ServiceClient.DataClient	{"Op":"identity","Action":"added","Fingerprint":"KelvinWorkLaptop","Id":{"Name":"HDC Kelvin Work Laptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","FingerPrint":"KelvinWorkLaptop","Active":true,"Loaded":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443"},"ControllerVersion":"v0.27.9","IdFileStatus":true,"MfaEnabled":false,"MfaNeeded":false,"Metrics":{"Up":0,"Down":0},"MfaMinTimeout":0,"MfaMaxTimeout":0,"MfaMinTimeoutRem":0,"MfaMaxTimeoutRem":0,"MinTimeoutRemInSvcEvent":0,"MaxTimeoutRemInSvcEvent":0,"Deleted":false,"Notified":false}}	
[2023-06-15T09:42:43.564Z]  INFO	ZitiDesktopEdge.Models.ZitiIdentity	Identity: HDC Kelvin Work Laptop updated To {"Name":"HDC Kelvin Work Laptop","FingerPrint":"KelvinWorkLaptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Active":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443","id":null,"configTypes":null},"Status":null,"Services":null,"Metrics":{"TotalBytes":0,"Up":0,"Down":0},"ControllerVersion":"v0.27.9","MfaEnabled":false,"MfaNeeded":false,"MinTimeout":0,"MaxTimeout":0,"MfaLastUpdatedTime":"0001-01-01T00:00:00"}	
[2023-06-15T09:42:43.564Z] DEBUG	ZitiDesktopEdge.MainWindow	==== IdentityEvent    : action:added identifer:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json name:HDC Kelvin Work Laptop 	
[2023-06-15T09:42:43.615Z] DEBUG	ZitiDesktopEdge.MainWindow	IDENTITY EVENT. Action: added identifier: C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json	
[2023-06-15T09:42:43.615Z] TRACE	ZitiDesktopEdge.ServiceClient.DataClient	{"Op":"controller","Action":"disconnected","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Fingerprint":"KelvinWorkLaptop"}	
[2023-06-15T09:42:43.615Z] DEBUG	ZitiDesktopEdge.ServiceClient.DataClient	Controller event received	
[2023-06-15T09:42:43.615Z] DEBUG	ZitiDesktopEdge.MainWindow	==== ControllerEvent    : action:disconnected identifier:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json	
[2023-06-15T09:42:43.819Z] TRACE	ZitiDesktopEdge.ServiceClient.DataClient	{"Op":"identity","Action":"added","Fingerprint":"KelvinWorkLaptop","Id":{"Name":"HDC Kelvin Work Laptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","FingerPrint":"KelvinWorkLaptop","Active":true,"Loaded":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443"},"ControllerVersion":"v0.27.9","IdFileStatus":true,"MfaEnabled":false,"MfaNeeded":false,"Metrics":{"Up":0,"Down":0},"MfaMinTimeout":0,"MfaMaxTimeout":0,"MfaMinTimeoutRem":0,"MfaMaxTimeoutRem":0,"MinTimeoutRemInSvcEvent":0,"MaxTimeoutRemInSvcEvent":0,"Deleted":false,"Notified":false}}	
[2023-06-15T09:42:43.819Z]  INFO	ZitiDesktopEdge.Models.ZitiIdentity	Identity: HDC Kelvin Work Laptop updated To {"Name":"HDC Kelvin Work Laptop","FingerPrint":"KelvinWorkLaptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Active":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443","id":null,"configTypes":null},"Status":null,"Services":null,"Metrics":{"TotalBytes":0,"Up":0,"Down":0},"ControllerVersion":"v0.27.9","MfaEnabled":false,"MfaNeeded":false,"MinTimeout":0,"MaxTimeout":0,"MfaLastUpdatedTime":"0001-01-01T00:00:00"}	
[2023-06-15T09:42:43.819Z] DEBUG	ZitiDesktopEdge.MainWindow	==== IdentityEvent    : action:added identifer:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json name:HDC Kelvin Work Laptop 	
[2023-06-15T09:42:43.858Z] DEBUG	ZitiDesktopEdge.MainWindow	IDENTITY EVENT. Action: added identifier: C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json	
[2023-06-15T09:42:43.858Z] TRACE	ZitiDesktopEdge.ServiceClient.DataClient	{"Op":"controller","Action":"connected","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Fingerprint":"KelvinWorkLaptop"}	
[2023-06-15T09:42:43.858Z] DEBUG	ZitiDesktopEdge.ServiceClient.DataClient	Controller event received	
[2023-06-15T09:42:43.858Z] DEBUG	ZitiDesktopEdge.MainWindow	==== ControllerEvent    : action:connected identifier:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json	
[2023-06-15T09:42:43.858Z] TRACE	ZitiDesktopEdge.ServiceClient.DataClient	{"Op":"identity","Action":"added","Fingerprint":"KelvinWorkLaptop","Id":{"Name":"HDC Kelvin Work Laptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","FingerPrint":"KelvinWorkLaptop","Active":true,"Loaded":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443"},"ControllerVersion":"v0.27.9","IdFileStatus":true,"MfaEnabled":false,"MfaNeeded":false,"Metrics":{"Up":0,"Down":0},"MfaMinTimeout":0,"MfaMaxTimeout":0,"MfaMinTimeoutRem":0,"MfaMaxTimeoutRem":0,"MinTimeoutRemInSvcEvent":0,"MaxTimeoutRemInSvcEvent":0,"Deleted":false,"Notified":false}}	
[2023-06-15T09:42:43.858Z]  INFO	ZitiDesktopEdge.Models.ZitiIdentity	Identity: HDC Kelvin Work Laptop updated To {"Name":"HDC Kelvin Work Laptop","FingerPrint":"KelvinWorkLaptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Active":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443","id":null,"configTypes":null},"Status":null,"Services":null,"Metrics":{"TotalBytes":0,"Up":0,"Down":0},"ControllerVersion":"v0.27.9","MfaEnabled":false,"MfaNeeded":false,"MinTimeout":0,"MaxTimeout":0,"MfaLastUpdatedTime":"0001-01-01T00:00:00"}	
[2023-06-15T09:42:43.858Z] DEBUG	ZitiDesktopEdge.MainWindow	==== IdentityEvent    : action:added identifer:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json name:HDC Kelvin Work Laptop 	
[2023-06-15T09:42:43.929Z] DEBUG	ZitiDesktopEdge.MainWindow	IDENTITY EVENT. Action: added identifier: C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json	
[2023-06-15T09:42:43.929Z] TRACE	ZitiDesktopEdge.ServiceClient.DataClient	{"Op":"controller","Action":"disconnected","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Fingerprint":"KelvinWorkLaptop"}	
[2023-06-15T09:42:43.929Z] DEBUG	ZitiDesktopEdge.ServiceClient.DataClient	Controller event received	
[2023-06-15T09:42:43.929Z] DEBUG	ZitiDesktopEdge.MainWindow	==== ControllerEvent    : action:disconnected identifier:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json	
[2023-06-15T09:42:44.445Z] TRACE	ZitiDesktopEdge.ServiceClient.DataClient	{"Op":"identity","Action":"added","Fingerprint":"KelvinWorkLaptop","Id":{"Name":"HDC Kelvin Work Laptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","FingerPrint":"KelvinWorkLaptop","Active":true,"Loaded":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443"},"ControllerVersion":"v0.27.9","IdFileStatus":true,"MfaEnabled":false,"MfaNeeded":false,"Metrics":{"Up":0,"Down":0},"MfaMinTimeout":0,"MfaMaxTimeout":0,"MfaMinTimeoutRem":0,"MfaMaxTimeoutRem":0,"MinTimeoutRemInSvcEvent":0,"MaxTimeoutRemInSvcEvent":0,"Deleted":false,"Notified":false}}	
[2023-06-15T09:42:44.445Z]  INFO	ZitiDesktopEdge.Models.ZitiIdentity	Identity: HDC Kelvin Work Laptop updated To {"Name":"HDC Kelvin Work Laptop","FingerPrint":"KelvinWorkLaptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Active":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443","id":null,"configTypes":null},"Status":null,"Services":null,"Metrics":{"TotalBytes":0,"Up":0,"Down":0},"ControllerVersion":"v0.27.9","MfaEnabled":false,"MfaNeeded":false,"MinTimeout":0,"MaxTimeout":0,"MfaLastUpdatedTime":"0001-01-01T00:00:00"}	
[2023-06-15T09:42:44.445Z] DEBUG	ZitiDesktopEdge.MainWindow	==== IdentityEvent    : action:added identifer:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json name:HDC Kelvin Work Laptop 	
[2023-06-15T09:42:44.474Z] DEBUG	ZitiDesktopEdge.MainWindow	IDENTITY EVENT. Action: added identifier: C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json	
[2023-06-15T09:42:44.474Z] TRACE	ZitiDesktopEdge.ServiceClient.DataClient	{"Op":"controller","Action":"connected","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Fingerprint":"KelvinWorkLaptop"}	
[2023-06-15T09:42:44.474Z] DEBUG	ZitiDesktopEdge.ServiceClient.DataClient	Controller event received	
[2023-06-15T09:42:44.474Z] DEBUG	ZitiDesktopEdge.MainWindow	==== ControllerEvent    : action:connected identifier:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json	
[2023-06-15T09:42:44.488Z] TRACE	ZitiDesktopEdge.ServiceClient.DataClient	{"Op":"identity","Action":"added","Fingerprint":"KelvinWorkLaptop","Id":{"Name":"HDC Kelvin Work Laptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","FingerPrint":"KelvinWorkLaptop","Active":true,"Loaded":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443"},"ControllerVersion":"v0.27.9","IdFileStatus":true,"MfaEnabled":false,"MfaNeeded":false,"Metrics":{"Up":0,"Down":0},"MfaMinTimeout":0,"MfaMaxTimeout":0,"MfaMinTimeoutRem":0,"MfaMaxTimeoutRem":0,"MinTimeoutRemInSvcEvent":0,"MaxTimeoutRemInSvcEvent":0,"Deleted":false,"Notified":false}}	
[2023-06-15T09:42:44.488Z]  INFO	ZitiDesktopEdge.Models.ZitiIdentity	Identity: HDC Kelvin Work Laptop updated To {"Name":"HDC Kelvin Work Laptop","FingerPrint":"KelvinWorkLaptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Active":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443","id":null,"configTypes":null},"Status":null,"Services":null,"Metrics":{"TotalBytes":0,"Up":0,"Down":0},"ControllerVersion":"v0.27.9","MfaEnabled":false,"MfaNeeded":false,"MinTimeout":0,"MaxTimeout":0,"MfaLastUpdatedTime":"0001-01-01T00:00:00"}	
[2023-06-15T09:42:44.488Z] DEBUG	ZitiDesktopEdge.MainWindow	==== IdentityEvent    : action:added identifer:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json name:HDC Kelvin Work Laptop 	
[2023-06-15T09:42:44.529Z] DEBUG	ZitiDesktopEdge.MainWindow	IDENTITY EVENT. Action: added identifier: C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json	
[2023-06-15T09:42:44.529Z] TRACE	ZitiDesktopEdge.ServiceClient.DataClient	{"Op":"controller","Action":"disconnected","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Fingerprint":"KelvinWorkLaptop"}	
[2023-06-15T09:42:44.529Z] DEBUG	ZitiDesktopEdge.ServiceClient.DataClient	Controller event received

@dovholuknf
Copy link
Member

That sure looks like a tight loop bug... Strange. Is the virtual box also running windows perhaps? Can you also look at the service log when this happens? Here, the UI is responding to IPC events from the tunneler running on this machine. I'm wondering if the vm is also running ZDEW or not, and I'm wondering what the service/data portion of ZDEW is doing. It's the one sending these IPC events to the UI. Still, the UI should not be growing it's memory uncontrollably. When this happens I expect you'll see one full cpu used by theziti-edge-tunnel as well.

Thanks for digging in. If you're feeling up to it, I would wonder how the preview/new UI would behave in this situation. https://github.com/openziti/desktop-edge-ui/releases/tag/3.2.3

@gooseleggs
Copy link
Author

It is a Windows VM, without ziti in it. It is running a VPN client inside it. I have sent a help file through to help at openziti.... It is a bitwarden send link due to its size etc.

@dovholuknf
Copy link
Member

Thanks. those logs confirm that the tunneler is sending IPC messages repeatedly and it's in a tight loop. It looks like the tunneler was last restarted on Jun 11 (the day you filed this issue) and this problem manifests immediately on startup and happens around 10 times every second "forever". I'd recommend you:

  • purge these log folders
  • restart the tunneler
  • see if the CPU use of the tunneler is one full CPU. (divide 100 by however many CPUs you have). I have 12 cores, so when i get into a tight loop, i see 8% CPU utilization in task manager.

Nothing changed on the network side, but did you perhaps 'forget' an identity or tear an older network down? If you look at the file in the logs you sent named ziti-tunneler.log.202306110000.log, on lines 20-22 you'll see:

[2023-06-11T20:49:14.653Z]    INFO ziti-edge-tunnel:ziti-edge-tunnel.c:1093 load_identities() loading identity file: b5.json
[2023-06-11T20:49:14.653Z]    INFO ziti-edge-tunnel:ziti-edge-tunnel.c:1093 load_identities() loading identity file: k..id.json
[2023-06-11T20:49:14.653Z]    INFO ziti-edge-tunnel:ziti-edge-tunnel.c:1093 load_identities() loading identity file: K..p.json

are those identities all expected to work properly? It seems (looking at the logs) only one identity is working? Maybe it's some kind of bug on an unused network/improperly removed identity or something like that...

If you expect all three identities to work, let's do this:

  • move all three identities from their location by making a 'backup' folder, and moving ALL the files at C:\Windows\System32\config\systemprofile\AppData\Roaming\NetFoundry into the backup folder. I will often make a folder at C:\Windows\System32\config\systemprofile\AppData\Roaming\NetFoundry\backup and just move them there...
  • restart the ZDEW, confirm things work properly, no identities are shown, memory not growing, etc.
  • Add back the one identity that seems to be working, this one: KelvinWorkLaptop.json
  • restart ZDEW, ,confirm the logs aren't going nuts
  • repeat that process for the other identities.

I expect one of the identities has 'gone bad' and is exposing some kind of bug

@dovholuknf dovholuknf reopened this Jun 15, 2023
@gooseleggs
Copy link
Author

Thanks. Yes it was pegging the CPU on a core. It was the 'KelvinWorkLaptop.json' that was causing the problem. I noticed that I had an identity with a long name - like GUID which was my original identity when starting to play around with Ziti. That went in, but had no services, then I found that my certs had expired on my main overlay network. Anyway, so the issue here was a bad identity. I have not deep dived further into the bad identity as my own overlay down is more important!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@gooseleggs @dovholuknf