[BUG] -D365 On Premise - DiagnosticStore logs filling up disk space in no time #1488
Comments
|
Attached complete log file for analysis if needed. This is one of the logs generated when log files grow very rapidly. |
|
@GeorgeSasDK can you confirm if you also had a certificate rollover right before you started to notice this issue? |
|
No changes on the SSL's neither before or after the issue started. Issue started when we upgraded Service Fabric from version 9.xx to the latest. |
|
And as stated , after a new D365 deployment everything can be fine for a day or two then the log files start increasing in size dramatically without any changes to the environment. |
|
hello, |
|
I can't find information about this last release |
|
I guess I will update my Sandbox in this week and check it out , if no issues , I will upgrade PROD next week. |
|
it's fine for me on production with the latest version ! |
Describe the bug
After upgrading to version 10.1.1541.9590 my DiagnosticStore fabric db_fabric_traces logs will fill my hard disk very fast with big log files generated every few seconds.
DiagnosticStore it is located on a UNC Share , not locally on AOS servers.
\Servername\SHARE\DiagnosticStore.
C:\Shares\DiagnosticsStore\fabriclogs-be9e9021-5451-4919-9eb5-ca2b585994c3\ax7aos1\Fabric
Area/Component:
monitoring
To Reproduce
Steps to reproduce the behavior:
Upgrade service fabric to 10.1.1541.9590 , deploy a package and wait a few days. Issue does not appear instantly after upgrade.
After AOS servers reboot , the log files return to normal size for a while and then will start growing again rapidly.
Expected behavior
I would expect log files to be generated as usually.
Observed behavior:
Trace files are filled with this kind of logs :
2024-3-7 07:58:15.170,Informational,6176,716,EntreeServiceProxy.LifeCycle@[5cb2920fd4ccef6d15b596bcb606c629:133540621775094929],/accepted client connection: target=192.168.1.202:59250 total=73/1000/
2024-3-7 07:58:15.170,Informational,1044,6772,Transport.SecurityNegotiationOngoing@1f7f9d79ab0,/negotiation ongoing, queuing message 1a3758b6-ceb8-4a92-bc18-98fea2e57ba2:84828560 in pending queue/
2024-3-7 07:58:15.170,Informational,5156,716,Transport.Activity_Dispatch@243c7aaed40,/1a3758b6-ceb8-4a92-bc18-98fea2e57ba2:84828570 False 1 286B NamingGateway:PingRequest 523d907c-7181-41bd-a713-d480ca33d889:0 lastDispatchDuration = 0ms/
2024-3-7 07:58:15.170,Informational,6176,716,Security.ClientRequestOperation,/ClientRequestOperation : ConnectionId:243c7aaed40, MessageId:1a3758b6-ceb8-4a92-bc18-98fea2e57ba2:84828570, Actor:NamingGateway, Action:PingRequest, Details:/
2024-3-7 07:58:15.170,Informational,6176,716,Security.ClientOperationFinished,/ClientOperationFinished : MessageId:1a3758b6-ceb8-4a92-bc18-98fea2e57ba2:84828570, Status:S_OK/
2024-3-7 07:58:15.170,Informational,6176,716,Transport.Enqueue@243c7aaed40,/1a3758b6-ceb8-4a92-bc18-98fea2e57ba2:84828570 True 282B @ qsize 0/0B/
2024-3-7 07:58:15.170,Informational,1676,6772,Transport.ConnectionEstablished@1f7f9d79ab0,/client-192.168.1.202:19000 : socket local name = 192.168.1.202:59250/
2024-3-7 07:58:15.170,Informational,1676,6772,Transport.Connection@1f7f9d79ab0,/FinishSocketInit: local message size limits:(incoming=4294967294/0xfffffffe, outgoing=4469566/0x44333e), TcpNoDelayEnabled = true/
2024-3-7 07:58:15.170,Informational,1676,6772,Transport.Connection@1f7f9d79ab0,/socket default: SO_RCVBUF=131072, SO_SNDBUF=131072/
2024-3-7 07:58:15.170,Informational,1676,6772,Transport.Connection@1f7f9d79ab0,/WSAIoctl(BehaviorId=SIO_SET_COMPATIBILITY_MODE, TargetOsVersion=6020000) returned S_OK/
2024-3-7 07:58:15.170,Informational,1676,6772,Transport.Tcp@1f7f9d79ab0,/enable TCP fast loopback: 0x8007273d/
2024-3-7 07:58:15.170,Informational,1676,6772,Transport.Connection@1f7f9d79ab0,/client-192.168.1.202:19000 enable TCP keep alive: S_OK/
2024-3-7 07:58:15.170,Informational,1676,6772,Transport.ConnectionStateTransit@1f7f9d79ab0,/client-192.168.1.202:19000 Connecting -> Connected, sendDrained=False, receiveDrained=False/
2024-3-7 07:58:15.170,Informational,6424,6772,Transport.Msg_Dispatch@1f7f452b3d0,/1a3758b6-ceb8-4a92-bc18-98fea2e57ba2:84828570 True 1 282B lastDispatchDuration = 0ms/
2024-3-7 07:58:15.170,Informational,6424,6772,Client.ClientConnectionManager@c676ca24-9fbf-4326-a99f-908733f534c7,/523d907c-7181-41bd-a713-d480ca33d889:0: connected to target=192.168.1.202:19000 gateway=[ address=192.168.1.202:19000 nodeInstance=5cb2920fd4ccef6d15b596bcb606c629:133540621775094929 nodeName=ax7aos3 ] priority=Normal/
2024-3-7 07:58:15.170,Informational,6424,6772,Client.FabricClient@c676ca24-9fbf-4326-a99f-908733f534c7,/Connected: 192.168.1.202:19000 ([ address=192.168.1.202:19000 nodeInstance=5cb2920fd4ccef6d15b596bcb606c629:133540621775094929 nodeName=ax7aos3 ])/
2024-3-7 07:58:15.170,Informational,6424,6772,Client.ServiceNotificationClient@c676ca24-9fbf-4326-a99f-908733f534c7,/e237a8ac-3ad0-4efa-ab90-af6b5bfb9376:0: gateway connected event: [ address=192.168.1.202:19000 nodeInstance=5cb2920fd4ccef6d15b596bcb606c629:133540621775094929 nodeName=ax7aos3 ]/
2024-3-7 07:58:15.170,Informational,6424,6772,Client.ServiceNotificationClient@c676ca24-9fbf-4326-a99f-908733f534c7,/e237a8ac-3ad0-4efa-ab90-af6b5bfb9376:0: collecting synchronization filters/
2024-3-7 07:58:15.170,Informational,6424,6772,Client.ServiceNotificationClient@c676ca24-9fbf-4326-a99f-908733f534c7,/e237a8ac-3ad0-4efa-ab90-af6b5bfb9376:0: connecting to target gateway [ address=192.168.1.202:19000 nodeInstance=5cb2920fd4ccef6d15b596bcb606c629:133540621775094929 nodeName=ax7aos3 ] with: filters=(1 2 3) gen=132223980608663823:b029d77a9a4887624dcf39c19642717e vers=[ [1, 17332) ] priority=High/
2024-3-7 07:58:15.170,Informational,6424,6772,Transport.SecurityNegotiationOngoing@1f7f9d79ab0,/negotiation ongoing, queuing message 1a3758b6-ceb8-4a92-bc18-98fea2e57ba2:84828577 in pending queue/
2024-3-7 07:58:15.170,Informational,5156,716,Transport.TcpRecvBuf@243c96d8020,/SecurityProviderMask in first frame header: 1, firstFrameHeader_ = 'frameLength=0x107,spMask=0xSSL,fhFlags=0x0,fhCRC=0x87,mhLength=0x62,fbCRC=0x1f0cb9e1'/
2024-3-7 07:58:15.170,Informational,5156,716,Transport.SecurityContext@243c96d8020,/TryGetIncomingSecurityNegotiationHeader: SecurityNegotiationHeader(framingProtectionEnabled_=true, listenInstance_=/0/00000000-0000-0000-0000-000000000000/true/0x1, maxIncomingFrameSize_=4294967294/0xfffffffe) found on first incoming message 1a3758b6-ceb8-4a92-bc18-98fea2e57ba2:84828573/
2024-3-7 07:58:15.170,Informational,5156,716,Transport.Connection@243c96d8020,/OnRemoteFrameSizeLimit: message size limits: remoteIncoming=4294967294/0xfffffffe, localOutgoing=4469566/0x44333e/
2024-3-7 07:58:15.170,Informational,5156,716,Transport.Connection@243c96d8020,/updating outgoing message size limit according to remote incoming: 4469566/0x44333e -> 4294967294/0xfffffffe/
2024-3-7 07:58:15.170,Informational,5156,716,Transport.SendTarget@243cb84e240-5cb2920fd4ccef6d15b596bcb606c629:133540621775094929,/SetMaxOutgoingMessageSize: 4469566/0x44333e -> 4294967294/0xfffffffe/
2024-3-7 07:58:15.170,Informational,5156,716,Transport.SecurityContext@243c96d8020,/FramingProtectionEnabled set true/
2024-3-7 07:58:15.170,Informational,5156,716,Transport.SecurityNegotiationDispatch@243c96d8020,/dispatch 1a3758b6-ceb8-4a92-bc18-98fea2e57ba2:84828573 False actor=SecurityContext/
2024-3-7 07:58:15.170,Informational,5156,716,Transport.SecurityNegotiationStatus@243c96d8020,/SSL: target=, status=0x90312/
2024-3-7 07:58:15.170,Informational,5156,716,Transport.SecurityContext@243c96d8020,/Add SecurityNegotiationHeader(framingProtectionEnabled_=false, listenInstance_=192.168.1.202:19000/0/2a431b78-25b8-4668-924b-ce1098172148/true/0x1, maxIncomingFrameSize_=4469566/0x44333e) to message 99c3ca34-1fbc-41e2-8347-eca52cc815c5:94920249/
2024-3-7 07:58:15.170,Informational,5156,716,Transport.Enqueue@243c96d8020,/99c3ca34-1fbc-41e2-8347-eca52cc815c5:94920249 False 311B @ qsize 0/0B/
2024-3-7 07:58:15.170,Informational,7564,6772,Transport.TcpRecvBuf@1f7f9d79ab0,/SecurityProviderMask in first frame header: 1, firstFrameHeader_ = 'frameLength=0x143,spMask=0xSSL,fhFlags=0x0,fhCRC=0x4,mhLength=0xaa,fbCRC=0x51162dfa'/
2024-3-7 07:58:15.170,Informational,7564,6772,Transport.SecurityContext@1f7f9d79ab0,/TryGetIncomingSecurityNegotiationHeader: SecurityNegotiationHeader(framingProtectionEnabled_=false, listenInstance_=192.168.1.202:19000/0/2a431b78-25b8-4668-924b-ce1098172148/true/0x1, maxIncomingFrameSize_=4469566/0x44333e) found on first incoming message 99c3ca34-1fbc-41e2-8347-eca52cc815c5:94920249/
2024-3-7 07:58:15.170,Informational,7564,6772,Transport.Connection@1f7f9d79ab0,/OnRemoteFrameSizeLimit: message size limits: remoteIncoming=4469566/0x44333e, localOutgoing=4469566/0x44333e/
2024-3-7 07:58:15.170,Informational,7564,6772,Transport.SecurityContext@1f7f9d79ab0,/TryGetIncomingSecurityNegotiationHeader: FramingProtectionEnabled=false on remote side, inbound_ = false, SecurityProvider = SSL/
2024-3-7 07:58:15.170,Informational,7564,6772,Transport.SecurityNegotiationDispatch@1f7f9d79ab0,/dispatch 99c3ca34-1fbc-41e2-8347-eca52cc815c5:94920249 False actor=SecurityContext/
2024-3-7 07:58:15.170,Informational,7564,6772,Transport.SecurityContext@1f7f9d79ab0,/ServerAuthHeader received: willSendConnectionAuthStatus=true,metadata=none/
2024-3-7 07:58:15.170,Informational,7564,6772,Transport.SecurityContextSsl@1f7f9d79ab0,/skipping client auth header: SSL/
2024-3-7 07:58:15.170,Informational,7564,6772,Transport.SecurityNegotiationStatus@1f7f9d79ab0,/SSL: target=, status=0x0/
2024-3-7 07:58:15.170,Informational,7564,6772,Transport.SecurityNegotiationSucceeded@1f7f9d79ab0,/SSL: target=, package=, capabilities=0, contextExpiration:2031-02-16 08:02:34.000/
2024-3-7 07:58:15.170,Informational,7564,6772,Transport.SecurityContextSsl@1f7f9d79ab0,/decryptionInputMergeBuffer_ set to 16413 bytes/
2024-3-7 07:58:15.171,Informational,7564,6772,Transport.SecurityContext@1f7f9d79ab0,/session will expire in 1:0:02:19.479/
2024-3-7 07:58:15.171,Informational,7564,6772,Transport.SecurityContextSsl@1f7f9d79ab0,/VerifyCertificate: remoteAuthenticatedAsPeer = false, incoming: tp='da7a37cb3ce078ae896f71887f190bc4ecd06db8', against: certThumbprintsToMatch='da7a37cb3ce078ae896f71887f190bc4ecd06db8', x509NamesToMatch='', certChainFlags=0x40000000, maskedFlags=0x40000000 shouldIgnoreCrlOffline=true shouldAcceptExpiredCert=false/
2024-3-7 07:58:15.171,Informational,7564,6772,Transport.SecurityContextSsl@1f7f9d79ab0,/usage: 1.3.6.1.5.5.7.3.2, cert chain trust status: info = 100, error = 0, chainSize = 2, SelfSigned = false/
2024-3-7 07:58:15.171,Informational,7564,6772,Transport.SecurityContextSsl@1f7f9d79ab0,/incoming cert: thumbprint = da7a37cb3ce078ae896f71887f190bc4ecd06db8, subject='CN=.fleggaard.com', issuer='DC=com, DC=fleggaard, CN=Fleggaard', issuerCertThumbprint=91c6b5dcdbc8848420dc59f4f63135968a1ae4f1, NotBefore=2022-09-28 08:41:29.000, NotAfter=2031-02-16 08:02:34.000/
2024-3-7 07:58:15.171,Informational,7564,6772,Transport.SecurityContextSsl@1f7f9d79ab0,/incoming cert thumbprint da7a37cb3ce078ae896f71887f190bc4ecd06db8 matched, CertChainShouldBeVerified=false, shouldAcceptExpiredPinnedCert=false, certChainErrorStatus=0x0/
2024-3-7 07:58:15.171,Informational,7564,6772,General.CrlOfflineErrCache,/remove da7a37cb3ce078ae896f71887f190bc4ecd06db8, certChainFlagsUsed = 40000000, CrlCheckingEnabled = true/
2024-3-7 07:58:15.171,Informational,7564,6772,Transport.SecurityContextSsl@1f7f9d79ab0,/cert auth completed: IsClientRoleInEffect = false, RoleMask = All/
2024-3-7 07:58:15.171,Informational,7564,6772,Transport.SecurityNegotiationSend@1f7f9d79ab0,/sending negotiation message 1a3758b6-ceb8-4a92-bc18-98fea2e57ba2:84828579/
2024-3-7 07:58:15.171,Informational,7564,6772,Transport.Enqueue@1f7f9d79ab0,/1a3758b6-ceb8-4a92-bc18-98fea2e57ba2:84828579 False 107B @ qsize 0/0B/
2024-3-7 07:58:15.171,Informational,7564,6772,Transport.SecurityContext@1f7f9d79ab0,/ShouldWaitForConnectionAuthStatus: IsClientOnly = true, remotePromisedToSendConnectionAuthStatus_ = true, shouldWait = true/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.SecurityNegotiationDispatch@243c96d8020,/dispatch 1a3758b6-ceb8-4a92-bc18-98fea2e57ba2:84828579 False actor=SecurityContext/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.SecurityNegotiationStatus@243c96d8020,/SSL: target=, status=0x0/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.SecurityNegotiationSucceeded@243c96d8020,/SSL: target=, package=, capabilities=0, contextExpiration:2031-02-16 08:02:34.000/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.SecurityContextSsl@243c96d8020,/decryptionInputMergeBuffer_ set to 16413 bytes/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.SecurityContext@243c96d8020,/session will expire in 1:0:04:14.890/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.SecurityContextSsl@243c96d8020,/VerifyCertificate: remoteAuthenticatedAsPeer = false, incoming: tp='da7a37cb3ce078ae896f71887f190bc4ecd06db8', against: certThumbprintsToMatch='da7a37cb3ce078ae896f71887f190bc4ecd06db8,db5923d2e130d42a846f6f27dc28f8d7d4573e4f', x509NamesToMatch='', certChainFlags=0x40000000, maskedFlags=0x40000000 shouldIgnoreCrlOffline=true shouldAcceptExpiredCert=false/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.SecurityContextSsl@243c96d8020,/usage: 1.3.6.1.5.5.7.3.2, cert chain trust status: info = 100, error = 0, chainSize = 2, SelfSigned = false/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.SecurityContextSsl@243c96d8020,/incoming cert: thumbprint = da7a37cb3ce078ae896f71887f190bc4ecd06db8, subject='CN=.fleggaard.com', issuer='DC=com, DC=fleggaard, CN=Fleggaard', issuerCertThumbprint=91c6b5dcdbc8848420dc59f4f63135968a1ae4f1, NotBefore=2022-09-28 08:41:29.000, NotAfter=2031-02-16 08:02:34.000/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.SecurityContextSsl@243c96d8020,/incoming cert thumbprint da7a37cb3ce078ae896f71887f190bc4ecd06db8 matched, CertChainShouldBeVerified=false, shouldAcceptExpiredPinnedCert=false, certChainErrorStatus=0x0/
2024-3-7 07:58:15.171,Informational,1708,716,General.CrlOfflineErrCache,/remove da7a37cb3ce078ae896f71887f190bc4ecd06db8, certChainFlagsUsed = 40000000, CrlCheckingEnabled = true/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.SecurityContextSsl@243c96d8020,/VerifyCertificate: remoteAuthenticatedAsPeer = false, incoming: tp='da7a37cb3ce078ae896f71887f190bc4ecd06db8', against: certThumbprintsToMatch='', x509NamesToMatch='', certChainFlags=0x40000000, maskedFlags=0x40000000 shouldIgnoreCrlOffline=true shouldAcceptExpiredCert=false/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.SecurityContextSsl@243c96d8020,/VerifyCertificate: remoteAuthenticatedAsPeer = false, incoming: tp='da7a37cb3ce078ae896f71887f190bc4ecd06db8', against: certThumbprintsToMatch='da7a37cb3ce078ae896f71887f190bc4ecd06db8,db5923d2e130d42a846f6f27dc28f8d7d4573e4f', x509NamesToMatch='', certChainFlags=0x40000000, maskedFlags=0x40000000 shouldIgnoreCrlOffline=true shouldAcceptExpiredCert=false/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.SecurityContextSsl@243c96d8020,/usage: 1.3.6.1.5.5.7.3.2, cert chain trust status: info = 100, error = 0, chainSize = 2, SelfSigned = false/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.SecurityContextSsl@243c96d8020,/incoming cert thumbprint da7a37cb3ce078ae896f71887f190bc4ecd06db8 matched, CertChainShouldBeVerified=false, shouldAcceptExpiredPinnedCert=false, certChainErrorStatus=0x0/
2024-3-7 07:58:15.171,Informational,1708,716,General.CrlOfflineErrCache,/remove da7a37cb3ce078ae896f71887f190bc4ecd06db8, certChainFlagsUsed = 40000000, CrlCheckingEnabled = true/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.SecurityContextSsl@243c96d8020,/cert auth completed: IsClientRoleInEffect = true, RoleMask = Admin/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.SecurityContext@243c96d8020,/connection auth status message created: S_OK:, role granted: Admin/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.SecurityContext@243c96d8020,/Add SecurityNegotiationHeader(framingProtectionEnabled_=false, listenInstance_=192.168.1.202:19000/0/2a431b78-25b8-4668-924b-ce1098172148/true/0x1, maxIncomingFrameSize_=4469566/0x44333e) to message 99c3ca34-1fbc-41e2-8347-eca52cc815c5:94920251/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.Enqueue@243c96d8020,/99c3ca34-1fbc-41e2-8347-eca52cc815c5:94920251 False 231B @ qsize 0/0B/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.SecurityContext@243c96d8020,/ShouldWaitForConnectionAuthStatus: IsClientOnly = false, remotePromisedToSendConnectionAuthStatus_ = false, shouldWait = false/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.Enqueue@243c96d8020,/99c3ca34-1fbc-41e2-8347-eca52cc815c5:94920244 False 146B @ qsize 1/243B/
2024-3-7 07:58:15.171,Informational,1708,716,Security.ClientConnect,/ClientConnect : ConnectionId:243c96d8020, ServerName:EntreeServiceProxy, LocalAddress:192.168.1.202:19000, ConnectionType:TCP, CredentialType:SSL, ClientAddress:192.168.1.202:59250, AuthStatus:Success, RoleGranted:Admin, ClientCredentialIdentifier:da7a37cb3ce078ae896f71887f190bc4ecd06db8/
2024-3-7 07:58:15.171,Informational,1044,6772,Transport.SecurityContext@1f7f9d79ab0,/CheckVerificationHeaders: SecurityNegotiationHeader(framingProtectionEnabled_=false, listenInstance_=192.168.1.202:19000/0/2a431b78-25b8-4668-924b-ce1098172148/true/0x1, maxIncomingFrameSize_=4469566/0x44333e) found on first secured incoming message 99c3ca34-1fbc-41e2-8347-eca52cc815c5:94920251/
2024-3-7 07:58:15.171,Informational,1044,6772,Transport.SecurityContext@1f7f9d79ab0,/CheckVerificationHeaders: SecurityNegotiationHeader: matchedPreviouslyReceived = true/
2024-3-7 07:58:15.171,Informational,1044,6772,Transport.Msg_Dispatch@1f7f9d79ab0,/99c3ca34-1fbc-41e2-8347-eca52cc815c5:94920251 False 1 231B lastDispatchDuration = 0ms/
2024-3-7 07:58:15.171,Informational,1044,6772,Transport.SendTarget@1f7f4161280-c676ca24-9fbf-4326-a99f-908733f534c7,/-192.168.1.202:19000: received ConnectionAuth message 99c3ca34-1fbc-41e2-8347-eca52cc815c5:94920251 for connection 1f7f9d79ab0/
2024-3-7 07:58:15.171,Informational,1044,6772,Transport.Connection@1f7f9d79ab0,/disable outgoing message size limit as this connection is granted admin role on server side/
2024-3-7 07:58:15.171,Informational,1044,6772,Transport.SendTarget@1f7f4161280-c676ca24-9fbf-4326-a99f-908733f534c7,/SetMaxOutgoingMessageSize: 4469566/0x44333e -> 4294967295/0xffffffff/
2024-3-7 07:58:15.171,Informational,1044,6772,Transport.Connection@1f7f9d79ab0,/outgoing message size limit disabled/
2024-3-7 07:58:15.171,Informational,1044,6772,Transport.SecurityContext@1f7f9d79ab0,/Add SecurityNegotiationHeader(framingProtectionEnabled_=true, listenInstance_=/0/00000000-0000-0000-0000-000000000000/true/0x1, maxIncomingFrameSize_=4294967294/0xfffffffe) to message 1a3758b6-ceb8-4a92-bc18-98fea2e57ba2:84828569/
2024-3-7 07:58:15.171,Informational,1044,6772,Transport.Enqueue@1f7f9d79ab0,/1a3758b6-ceb8-4a92-bc18-98fea2e57ba2:84828569 False 133B @ qsize 0/0B/
2024-3-7 07:58:15.171,Informational,1044,6772,Transport.Enqueue@1f7f9d79ab0,/1a3758b6-ceb8-4a92-bc18-98fea2e57ba2:84828571 False 932B @ qsize 1/145B/
2024-3-7 07:58:15.171,Informational,1044,6772,Transport.Enqueue@1f7f9d79ab0,/1a3758b6-ceb8-4a92-bc18-98fea2e57ba2:84828572 False 711B @ qsize 2/1089B/
2024-3-7 07:58:15.171,Informational,1044,6772,Transport.Enqueue@1f7f9d79ab0,/1a3758b6-ceb8-4a92-bc18-98fea2e57ba2:84828560 False 932B @ qsize 3/1812B/
2024-3-7 07:58:15.171,Informational,1044,6772,Transport.Enqueue@1f7f9d79ab0,/1a3758b6-ceb8-4a92-bc18-98fea2e57ba2:84828577 False 932B @ qsize 4/2756B/
2024-3-7 07:58:15.171,Informational,1044,6772,Transport.Msg_Dispatch@1f7f9d79ab0,/99c3ca34-1fbc-41e2-8347-eca52cc815c5:94920244 False 2 146B lastDispatchDuration = 0ms/
2024-3-7 07:58:15.171,Informational,1044,6772,Transport.Connection@1f7f9d79ab0,/SetLocalFrameHeaderFlags 0x1 BodyCRCTypeCRC32C/
2024-3-7 07:58:15.171,Informational,1044,6772,Transport.ConnectionInstanceConfirmed@1f7f9d79ab0,/current instance = 0, confirmed remote ListenInstance = 192.168.1.202:19000/0/2a431b78-25b8-4668-924b-ce1098172148/True/0x1/
2024-3-7 07:58:15.171,Informational,1044,6772,Transport.TargetConnectionsChanged@1f7f4161280-c676ca24-9fbf-4326-a99f-908733f534c7,/-192.168.1.202:19000: anonymous=False, instance=0, 69 connections:
1f7f9d89300: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=4c113705-ce2a-4f6b-8157-d9574e93cf22)
1f7f452b3d0: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=1bb9ee14-60d3-451f-844d-23630811beb6)
1f7f9d73c80: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=d4a6e730-4710-4ece-b515-3dc9927cf580)
1f7f9d74510: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=9d399f6c-2c97-40e4-8584-13e872dd8a8e)
1f7f9d845f0: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=fa445f2c-ee91-460d-80ab-c615821499d6)
1f7f9d70090: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=44b31034-c960-4863-9384-2cb517988193)
1f7f9d7a340: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=3e8edf30-b90f-4f26-bf19-a3ff773a6f5d)
1f7f9d74da0: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=a419b237-9b30-4178-b289-eed3ace65cfa)
1f7f9d7f050: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=37838516-44a6-4ef5-8346-3e5537b61083)
1f7f9d7e7c0: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=bb11e3cf-7d79-4840-8a8e-4d32de27a39f)
1f7f9d7f8e0: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=fe77e04e-01fc-40ef-94d9-223ce82c2f0a)
1f7f9d81290: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=3559c4b2-01b6-4d50-a4f7-032544b23e96)
1f7f9d81b20: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=fd98fdbd-07c0-4423-80b3-ddfd9058b9a6)
1f7f9d72b60: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=7aaef305-1384-4697-a1f0-e2525eb928f0)
1f7f9d7abd0: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=6df31f4f-9c92-4acb-9732-fde931eb4fa4)
1f7f9d7b460: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=7ebdbdd6-4fdf-4d83-bfd0-1083b5fcf799)
1f7f9d88a70: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=19f84f48-28f7-4fb5-8ed2-ced4ad1427c1)
1f7f9d75630: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=4a5f8ed4-cf6d-47d3-8c9e-d1488d6cfd11)
1f7f9d82c40: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=7e7f111c-693a-47a9-8df2-4b0f120d9356)
1f7f9d834d0: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=13943eff-8bc6-429e-934a-a45bc7fe0819)
1f7f9d7d6a0: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=f86b2216-0da1-4eb4-87fd-e6c47ca0b0bd)
1f7f9d8a420: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=d545275b-0580-4340-bc1b-90cfe95a24eb)
1f7f9d84e80: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=b0883e75-b8af-4f2e-ba2f-5f93b10f21a0)
1f7f9d7ce10: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=fbb581bb-f0a5-4de8-8283-a6e4d4596a18)
1f7f9d87950: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=9152c537-8761-42df-8d8e-ea8bf1bf47fc)
1f7f9d86830: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=61b4b3bc-24f4-4015-9193-44627567d3fa)
1f7f9d881e0: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=1a3c95a2-7948-4131-8ff2-86fbbebf71ca)
1f7f9d8b540: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=a4da681b-c213-4d92-9ddd-bf019edce3c7)
1f7f9d89b90: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=6738ff8b-68bc-4c31-a5ad-53c5717ff461)
1f7f9d7bcf0: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=52bc6440-77d7-410f-8564-8bceb5ca7d5a)
1f7f9d85fa0: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=04cfe214-0caa-494e-a9be-3f0e235d6eb6)
1f7f9d8c660: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=3b379671-1fad-4f6a-909a-531fdbe69651)
1f7f9d993e0: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=d6be179f-3edb-48a2-a184-027928d52676)
1f7f9d9a500: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=bd560f98-5a7f-44ef-8eb1-9afe0461e7c7)
1f7f9d92490: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=a1ce0b46-ecc8-43ab-8dc5-329b07ed12af)
1f7f9d96080: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=5388823a-5a05-43b5-b963-980d6787e421)
1f7f9d9ad90: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=2810ddfd-0726-4cc7-8933-0481a1485898)
1f7f9d93e40: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=99392448-112b-42b9-a961-c2444f605cc5)
1f7f9d982c0: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=ef0e7e28-9e45-410f-b5e8-880ccac5d707)
1f7f9d97a30: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=8451234e-20e0-45b9-81de-80dac9545253)
1f7f9d96910: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=b44419b6-355f-4003-a2d6-7c1a7991ab6d)
1f7f9d98b50: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=e20d5eed-1470-4fc5-98b3-774484b29e19)
1f7f9d946d0: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=6c27989c-1d61-458e-8122-88e8e36e8f7b)
1f7f9d99c70: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=4eba5d2b-b2e7-46ec-9840-a2dcb40b4ccb)
1f7f9d92d20: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=07b70889-702c-4f86-9136-57265d02c089)
1f7f9d935b0: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=e85eaa89-9e42-41dd-933d-d7e929315eca)
1f7f9d9b620: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=a4be5b19-989c-46f8-8cca-45591f15a54e)
1f7f9d971a0: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=e9e0d723-84af-4145-b7b3-811ca20693f0)
1f7f9d7c580: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=097e2830-a7d9-4ff7-b9e1-5e8b95d8434e)
1f7f9d75ec0: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=dc57342a-27d6-44c6-829a-9f0dcc430f28)
1f7f9d76750: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=d94c1e4c-95fc-47f4-b6b5-9c6f5aee7298)
1f7f9d76fe0: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=7d93bdc6-cd36-4f98-8324-2d70b2e8a21e)
1f7f9d70920: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=a979a56c-61e6-40eb-b3e3-a5b20f7c6922)
1f7f9d722d0: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=9956318b-860c-4d9d-aeb0-6d3dee3f46ec)
1f7f9d78990: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=07935595-bd1a-46b7-8daa-ada796789845)
1f7f9d77870: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=88049768-b011-4aa1-b804-887edd63192a)
1f7f9d71a40: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=35322777-6e5d-47ef-b480-d580604693d8)
1f7f9d78100: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=effb6e90-fe09-420f-8379-473e2170bf32)
1f7f9d733f0: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=bfe031ab-1014-4644-88b8-79365a9a2aba)
1f7f9d85710: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=7134647c-7feb-4f50-9ff5-593ef90d82a8)
1f7f9d711b0: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=234a3586-5cd9-43b0-9b71-fb4f913e5e2a)
1f7f9d83d60: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=98fc7ffa-3f1c-407e-a882-dc7e16647234)
1f7f9d7df30: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=0918428b-e32b-466d-8924-b1aafda25dca)
1f7f9d870c0: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=2c2b9d44-cac3-4ef0-80b1-cb746d8f4aad)
1f7f9d80170: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=78eca989-329c-4c1b-ac92-cd6c2571d1cd)
1f7f9d79220: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=425f32b7-a4dd-40b9-b976-3e2c6b3751f0)
1f7f9d823b0: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=80b4f07f-61fd-472a-870a-d8b9af0c17ba)
1f7f9d80a00: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=c75f18ef-e7a9-4c12-8de7-d8189a7da8f6)
1f7f9d79ab0: (client-192.168.1.202:19000, Passive=false, Instance=0, Confirmed=true, Nonce=2a431b78-25b8-4668-924b-ce1098172148)
/
2024-3-7 07:58:15.171,Informational,1044,6772,Transport.SendTarget@1f7f4161280-c676ca24-9fbf-4326-a99f-908733f534c7,/-192.168.1.202:19000: found 69 confirmed connections, greater than 2/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.SecurityContext@243c96d8020,/CheckVerificationHeaders: SecurityNegotiationHeader(framingProtectionEnabled_=true, listenInstance_=/0/00000000-0000-0000-0000-000000000000/true/0x1, maxIncomingFrameSize_=4294967294/0xfffffffe) found on first secured incoming message 1a3758b6-ceb8-4a92-bc18-98fea2e57ba2:84828569/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.SecurityContext@243c96d8020,/CheckVerificationHeaders: SecurityNegotiationHeader: matchedPreviouslyReceived = true/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.Msg_Dispatch@243c96d8020,/1a3758b6-ceb8-4a92-bc18-98fea2e57ba2:84828569 False 1 173B lastDispatchDuration = 0ms/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.Connection@243c96d8020,/incoming message size limit disabled/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.Connection@243c96d8020,/SetLocalFrameHeaderFlags 0x1 BodyCRCTypeCRC32C/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.ConnectionInstanceConfirmed@243c96d8020,/current instance = 0, confirmed remote ListenInstance = /0/00000000-0000-0000-0000-000000000000/True/0x1/
2024-3-7 07:58:15.171,Informational,1708,716,Transport.TargetConnectionsChanged@243cb84e240-5cb2920fd4ccef6d15b596bcb606c629:133540621775094929,/192.168.1.202:19000-192.168.1.202:59250: anonymous=True, instance=0, 1 connections:
243c96d8020: (192.168.1.202:19000-192.168.1.202:59250, Passive=true, Instance=0, Confirmed=true, Nonce=2a431b78-25b8-4668-924b-ce1098172148)
Screenshots
Huge Log files.
Normal log files.
Service Fabric Runtime Version:
10.1.1541.9590
Environment:
Windows Server 2019 Standard on both Sandbox and Production
D365 on Service Fabric 10.1.1541.9590 OnPremise Installation.
I do not have same issue on Sanbox , but this might be because sandbox uses local DiagnosticStore instead of UNC Share.
If this is a regression, which version did it regress from?
Additional context
Please see my complete description here :
https://community.dynamics.com/forums/thread/details/?threadid=b3dda268-5adc-ee11-904d-000d3a8b3756
Assignees: /cc @microsoft/service-fabric-triage
The text was updated successfully, but these errors were encountered: