argocd diff shows no diff when secret key deleted

[lcc3108]

Checklist:

• I've searched in the docs and FAQ for my answer: https://bit.ly/argocd-faq.
• I've included steps to reproduce the bug.
• I've pasted the output of argocd version.

Describe the bug

We manage the secret of the application as argocd.

When I deleted the secret, the diff didn't come up, so I found a problem with the previous version of manifest being applied as it was.

To Reproduce

1. Update github code to show yaml file below

apiVersion: v1
data:
  CACHE_REDIS_PASSWORD: ++++++++
  STATISTIC_POSTGRES_DB: ++++++++
  STATISTIC_POSTGRES_PASSWORD: ++++++++
  STATISTIC_POSTGRES_USER: ++++++++
kind: Secret
metadata:
  name: statistic-consumer
type: Opaque

2. Synchronize to argocd

3.Update the contents of CACHE_REDIS_PASSWORD key

Expected behavior
argocd detect diff and remove secret key CACHE_REDIS_PASSWORD
Screenshots
live

desired

but no diff

Version

{
"Version": "v2.8.4+c279299",
"BuildDate": "2023-09-13T19:12:09Z",
"GitCommit": "c27929928104dc37b937764baf65f38b78930e59",
"GitTreeState": "clean",
"GoVersion": "go1.20.6",
"Compiler": "gc",
"Platform": "linux/amd64",
"KustomizeVersion": "v5.1.0 2023-06-19T16:58:18Z",
"HelmVersion": "v3.12.1+gf32a527",
"KubectlVersion": "v0.24.2",
"JsonnetVersion": "v0.20.0"
}

Logs

Paste any relevant application logs here.

[ligol]

We also are encountering this issue on secret and configmap, and can't be sure that our secret are correctly in sync when we deploy if we don't do a destroy and recreate on them. Any information or way to fix this?

Another issue exist for the ConfigMap: #16092

[jsalatiel]

Are you using controller.diff.server.side: "true" ?

[ligol]

No we aren't, we are going to try and validate if it fix the issue for us, thanks

[andrii-korotkov-verkada]

ArgoCD versions 2.10 and below have reached EOL. Can you upgrade and let us know if the issue is still present, please?

[sergeyshevch]

@andrii-korotkov-verkada I see same behaviour in v2.13.2+dc43124 with SSA and Server-Side Diff

At same time if I disable Server Side diff then everything works correctly.