Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[helm deployment] GDPR export by newly created user takes too long - probably generating doesn't finish #6168

Closed
Tracked by #6230
saw-jan opened this issue Apr 27, 2023 · 9 comments
Assignees
Labels
Priority:p2-high Escalation, on top of current planning, release blocker Type:Bug Type:Discussion

Comments

@saw-jan
Copy link
Member

saw-jan commented Apr 27, 2023

Trying GDPR export by a fresh created user, report generation won't finish even after waiting significant time.

URL: https://ocis.kube.test/remote.php/dav/spaces/78d220ff-d7cf-4d68-8ef5-89e3e9365585%24c8503329-8731-4900-ba71-176b54113f92/.personal_data_export.json
Method: PROPFIND
Status: 200
<d:multistatus
	xmlns:s="http://sabredav.org/ns"
	xmlns:d="DAV:"
	xmlns:oc="http://owncloud.org/ns">
	<d:response>
		<d:href>/remote.php/dav/spaces/78d220ff-d7cf-4d68-8ef5-89e3e9365585$c8503329-8731-4900-ba71-176b54113f92/.personal_data_export.json</d:href>
		<d:propstat>
			<d:prop>
				<oc:permissions>RDNVWZ</oc:permissions>
				<oc:favorite>0</oc:favorite>
				<oc:fileid>78d220ff-d7cf-4d68-8ef5-89e3e9365585$c8503329-8731-4900-ba71-176b54113f92!3f9ee3cf-f998-4fe5-975e-d9424a8b8091</oc:fileid>
				<oc:file-parent>78d220ff-d7cf-4d68-8ef5-89e3e9365585$c8503329-8731-4900-ba71-176b54113f92!c8503329-8731-4900-ba71-176b54113f92</oc:file-parent>
				<oc:name>.personal_data_export.json</oc:name>
				<oc:owner-id>demo</oc:owner-id>
				<oc:owner-display-name>demo</oc:owner-display-name>
				<oc:privatelink>https://ocis.kube.test/f/78d220ff-d7cf-4d68-8ef5-89e3e9365585$c8503329-8731-4900-ba71-176b54113f92%213f9ee3cf-f998-4fe5-975e-d9424a8b8091</oc:privatelink>
				<d:getcontentlength>0</d:getcontentlength>
				<oc:size>0</oc:size>
				<d:getlastmodified>Thu, 27 Apr 2023 11:04:12 GMT</d:getlastmodified>
				<d:getetag>"9b500698d70001e5a4b3ee908dd67ee2"</d:getetag>
				<d:getcontenttype>application/json</d:getcontenttype>
				<d:resourcetype></d:resourcetype>
				<oc:tags></oc:tags>
			</d:prop>
			<d:status>HTTP/1.1 425 TOO EARLY</d:status>
		</d:propstat>
	</d:response>
</d:multistatus>

Screenshot from 2023-04-27 16-59-30

Setup

Deployed via Helm charts: https://doc.owncloud.com/ocis/next/deployment/container/orchestration/orchestration.html#kubernetes-and-helm

oCIS: 3.0.0-rc.1 Community
Minikube: 1.30.1
Kubernetes: 1.26.0
OS: Ubuntu22.04

@ScharfViktor ScharfViktor mentioned this issue Apr 27, 2023
89 tasks
@saw-jan saw-jan changed the title [helm deployment] GDPR export by newly created user takes too long [helm deployment] GDPR export by newly created user takes too long - probably doesn't finish Apr 27, 2023
@saw-jan saw-jan changed the title [helm deployment] GDPR export by newly created user takes too long - probably doesn't finish [helm deployment] GDPR export by newly created user takes too long - probably generating doesn't finish Apr 27, 2023
@micbar
Copy link
Contributor

micbar commented Apr 27, 2023

Did you use the default config?

I don't know if the helm-charts enable ASYNC_POSTPROCESSING by default.

@kobergj what happens if we use the GDPR export with async postprocessing off?

@saw-jan
Copy link
Member Author

saw-jan commented Apr 27, 2023

Did you use the default config?

Yeah, just followed the docs

@kobergj
Copy link
Collaborator

kobergj commented Apr 28, 2023

@kobergj what happens if we use the GDPR export with async postprocessing off?

Good point. That won't work atm. The file will be in 425 state forever

@micbar micbar added the Priority:p2-high Escalation, on top of current planning, release blocker label Apr 28, 2023
@micbar micbar moved this from Qualification to Prio 2 in Infinite Scale Team Board Apr 28, 2023
@micbar
Copy link
Contributor

micbar commented May 2, 2023

needs fix.

@saw-jan
Copy link
Member Author

saw-jan commented May 2, 2023

It works now with the latest helm chart.
What was the fix?

@kobergj
Copy link
Collaborator

kobergj commented May 8, 2023

Latest helmchart has async uploads enabled. It only fails when async uploads are disabled.

@saw-jan
Copy link
Member Author

saw-jan commented May 8, 2023

Latest helmchart has async uploads enabled. It only fails when async uploads are disabled.

So, can it be closed?

@micbar
Copy link
Contributor

micbar commented May 8, 2023

we should be safe that the feature also works for instances with postprocessing disabled.

@kobergj kobergj self-assigned this May 8, 2023
@kobergj
Copy link
Collaborator

kobergj commented May 9, 2023

Seems there was a different issue. I can't reproduce on current master, even with Async Postprocessing disabled.

Should we investigate why it didn't work before?

@kobergj kobergj closed this as completed May 9, 2023
@kobergj kobergj moved this from Prio 2 to Done in Infinite Scale Team Board May 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Priority:p2-high Escalation, on top of current planning, release blocker Type:Bug Type:Discussion
Projects
Archived in project
Development

No branches or pull requests

3 participants