Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CSV button not showing up #91

Open
grrigore opened this issue May 9, 2021 · 2 comments
Open

CSV button not showing up #91

grrigore opened this issue May 9, 2021 · 2 comments

Comments

@grrigore
Copy link

grrigore commented May 9, 2021

I've used hydrator in order to get some tweets. I am not at 3,704,430 tweets hydrated (the .jsonl file is 11.5 GB) and I've decided to stop so I hit the stop button. I've done some tests with smaller datasets and after stopping the process the CSV button would show up. However, not it's not. Is it still working on the CSV? I've noticed that I can press start again so I guess the app is still working ok.

How can I tell if the CSV is generating? Will the button show up? Is there a way to manually start the conversion process?

@edsu
Copy link
Member

edsu commented May 9, 2021

Actually the csv button only shows up after the hydration is finished. But I agree that it would be useful for it to be available whenever hydration is stopped. If you want you can use another tool like json2csv utility to convert it:

https://github.com/DocNow/twarc/blob/main/utils/json2csv.py

@edsu
Copy link
Member

edsu commented May 20, 2021

I'm going to reopen this because I think you are right that this would be a good feature to have.

@edsu edsu reopened this May 20, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants