Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

documentation for transforming exported ndjson to parquet with spark #3372

Closed
lmsurpre opened this issue Feb 21, 2022 · 1 comment
Closed

documentation for transforming exported ndjson to parquet with spark #3372

lmsurpre opened this issue Feb 21, 2022 · 1 comment
Assignees
@lmsurpre
Labels
documentation Improvements or additions to documentation

Comments

@lmsurpre
Copy link
Member

I think we should remove this feature and replace it with documentation that clearly shows how to convert the exported NDJSON to Parquet using spark (maybe a blog post?)

this piece of it is not done yet and I think we should do it either for this one or in a new related task

Originally posted by @lmsurpre in #3156 (comment)
@lmsurpre lmsurpre added the documentation Improvements or additions to documentation label Feb 21, 2022
@prb112 prb112 changed the title documentation for transformating exporeted ndjson to parquest with spark documentation for transformating exported ndjson to parquest with spark Feb 21, 2022
@lmsurpre lmsurpre changed the title documentation for transformating exported ndjson to parquest with spark documentation for transforming exported ndjson to parquest with spark Mar 1, 2022
@lmsurpre lmsurpre self-assigned this Mar 14, 2022
lmsurpre added a commit that referenced this issue May 10, 2022
@lmsurpre
issue #3372 - document transforming ndjson export to parquet
bd0eb3f 
Signed-off-by: Lee Surprenant <[email protected]>
lmsurpre added a commit that referenced this issue May 10, 2022
@lmsurpre
issue #3372 - document transforming ndjson export to parquet
cd52bb8 
Signed-off-by: Lee Surprenant <[email protected]>
@lmsurpre lmsurpre changed the title documentation for transforming exported ndjson to parquest with spark documentation for transforming exported ndjson to parquet with spark May 10, 2022
lmsurpre added a commit that referenced this issue May 10, 2022
@lmsurpre
issue #3372 - document transforming ndjson export to parquet
0cc7e3e 
Signed-off-by: Lee Surprenant <[email protected]>
lmsurpre added a commit that referenced this issue May 10, 2022
@lmsurpre
issue #3372 - document transforming ndjson export to parquet
8ce83c5 
Signed-off-by: Lee Surprenant <[email protected]>
lmsurpre added a commit that referenced this issue May 10, 2022
@lmsurpre
fixup! issue #3372 - document transforming ndjson export to parquet
0d86598
lmsurpre added a commit that referenced this issue May 10, 2022
@lmsurpre
issue #3372 - document transforming ndjson export to parquet
ceaccd8 
Signed-off-by: Lee Surprenant <[email protected]>
lmsurpre added a commit that referenced this issue May 11, 2022
@lmsurpre
issue #3372 - document transforming ndjson export to parquet
3514ba0 
Signed-off-by: Lee Surprenant <[email protected]>
lmsurpre added a commit that referenced this issue May 11, 2022
@lmsurpre
Merge pull request #3626 from IBM/lee-main
79b4c64 
issue #3372 - document transforming ndjson export to parquet
@punktilious
Copy link
Collaborator

I read through the post again and it seems reasonable. I think this one should be OK to just close.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@lmsurpre lmsurpre

Labels
documentation Improvements or additions to documentation
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@lmsurpre @punktilious