Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Consider removing parquetexporter #27284

Closed
atoulme opened this issue Sep 30, 2023 · 0 comments · Fixed by #27285
Closed

Consider removing parquetexporter #27284

atoulme opened this issue Sep 30, 2023 · 0 comments · Fixed by #27285
Assignees
@atoulme
Labels
chore exporter/parquet

Comments

@atoulme
Copy link
Contributor

atoulme commented Sep 30, 2023

Component(s)

exporter/parquet

Describe the issue you're reporting

I am the original author of the parquetexporter, and I think it needs to be removed.

Apache Parquet is a project defining a columnar data format that allows to work well with big data and S3-type storage.

This exporter was meant to be used to export data to Parquet files, but it's ambiguous how to write those files to S3. The awss3exporter would be a preferred approach to writing data. It is possible an encoder using Parquet will be applied moving forward, allowing easy marshaling and unmarshaling.

As is, the exporter is misleading ; it offers the hope for Parquet support but does little to get it done.

There was work from me on delivering a Parquet schema based off our protobuf schema, but it faltered. It appears the Otel Arrow approach is superior there and we should use this move forward.

In any case, I think it's time to remove this exporter altogether. No work has taken place on it in the last year.
@atoulme atoulme added the needs triage New item requiring triage label Sep 30, 2023
@atoulme atoulme mentioned this issue Sep 30, 2023
Merged
@atoulme atoulme added exporter/parquet and removed needs triage New item requiring triage labels Sep 30, 2023
@atoulme atoulme mentioned this issue Sep 30, 2023
Merged
@crobert-1 crobert-1 mentioned this issue Oct 2, 2023
Merged
@crobert-1 crobert-1 added the chore label Oct 2, 2023
This was referenced Oct 3, 2023
Closed
Open
dmitryax pushed a commit that referenced this issue Oct 11, 2023
@atoulme
[exporter/parquet] remove Parquet exporter (#27285)
e5e0aa0 
**Description:**
Remove the parquet exporter

**Link to tracking Issue:**
Fixes #27284
JaredTan95 pushed a commit to openinsight-proj/opentelemetry-collector-contrib that referenced this issue Oct 18, 2023
@atoulme @JaredTan95
[exporter/parquet] remove Parquet exporter (open-telemetry#27285)
d72f20f 
**Description:**
Remove the parquet exporter

**Link to tracking Issue:**
Fixes open-telemetry#27284
jmsnll pushed a commit to jmsnll/opentelemetry-collector-contrib that referenced this issue Nov 12, 2023
@atoulme @jmsnll
[exporter/parquet] remove Parquet exporter (open-telemetry#27285)
5d63b22 
**Description:**
Remove the parquet exporter

**Link to tracking Issue:**
Fixes open-telemetry#27284
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@atoulme atoulme

Labels
chore exporter/parquet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[exporter/parquet] remove Parquet exporter atoulme/opentelemetry-collector-contrib
2 participants
@atoulme @crobert-1