Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: org.apache.arrow dependency introduced unsupported SLF4J 2 #30304

Closed
16 tasks
Abacn opened this issue Feb 13, 2024 · 0 comments · Fixed by #30306
Closed
16 tasks

[Bug]: org.apache.arrow dependency introduced unsupported SLF4J 2 #30304

Abacn opened this issue Feb 13, 2024 · 0 comments · Fixed by #30306

Comments

@Abacn
Copy link
Contributor

Abacn commented Feb 13, 2024

What happened?

We bumped org.apache.arrow to major version 15. It contains slf4j 2.x binding, causing Beam pipelines having slf4j 2 runtime dependency which is not supported:

pipeline submission log:

SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See https://www.slf4j.org/codes.html#noProviders for further details.
SLF4J: Class path contains SLF4J bindings targeting slf4j-api versions 1.7.x or earlier.
SLF4J: Ignoring binding found at [jar:file:/Users/.../.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.36/4a18af6554bfe48b0f76eec98119c417da23c7e1/slf4j-jdk14-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]

Dataflow worker log:

2024-02-13 13:33:28.310 EST
Please use a logger instead of System.out or System.err. Please switch to using org.slf4j.Logger. See: https://cloud.google.com/dataflow/pipelines/logging
2024-02-13 13:33:28.383 EST
Please use a logger instead of System.out or System.err. Please switch to using org.slf4j.Logger. See: https://cloud.google.com/dataflow/pipelines/logging

Issue Priority

Priority: 1 (data loss / total loss of function)

Issue Components

  • Component: Python SDK
  • Component: Java SDK
  • Component: Go SDK
  • Component: Typescript SDK
  • Component: IO connector
  • Component: Beam YAML
  • Component: Beam examples
  • Component: Beam playground
  • Component: Beam katas
  • Component: Website
  • Component: Spark Runner
  • Component: Flink Runner
  • Component: Samza Runner
  • Component: Twister2 Runner
  • Component: Hazelcast Jet Runner
  • Component: Google Cloud Dataflow Runner
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants