You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Sep 18, 2023. It is now read-only.
Describe the bug
When we start spark with user spark extension and gazelle, it will throw "Spark extensions are already specified before enabling Gazelle plugin: ".
To Reproduce
Start spark with use spark extension and gazelle, which means we would set spark.sql.extensions in spark-defaults.conf to another extension.
Expected behavior
This exception should only be thrown when user set spark.sql.extensions to GazelleSessionExtensions or ArrowWriteExtension.
Additional context
None
The text was updated successfully, but these errors were encountered:
Describe the bug
When we start spark with user spark extension and gazelle, it will throw "Spark extensions are already specified before enabling Gazelle plugin: ".
To Reproduce
Start spark with use spark extension and gazelle, which means we would set
spark.sql.extensions
in spark-defaults.conf to another extension.Expected behavior
This exception should only be thrown when user set
spark.sql.extensions
toGazelleSessionExtensions
orArrowWriteExtension
.Additional context
None
The text was updated successfully, but these errors were encountered: