Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Spark Doris Connector Release Note 25.0.0 #268

Open
JNSimba opened this issue Feb 20, 2025 · 0 comments
Open

Spark Doris Connector Release Note 25.0.0 #268

JNSimba opened this issue Feb 20, 2025 · 0 comments

Comments

@JNSimba
Copy link
Member

JNSimba commented Feb 20, 2025

Spark Connector

Feature

Support spark datasource V2 API pushdown. #250

Support partial limit pushdown for spark 3.2 and above. #257

Improvement

Compatible with FE API changes. #260
Support create table statement for spark 3.3 and above. #264

BugFix

Fix driver exception when spark catalog gets jdbc connection. #251

Fix data conversion exception when reading date type. #253

Fix the exception of loading arrow jdbc driver when loading mysql driver. #254

Fix the problem that the column order in the schema is inconsistent with the order in the data. #256

Fix exception when reading json type data via flight sql. #263

Fix the exception of reading date type caused by turning on spark.sql.datetime.java8API.enabled configuration. #265

Spark Load

Feature

Support job execution based on object storage. #266

Thanks

@gnehil
@JNSimba

@JNSimba JNSimba pinned this issue Feb 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant