Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Spark 1.3 or later #2

Open
kmaehashi opened this issue Jun 8, 2015 · 2 comments
Open

Support Spark 1.3 or later #2

kmaehashi opened this issue Jun 8, 2015 · 2 comments
Assignees

Comments

@kmaehashi
Copy link
Member

Currently JubaQL only supports Spark 1.1.
As Spark 1.2 and 1.3 is now released, we want to run JubaQL on them.

Are there any technical difficulties to support Spark 1.2 or later?

cc: @tgpfeiffer

@kmaehashi kmaehashi self-assigned this Jun 8, 2015
@tgpfeiffer
Copy link
Contributor

The upcoming release of JubaQL (will be called 1.3.0) will use Spark 1.2.

As for Spark 1.3, it seems like there have been some backwards-incompatible changes to the Spark SQL component, e.g., class renames. There is a migration guide available at http://spark.apache.org/docs/1.3.0/sql-programming-guide.html#migration-guide, but as we have been working quite close to the Spark SQL internals for some features, it may become a bit tough to upgrade.

@kmaehashi kmaehashi changed the title Support Spark 1.2 or later Support Spark 1.3 or later Sep 24, 2015
@kmaehashi
Copy link
Member Author

Subject renamed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants