-
Notifications
You must be signed in to change notification settings - Fork 242
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
BooleanType test shouldn't xfail #639
Conversation
Signed-off-by: Raza Jafri <[email protected]>
This reverts commit 64714a5.
Signed-off-by: Raza Jafri <[email protected]>
@revans2 I have addressed your concern PTAL |
build |
@@ -61,7 +62,7 @@ def test_passing_gpuExpr_as_Expr(): | |||
@pytest.mark.parametrize('join_type', ['Left', 'Right', 'Inner', 'LeftSemi', 'LeftAnti'], ids=idfn) | |||
@ignore_order | |||
def test_cache_join(data_gen, join_type): | |||
if data_gen.data_type == BooleanType(): | |||
if spark_version() == "3.0.0" and data_gen.data_type == BooleanType(): | |||
pytest.xfail("https://github.com/NVIDIA/spark-rapids/issues/350") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I would point to the spark issue for all of these instead
@@ -41,3 +41,5 @@ def get_spark_i_know_what_i_am_doing(): | |||
""" | |||
return _spark | |||
|
|||
def spark_version(): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I like this, but there are a number of other places in the code that are doing a
with_spark_session(spark: spark.sparkContext.version ...
It would probably be good to update all of them to be consistent or do it the same way here too.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I have reverted the change to be more like the rest to be consistent
Signed-off-by: Raza Jafri <[email protected]>
build |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It is consistent now, but I like your new function better.
OK. let me make the change. I thought making the PR bigger will be frowned upon. |
This reverts commit a9d9a04.
This reverts commit 6472e92.
Signed-off-by: Raza Jafri <[email protected]>
build |
build |
build |
* BooleanType test shouldn't xfail Signed-off-by: Raza Jafri <[email protected]> * Revert "BooleanType test shouldn't xfail" This reverts commit 64714a5. * xfail only for 3.0.0 Signed-off-by: Raza Jafri <[email protected]> * addressed review comments Signed-off-by: Raza Jafri <[email protected]> * removed the version method * Revert "removed the version method" This reverts commit a9d9a04. * Revert "addressed review comments" This reverts commit 6472e92. * added version checks * missed changing it in cache_test.py Signed-off-by: Raza Jafri <[email protected]> * removing unnecessary lambda Co-authored-by: Raza Jafri <[email protected]>
* BooleanType test shouldn't xfail Signed-off-by: Raza Jafri <[email protected]> * Revert "BooleanType test shouldn't xfail" This reverts commit 64714a5. * xfail only for 3.0.0 Signed-off-by: Raza Jafri <[email protected]> * addressed review comments Signed-off-by: Raza Jafri <[email protected]> * removed the version method * Revert "removed the version method" This reverts commit a9d9a04. * Revert "addressed review comments" This reverts commit 6472e92. * added version checks * missed changing it in cache_test.py Signed-off-by: Raza Jafri <[email protected]> * removing unnecessary lambda Co-authored-by: Raza Jafri <[email protected]>
…IDIA#639) Signed-off-by: spark-rapids automation <[email protected]> Signed-off-by: spark-rapids automation <[email protected]>
Signed-off-by: Raza Jafri [email protected]
Now that https://github.com/apache/spark/pull/29506/files has been merged to branch 3.0 in spark. This is no longer needed
fixes #350