You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
After #9482 is merged, should further finish the following items:
Test permerge with a time zone Env variable, by default it's UTC.
importosdefget_time_zone_for_testing():
tz=os.getenv('TEST_SPARK_SESSION_TIMEZONE')
iftzisNone:
tz="UTC"else:
tz=tz.strip()
returntz# spark_session.pytz=get_time_zone_for_testing()
_spark.conf.set("spark.sql.session.timeZone", tz)
# conftest.pyif (item.get_closest_marker('disable_timezone_test') andget_time_zone_for_testing() !="UTC"):
//forcasesdisablenon-utctestandcurrenttimezonefortestingisnon-utc, skipthem.
pytest.skip('Skip because this case is not ready for non UTC time zone')
Update CI to testing non UTC for some Spark versions, e.g.: only for Spark 311 and Spark 350
For the cases with 'disable_timezone_test' mark, these cases was skipped when timezone is non UTC. We should confirm they fallbacks to CPU when timezone is non UTC either by manually way or write corresponding case for each case that has 'disable_timezone_test' mark
Additional context
Finally we should remove the fallback cases that testing non UTC.
The text was updated successfully, but these errors were encountered:
res-life
changed the title
[BUG] [Follow on] Follow on issues for the checking non UTC test cases.
[FEA] [Follow on] Follow on issues for the checking non UTC test cases.
Nov 7, 2023
Describe the bug
After #9482 is merged, should further finish the following items:
Update CI to testing non UTC for some Spark versions, e.g.: only for Spark 311 and Spark 350
For the cases with 'disable_timezone_test' mark, these cases was skipped when timezone is non UTC. We should confirm they fallbacks to CPU when timezone is non UTC either by manually way or write corresponding case for each case that has 'disable_timezone_test' mark
Additional context
Finally we should remove the fallback cases that testing non UTC.
The text was updated successfully, but these errors were encountered: