You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
spark-sql> select sha1(c_customer_id) from customer limit 10;
! <Sha1> sha1(cast(c_customer_id#25 as binary)) cannot run on GPU because GPU does not currently support the operator class org.apache.spark.sql.catalyst.expressions.Sha1
The text was updated successfully, but these errors were encountered:
We need to be a bit careful here to be sure that our requirements match that of pandas/python. In Spark the output of all sha hashes is a string that is a lowercase HEX encoded representation of the binary hash result. This corresponds to the hexdigest() method. Also rapidsai/cudf#8641 calls out sha256 and sha512, not sha1. Spark supports sha1 and sha2. sha2 supports bit lengths of 224, 256, 384, and 512. sha2 matches sha256 and sha512.
I wish we can support function sha1.
eg:
The text was updated successfully, but these errors were encountered: