-
Notifications
You must be signed in to change notification settings - Fork 244
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Rename DECIMAL_128_FULL and rework usage of TypeSig.gpuNumeric #4462
Conversation
Signed-off-by: Kuhu Shukla <[email protected]>
…TypeSig.numeric Signed-off-by: Kuhu Shukla <[email protected]>
…' into dec128_audit
build |
@revans2 , @sperlingxx thoughts? |
I am fine with renaming DECIMAL_128_FULL to DECIMAL_128. It had FULL on it before because I thought we would use it to restrict the maximum precision allowed for things like multiply and divide, but the computation was complicated enough that there is not simple cutoff for most operations. I do not want to mix GPU and non GPU TypeSig categories. TypeSig.numeric should never be used in a GPU type signature. This is about future proofing things. So if someone adds in a new DECIMAL_256 or something like that in the future we can update one of them and know that it matches the CPU, and not have to worry about it impacting anything on the GPU. It might be nice to rename numeric to be cpuNumberic instead so it is clearer. Again they started out as common, and then when we started to run into decimal situations I separated them, but I didn't want to change the name all at once for backwards compatibility reasons, but I should have. |
@revans2 , that makes sense. I can do that here shortly but then based on the comment I think we may just want to keep the occurrences of |
I think we have more places that use |
Ok yes I also think that makes most sense. |
…ed with TypeSig.numeric" This reverts commit 7809256.
…' into dec128_audit
Some places in 320 shims for example the cast operator was missed for decimal 128 which with this change is now covered without any changes to the specific lines in the shims code. Mostly FYI. |
build |
build |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just one nit.
sql-plugin/src/main/scala/com/nvidia/spark/rapids/TypeChecks.scala
Outdated
Show resolved
Hide resolved
Signed-off-by: Kuhu Shukla <[email protected]>
build |
Partially addresses #3890 , specifically the first two sub-tasks.