You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@xiangzez
Additionally, at the beginning, we can't confirm if it works well that TF supports bf16 on CPUs, so we didn't open the data type for bf16. Since you have already made enough testing, I believe we can try to open it, could you commit a PR?
TFRA supports many value types including float16, but bfloat16 type is not there. Are there any specific reasons?
I tried to add a BF16 value type kernel for cuckoo hashtable op and it seems to work. And it is easier to converge than FP16 in training.
The text was updated successfully, but these errors were encountered: