You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
While working on BEAM-12384 to preserve correctly the typeDescriptor of the Read transform. I noticed that ParDo passes the outputType information into the next transforms by taking the output of getOutputTypeDescriptor specified in the DoFn, but the subsequent transform does not get the full inputTypeDescriptor.
There are other open questions:
How can we make this easier for users who rarely override the getOutputTypeDescriptor?
Where the typeDescriptor should come in the SDF case, from the Restriction?
While working on BEAM-12384 to preserve correctly the typeDescriptor of the Read transform. I noticed that ParDo passes the outputType information into the next transforms by taking the output of
getOutputTypeDescriptor
specified in theDoFn
, but the subsequent transform does not get the full inputTypeDescriptor.There are other open questions:
For more details:
#14854 (comment)
Imported from Jira BEAM-12420. Original Jira may contain additional context.
Reported by: iemejia.
The text was updated successfully, but these errors were encountered: