[FEA] Finish retry and retryAndSplit support in GpuGenerateExec #8506
Labels
feature request
New feature or request
reliability
Features to improve reliability or bugs that severly impact the reliability of the plugin
Is your feature request related to a problem? Please describe.
Some support for retry and splitAndRetry has already been implemented for GpuGenerateExec (#8167)
I believe we can tie into the generate splits semantics under a SplitAndRetry, and that happens before the current retry handling, so we would need to add more retry blocks here.
The text was updated successfully, but these errors were encountered: