Add BackendAttribute for parallel model instance loading#235

Merged

rmccorm4 merged 9 commits intomainfrom rmccormick-optin

Jul 26, 2023

+117-20

Commits on Jul 20, 2023

Add initial parallel instance loading BackendAttribute and corresponding API to opt-in
rmccorm4
committed
Add backend attribute check to decide whether to load instances serially or concurrently
rmccorm4
committed

Commits on Jul 21, 2023

Add backend attribute check to decide whether to load instances serially or concurrently
rmccorm4
committed
Fix merge conflict
rmccorm4
committed
Protect payload_queue->specific_queues from concurrent instance initialization
rmccorm4
committed

Commits on Jul 24, 2023

formatting
rmccorm4
committed

Commits on Jul 25, 2023