You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Dec 1, 2024. It is now read-only.
on file general/hooks/forward.py on FlexPrepare init (~line 64)
self.use_streams = torch.cuda.is_available() and policy.overlap
self.streams = {}
self.streams["prev_layer"] = torch.cuda.Stream() if self.use_streams else None
self.streams["next_layer"] = torch.cuda.Stream() if self.use_streams else None
self.streams["prev_batch"] = torch.cuda.Stream() if self.use_streams else None
self.streams["next_batch"] = torch.cuda.Stream() if self.use_streams else None
self.stream_names = list(self.streams.keys())
if 'stream' is None (self.use_streams is False), I will get the error: AttributeError: 'NoneType' object has no attribute 'stream_id'
you have to change the code to:
for name, stream in self.streams.items():
if stream:
logger.info(f"{name}: id-{stream.stream_id}")
The text was updated successfully, but these errors were encountered: