Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ERROR: can't concat WebSocketError to bytes #2775

Closed
andriihomiak opened this issue Jul 4, 2022 · 3 comments
Closed

ERROR: can't concat WebSocketError to bytes #2775

andriihomiak opened this issue Jul 4, 2022 · 3 comments
Labels
bug Something isn't working

Comments

@andriihomiak
Copy link
Contributor

Description:

Sometimes neuro fails with the following message:

ERROR: can't concat WebSocketError to bytes

After which the logs are not saved

Example:

Seems to happen randomly when running any job via neuro run.
Example logs with traceback:

Traceback (most recent call last):
  File "/home/andrii/.local/pipx/venvs/neuro-all/lib/python3.8/site-packages/neuro_cli/main.py", line 557, in main
    cli.main(
  File "/home/andrii/.local/pipx/venvs/neuro-all/lib/python3.8/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
  File "/home/andrii/.local/pipx/venvs/neuro-all/lib/python3.8/site-packages/neuro_cli/utils.py", line 332, in invoke
    super().invoke(ctx)
  File "/home/andrii/.local/pipx/venvs/neuro-all/lib/python3.8/site-packages/click/core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/home/andrii/.local/pipx/venvs/neuro-all/lib/python3.8/site-packages/neuro_cli/utils.py", line 298, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/home/andrii/.local/pipx/venvs/neuro-all/lib/python3.8/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
  File "/home/andrii/.local/pipx/venvs/neuro-all/lib/python3.8/site-packages/click/decorators.py", line 38, in new_func
    return f(get_current_context().obj, *args, **kwargs)
  File "/home/andrii/.local/pipx/venvs/neuro-all/lib/python3.8/site-packages/neuro_cli/utils.py", line 110, in wrapper
    return root.run(
  File "/home/andrii/.local/pipx/venvs/neuro-all/lib/python3.8/site-packages/neuro_cli/root.py", line 148, in run
    return self._runner.run(main)
  File "/home/andrii/.local/pipx/venvs/neuro-all/lib/python3.8/site-packages/neuro_cli/asyncio_utils.py", line 53, in run
    return self._loop.run_until_complete(main_task)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/home/andrii/.local/pipx/venvs/neuro-all/lib/python3.8/site-packages/neuro_cli/utils.py", line 82, in _run_async_function
    return await func(root, *args, **kwargs)
  File "/home/andrii/.local/pipx/venvs/neuro-all/lib/python3.8/site-packages/neuro_cli/job.py", line 229, in logs
    await process_logs(
  File "/home/andrii/.local/pipx/venvs/neuro-all/lib/python3.8/site-packages/neuro_cli/ael.py", line 108, in process_logs
    txt = decoder.decode(chunk)
  File "/usr/lib/python3.8/codecs.py", line 321, in decode
    data = self.buffer + input
TypeError: can't concat WebSocketError to bytes

Expected behavior:

No error is shown and logs are accessible

Additional context:

Neuro Platform Client 22.6.0
Linux pop-os 5.17.9-051709-generic #202205230806-Ubuntu SMP PREEMPT Mon May 23 08:22:33 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
@andriihomiak andriihomiak added the bug Something isn't working label Jul 4, 2022
@andriihomiak
Copy link
Contributor Author

Possibly a duplicate of neuro-inc/platform-monitoring#719

@serhiy-storchaka
Copy link
Contributor

It was partially fixed in #2746 (at least you should now get a different error in this case). Wait for the next release today.

@andriihomiak
Copy link
Contributor Author

Yes, still get the error, but with a different - more informative - message. Repurposed into #2788

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants