Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Turn off the error complaint when data reader is interrupted #638

Closed
kuke opened this issue Feb 6, 2018 · 0 comments
Closed

Turn off the error complaint when data reader is interrupted #638

kuke opened this issue Feb 6, 2018 · 0 comments
Assignees
Labels

Comments

@kuke
Copy link
Collaborator

kuke commented Feb 6, 2018

If the data reader is interrupted by break in the for loop or ctrl+c from keyboard when loading batch data iteratively, there would output a lot of error complaints which look like

Process Process-9:
Process Process-10:
Traceback (most recent call last):
Process Process-5:
  File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap
Traceback (most recent call last):
  File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap
Traceback (most recent call last):
    self.run()
  File "/usr/lib/python2.7/multiprocessing/process.py", line 114, in run
  File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap
    self._target(*self._args, **self._kwargs)
  File "/paddle_work/models/fluid/DeepASR/data_utils/data_reader.py", line 264, in ordered_processing_task
Exception in thread Thread-1:
Traceback (most recent call last):
  File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.7/threading.py", line 754, in run
    self.__target(*self.__args, **self.__kwargs)
  File "/paddle_work/models/fluid/DeepASR/data_utils/data_reader.py", line 317, in batch_assembling_task
    for sample in sample_generator():
  File "/paddle_work/models/fluid/DeepASR/data_utils/data_reader.py", line 291, in _sample_generator
    sample = sample_queue.get()
  File "<string>", line 2, in get
  File "/usr/lib/python2.7/multiprocessing/managers.py", line 759, in _callmethod
    kind, result = conn.recv()
IOError: [Errno 104] Connection reset by peer

    while order_id != out_order[0]:
  File "<string>", line 2, in __getitem__
  File "/usr/lib/python2.7/multiprocessing/managers.py", line 759, in _callmethod
    self.run()
    self.run()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants