Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

us_data pipeline execution fails with "AttributeError: module 'text_extensions_for_pandas' has no attribute 'TensorDtype'" #35

Open
ptitzler opened this issue Nov 23, 2021 · 1 comment
Open

us_data pipeline execution fails with "AttributeError: module 'text_extensions_for_pandas' has no attribute 'TensorDtype'" #35

ptitzler opened this issue Nov 23, 2021 · 1 comment

Comments

@ptitzler
Copy link
Contributor

Details are in airflow run log file:

*** Reading local file: /opt/airflow/logs/us_data-1123151331/fit_us_data/2021-11-22T00:00:00+00:00/1.log
[2021-11-23 23:19:58,770] {taskinstance.py:670} INFO - Dependencies all met for <TaskInstance: us_data-1123151331.fit_us_data 2021-11-22T00:00:00+00:00 [queued]>
[2021-11-23 23:19:58,804] {taskinstance.py:670} INFO - Dependencies all met for <TaskInstance: us_data-1123151331.fit_us_data 2021-11-22T00:00:00+00:00 [queued]>
[2021-11-23 23:19:58,804] {taskinstance.py:880} INFO - 
--------------------------------------------------------------------------------
[2021-11-23 23:19:58,804] {taskinstance.py:881} INFO - Starting attempt 1 of 1
[2021-11-23 23:19:58,804] {taskinstance.py:882} INFO - 
--------------------------------------------------------------------------------
[2021-11-23 23:19:58,823] {taskinstance.py:901} INFO - Executing <Task(KubernetesPodOperator): fit_us_data> on 2021-11-22T00:00:00+00:00
[2021-11-23 23:19:58,829] {standard_task_runner.py:54} INFO - Started process 145 to run task
[2021-11-23 23:19:58,857] {standard_task_runner.py:77} INFO - Running: ['airflow', 'run', 'us_data-1123151331', 'fit_us_data', '2021-11-22T00:00:00+00:00', '--job_id', '103', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/us_data-1123151331.py', '--cfg_path', '/tmp/tmpwtideyim']
[2021-11-23 23:19:58,863] {standard_task_runner.py:78} INFO - Job 103: Subtask fit_us_data
[2021-11-23 23:19:58,931] {logging_mixin.py:112} INFO - Running %s on host %s <TaskInstance: us_data-1123151331.fit_us_data 2021-11-22T00:00:00+00:00 [running]> usdata1123151331fitusdata-512997509ad54946a9e16dd045522598
[2021-11-23 23:19:59,026] {logging_mixin.py:112} WARNING - /home/airflow/.local/lib/python3.6/site-packages/airflow/kubernetes/pod_launcher.py:330: DeprecationWarning: Using `airflow.contrib.kubernetes.pod.Pod` is deprecated. Please use `k8s.V1Pod`.
  security_context=_extract_security_context(pod.spec.security_context)
[2021-11-23 23:19:59,026] {logging_mixin.py:112} WARNING - /home/airflow/.local/lib/python3.6/site-packages/airflow/kubernetes/pod_launcher.py:77: DeprecationWarning: Using `airflow.contrib.kubernetes.pod.Pod` is deprecated. Please use `k8s.V1Pod` instead.
  pod = self._mutate_pod_backcompat(pod)
[2021-11-23 23:19:59,102] {pod_launcher.py:173} INFO - Event: fit-us-data-fc7801159eb44794b4b225f3ad28ce99 had an event of type Pending
[2021-11-23 23:19:59,102] {pod_launcher.py:139} WARNING - Pod not yet started: fit-us-data-fc7801159eb44794b4b225f3ad28ce99
[2021-11-23 23:20:00,113] {pod_launcher.py:173} INFO - Event: fit-us-data-fc7801159eb44794b4b225f3ad28ce99 had an event of type Pending
[2021-11-23 23:20:00,113] {pod_launcher.py:139} WARNING - Pod not yet started: fit-us-data-fc7801159eb44794b4b225f3ad28ce99
[2021-11-23 23:20:01,126] {pod_launcher.py:173} INFO - Event: fit-us-data-fc7801159eb44794b4b225f3ad28ce99 had an event of type Pending
[2021-11-23 23:20:01,126] {pod_launcher.py:139} WARNING - Pod not yet started: fit-us-data-fc7801159eb44794b4b225f3ad28ce99
[2021-11-23 23:20:02,137] {pod_launcher.py:173} INFO - Event: fit-us-data-fc7801159eb44794b4b225f3ad28ce99 had an event of type Running
[2021-11-23 23:20:02,158] {pod_launcher.py:156} INFO - b'  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current\n'
[2021-11-23 23:20:02,159] {pod_launcher.py:156} INFO - b'                                 Dload  Upload   Total   Spent    Left  Speed\n'
[2021-11-23 23:20:02,159] {pod_launcher.py:156} INFO - b'\r  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0\r  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0\r100 18755  100 18755    0     0  91487      0 --:--:-- --:--:-- --:--:-- 91043\n'
[2021-11-23 23:20:02,159] {pod_launcher.py:156} INFO - b'  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current\n'
[2021-11-23 23:20:02,159] {pod_launcher.py:156} INFO - b'                                 Dload  Upload   Total   Spent    Left  Speed\n'
[2021-11-23 23:20:02,160] {pod_launcher.py:156} INFO - b'\r  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0\r100  1281  100  1281    0     0   8372      0 --:--:-- --:--:-- --:--:--  8372\n'
[2021-11-23 23:20:02,160] {pod_launcher.py:156} INFO - b'Requirement already satisfied: packaging in /opt/conda/lib/python3.8/site-packages (20.4)\n'
[2021-11-23 23:20:02,160] {pod_launcher.py:156} INFO - b'Requirement already satisfied: six in /opt/conda/lib/python3.8/site-packages (from packaging) (1.15.0)\n'
[2021-11-23 23:20:02,163] {pod_launcher.py:156} INFO - b'Requirement already satisfied: pyparsing>=2.0.2 in /opt/conda/lib/python3.8/site-packages (from packaging) (2.4.7)\n'
[2021-11-23 23:20:04,049] {pod_launcher.py:156} INFO - b'WARNING: You are using pip version 20.2.3; however, version 21.3.1 is available.\n'
[2021-11-23 23:20:04,049] {pod_launcher.py:156} INFO - b"You should consider upgrading via the '/opt/conda/bin/python3 -m pip install --upgrade pip' command.\n"
[2021-11-23 23:20:05,018] {pod_launcher.py:156} INFO - b"[I 23:20:05.017] 'us_data-1123151331':'fit_us_data' - starting operation \n"
[2021-11-23 23:20:05,018] {pod_launcher.py:156} INFO - b"[I 23:20:05.017] 'us_data-1123151331':'fit_us_data' - Installing packages \n"
[2021-11-23 23:20:05,022] {pod_launcher.py:156} INFO - b'[W 23:20:05.017] WARNING: Package ipykernel found with unsupported Legacy version scheme file:///tmp/build/80754af9/ipykernel_1594753368510/work/dist/ipykernel-5.3.2-py3-none-any.whl already installed. Skipping...\n'
[2021-11-23 23:20:05,022] {pod_launcher.py:156} INFO - b'[W 23:20:05.018] WARNING: Package ipython found with unsupported Legacy version scheme file:///tmp/build/80754af9/ipython_1593447377063/work already installed. Skipping...\n'
[2021-11-23 23:20:05,022] {pod_launcher.py:156} INFO - b'[I 23:20:05.018] Newer jupyter-client package with version 6.1.7 already installed. Skipping...\n'
[2021-11-23 23:20:05,023] {pod_launcher.py:156} INFO - b'[I 23:20:05.018] Package not found. Installing minio package with version 6.0.2...\n'
[2021-11-23 23:20:05,023] {pod_launcher.py:156} INFO - b'[I 23:20:05.018] Newer nbclient package with version 0.5.0 already installed. Skipping...\n'
[2021-11-23 23:20:05,023] {pod_launcher.py:156} INFO - b'[I 23:20:05.018] Newer nbconvert package with version 6.0.3 already installed. Skipping...\n'
[2021-11-23 23:20:05,024] {pod_launcher.py:156} INFO - b'[I 23:20:05.018] Package not found. Installing papermill package with version 2.1.2...\n'
[2021-11-23 23:20:05,024] {pod_launcher.py:156} INFO - b'[W 23:20:05.019] WARNING: Package requests found with unsupported Legacy version scheme file:///tmp/build/80754af9/requests_1592841827918/work already installed. Skipping...\n'
[2021-11-23 23:20:05,024] {pod_launcher.py:156} INFO - b'[I 23:20:05.019] Updating urllib3 package from version 1.25.9 to 1.26.5...\n'
[2021-11-23 23:20:06,174] {pod_launcher.py:156} INFO - b'Collecting minio==6.0.2\n'
[2021-11-23 23:20:06,450] {pod_launcher.py:156} INFO - b'  Downloading minio-6.0.2-py2.py3-none-any.whl (73 kB)\n'
[2021-11-23 23:20:06,826] {pod_launcher.py:156} INFO - b'Collecting papermill==2.1.2\n'
[2021-11-23 23:20:06,870] {pod_launcher.py:156} INFO - b'  Downloading papermill-2.1.2-py3-none-any.whl (32 kB)\n'
[2021-11-23 23:20:07,205] {pod_launcher.py:156} INFO - b'Collecting urllib3==1.26.5\n'
[2021-11-23 23:20:07,241] {pod_launcher.py:156} INFO - b'  Downloading urllib3-1.26.5-py2.py3-none-any.whl (138 kB)\n'
[2021-11-23 23:20:07,479] {pod_launcher.py:156} INFO - b'Collecting configparser\n'
[2021-11-23 23:20:07,523] {pod_launcher.py:156} INFO - b'  Downloading configparser-5.1.0-py3-none-any.whl (19 kB)\n'
[2021-11-23 23:20:07,620] {pod_launcher.py:156} INFO - b'Requirement already satisfied: python-dateutil in /opt/conda/lib/python3.8/site-packages (from minio==6.0.2) (2.8.1)\n'
[2021-11-23 23:20:07,627] {pod_launcher.py:156} INFO - b'Requirement already satisfied: certifi in /opt/conda/lib/python3.8/site-packages (from minio==6.0.2) (2020.6.20)\n'
[2021-11-23 23:20:07,632] {pod_launcher.py:156} INFO - b'Requirement already satisfied: pytz in /opt/conda/lib/python3.8/site-packages (from minio==6.0.2) (2020.1)\n'
[2021-11-23 23:20:07,634] {pod_launcher.py:156} INFO - b'Requirement already satisfied: pyyaml in /opt/conda/lib/python3.8/site-packages (from papermill==2.1.2) (5.3.1)\n'
[2021-11-23 23:20:07,637] {pod_launcher.py:156} INFO - b'Requirement already satisfied: click in /opt/conda/lib/python3.8/site-packages (from papermill==2.1.2) (7.1.2)\n'
[2021-11-23 23:20:07,641] {pod_launcher.py:156} INFO - b'Requirement already satisfied: entrypoints in /opt/conda/lib/python3.8/site-packages (from papermill==2.1.2) (0.3)\n'
[2021-11-23 23:20:07,645] {pod_launcher.py:156} INFO - b'Requirement already satisfied: jupyter-client in /opt/conda/lib/python3.8/site-packages (from papermill==2.1.2) (6.1.7)\n'
[2021-11-23 23:20:07,845] {pod_launcher.py:156} INFO - b'Collecting tenacity\n'
[2021-11-23 23:20:07,909] {pod_launcher.py:156} INFO - b'  Downloading tenacity-8.0.1-py3-none-any.whl (24 kB)\n'
[2021-11-23 23:20:07,982] {pod_launcher.py:156} INFO - b'Requirement already satisfied: nbclient>=0.2.0 in /opt/conda/lib/python3.8/site-packages (from papermill==2.1.2) (0.5.0)\n'
[2021-11-23 23:20:08,040] {pod_launcher.py:156} INFO - b'Requirement already satisfied: nbformat in /opt/conda/lib/python3.8/site-packages (from papermill==2.1.2) (5.0.7)\n'
[2021-11-23 23:20:08,050] {pod_launcher.py:156} INFO - b'Requirement already satisfied: tqdm>=4.32.2 in /opt/conda/lib/python3.8/site-packages (from papermill==2.1.2) (4.47.0)\n'
[2021-11-23 23:20:08,206] {pod_launcher.py:156} INFO - b'Collecting ansiwrap\n'
[2021-11-23 23:20:08,252] {pod_launcher.py:156} INFO - b'  Downloading ansiwrap-0.8.4-py2.py3-none-any.whl (8.5 kB)\n'
[2021-11-23 23:20:08,330] {pod_launcher.py:156} INFO - b'Requirement already satisfied: requests in /opt/conda/lib/python3.8/site-packages (from papermill==2.1.2) (2.24.0)\n'
[2021-11-23 23:20:08,532] {pod_launcher.py:156} INFO - b'Collecting black\n'
[2021-11-23 23:20:08,577] {pod_launcher.py:156} INFO - b'  Downloading black-21.11b1-py3-none-any.whl (155 kB)\n'
[2021-11-23 23:20:08,715] {pod_launcher.py:156} INFO - b'Requirement already satisfied: six>=1.5 in /opt/conda/lib/python3.8/site-packages (from python-dateutil->minio==6.0.2) (1.15.0)\n'
[2021-11-23 23:20:08,724] {pod_launcher.py:156} INFO - b'Requirement already satisfied: jupyter-core>=4.6.0 in /opt/conda/lib/python3.8/site-packages (from jupyter-client->papermill==2.1.2) (4.6.3)\n'
[2021-11-23 23:20:08,735] {pod_launcher.py:156} INFO - b'Requirement already satisfied: tornado>=4.1 in /opt/conda/lib/python3.8/site-packages (from jupyter-client->papermill==2.1.2) (6.0.4)\n'
[2021-11-23 23:20:08,737] {pod_launcher.py:156} INFO - b'Requirement already satisfied: pyzmq>=13 in /opt/conda/lib/python3.8/site-packages (from jupyter-client->papermill==2.1.2) (19.0.1)\n'
[2021-11-23 23:20:08,741] {pod_launcher.py:156} INFO - b'Requirement already satisfied: traitlets in /opt/conda/lib/python3.8/site-packages (from jupyter-client->papermill==2.1.2) (4.3.3)\n'
[2021-11-23 23:20:08,761] {pod_launcher.py:156} INFO - b'Requirement already satisfied: nest-asyncio in /opt/conda/lib/python3.8/site-packages (from nbclient>=0.2.0->papermill==2.1.2) (1.4.0)\n'
[2021-11-23 23:20:08,764] {pod_launcher.py:156} INFO - b'Requirement already satisfied: async-generator in /opt/conda/lib/python3.8/site-packages (from nbclient>=0.2.0->papermill==2.1.2) (1.10)\n'
[2021-11-23 23:20:08,768] {pod_launcher.py:156} INFO - b'Requirement already satisfied: jsonschema!=2.5.0,>=2.4 in /opt/conda/lib/python3.8/site-packages (from nbformat->papermill==2.1.2) (3.2.0)\n'
[2021-11-23 23:20:08,799] {pod_launcher.py:156} INFO - b'Requirement already satisfied: ipython-genutils in /opt/conda/lib/python3.8/site-packages (from nbformat->papermill==2.1.2) (0.2.0)\n'
[2021-11-23 23:20:08,950] {pod_launcher.py:156} INFO - b'Collecting textwrap3>=0.9.2\n'
[2021-11-23 23:20:08,999] {pod_launcher.py:156} INFO - b'  Downloading textwrap3-0.9.2-py2.py3-none-any.whl (12 kB)\n'
[2021-11-23 23:20:09,065] {pod_launcher.py:156} INFO - b'Requirement already satisfied: chardet<4,>=3.0.2 in /opt/conda/lib/python3.8/site-packages (from requests->papermill==2.1.2) (3.0.4)\n'
[2021-11-23 23:20:09,069] {pod_launcher.py:156} INFO - b'Requirement already satisfied: idna<3,>=2.5 in /opt/conda/lib/python3.8/site-packages (from requests->papermill==2.1.2) (2.10)\n'
[2021-11-23 23:20:09,220] {pod_launcher.py:156} INFO - b'Collecting platformdirs>=2\n'
[2021-11-23 23:20:09,253] {pod_launcher.py:156} INFO - b'  Downloading platformdirs-2.4.0-py3-none-any.whl (14 kB)\n'
[2021-11-23 23:20:09,461] {pod_launcher.py:156} INFO - b'Collecting mypy-extensions>=0.4.3\n'
[2021-11-23 23:20:09,507] {pod_launcher.py:156} INFO - b'  Downloading mypy_extensions-0.4.3-py2.py3-none-any.whl (4.5 kB)\n'
[2021-11-23 23:20:09,730] {pod_launcher.py:156} INFO - b'Collecting tomli<2.0.0,>=0.2.6\n'
[2021-11-23 23:20:09,773] {pod_launcher.py:156} INFO - b'  Downloading tomli-1.2.2-py3-none-any.whl (12 kB)\n'
[2021-11-23 23:20:09,918] {pod_launcher.py:156} INFO - b'Collecting typing-extensions>=3.10.0.0\n'
[2021-11-23 23:20:09,962] {pod_launcher.py:156} INFO - b'  Downloading typing_extensions-4.0.0-py3-none-any.whl (22 kB)\n'
[2021-11-23 23:20:10,139] {pod_launcher.py:156} INFO - b'Collecting pathspec<1,>=0.9.0\n'
[2021-11-23 23:20:10,187] {pod_launcher.py:156} INFO - b'  Downloading pathspec-0.9.0-py2.py3-none-any.whl (31 kB)\n'
[2021-11-23 23:20:11,505] {pod_launcher.py:156} INFO - b'Collecting regex>=2021.4.4\n'
[2021-11-23 23:20:11,557] {pod_launcher.py:156} INFO - b'  Downloading regex-2021.11.10-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (764 kB)\n'
[2021-11-23 23:20:11,648] {pod_launcher.py:156} INFO - b'Requirement already satisfied: decorator in /opt/conda/lib/python3.8/site-packages (from traitlets->jupyter-client->papermill==2.1.2) (4.4.2)\n'
[2021-11-23 23:20:11,657] {pod_launcher.py:156} INFO - b'Requirement already satisfied: pyrsistent>=0.14.0 in /opt/conda/lib/python3.8/site-packages (from jsonschema!=2.5.0,>=2.4->nbformat->papermill==2.1.2) (0.16.0)\n'
[2021-11-23 23:20:11,658] {pod_launcher.py:156} INFO - b'Requirement already satisfied: attrs>=17.4.0 in /opt/conda/lib/python3.8/site-packages (from jsonschema!=2.5.0,>=2.4->nbformat->papermill==2.1.2) (19.3.0)\n'
[2021-11-23 23:20:11,689] {pod_launcher.py:156} INFO - b'Requirement already satisfied: setuptools in /opt/conda/lib/python3.8/site-packages (from jsonschema!=2.5.0,>=2.4->nbformat->papermill==2.1.2) (49.2.0.post20200714)\n'
[2021-11-23 23:20:12,949] {pod_launcher.py:156} INFO - b'Installing collected packages: configparser, urllib3, minio, tenacity, textwrap3, ansiwrap, platformdirs, mypy-extensions, tomli, typing-extensions, pathspec, regex, black, papermill\n'
[2021-11-23 23:20:12,979] {pod_launcher.py:156} INFO - b'  Attempting uninstall: urllib3\n'
[2021-11-23 23:20:12,983] {pod_launcher.py:156} INFO - b'    Found existing installation: urllib3 1.25.9\n'
[2021-11-23 23:20:12,997] {pod_launcher.py:156} INFO - b'    Uninstalling urllib3-1.25.9:\n'
[2021-11-23 23:20:13,021] {pod_launcher.py:156} INFO - b'      Successfully uninstalled urllib3-1.25.9\n'
[2021-11-23 23:20:13,385] {pod_launcher.py:156} INFO - b'  Attempting uninstall: typing-extensions\n'
[2021-11-23 23:20:13,385] {pod_launcher.py:156} INFO - b'    Found existing installation: typing-extensions 3.7.4.2\n'
[2021-11-23 23:20:13,385] {pod_launcher.py:156} INFO - b'    Uninstalling typing-extensions-3.7.4.2:\n'
[2021-11-23 23:20:14,147] {pod_launcher.py:156} INFO - b'      Successfully uninstalled typing-extensions-3.7.4.2\n'
[2021-11-23 23:20:14,229] {pod_launcher.py:156} INFO - b'  Attempting uninstall: regex\n'
[2021-11-23 23:20:14,232] {pod_launcher.py:156} INFO - b'    Found existing installation: regex 2020.7.14\n'
[2021-11-23 23:20:14,235] {pod_launcher.py:156} INFO - b'    Uninstalling regex-2020.7.14:\n'
[2021-11-23 23:20:14,241] {pod_launcher.py:156} INFO - b'      Successfully uninstalled regex-2020.7.14\n'
[2021-11-23 23:20:14,773] {pod_launcher.py:156} INFO - b'ERROR: After October 2020 you may experience errors when installing or updating packages. This is because pip will change the way that it resolves dependency conflicts.\n'
[2021-11-23 23:20:14,773] {pod_launcher.py:156} INFO - b'\n'
[2021-11-23 23:20:14,774] {pod_launcher.py:156} INFO - b'We recommend you use --use-feature=2020-resolver to test your packages with the new resolver before it becomes the default.\n'
[2021-11-23 23:20:14,774] {pod_launcher.py:156} INFO - b'\n'
[2021-11-23 23:20:14,774] {pod_launcher.py:156} INFO - b"requests 2.24.0 requires urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1, but you'll have urllib3 1.26.5 which is incompatible.\n"
[2021-11-23 23:20:14,775] {pod_launcher.py:156} INFO - b'Successfully installed ansiwrap-0.8.4 black-21.11b1 configparser-5.1.0 minio-6.0.2 mypy-extensions-0.4.3 papermill-2.1.2 pathspec-0.9.0 platformdirs-2.4.0 regex-2021.11.10 tenacity-8.0.1 textwrap3-0.9.2 tomli-1.2.2 typing-extensions-4.0.0 urllib3-1.26.5\n'
[2021-11-23 23:20:14,880] {pod_launcher.py:156} INFO - b'WARNING: You are using pip version 20.2.3; however, version 21.3.1 is available.\n'
[2021-11-23 23:20:14,880] {pod_launcher.py:156} INFO - b"You should consider upgrading via the '/opt/conda/bin/python3 -m pip install --upgrade pip' command.\n"
[2021-11-23 23:20:15,776] {pod_launcher.py:156} INFO - b'alabaster==0.7.12\n'
[2021-11-23 23:20:15,778] {pod_launcher.py:156} INFO - b'anaconda-client==1.7.2\n'
[2021-11-23 23:20:15,779] {pod_launcher.py:156} INFO - b'anaconda-navigator==1.9.12\n'
[2021-11-23 23:20:15,780] {pod_launcher.py:156} INFO - b'anaconda-project==0.8.3\n'
[2021-11-23 23:20:15,782] {pod_launcher.py:156} INFO - b'ansiwrap==0.8.4\n'
[2021-11-23 23:20:15,783] {pod_launcher.py:156} INFO - b'argh==0.26.2\n'
[2021-11-23 23:20:15,783] {pod_launcher.py:156} INFO - b'argon2-cffi==20.1.0\n'
[2021-11-23 23:20:15,785] {pod_launcher.py:156} INFO - b'asn1crypto==1.3.0\n'
[2021-11-23 23:20:15,785] {pod_launcher.py:156} INFO - b'astroid @ file:///tmp/build/80754af9/astroid_1592495912941/work\n'
[2021-11-23 23:20:15,785] {pod_launcher.py:156} INFO - b'astropy==4.0.1.post1\n'
[2021-11-23 23:20:15,785] {pod_launcher.py:156} INFO - b'async-generator==1.10\n'
[2021-11-23 23:20:15,785] {pod_launcher.py:156} INFO - b'atomicwrites==1.4.0\n'
[2021-11-23 23:20:15,786] {pod_launcher.py:156} INFO - b'attrs==19.3.0\n'
[2021-11-23 23:20:15,786] {pod_launcher.py:156} INFO - b'autopep8 @ file:///tmp/build/80754af9/autopep8_1592412889138/work\n'
[2021-11-23 23:20:15,786] {pod_launcher.py:156} INFO - b'Babel==2.8.0\n'
[2021-11-23 23:20:15,786] {pod_launcher.py:156} INFO - b'backcall==0.2.0\n'
[2021-11-23 23:20:15,788] {pod_launcher.py:156} INFO - b'backports.functools-lru-cache==1.6.1\n'
[2021-11-23 23:20:15,788] {pod_launcher.py:156} INFO - b'backports.shutil-get-terminal-size==1.0.0\n'
[2021-11-23 23:20:15,789] {pod_launcher.py:156} INFO - b'backports.tempfile==1.0\n'
[2021-11-23 23:20:15,789] {pod_launcher.py:156} INFO - b'backports.weakref==1.0.post1\n'
[2021-11-23 23:20:15,789] {pod_launcher.py:156} INFO - b'beautifulsoup4==4.9.1\n'
[2021-11-23 23:20:15,789] {pod_launcher.py:156} INFO - b'bitarray @ file:///tmp/build/80754af9/bitarray_1594753876414/work\n'
[2021-11-23 23:20:15,789] {pod_launcher.py:156} INFO - b'bkcharts==0.2\n'
[2021-11-23 23:20:15,790] {pod_launcher.py:156} INFO - b'black==21.11b1\n'
[2021-11-23 23:20:15,790] {pod_launcher.py:156} INFO - b'bleach==3.1.5\n'
[2021-11-23 23:20:15,790] {pod_launcher.py:156} INFO - b'bokeh @ file:///tmp/build/80754af9/bokeh_1593187602660/work\n'
[2021-11-23 23:20:15,790] {pod_launcher.py:156} INFO - b'boto==2.49.0\n'
[2021-11-23 23:20:15,790] {pod_launcher.py:156} INFO - b'Bottleneck==1.3.2\n'
[2021-11-23 23:20:15,791] {pod_launcher.py:156} INFO - b'brotlipy==0.7.0\n'
[2021-11-23 23:20:15,791] {pod_launcher.py:156} INFO - b'certifi==2020.6.20\n'
[2021-11-23 23:20:15,791] {pod_launcher.py:156} INFO - b'cffi==1.14.0\n'
[2021-11-23 23:20:15,791] {pod_launcher.py:156} INFO - b'chardet==3.0.4\n'
[2021-11-23 23:20:15,791] {pod_launcher.py:156} INFO - b'click==7.1.2\n'
[2021-11-23 23:20:15,791] {pod_launcher.py:156} INFO - b'cloudpickle @ file:///tmp/build/80754af9/cloudpickle_1594141588948/work\n'
[2021-11-23 23:20:15,792] {pod_launcher.py:156} INFO - b'clyent==1.2.2\n'
[2021-11-23 23:20:15,792] {pod_launcher.py:156} INFO - b'colorama==0.4.3\n'
[2021-11-23 23:20:15,792] {pod_launcher.py:156} INFO - b'conda==4.8.4\n'
[2021-11-23 23:20:15,792] {pod_launcher.py:156} INFO - b'conda-build==3.18.11\n'
[2021-11-23 23:20:15,792] {pod_launcher.py:156} INFO - b'conda-package-handling==1.7.0\n'
[2021-11-23 23:20:15,792] {pod_launcher.py:156} INFO - b'conda-verify==3.4.2\n'
[2021-11-23 23:20:15,793] {pod_launcher.py:156} INFO - b'configparser==5.1.0\n'
[2021-11-23 23:20:15,793] {pod_launcher.py:156} INFO - b'contextlib2==0.6.0.post1\n'
[2021-11-23 23:20:15,793] {pod_launcher.py:156} INFO - b'cryptography==2.9.2\n'
[2021-11-23 23:20:15,793] {pod_launcher.py:156} INFO - b'cycler==0.10.0\n'
[2021-11-23 23:20:15,793] {pod_launcher.py:156} INFO - b'Cython @ file:///tmp/build/80754af9/cython_1594831566883/work\n'
[2021-11-23 23:20:15,794] {pod_launcher.py:156} INFO - b'cytoolz==0.10.1\n'
[2021-11-23 23:20:15,794] {pod_launcher.py:156} INFO - b'dask @ file:///tmp/build/80754af9/dask-core_1594156306305/work\n'
[2021-11-23 23:20:15,794] {pod_launcher.py:156} INFO - b'decorator==4.4.2\n'
[2021-11-23 23:20:15,794] {pod_launcher.py:156} INFO - b'defusedxml==0.6.0\n'
[2021-11-23 23:20:15,794] {pod_launcher.py:156} INFO - b'diff-match-patch @ file:///tmp/build/80754af9/diff-match-patch_1594828741838/work\n'
[2021-11-23 23:20:15,794] {pod_launcher.py:156} INFO - b'distributed @ file:///tmp/build/80754af9/distributed_1594750293818/work\n'
[2021-11-23 23:20:15,795] {pod_launcher.py:156} INFO - b'docutils==0.16\n'
[2021-11-23 23:20:15,795] {pod_launcher.py:156} INFO - b'entrypoints==0.3\n'
[2021-11-23 23:20:15,795] {pod_launcher.py:156} INFO - b'et-xmlfile==1.0.1\n'
[2021-11-23 23:20:15,795] {pod_launcher.py:156} INFO - b'fastcache==1.1.0\n'
[2021-11-23 23:20:15,795] {pod_launcher.py:156} INFO - b'fastparquet==0.4.1\n'
[2021-11-23 23:20:15,795] {pod_launcher.py:156} INFO - b'filelock==3.0.12\n'
[2021-11-23 23:20:15,796] {pod_launcher.py:156} INFO - b'flake8==3.8.3\n'
[2021-11-23 23:20:15,796] {pod_launcher.py:156} INFO - b'Flask==1.1.2\n'
[2021-11-23 23:20:15,796] {pod_launcher.py:156} INFO - b'fsspec==0.7.4\n'
[2021-11-23 23:20:15,796] {pod_launcher.py:156} INFO - b'future==0.18.2\n'
[2021-11-23 23:20:15,796] {pod_launcher.py:156} INFO - b'gevent @ file:///tmp/build/80754af9/gevent_1593009537125/work\n'
[2021-11-23 23:20:15,796] {pod_launcher.py:156} INFO - b'glob2==0.7\n'
[2021-11-23 23:20:15,797] {pod_launcher.py:156} INFO - b'gmpy2==2.0.8\n'
[2021-11-23 23:20:15,797] {pod_launcher.py:156} INFO - b'greenlet==0.4.16\n'
[2021-11-23 23:20:15,797] {pod_launcher.py:156} INFO - b'grpcio==1.32.0\n'
[2021-11-23 23:20:15,797] {pod_launcher.py:156} INFO - b'grpcio-tools==1.32.0\n'
[2021-11-23 23:20:15,797] {pod_launcher.py:156} INFO - b'h5py==2.10.0\n'
[2021-11-23 23:20:15,797] {pod_launcher.py:156} INFO - b'HeapDict==1.0.1\n'
[2021-11-23 23:20:15,798] {pod_launcher.py:156} INFO - b'html5lib @ file:///tmp/build/80754af9/html5lib_1593446221756/work\n'
[2021-11-23 23:20:15,798] {pod_launcher.py:156} INFO - b'idna @ file:///tmp/build/80754af9/idna_1593446292537/work\n'
[2021-11-23 23:20:15,798] {pod_launcher.py:156} INFO - b'imageio @ file:///tmp/build/80754af9/imageio_1594161405741/work\n'
[2021-11-23 23:20:15,798] {pod_launcher.py:156} INFO - b'imagesize==1.2.0\n'
[2021-11-23 23:20:15,799] {pod_launcher.py:156} INFO - b'importlib-metadata @ file:///tmp/build/80754af9/importlib-metadata_1593446406207/work\n'
[2021-11-23 23:20:15,799] {pod_launcher.py:156} INFO - b'intervaltree @ file:///tmp/build/80754af9/intervaltree_1594361675072/work\n'
[2021-11-23 23:20:15,799] {pod_launcher.py:156} INFO - b'ipykernel @ file:///tmp/build/80754af9/ipykernel_1594753368510/work/dist/ipykernel-5.3.2-py3-none-any.whl\n'
[2021-11-23 23:20:15,799] {pod_launcher.py:156} INFO - b'ipython @ file:///tmp/build/80754af9/ipython_1593447377063/work\n'
[2021-11-23 23:20:15,799] {pod_launcher.py:156} INFO - b'ipython-genutils==0.2.0\n'
[2021-11-23 23:20:15,800] {pod_launcher.py:156} INFO - b'ipywidgets==7.5.1\n'
[2021-11-23 23:20:15,800] {pod_launcher.py:156} INFO - b'isort==4.3.21\n'
[2021-11-23 23:20:15,800] {pod_launcher.py:156} INFO - b'itsdangerous==1.1.0\n'
[2021-11-23 23:20:15,800] {pod_launcher.py:156} INFO - b'jdcal==1.4.1\n'
[2021-11-23 23:20:15,800] {pod_launcher.py:156} INFO - b'jedi @ file:///tmp/build/80754af9/jedi_1592841866100/work\n'
[2021-11-23 23:20:15,800] {pod_launcher.py:156} INFO - b'jeepney==0.4.3\n'
[2021-11-23 23:20:15,801] {pod_launcher.py:156} INFO - b'Jinja2==2.11.2\n'
[2021-11-23 23:20:15,801] {pod_launcher.py:156} INFO - b'joblib @ file:///tmp/build/80754af9/joblib_1594236160679/work\n'
[2021-11-23 23:20:15,801] {pod_launcher.py:156} INFO - b'json5==0.9.5\n'
[2021-11-23 23:20:15,801] {pod_launcher.py:156} INFO - b'jsonschema==3.2.0\n'
[2021-11-23 23:20:15,801] {pod_launcher.py:156} INFO - b'jupyter==1.0.0\n'
[2021-11-23 23:20:15,801] {pod_launcher.py:156} INFO - b'jupyter-client==6.1.7\n'
[2021-11-23 23:20:15,802] {pod_launcher.py:156} INFO - b'jupyter-console==6.1.0\n'
[2021-11-23 23:20:15,802] {pod_launcher.py:156} INFO - b'jupyter-core==4.6.3\n'
[2021-11-23 23:20:15,802] {pod_launcher.py:156} INFO - b'jupyterlab==2.1.5\n'
[2021-11-23 23:20:15,802] {pod_launcher.py:156} INFO - b'jupyterlab-pygments==0.1.1\n'
[2021-11-23 23:20:15,802] {pod_launcher.py:156} INFO - b'jupyterlab-server @ file:///tmp/build/80754af9/jupyterlab_server_1594164409481/work\n'
[2021-11-23 23:20:15,802] {pod_launcher.py:156} INFO - b'keyring @ file:///tmp/build/80754af9/keyring_1593109721646/work\n'
[2021-11-23 23:20:15,803] {pod_launcher.py:156} INFO - b'kiwisolver==1.2.0\n'
[2021-11-23 23:20:15,803] {pod_launcher.py:156} INFO - b'lazy-object-proxy==1.4.3\n'
[2021-11-23 23:20:15,803] {pod_launcher.py:156} INFO - b'libarchive-c==2.9\n'
[2021-11-23 23:20:15,803] {pod_launcher.py:156} INFO - b'llvmlite==0.33.0+1.g022ab0f\n'
[2021-11-23 23:20:15,804] {pod_launcher.py:156} INFO - b'locket==0.2.0\n'
[2021-11-23 23:20:15,804] {pod_launcher.py:156} INFO - b'lxml @ file:///tmp/build/80754af9/lxml_1594826779415/work\n'
[2021-11-23 23:20:15,804] {pod_launcher.py:156} INFO - b'MarkupSafe==1.1.1\n'
[2021-11-23 23:20:15,804] {pod_launcher.py:156} INFO - b'matplotlib==3.2.1\n'
[2021-11-23 23:20:15,804] {pod_launcher.py:156} INFO - b'mccabe==0.6.1\n'
[2021-11-23 23:20:15,804] {pod_launcher.py:156} INFO - b'memoized-property==1.0.3\n'
[2021-11-23 23:20:15,805] {pod_launcher.py:156} INFO - b'minio==6.0.2\n'
[2021-11-23 23:20:15,805] {pod_launcher.py:156} INFO - b'mistune==0.8.4\n'
[2021-11-23 23:20:15,805] {pod_launcher.py:156} INFO - b'mkl-fft==1.1.0\n'
[2021-11-23 23:20:15,806] {pod_launcher.py:156} INFO - b'mkl-random==1.1.1\n'
[2021-11-23 23:20:15,806] {pod_launcher.py:156} INFO - b'mkl-service==2.3.0\n'
[2021-11-23 23:20:15,806] {pod_launcher.py:156} INFO - b'mock==4.0.2\n'
[2021-11-23 23:20:15,806] {pod_launcher.py:156} INFO - b'more-itertools==8.4.0\n'
[2021-11-23 23:20:15,807] {pod_launcher.py:156} INFO - b'mpmath==1.1.0\n'
[2021-11-23 23:20:15,807] {pod_launcher.py:156} INFO - b'msgpack==1.0.0\n'
[2021-11-23 23:20:15,807] {pod_launcher.py:156} INFO - b'multipledispatch==0.6.0\n'
[2021-11-23 23:20:15,807] {pod_launcher.py:156} INFO - b'mypy-extensions==0.4.3\n'
[2021-11-23 23:20:15,807] {pod_launcher.py:156} INFO - b'navigator-updater==0.2.1\n'
[2021-11-23 23:20:15,807] {pod_launcher.py:156} INFO - b'nbclient==0.5.0\n'
[2021-11-23 23:20:15,808] {pod_launcher.py:156} INFO - b'nbconvert==6.0.3\n'
[2021-11-23 23:20:15,808] {pod_launcher.py:156} INFO - b'nbformat==5.0.7\n'
[2021-11-23 23:20:15,808] {pod_launcher.py:156} INFO - b'nest-asyncio==1.4.0\n'
[2021-11-23 23:20:15,808] {pod_launcher.py:156} INFO - b'networkx @ file:///tmp/build/80754af9/networkx_1594377231366/work\n'
[2021-11-23 23:20:15,808] {pod_launcher.py:156} INFO - b'nltk @ file:///tmp/build/80754af9/nltk_1592496090529/work\n'
[2021-11-23 23:20:15,808] {pod_launcher.py:156} INFO - b'nose==1.3.7\n'
[2021-11-23 23:20:15,809] {pod_launcher.py:156} INFO - b'notebook==6.1.4\n'
[2021-11-23 23:20:15,809] {pod_launcher.py:156} INFO - b'numba==0.50.1\n'
[2021-11-23 23:20:15,809] {pod_launcher.py:156} INFO - b'numexpr==2.7.1\n'
[2021-11-23 23:20:15,809] {pod_launcher.py:156} INFO - b'numpy==1.18.5\n'
[2021-11-23 23:20:15,810] {pod_launcher.py:156} INFO - b'numpydoc @ file:///tmp/build/80754af9/numpydoc_1594166760263/work\n'
[2021-11-23 23:20:15,810] {pod_launcher.py:156} INFO - b'olefile==0.46\n'
[2021-11-23 23:20:15,810] {pod_launcher.py:156} INFO - b'openpyxl @ file:///tmp/build/80754af9/openpyxl_1594167385094/work\n'
[2021-11-23 23:20:15,810] {pod_launcher.py:156} INFO - b'opt-einsum==2.3.2\n'
[2021-11-23 23:20:15,810] {pod_launcher.py:156} INFO - b'packaging==20.4\n'
[2021-11-23 23:20:15,810] {pod_launcher.py:156} INFO - b'pandas==1.0.3\n'
[2021-11-23 23:20:15,811] {pod_launcher.py:156} INFO - b'pandocfilters==1.4.2\n'
[2021-11-23 23:20:15,811] {pod_launcher.py:156} INFO - b'papermill==2.1.2\n'
[2021-11-23 23:20:15,811] {pod_launcher.py:156} INFO - b'parso==0.7.0\n'
[2021-11-23 23:20:15,811] {pod_launcher.py:156} INFO - b'partd==1.1.0\n'
[2021-11-23 23:20:15,811] {pod_launcher.py:156} INFO - b'path==13.1.0\n'
[2021-11-23 23:20:15,811] {pod_launcher.py:156} INFO - b'pathlib2==2.3.5\n'
[2021-11-23 23:20:15,812] {pod_launcher.py:156} INFO - b'pathspec==0.9.0\n'
[2021-11-23 23:20:15,812] {pod_launcher.py:156} INFO - b'pathtools==0.1.2\n'
[2021-11-23 23:20:15,812] {pod_launcher.py:156} INFO - b'patsy==0.5.1\n'
[2021-11-23 23:20:15,812] {pod_launcher.py:156} INFO - b'pep8==1.7.1\n'
[2021-11-23 23:20:15,812] {pod_launcher.py:156} INFO - b'pexpect==4.8.0\n'
[2021-11-23 23:20:15,813] {pod_launcher.py:156} INFO - b'pickleshare==0.7.5\n'
[2021-11-23 23:20:15,813] {pod_launcher.py:156} INFO - b'Pillow @ file:///tmp/build/80754af9/pillow_1594307295532/work\n'
[2021-11-23 23:20:15,813] {pod_launcher.py:156} INFO - b'pkginfo==1.5.0.1\n'
[2021-11-23 23:20:15,813] {pod_launcher.py:156} INFO - b'platformdirs==2.4.0\n'
[2021-11-23 23:20:15,813] {pod_launcher.py:156} INFO - b'plotly==4.10.0\n'
[2021-11-23 23:20:15,814] {pod_launcher.py:156} INFO - b'pluggy==0.13.1\n'
[2021-11-23 23:20:15,814] {pod_launcher.py:156} INFO - b'ply==3.11\n'
[2021-11-23 23:20:15,814] {pod_launcher.py:156} INFO - b'prometheus-client==0.8.0\n'
[2021-11-23 23:20:15,814] {pod_launcher.py:156} INFO - b'prompt-toolkit==3.0.5\n'
[2021-11-23 23:20:15,814] {pod_launcher.py:156} INFO - b'protobuf==3.13.0\n'
[2021-11-23 23:20:15,814] {pod_launcher.py:156} INFO - b'psutil==5.7.0\n'
[2021-11-23 23:20:15,815] {pod_launcher.py:156} INFO - b'ptyprocess==0.6.0\n'
[2021-11-23 23:20:15,815] {pod_launcher.py:156} INFO - b'py @ file:///tmp/build/80754af9/py_1593446248552/work\n'
[2021-11-23 23:20:15,815] {pod_launcher.py:156} INFO - b'pyarrow==1.0.1\n'
[2021-11-23 23:20:15,815] {pod_launcher.py:156} INFO - b'pycodestyle==2.6.0\n'
[2021-11-23 23:20:15,815] {pod_launcher.py:156} INFO - b'pycosat==0.6.3\n'
[2021-11-23 23:20:15,815] {pod_launcher.py:156} INFO - b'pycparser @ file:///tmp/build/80754af9/pycparser_1594388511720/work\n'
[2021-11-23 23:20:15,816] {pod_launcher.py:156} INFO - b'pycurl==7.43.0.5\n'
[2021-11-23 23:20:15,816] {pod_launcher.py:156} INFO - b'pydocstyle @ file:///tmp/build/80754af9/pydocstyle_1592848020240/work\n'
[2021-11-23 23:20:15,816] {pod_launcher.py:156} INFO - b'pyflakes==2.2.0\n'
[2021-11-23 23:20:15,816] {pod_launcher.py:156} INFO - b'Pygments==2.6.1\n'
[2021-11-23 23:20:15,816] {pod_launcher.py:156} INFO - b'pylint @ file:///tmp/build/80754af9/pylint_1592496053748/work\n'
[2021-11-23 23:20:15,816] {pod_launcher.py:156} INFO - b'pyodbc===4.0.0-unsupported\n'
[2021-11-23 23:20:15,817] {pod_launcher.py:156} INFO - b'pyOpenSSL @ file:///tmp/build/80754af9/pyopenssl_1594392929924/work\n'
[2021-11-23 23:20:15,817] {pod_launcher.py:156} INFO - b'pyparsing==2.4.7\n'
[2021-11-23 23:20:15,817] {pod_launcher.py:156} INFO - b'pyrsistent==0.16.0\n'
[2021-11-23 23:20:15,817] {pod_launcher.py:156} INFO - b'PySocks==1.7.1\n'
[2021-11-23 23:20:15,817] {pod_launcher.py:156} INFO - b'pytest==5.4.3\n'
[2021-11-23 23:20:15,817] {pod_launcher.py:156} INFO - b'python-dateutil==2.8.1\n'
[2021-11-23 23:20:15,818] {pod_launcher.py:156} INFO - b'python-jsonrpc-server @ file:///tmp/build/80754af9/python-jsonrpc-server_1594397536060/work\n'
[2021-11-23 23:20:15,818] {pod_launcher.py:156} INFO - b'python-language-server @ file:///tmp/build/80754af9/python-language-server_1594161909948/work\n'
[2021-11-23 23:20:15,818] {pod_launcher.py:156} INFO - b'pytz==2020.1\n'
[2021-11-23 23:20:15,818] {pod_launcher.py:156} INFO - b'PyWavelets==1.1.1\n'
[2021-11-23 23:20:15,818] {pod_launcher.py:156} INFO - b'pyxdg==0.26\n'
[2021-11-23 23:20:15,818] {pod_launcher.py:156} INFO - b'PyYAML==5.3.1\n'
[2021-11-23 23:20:15,819] {pod_launcher.py:156} INFO - b'pyzmq==19.0.1\n'
[2021-11-23 23:20:15,819] {pod_launcher.py:156} INFO - b'QDarkStyle==2.8.1\n'
[2021-11-23 23:20:15,819] {pod_launcher.py:156} INFO - b'QtAwesome==0.7.2\n'
[2021-11-23 23:20:15,819] {pod_launcher.py:156} INFO - b'qtconsole @ file:///tmp/build/80754af9/qtconsole_1592848611704/work\n'
[2021-11-23 23:20:15,819] {pod_launcher.py:156} INFO - b'QtPy==1.9.0\n'
[2021-11-23 23:20:15,819] {pod_launcher.py:156} INFO - b'regex==2021.11.10\n'
[2021-11-23 23:20:15,820] {pod_launcher.py:156} INFO - b'requests @ file:///tmp/build/80754af9/requests_1592841827918/work\n'
[2021-11-23 23:20:15,820] {pod_launcher.py:156} INFO - b'retrying==1.3.3\n'
[2021-11-23 23:20:15,820] {pod_launcher.py:156} INFO - b'rope==0.17.0\n'
[2021-11-23 23:20:15,820] {pod_launcher.py:156} INFO - b'Rtree==0.9.4\n'
[2021-11-23 23:20:15,821] {pod_launcher.py:156} INFO - b'ruamel-yaml==0.15.87\n'
[2021-11-23 23:20:15,821] {pod_launcher.py:156} INFO - b'scikit-image==0.16.2\n'
[2021-11-23 23:20:15,821] {pod_launcher.py:156} INFO - b'scikit-learn==0.23.2\n'
[2021-11-23 23:20:15,821] {pod_launcher.py:156} INFO - b'scipy==1.5.2\n'
[2021-11-23 23:20:15,821] {pod_launcher.py:156} INFO - b'seaborn==0.11.0\n'
[2021-11-23 23:20:15,822] {pod_launcher.py:156} INFO - b'SecretStorage==3.1.2\n'
[2021-11-23 23:20:15,822] {pod_launcher.py:156} INFO - b'Send2Trash==1.5.0\n'
[2021-11-23 23:20:15,823] {pod_launcher.py:156} INFO - b'simplegeneric==0.8.1\n'
[2021-11-23 23:20:15,823] {pod_launcher.py:156} INFO - b'singledispatch==3.4.0.3\n'
[2021-11-23 23:20:15,823] {pod_launcher.py:156} INFO - b'sip==4.19.13\n'
[2021-11-23 23:20:15,823] {pod_launcher.py:156} INFO - b'six==1.15.0\n'
[2021-11-23 23:20:15,824] {pod_launcher.py:156} INFO - b'snowballstemmer==2.0.0\n'
[2021-11-23 23:20:15,824] {pod_launcher.py:156} INFO - b'sortedcollections==1.2.1\n'
[2021-11-23 23:20:15,824] {pod_launcher.py:156} INFO - b'sortedcontainers==2.2.2\n'
[2021-11-23 23:20:15,824] {pod_launcher.py:156} INFO - b'soupsieve==2.0.1\n'
[2021-11-23 23:20:15,824] {pod_launcher.py:156} INFO - b'Sphinx @ file:///tmp/build/80754af9/sphinx_1594223420021/work\n'
[2021-11-23 23:20:15,825] {pod_launcher.py:156} INFO - b'sphinxcontrib-applehelp==1.0.2\n'
[2021-11-23 23:20:15,826] {pod_launcher.py:156} INFO - b'sphinxcontrib-devhelp==1.0.2\n'
[2021-11-23 23:20:15,826] {pod_launcher.py:156} INFO - b'sphinxcontrib-htmlhelp==1.0.3\n'
[2021-11-23 23:20:15,827] {pod_launcher.py:156} INFO - b'sphinxcontrib-jsmath==1.0.1\n'
[2021-11-23 23:20:15,827] {pod_launcher.py:156} INFO - b'sphinxcontrib-qthelp==1.0.3\n'
[2021-11-23 23:20:15,828] {pod_launcher.py:156} INFO - b'sphinxcontrib-serializinghtml==1.1.4\n'
[2021-11-23 23:20:15,828] {pod_launcher.py:156} INFO - b'sphinxcontrib-websupport @ file:///tmp/build/80754af9/sphinxcontrib-websupport_1593446360927/work\n'
[2021-11-23 23:20:15,829] {pod_launcher.py:156} INFO - b'spyder @ file:///tmp/build/80754af9/spyder_1594832131358/work\n'
[2021-11-23 23:20:15,829] {pod_launcher.py:156} INFO - b'spyder-kernels @ file:///tmp/build/80754af9/spyder-kernels_1594751551963/work\n'
[2021-11-23 23:20:15,829] {pod_launcher.py:156} INFO - b'SQLAlchemy @ file:///tmp/build/80754af9/sqlalchemy_1593446299926/work\n'
[2021-11-23 23:20:15,829] {pod_launcher.py:156} INFO - b'statsmodels==0.11.1\n'
[2021-11-23 23:20:15,829] {pod_launcher.py:156} INFO - b'sympy @ file:///tmp/build/80754af9/sympy_1594236545715/work\n'
[2021-11-23 23:20:15,829] {pod_launcher.py:156} INFO - b'tables==3.6.1\n'
[2021-11-23 23:20:15,830] {pod_launcher.py:156} INFO - b'tblib==1.6.0\n'
[2021-11-23 23:20:15,830] {pod_launcher.py:156} INFO - b'tenacity==8.0.1\n'
[2021-11-23 23:20:15,830] {pod_launcher.py:156} INFO - b'terminado==0.8.3\n'
[2021-11-23 23:20:15,830] {pod_launcher.py:156} INFO - b'testpath==0.4.4\n'
[2021-11-23 23:20:15,830] {pod_launcher.py:156} INFO - b'text-extensions-for-pandas @ git+https://github.com/frreiss/text-extensions-for-pandas@f5be77d6972792cfc49c312af525d887a20c976b\n'
[2021-11-23 23:20:15,831] {pod_launcher.py:156} INFO - b'textwrap3==0.9.2\n'
[2021-11-23 23:20:15,831] {pod_launcher.py:156} INFO - b'threadpoolctl @ file:///tmp/tmp9twdgx9k/threadpoolctl-2.1.0-py3-none-any.whl\n'
[2021-11-23 23:20:15,831] {pod_launcher.py:156} INFO - b'thrift==0.13.0\n'
[2021-11-23 23:20:15,831] {pod_launcher.py:156} INFO - b'toml @ file:///tmp/build/80754af9/toml_1592853716807/work\n'
[2021-11-23 23:20:15,831] {pod_launcher.py:156} INFO - b'tomli==1.2.2\n'
[2021-11-23 23:20:15,831] {pod_launcher.py:156} INFO - b'toolz==0.10.0\n'
[2021-11-23 23:20:15,832] {pod_launcher.py:156} INFO - b'tornado==6.0.4\n'
[2021-11-23 23:20:15,832] {pod_launcher.py:156} INFO - b'tqdm @ file:///tmp/build/80754af9/tqdm_1593446365756/work\n'
[2021-11-23 23:20:15,832] {pod_launcher.py:156} INFO - b'traitlets==4.3.3\n'
[2021-11-23 23:20:15,832] {pod_launcher.py:156} INFO - b'typing-extensions==4.0.0\n'
[2021-11-23 23:20:15,832] {pod_launcher.py:156} INFO - b'ujson==1.35\n'
[2021-11-23 23:20:15,832] {pod_launcher.py:156} INFO - b'unicodecsv==0.14.1\n'
[2021-11-23 23:20:15,833] {pod_launcher.py:156} INFO - b'urllib3==1.26.5\n'
[2021-11-23 23:20:15,833] {pod_launcher.py:156} INFO - b'watchdog @ file:///tmp/build/80754af9/watchdog_1593447344699/work\n'
[2021-11-23 23:20:15,833] {pod_launcher.py:156} INFO - b'wcwidth @ file:///tmp/build/80754af9/wcwidth_1593447189090/work\n'
[2021-11-23 23:20:15,833] {pod_launcher.py:156} INFO - b'webencodings==0.5.1\n'
[2021-11-23 23:20:15,833] {pod_launcher.py:156} INFO - b'Werkzeug==1.0.1\n'
[2021-11-23 23:20:15,833] {pod_launcher.py:156} INFO - b'widgetsnbextension==3.5.1\n'
[2021-11-23 23:20:15,834] {pod_launcher.py:156} INFO - b'wrapt==1.11.2\n'
[2021-11-23 23:20:15,834] {pod_launcher.py:156} INFO - b'wurlitzer @ file:///tmp/build/80754af9/wurlitzer_1594753850195/work\n'
[2021-11-23 23:20:15,834] {pod_launcher.py:156} INFO - b'xlrd==1.2.0\n'
[2021-11-23 23:20:15,834] {pod_launcher.py:156} INFO - b'XlsxWriter==1.2.9\n'
[2021-11-23 23:20:15,834] {pod_launcher.py:156} INFO - b'xlwt==1.3.0\n'
[2021-11-23 23:20:15,834] {pod_launcher.py:156} INFO - b'xmltodict==0.12.0\n'
[2021-11-23 23:20:15,835] {pod_launcher.py:156} INFO - b'yapf @ file:///tmp/build/80754af9/yapf_1593528177422/work\n'
[2021-11-23 23:20:15,835] {pod_launcher.py:156} INFO - b'zict==2.0.0\n'
[2021-11-23 23:20:15,835] {pod_launcher.py:156} INFO - b'zipp==3.1.0\n'
[2021-11-23 23:20:15,836] {pod_launcher.py:156} INFO - b'zope.event==4.4\n'
[2021-11-23 23:20:15,836] {pod_launcher.py:156} INFO - b'zope.interface==4.7.1\n'
[2021-11-23 23:20:15,836] {pod_launcher.py:156} INFO - b"[I 23:20:15.821] 'us_data-1123151331':'fit_us_data' - Packages installed (10.804 secs)\n"
[2021-11-23 23:20:15,963] {pod_launcher.py:156} INFO - b"[I 23:20:15.961] 'us_data-1123151331':'fit_us_data' - processing dependencies \n"
[2021-11-23 23:20:16,004] {pod_launcher.py:156} INFO - b"[I 23:20:16.003] 'us_data-1123151331':'fit_us_data' - downloaded fit_us_data-884bbad3-6200-4faa-b169-0cd17cee40a4.tar.gz from bucket: ptitzler-test, object: us_data-1123151331/fit_us_data-884bbad3-6200-4faa-b169-0cd17cee40a4.tar.gz (0.042 secs)\n"
[2021-11-23 23:20:16,015] {pod_launcher.py:156} INFO - b"[I 23:20:16.014] 'us_data-1123151331':'fit_us_data' - downloaded outputs/dates.feather from bucket: ptitzler-test, object: us_data-1123151331/outputs/dates.feather (0.011 secs)\n"
[2021-11-23 23:20:16,320] {pod_launcher.py:156} INFO - b"[I 23:20:16.319] 'us_data-1123151331':'fit_us_data' - downloaded outputs/us_counties.csv from bucket: ptitzler-test, object: us_data-1123151331/outputs/us_counties.csv (0.304 secs)\n"
[2021-11-23 23:20:16,328] {pod_launcher.py:156} INFO - b"[I 23:20:16.327] 'us_data-1123151331':'fit_us_data' - downloaded outputs/us_counties_clean_meta.json from bucket: ptitzler-test, object: us_data-1123151331/outputs/us_counties_clean_meta.json (0.008 secs)\n"
[2021-11-23 23:20:16,341] {pod_launcher.py:156} INFO - b"[I 23:20:16.336] 'us_data-1123151331':'fit_us_data' - downloaded outputs/us_counties_meta.json from bucket: ptitzler-test, object: us_data-1123151331/outputs/us_counties_meta.json (0.008 secs)\n"
[2021-11-23 23:20:16,360] {pod_launcher.py:156} INFO - b"[I 23:20:16.358] 'us_data-1123151331':'fit_us_data' - downloaded outputs/us_counties_clean.feather from bucket: ptitzler-test, object: us_data-1123151331/outputs/us_counties_clean.feather (0.022 secs)\n"
[2021-11-23 23:20:16,698] {pod_launcher.py:156} INFO - b"[I 23:20:16.697] 'us_data-1123151331':'fit_us_data' - downloaded outputs/us_counties_clean.csv from bucket: ptitzler-test, object: us_data-1123151331/outputs/us_counties_clean.csv (0.339 secs)\n"
[2021-11-23 23:20:16,709] {pod_launcher.py:156} INFO - b"tar: Removing leading `/' from member names\n"
[2021-11-23 23:20:16,710] {pod_launcher.py:156} INFO - b'/\n'
[2021-11-23 23:20:16,710] {pod_launcher.py:156} INFO - b'fit_us_data.ipynb\n'
[2021-11-23 23:20:16,716] {pod_launcher.py:156} INFO - b'util.py\n'
[2021-11-23 23:20:16,735] {pod_launcher.py:156} INFO - b"[I 23:20:16.716] 'us_data-1123151331':'fit_us_data' - dependencies processed (0.755 secs)\n"
[2021-11-23 23:20:16,736] {pod_launcher.py:156} INFO - b"[I 23:20:16.717] 'us_data-1123151331':'fit_us_data' - executing notebook using 'papermill fit_us_data.ipynb fit_us_data-output.ipynb' \n"
[2021-11-23 23:20:17,205] {pod_launcher.py:156} INFO - b"/opt/conda/lib/python3.8/site-packages/requests/__init__.py:89: RequestsDependencyWarning: urllib3 (1.26.5) or chardet (3.0.4) doesn't match a supported version!\n"
[2021-11-23 23:20:17,206] {pod_launcher.py:156} INFO - b'  warnings.warn("urllib3 ({}) or chardet ({}) doesn\'t match a supported "\n'
[2021-11-23 23:20:17,206] {pod_launcher.py:156} INFO - b'[I 23:20:17.205] Input Notebook:  fit_us_data.ipynb\n'
[2021-11-23 23:20:17,206] {pod_launcher.py:156} INFO - b'[I 23:20:17.205] Output Notebook: fit_us_data-output.ipynb\n'
[2021-11-23 23:20:18,481] {pod_launcher.py:156} INFO - b'\rExecuting:   0%|          | 0/36 [00:00<?, ?cell/s][I 23:20:18.480] Executing notebook with kernel: python3\n'
[2021-11-23 23:20:23,156] {pod_launcher.py:156} INFO - b'\rExecuting:   3%|\xe2\x96\x8e         | 1/36 [00:01<00:45,  1.29s/cell]\rExecuting:   6%|\xe2\x96\x8c         | 2/36 [00:03<00:50,  1.50s/cell]\rExecuting:  11%|\xe2\x96\x88         | 4/36 [00:03<00:35,  1.10s/cell]\rExecuting:  17%|\xe2\x96\x88\xe2\x96\x8b        | 6/36 [00:03<00:23,  1.26cell/s]\rExecuting:  19%|\xe2\x96\x88\xe2\x96\x89        | 7/36 [00:04<00:25,  1.16cell/s]\rExecuting:  25%|\xe2\x96\x88\xe2\x96\x88\xe2\x96\x8c       | 9/36 [00:05<00:18,  1.48cell/s]\rExecuting:  25%|\xe2\x96\x88\xe2\x96\x88\xe2\x96\x8c       | 9/36 [00:05<00:17,  1.54cell/s]\n'
[2021-11-23 23:20:23,157] {pod_launcher.py:156} INFO - b"[E 23:20:23.152] Unexpected error: <class 'papermill.exceptions.PapermillExecutionError'>\n"
[2021-11-23 23:20:23,302] {pod_launcher.py:156} INFO - b"[I 23:20:23.282] 'us_data-1123151331':'fit_us_data' - converting from fit_us_data-output.ipynb to fit_us_data.html \n"
[2021-11-23 23:20:23,984] {pod_launcher.py:156} INFO - b"[I 23:20:23.979] 'us_data-1123151331':'fit_us_data' - fit_us_data-output.ipynb converted to fit_us_data.html (0.697 secs)\n"
[2021-11-23 23:20:23,992] {pod_launcher.py:156} INFO - b"[I 23:20:23.990] 'us_data-1123151331':'fit_us_data' - uploaded fit_us_data-output.ipynb to bucket: ptitzler-test object: us_data-1123151331/fit_us_data.ipynb (0.010 secs)\n"
[2021-11-23 23:20:24,012] {pod_launcher.py:156} INFO - b"[I 23:20:24.008] 'us_data-1123151331':'fit_us_data' - uploaded fit_us_data.html to bucket: ptitzler-test object: us_data-1123151331/fit_us_data.html (0.018 secs)\n"
[2021-11-23 23:20:24,014] {pod_launcher.py:156} INFO - b'Traceback (most recent call last):\n'
[2021-11-23 23:20:24,015] {pod_launcher.py:156} INFO - b'  File "bootstrapper.py", line 434, in <module>\n'
[2021-11-23 23:20:24,016] {pod_launcher.py:156} INFO - b'    main()\n'
[2021-11-23 23:20:24,016] {pod_launcher.py:156} INFO - b'  File "bootstrapper.py", line 427, in main\n'
[2021-11-23 23:20:24,017] {pod_launcher.py:156} INFO - b'    file_op.execute()\n'
[2021-11-23 23:20:24,017] {pod_launcher.py:156} INFO - b'  File "bootstrapper.py", line 224, in execute\n'
[2021-11-23 23:20:24,017] {pod_launcher.py:156} INFO - b'    raise ex\n'
[2021-11-23 23:20:24,018] {pod_launcher.py:156} INFO - b'  File "bootstrapper.py", line 209, in execute\n'
[2021-11-23 23:20:24,018] {pod_launcher.py:156} INFO - b'    papermill.execute_notebook(notebook, notebook_output)\n'
[2021-11-23 23:20:24,018] {pod_launcher.py:156} INFO - b'  File "/opt/conda/lib/python3.8/site-packages/papermill/execute.py", line 110, in execute_notebook\n'
[2021-11-23 23:20:24,019] {pod_launcher.py:156} INFO - b'    raise_for_execution_errors(nb, output_path)\n'
[2021-11-23 23:20:24,019] {pod_launcher.py:156} INFO - b'  File "/opt/conda/lib/python3.8/site-packages/papermill/execute.py", line 222, in raise_for_execution_errors\n'
[2021-11-23 23:20:24,020] {pod_launcher.py:156} INFO - b'    raise error\n'
[2021-11-23 23:20:24,020] {pod_launcher.py:156} INFO - b'papermill.exceptions.PapermillExecutionError: \n'
[2021-11-23 23:20:24,021] {pod_launcher.py:156} INFO - b'---------------------------------------------------------------------------\n'
[2021-11-23 23:20:24,021] {pod_launcher.py:156} INFO - b'Exception encountered at "In [5]":\n'
[2021-11-23 23:20:24,022] {pod_launcher.py:156} INFO - b'---------------------------------------------------------------------------\n'
[2021-11-23 23:20:24,022] {pod_launcher.py:156} INFO - b'AttributeError                            Traceback (most recent call last)\n'
[2021-11-23 23:20:24,022] {pod_launcher.py:156} INFO - b'<ipython-input-5-26eeebe14cd8> in <module>\n'
[2021-11-23 23:20:24,023] {pod_launcher.py:156} INFO - b'     31 to_drop = []\n'
[2021-11-23 23:20:24,023] {pod_launcher.py:156} INFO - b'     32 for colname in filtered.columns:\n'
[2021-11-23 23:20:24,023] {pod_launcher.py:156} INFO - b'---> 33     if not isinstance(filtered[colname].dtype, tp.TensorDtype):\n'
[2021-11-23 23:20:24,024] {pod_launcher.py:156} INFO - b'     34         metadata_cols.append(colname)\n'
[2021-11-23 23:20:24,024] {pod_launcher.py:156} INFO - b'     35     elif colname not in series_to_keep:\n'
[2021-11-23 23:20:24,024] {pod_launcher.py:156} INFO - b'\n'
[2021-11-23 23:20:24,025] {pod_launcher.py:156} INFO - b"AttributeError: module 'text_extensions_for_pandas' has no attribute 'TensorDtype'\n"
[2021-11-23 23:20:24,025] {pod_launcher.py:156} INFO - b'\n'
[2021-11-23 23:20:27,273] {pod_launcher.py:173} INFO - Event: fit-us-data-fc7801159eb44794b4b225f3ad28ce99 had an event of type Running
[2021-11-23 23:20:27,274] {pod_launcher.py:166} INFO - Pod fit-us-data-fc7801159eb44794b4b225f3ad28ce99 has state running
[2021-11-23 23:20:29,286] {pod_launcher.py:173} INFO - Event: fit-us-data-fc7801159eb44794b4b225f3ad28ce99 had an event of type Failed
[2021-11-23 23:20:29,287] {pod_launcher.py:284} INFO - Event with job id fit-us-data-fc7801159eb44794b4b225f3ad28ce99 Failed
[2021-11-23 23:20:29,306] {pod_launcher.py:173} INFO - Event: fit-us-data-fc7801159eb44794b4b225f3ad28ce99 had an event of type Failed
[2021-11-23 23:20:29,306] {pod_launcher.py:284} INFO - Event with job id fit-us-data-fc7801159eb44794b4b225f3ad28ce99 Failed
[2021-11-23 23:20:29,324] {taskinstance.py:1150} ERROR - Pod Launching failed: Pod returned a failure: failed
Traceback (most recent call last):
  File "/home/airflow/.local/lib/python3.6/site-packages/airflow/contrib/operators/kubernetes_pod_operator.py", line 287, in execute
    'Pod returned a failure: {state}'.format(state=final_state))
airflow.exceptions.AirflowException: Pod returned a failure: failed
@ptitzler ptitzler mentioned this issue Nov 24, 2021
Merged
@frreiss
Copy link
Member

frreiss commented Feb 21, 2022

I'm not seeing this on my machine as of today. Is this still a problem for you @ptitzler ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@frreiss @ptitzler