unable to insert data in Big query using custom prediction routine

[rshah1990]

When i am trying to insert a record in big query using from pandas.io import gbq , it throws some installation error.

Code:

final_df.to_gbq(destination_table="dataset_logging.drift_detection",project_id="advance-vector-233712",if_exists='append')

pandas-gbq requires google-cloud-bigquery: cannot import name 'collections_abc' from 'six.moves'

[tswast]

This is a duplicate of googleapis/google-cloud-python#9965. A fix was released in google-cloud-bigquery 1.23.1.

To fix, please upgrade your google-cloud-bigquery library and the six package.

pip install --upgrade six

[rshah1990]

This is a duplicate of googleapis/google-cloud-python#9965. A fix was released in google-cloud-bigquery 1.23.1.

To fix, please upgrade your google-cloud-bigquery library and the six package.

pip install --upgrade six

I have updated the package but its still not working.
my setup.py file:

**from setuptools import setup

REQUIRED_PACKAGES = ['sklearn','numpy','pandas','google-cloud-bigquery == 1.23.1','six == 1.13.0','pandas-gbq']

setup(
name='my_custom_code',
version='0.1',
install_requires=REQUIRED_PACKAGES,
scripts=['scikit-predictor.py'])**

Python Version: 3.5

Error:

[tswast]

Can you provide more of the ImportError traceback? It's not clear to me in which package the import is failing.

[rshah1990]

I have uploaded sample code with setup file, I have also shared entire log file here , Please let me know in case you need more information.

git.zip

[tswast]

Gonzalo, can you investigate this problem with using BigQuery from AI Platform? I can't tell from the logs what might be causing this error.

[rshah1990]

are you guys able to reproduce the issue ?
As mentioned in reference post that issue has been resolved , can you share the exact version of google-cloud-bigquery , six & pandas-gbq

[andrewferlitsch]

@gogasca PTAL

[gogasca]

We support Python 3.7. Can you please try it:

• Python 3.7
• google-cloud-bigquery 1.24.0
• pandas-gbq 0.13.1

[tbpg]

We haven't heard back in a few weeks. So, I'm going to close this. But, feel free to comment or open another issue if you have trouble with another sample.