Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ocean.py marketplace quickstart fails #89

Closed
trentmc opened this issue Jan 6, 2021 · 22 comments
Closed

ocean.py marketplace quickstart fails #89

trentmc opened this issue Jan 6, 2021 · 22 comments
Assignees
Labels
Type: Bug Something isn't working

Comments

@trentmc
Copy link
Member

trentmc commented Jan 6, 2021

In marketplace quickstart, the line asset = ocean.assets.create(metadata...) fails.

I copied the python code into a file play.py and ran that. Here's the py file.

Here's the traceback:

(venv) trentmc@trentmcLnv:~$ python play.py 
publish datatoken: begin
publish datatoken: done
Traceback (most recent call last):
  File "/home/trentmc/venv/lib/python3.6/site-packages/ocean_utils/aquarius/aquarius.py", line 70, in list_assets
    asset_list = json.loads(response)
  File "/usr/lib/python3.6/json/__init__.py", line 354, in loads
    return _default_decoder.decode(s)
  File "/usr/lib/python3.6/json/decoder.py", line 339, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/lib/python3.6/json/decoder.py", line 357, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "play.py", line 52, in <module>
    asset = ocean.assets.create(metadata, alice_wallet, service_descriptors=[download_service], data_token_address=token_address)
  File "/home/trentmc/venv/lib/python3.6/site-packages/ocean_lib/ocean/ocean_assets.py", line 190, in create
    if did in self._get_aquarius().list_assets():
  File "/home/trentmc/venv/lib/python3.6/site-packages/ocean_utils/aquarius/aquarius.py", line 74, in list_assets
    raise ValueError(response.decode('UTF-8'))
ValueError: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2 Final//EN">
<title>500 Internal Server Error</title>
<h1>Internal Server Error</h1>
<p>The server encountered an internal error and was unable to complete your request. Either the server is overloaded or there is an error in the application.</p>
@trentmc trentmc added the Type: Bug Something isn't working label Jan 6, 2021
@trentmc trentmc self-assigned this Jan 6, 2021
@trentmc
Copy link
Member Author

trentmc commented Jan 6, 2021

Debugging info:

In aquarius.py (~/venv/lib/python3.6/site-packages/ocean_utils/aquarius/aquarius.py), method list_assets(), right before line json.loads(response), values are:

(Pdb) response
b'<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2 Final//EN">\n<title>500 Internal Server Error</title>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error and was unable to complete your request. Either the server is overloaded or there is an error in the application.</p>\n'
(Pdb) self._base_url
'https://aquarius.rinkeby.v3.dev-ocean.com/api/v1/aquarius/assets'
(Pdb) self.requests_session.get(self._base_url).content
b'<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2 Final//EN">\n<title>500 Internal Server Error</title>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error and was unable to complete your request. Either the server is overloaded or there is an error in the application.</p>\n'
(Pdb) self._headers
{'content-type': 'application/json'}
(Pdb) self.requests_session
<requests.sessions.Session object at 0x7f7ecffb90f0>
(Pdb) print(self.requests_session)
<requests.sessions.Session object at 0x7f7ecffb90f0>
(Pdb) dir(self.requests_session)
['__attrs__', '__class__', '__delattr__', '__dict__', '__dir__', '__doc__', '__enter__', '__eq__', '__exit__', '__format__', '__ge__', '__getattribute__', '__getstate__', '__gt__', '__hash__', '__init__', '__init_subclass__', '__le__', '__lt__', '__module__', '__ne__', '__new__', '__reduce__', '__reduce_ex__', '__repr__', '__setattr__', '__setstate__', '__sizeof__', '__str__', '__subclasshook__', '__weakref__', 'adapters', 'auth', 'cert', 'close', 'cookies', 'delete', 'get', 'get_adapter', 'get_redirect_target', 'head', 'headers', 'hooks', 'max_redirects', 'merge_environment_settings', 'mount', 'options', 'params', 'patch', 'post', 'prepare_request', 'proxies', 'put', 'rebuild_auth', 'rebuild_method', 'rebuild_proxies', 'request', 'resolve_redirects', 'send', 'should_strip_auth', 'stream', 'trust_env', 'verify']
(Pdb) self.url
'https://aquarius.rinkeby.v3.dev-ocean.com/api/v1/aquarius/assets/ddo'
(Pdb) self.root_url
'https://aquarius.rinkeby.v3.dev-ocean.com'
(Pdb) self.get_service_endpoint()
'https://aquarius.rinkeby.v3.dev-ocean.com/api/v1/aquarius/assets/ddo/{did}'

@trentmc trentmc changed the title ocean.py marketplace quickstart fails ocean.py marketplace quickstart fails. May be an Aquarius issue. Jan 6, 2021
@trentmc
Copy link
Member Author

trentmc commented Jan 6, 2021

Just talking with @alexcos20 : the problem is that ocean.py does not know what the smart contract addresses on rinkeby are. Unlike ocean.js, it's not smart enough to figure those out itself at this point.

This can be fixed in the quickstart by setting the ADDRESS_FILE envvar.

Here's how ocean.js is working: https://github.com/oceanprotocol/ocean.js/blob/main/src/utils/ConfigHelper.ts#L21

@trentmc
Copy link
Member Author

trentmc commented Jan 7, 2021

The rinkeby addresses for ocean.py and contracts are out of sync. Not sure which is the one in error. New github issue created:
https://app.zenhub.com/workspaces/ocean-main-5e5e5a97e91ce03f380fb9b7/issues/oceanprotocol/ocean.py/92

@trentmc
Copy link
Member Author

trentmc commented Jan 7, 2021

To try to get this issue solved without waiting for the fix listed in #92 above, I changed the addresses locally. That is:

  1. In bash:
export NAME_ADDRESS_FILE=/home/trentmc/address.json
  1. Created I created /home/trentmc/address.json by copying ocean.py/artifacts/address.json and changing the following fields:
  "rinkeby": {
    "DTFactory": "0x25A232Fa6eBbd9E1F833ADF036c4472565298A8E",
    "BFactory": "0xCE79A7F7666a359dc679c21FD1514108c1300624",
    "FixedRateExchange": "0xB675f4d7D1Bf01D63CA58CA9D616c797178946f0",
    "Metadata": "0x4B38ab101c106C057Aa0335553830D313f6c8AA8",
    "Ocean": "0x8967BCF84170c91B0d24D4302C2376283b0B3a07"

Same issue :(

@trentmc
Copy link
Member Author

trentmc commented Jan 7, 2021

However it turns out that it might be just an issue with rinkeby aquarius. More digging led me to see the following. (And this is fully independent of ocean.py)

Of the bash commands below, the first two work, and the third fails.

curl https://aquarius.mainnet.oceanprotocol.com/api/v1/aquarius/assets
curl https://aquarius.ropsten.oceanprotocol.com/api/v1/aquarius/assets
curl https://aquarius.rinkeby.oceanprotocol.com/api/v1/aquarius/assets

I posted this to eng slack, Marian is taking a look.

Update: created a zenhub issue for this one. "Aquarius failing on rinkeby"
https://app.zenhub.com/workspaces/ocean-main-5e5e5a97e91ce03f380fb9b7/issues/oceanprotocol/aquarius/351

@trentmc trentmc changed the title ocean.py marketplace quickstart fails. May be an Aquarius issue. ocean.py marketplace quickstart fails Jan 7, 2021
@trentmc
Copy link
Member Author

trentmc commented Jan 7, 2021

My debugging notes, for posterity:
https://app.zenhub.com/files/266274883/a344f750-4371-4940-8723-3ded19ccf9b6/download

Ideally this ticket will be solved once the two new issues above are solved.

@trentmc
Copy link
Member Author

trentmc commented Jan 7, 2021

Of the bash commands below, the first two work, and the third fails.

Update: @ssallam worked on this, and got Aquarius to work for the third. I just checked and can confirm it's working now too.

@trentmc
Copy link
Member Author

trentmc commented Jan 7, 2021

Another issue emerged: service urls in the READMEs pointed to *.dev-ocean.com rather than *.oceanprotocol.com. I created a github issue for this: #93

@trentmc
Copy link
Member Author

trentmc commented Jan 7, 2021

Up to this point, 3 problems emerged that led to 3 corresponding github issues, as given in above comments. Each of those problems have been solved, and github issues closed.

Therefore we're now in a position to test the marketplace flow again, for this github issue.

@surajsjain
Copy link
Contributor

surajsjain commented Jan 8, 2021

The ocean.assets.create() step is now giving me the following error:

Traceback (most recent call last):
  File "path_to_virtual_env/lib/python3.8/site-packages/urllib3/connection.py", line 156, in _new_conn
    conn = connection.create_connection(
  File "path_to_virtual_env/lib/python3.8/site-packages/urllib3/util/connection.py", line 61, in create_connection
    for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
  File "/usr/lib/python3.8/socket.py", line 918, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -5] No address associated with hostname

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "path_to_virtual_env/lib/python3.8/site-packages/urllib3/connectionpool.py", line 665, in urlopen
    httplib_response = self._make_request(
  File "path_to_virtual_env/lib/python3.8/site-packages/urllib3/connectionpool.py", line 376, in _make_request
    self._validate_conn(conn)
  File "path_to_virtual_env/lib/python3.8/site-packages/urllib3/connectionpool.py", line 996, in _validate_conn
    conn.connect()
  File "path_to_virtual_env/lib/python3.8/site-packages/urllib3/connection.py", line 300, in connect
    conn = self._new_conn()
  File "path_to_virtual_env/lib/python3.8/site-packages/urllib3/connection.py", line 168, in _new_conn
    raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.VerifiedHTTPSConnection object at 0x7f54da47ab80>: Failed to establish a new connection: [Errno -5] No address associated with hostname

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "path_to_virtual_env/lib/python3.8/site-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "path_to_virtual_env/lib/python3.8/site-packages/urllib3/connectionpool.py", line 719, in urlopen
    retries = retries.increment(
  File "path_to_virtual_env/lib/python3.8/site-packages/urllib3/util/retry.py", line 436, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='aquarius.rinkeby.v3.oceanprotocol.com', port=443): Max retries exceeded with url: /api/v1/aquarius/assets (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f54da47ab80>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "path_to_virtual_env/lib/python3.8/site-packages/ocean_lib/ocean/ocean_assets.py", line 190, in create
    if did in self._get_aquarius().list_assets():
  File "path_to_virtual_env/lib/python3.8/site-packages/ocean_utils/aquarius/aquarius.py", line 65, in list_assets
    response = self.requests_session.get(self._base_url).content
  File "path_to_virtual_env/lib/python3.8/site-packages/requests/sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "path_to_virtual_env/lib/python3.8/site-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "path_to_virtual_env/lib/python3.8/site-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "path_to_virtual_env/lib/python3.8/site-packages/requests/adapters.py", line 516, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='aquarius.rinkeby.v3.oceanprotocol.com', port=443): Max retries exceeded with url: /api/v1/aquarius/assets (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f54da47ab80>: Failed to establish a new connection: [Errno -5] No address associated with hostname'))

It says Max retries exceeded with url: /api/v1/aquarius/assets. So, this one an error from Aquarius as well?

@trentmc
Copy link
Member Author

trentmc commented Jan 9, 2021

I was able to replicate your error, @surajsjain.

I fixed that error with this PR: #97

Notes:

  • originally the service had url aquarius.rinkeby.v3.dev-ocean.com (and similar for provider)
  • then we created the service aquarius.rinkeby.oceanprotocol.com, quite a while ago now. That's the ones we've been maintaining. The READMEs etc were not updated at the time. The old services at dev-ocean were / are still running.
  • ocean.py READMEs point to *.dev-ocean.com not *.oceanprotocol.com #93 was to update the READMEs etc. Done. Except the wrong new url was provided: it had the v3 in it, and it shouldn't have.
  • The PR fixes that problem.

@trentmc
Copy link
Member Author

trentmc commented Jan 9, 2021

Now it's working up to mid step 7.
#104

@trentmc
Copy link
Member Author

trentmc commented Jan 9, 2021

Here's the error I get in mid step 7, which is the current subject of this issue.

>>> order_tx_id = bob_ocean.assets.pay_for_service(
...     quote.amount, quote.data_token_address, asset.did, service.index, market_address, bob_wallet)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/trentmc/venv/lib/python3.8/site-packages/ocean_lib/ocean/ocean_assets.py", line 397, in pay_for_service
    tx_hash = dt.startOrder(from_wallet.address, amount_base, service_id, fee_receiver, from_wallet)
  File "/home/trentmc/venv/lib/python3.8/site-packages/ocean_lib/models/data_token.py", line 381, in startOrder
    return self.send_transaction(
  File "/home/trentmc/venv/lib/python3.8/site-packages/ocean_lib/web3_internal/contract_base.py", line 178, in send_transaction
    contract_fn = getattr(self.contract.functions, fn_name)(*fn_args)
  File "/home/trentmc/venv/lib/python3.8/site-packages/web3/contract.py", line 1039, in __call__
    clone._set_function_info()
  File "/home/trentmc/venv/lib/python3.8/site-packages/web3/contract.py", line 1044, in _set_function_info
    self.abi = find_matching_fn_abi(
  File "/home/trentmc/venv/lib/python3.8/site-packages/web3/utils/contracts.py", line 128, in find_matching_fn_abi
    raise ValidationError(message)
web3.exceptions.ValidationError: 
Could not identify the intended function with name `startOrder`, positional argument(s) of type `(<class 'str'>, <class 'int'>, <class 'int'>, <class 'str'>)` and keyword argument(s) of type `{}`.
Found 1 function(s) with the name `startOrder`: ['startOrder(address,uint256,uint256,address)']
Function invocation failed due to no matching argument types.

@trentmc
Copy link
Member Author

trentmc commented Jan 9, 2021

Just put in 3c5e07f

Now it's successfully running to end of step 7/7.

Still have the bonus rounds to go.

@trentmc
Copy link
Member Author

trentmc commented Jan 12, 2021

What was left: bonus rounds. I realized that we can simply deprecate these. So I did that in 508611f. Specific reasons given in that commit.

@tmk1221
Copy link

tmk1221 commented Jan 15, 2022

Im still running into @trentmc's original doc-type error.

Can someone please explicate how to resolve? I couldn't figure it out from the thread above - Thanks!

Traceback (most recent call last):
  File "/Users/traviskassab/.local/share/virtualenvs/barge-ObMt025v/lib/python3.9/site-packages/requests/models.py", line 910, in json
    return complexjson.loads(self.text, **kwargs)
  File "/opt/homebrew/Cellar/[email protected]/3.9.9/Frameworks/Python.framework/Versions/3.9/lib/python3.9/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "/opt/homebrew/Cellar/[email protected]/3.9.9/Frameworks/Python.framework/Versions/3.9/lib/python3.9/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/opt/homebrew/Cellar/[email protected]/3.9.9/Frameworks/Python.framework/Versions/3.9/lib/python3.9/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/traviskassab/ocean/barge/publish.py", line 62, in <module>
    asset = ocean.assets.create(
  File "/Users/traviskassab/.local/share/virtualenvs/barge-ObMt025v/lib/python3.9/site-packages/enforce_typing/decorator.py", line 29, in wrapper
    return func(*args, **kwargs)
  File "/Users/traviskassab/.local/share/virtualenvs/barge-ObMt025v/lib/python3.9/site-packages/ocean_lib/ocean/ocean_assets.py", line 139, in create
    validation_result, validation_errors = self.validate(metadata)
  File "/Users/traviskassab/.local/share/virtualenvs/barge-ObMt025v/lib/python3.9/site-packages/enforce_typing/decorator.py", line 29, in wrapper
    return func(*args, **kwargs)
  File "/Users/traviskassab/.local/share/virtualenvs/barge-ObMt025v/lib/python3.9/site-packages/ocean_lib/ocean/ocean_assets.py", line 580, in validate
    return self._get_aquarius(self._metadata_cache_uri).validate_metadata(metadata)
  File "/Users/traviskassab/.local/share/virtualenvs/barge-ObMt025v/lib/python3.9/site-packages/enforce_typing/decorator.py", line 29, in wrapper
    return func(*args, **kwargs)
  File "/Users/traviskassab/.local/share/virtualenvs/barge-ObMt025v/lib/python3.9/site-packages/ocean_lib/common/aquarius/aquarius.py", line 147, in validate_metadata
    parsed_response = response.json()
  File "/Users/traviskassab/.local/share/virtualenvs/barge-ObMt025v/lib/python3.9/site-packages/requests/models.py", line 917, in json
    raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: [Errno Expecting value] : 0

@calina-c
Copy link
Contributor

calina-c commented Jan 15, 2022

@tmk1221 Are you using those same inputs? Is this Aquarius the public one or is it private? Can you paste some configs? What parameters are you using for ocean.assets.create?

Please tag me and I'll try to help you out :)

@tmk1221
Copy link

tmk1221 commented Jan 15, 2022

@calina-c much appreciated - thanks for your response.

I'm running Barge, which appears to start up Aquarius on http://172.15.0.5:5000

After running Barge, aquarius_1 loops through "Trying to connect..." and then "WORKER TIMEOUT". Not sure if this is expected behavior, but please see attached "barge_log.txt" for details.

Previously I changed Aquarius to run on port 5001, because there was already a process bound to default port 5000 on my Mac Mini (i.e. airplay functionality). But I changed back to default port 5000.

Interestingly, I no longer get the doc-type error, but my program still hangs on the ocean.assets.create() line. When I escape, it prints the following message:

  File "/Users/traviskassab/ocean/barge/publish.py", line 62, in <module>
    asset = ocean.assets.create(
  File "/Users/traviskassab/.local/share/virtualenvs/barge-ObMt025v/lib/python3.9/site-packages/enforce_typing/decorator.py", line 29, in wrapper
    return func(*args, **kwargs)
  File "/Users/traviskassab/.local/share/virtualenvs/barge-ObMt025v/lib/python3.9/site-packages/ocean_lib/ocean/ocean_assets.py", line 139, in create
    validation_result, validation_errors = self.validate(metadata)
  File "/Users/traviskassab/.local/share/virtualenvs/barge-ObMt025v/lib/python3.9/site-packages/enforce_typing/decorator.py", line 29, in wrapper
    return func(*args, **kwargs)
  File "/Users/traviskassab/.local/share/virtualenvs/barge-ObMt025v/lib/python3.9/site-packages/ocean_lib/ocean/ocean_assets.py", line 580, in validate
    return self._get_aquarius(self._metadata_cache_uri).validate_metadata(metadata)
  File "/Users/traviskassab/.local/share/virtualenvs/barge-ObMt025v/lib/python3.9/site-packages/enforce_typing/decorator.py", line 29, in wrapper
    return func(*args, **kwargs)
  File "/Users/traviskassab/.local/share/virtualenvs/barge-ObMt025v/lib/python3.9/site-packages/ocean_lib/common/aquarius/aquarius.py", line 138, in validate_metadata
    response = self.requests_session.post(
  File "/Users/traviskassab/.local/share/virtualenvs/barge-ObMt025v/lib/python3.9/site-packages/requests/sessions.py", line 577, in post
    return self.request('POST', url, data=data, json=json, **kwargs)
  File "/Users/traviskassab/.local/share/virtualenvs/barge-ObMt025v/lib/python3.9/site-packages/requests/sessions.py", line 529, in request
    resp = self.send(prep, **send_kwargs)
  File "/Users/traviskassab/.local/share/virtualenvs/barge-ObMt025v/lib/python3.9/site-packages/requests/sessions.py", line 645, in send
    r = adapter.send(request, **kwargs)
  File "/Users/traviskassab/.local/share/virtualenvs/barge-ObMt025v/lib/python3.9/site-packages/requests/adapters.py", line 440, in send
    resp = conn.urlopen(
  File "/Users/traviskassab/.local/share/virtualenvs/barge-ObMt025v/lib/python3.9/site-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/Users/traviskassab/.local/share/virtualenvs/barge-ObMt025v/lib/python3.9/site-packages/urllib3/connectionpool.py", line 449, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/Users/traviskassab/.local/share/virtualenvs/barge-ObMt025v/lib/python3.9/site-packages/urllib3/connectionpool.py", line 444, in _make_request
    httplib_response = conn.getresponse()
  File "/opt/homebrew/Cellar/[email protected]/3.9.9/Frameworks/Python.framework/Versions/3.9/lib/python3.9/http/client.py", line 1377, in getresponse
    response.begin()
  File "/opt/homebrew/Cellar/[email protected]/3.9.9/Frameworks/Python.framework/Versions/3.9/lib/python3.9/http/client.py", line 320, in begin
    version, status, reason = self._read_status()
  File "/opt/homebrew/Cellar/[email protected]/3.9.9/Frameworks/Python.framework/Versions/3.9/lib/python3.9/http/client.py", line 281, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/opt/homebrew/Cellar/[email protected]/3.9.9/Frameworks/Python.framework/Versions/3.9/lib/python3.9/socket.py", line 704, in readinto
    return self._sock.recv_into(b)

Here is my address.json file in directory: /Users/traviskassab/.ocean/ocean-contracts/artifacts

{
  "rinkeby": {
   "DTFactory": "0x25A232Fa6eBbd9E1F833ADF036c4472565298A8E",
    "BFactory": "0xCE79A7F7666a359dc679c21FD1514108c1300624",
    "FixedRateExchange": "0xB675f4d7D1Bf01D63CA58CA9D616c797178946f0",
    "Metadata": "0x4B38ab101c106C057Aa0335553830D313f6c8AA8",
    "Ocean": "0x8967BCF84170c91B0d24D4302C2376283b0B3a07"
  },
  "ropsten": {
    "DTFactory": "0x6ebcCa6df2CAba986FCF44E64Ee82251c1455Dcc",
    "BFactory": "0x75be6e18c80A487C8b49663bf14f80A6495045B2",
    "FixedRateExchange": "0xA7a711A09396DF82D9be46A26B48BafdB9BB4fA6",
    "Metadata": "0x3cd7Ef1F207E1a46AAd7D5d7F5f0A5cF081Fc726",
    "Ocean": "0x5e8DCB2AfA23844bcc311B00Ad1A0C30025aADE9"
  },
  "development": {
    "DTFactory": "0x726baA2f854A3BEC2378a707AeB38c9d933Ebad6",
    "BFactory": "0x336EFb3c9E56F713dFdA4CDB3Dd0882F3226b6eE",
    "FixedRateExchange": "0xfeA10BBb093d7fcb1EDf575Aa7e28d37b9DcFcE9",
    "Metadata": "0xEEE56e2a630DD29F9A628d618E58bb173911F393",
    "Ocean": "0xc354ba9AD5dF1023C2640b14A09E61a500F21546",
    "Dispenser": "0x85cCa2B01adddCA8Df221e6027EE0D7716224202"
  },
  "mainnet": {
    "DTFactory": "0x57317f97E9EA49eBd19f7c9bB7c180b8cDcbDeB9",
    "BFactory": "0xbe0083053744ECb871510C88dC0f6b77Da162706",
    "FixedRateExchange": "0x608d05214E42722B94a54cF6114d4840FCfF84e1",
    "Metadata": "0x1a4b70d8c9DcA47cD6D0Fb3c52BB8634CA1C0Fdf",
    "Ocean": "0x967da4048cD07aB37855c090aAF366e4ce1b9F48"
  },
  "polygon": {
    "DTFactory": "0xF6410bf5d773C7a41ebFf972f38e7463FA242477",
    "BFactory": "0x69B6E54Ad2b3c2801d11d8Ad56ea1d892555b776",
    "FixedRateExchange": "0x2112Eb973af1DBf83a4f11eda82f7a7527D7Fde5",
    "Metadata": "0x80E63f73cAc60c1662f27D2DFd2EA834acddBaa8",
    "Ocean": "0x282d8efCe846A88B159800bd4130ad77443Fa1A1"
  }
}

Also, just to be throrough, I attached all compose-files, but these should now be default, and match git clone ocean.py

barge_log.txt
aquarius.txt
dashboard.txt
elasticsearch.txt
ganache.txt
network_volumes.txt
ocean_contracts.txt
provider.txt
provider2.txt
rbac.txt
redis.txt
thegraph.txt

@calina-c
Copy link
Contributor

calina-c commented Jan 16, 2022

@tmk1221 this seems to be related to a connection error, specifically from the validation endpoint. It also seems to be a problem from Aquarius itself, rather than ocean.py specifically.

If you use curl or POSTMAN and use the Aquarius root URL (GET http://172.15.0.5:5000), do you get any response? How about if you POST to the validation endpoint (http://172.15.0.5:5000/api/v1/aquarius/assets/ddo/validate) with similar metadata (as you would through ocean.py, i.e. just POST the metadata dictionary to that endpoint)?

@tmk1221
Copy link

tmk1221 commented Jan 18, 2022

Yes I believe you correct about connection error, because I don't get a response when calling either of those APIs.

In between Aquarius printing "Trying to connect" and "WORKER TIMEOUT", I see the following error.... it appears to be an issue with Gunicorn, which I tried installing previous versions, but to no avail:

aquarius_1         | --- Logging error ---
aquarius_1         | Traceback (most recent call last):
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1085, in emit
aquarius_1         |     self.flush()
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1065, in flush
aquarius_1         |     self.stream.flush()
aquarius_1         | RuntimeError: reentrant call inside <_io.BufferedWriter name='<stderr>'>
aquarius_1         | 
aquarius_1         | During handling of the above exception, another exception occurred:
aquarius_1         | 
aquarius_1         | Traceback (most recent call last):
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1085, in emit
aquarius_1         |     self.flush()
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1065, in flush
aquarius_1         |     self.stream.flush()
aquarius_1         | RuntimeError: reentrant call inside <_io.BufferedWriter name='<stderr>'>
aquarius_1         | 
aquarius_1         | During handling of the above exception, another exception occurred:
aquarius_1         | 
aquarius_1         | Traceback (most recent call last):
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1085, in emit
aquarius_1         |     self.flush()
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1065, in flush
aquarius_1         |     self.stream.flush()
aquarius_1         | RuntimeError: reentrant call inside <_io.BufferedWriter name='<stderr>'>
aquarius_1         | 
aquarius_1         | During handling of the above exception, another exception occurred:
aquarius_1         | 
aquarius_1         | Traceback (most recent call last):
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1085, in emit
aquarius_1         |     self.flush()
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1065, in flush
aquarius_1         |     self.stream.flush()
aquarius_1         | RuntimeError: reentrant call inside <_io.BufferedWriter name='<stderr>'>
aquarius_1         | 
aquarius_1         | During handling of the above exception, another exception occurred:
aquarius_1         | 
aquarius_1         | Traceback (most recent call last):
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1085, in emit
aquarius_1         |     self.flush()
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1065, in flush
aquarius_1         |     self.stream.flush()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 242, in handle_chld
aquarius_1         |     self.reap_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 530, in reap_workers
aquarius_1         |     self.log.warning(
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/glogging.py", line 261, in warning
aquarius_1         |     self.error_log.warning(msg, *args, **kwargs)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1446, in warning
aquarius_1         |     self._log(WARNING, msg, args, **kwargs)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1577, in _log
aquarius_1         |     self.handle(record)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1587, in handle
aquarius_1         |     self.callHandlers(record)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1649, in callHandlers
aquarius_1         |     hdlr.handle(record)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 950, in handle
aquarius_1         |     self.emit(record)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1089, in emit
aquarius_1         |     self.handleError(record)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1012, in handleError
aquarius_1         |     traceback.print_stack(frame, file=sys.stderr)
aquarius_1         |   File "/usr/lib/python3.8/traceback.py", line 190, in print_stack
aquarius_1         |     print_list(extract_stack(f, limit=limit), file=file)
aquarius_1         |   File "/usr/lib/python3.8/traceback.py", line 211, in extract_stack
aquarius_1         |     stack = StackSummary.extract(walk_stack(f), limit=limit)
aquarius_1         |   File "/usr/lib/python3.8/traceback.py", line 359, in extract
aquarius_1         |     result.append(FrameSummary(
aquarius_1         |   File "/usr/lib/python3.8/traceback.py", line 243, in __init__
aquarius_1         |     def __init__(self, filename, lineno, name, *, lookup_line=True,
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 242, in handle_chld
aquarius_1         |     self.reap_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 530, in reap_workers
aquarius_1         |     self.log.warning(
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/glogging.py", line 261, in warning
aquarius_1         |     self.error_log.warning(msg, *args, **kwargs)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1446, in warning
aquarius_1         |     self._log(WARNING, msg, args, **kwargs)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1577, in _log
aquarius_1         |     self.handle(record)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1587, in handle
aquarius_1         |     self.callHandlers(record)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1649, in callHandlers
aquarius_1         |     hdlr.handle(record)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 950, in handle
aquarius_1         |     self.emit(record)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1089, in emit
aquarius_1         |     self.handleError(record)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1012, in handleError
aquarius_1         |     traceback.print_stack(frame, file=sys.stderr)
aquarius_1         |   File "/usr/lib/python3.8/traceback.py", line 190, in print_stack
aquarius_1         |     print_list(extract_stack(f, limit=limit), file=file)
aquarius_1         |   File "/usr/lib/python3.8/traceback.py", line 211, in extract_stack
aquarius_1         |     stack = StackSummary.extract(walk_stack(f), limit=limit)
aquarius_1         |   File "/usr/lib/python3.8/traceback.py", line 362, in extract
aquarius_1         |     linecache.checkcache(filename)
aquarius_1         |   File "/usr/lib/python3.8/linecache.py", line 74, in checkcache
aquarius_1         |     stat = os.stat(fullname)
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 242, in handle_chld
aquarius_1         |     self.reap_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 530, in reap_workers
aquarius_1         |     self.log.warning(
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/glogging.py", line 261, in warning
aquarius_1         |     self.error_log.warning(msg, *args, **kwargs)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1446, in warning
aquarius_1         |     self._log(WARNING, msg, args, **kwargs)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1577, in _log
aquarius_1         |     self.handle(record)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1587, in handle
aquarius_1         |     self.callHandlers(record)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1649, in callHandlers
aquarius_1         |     hdlr.handle(record)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 950, in handle
aquarius_1         |     self.emit(record)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1089, in emit
aquarius_1         |     self.handleError(record)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1012, in handleError
aquarius_1         |     traceback.print_stack(frame, file=sys.stderr)
aquarius_1         |   File "/usr/lib/python3.8/traceback.py", line 190, in print_stack
aquarius_1         |     print_list(extract_stack(f, limit=limit), file=file)
aquarius_1         |   File "/usr/lib/python3.8/traceback.py", line 211, in extract_stack
aquarius_1         |     stack = StackSummary.extract(walk_stack(f), limit=limit)
aquarius_1         |   File "/usr/lib/python3.8/traceback.py", line 366, in extract
aquarius_1         |     f.line
aquarius_1         |   File "/usr/lib/python3.8/traceback.py", line 288, in line
aquarius_1         |     self._line = linecache.getline(self.filename, self.lineno).strip()
aquarius_1         |   File "/usr/lib/python3.8/linecache.py", line 16, in getline
aquarius_1         |     lines = getlines(filename, module_globals)
aquarius_1         |   File "/usr/lib/python3.8/linecache.py", line 47, in getlines
aquarius_1         |     return updatecache(filename, module_globals)
aquarius_1         |   File "/usr/lib/python3.8/linecache.py", line 136, in updatecache
aquarius_1         |     with tokenize.open(fullname) as fp:
aquarius_1         |   File "/usr/lib/python3.8/tokenize.py", line 392, in open
aquarius_1         |     buffer = _builtin_open(filename, 'rb')
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 242, in handle_chld
aquarius_1         |     self.reap_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 530, in reap_workers
aquarius_1         |     self.log.warning(
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/glogging.py", line 261, in warning
aquarius_1         |     self.error_log.warning(msg, *args, **kwargs)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1446, in warning
aquarius_1         |     self._log(WARNING, msg, args, **kwargs)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1577, in _log
aquarius_1         |     self.handle(record)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1587, in handle
aquarius_1         |     self.callHandlers(record)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1649, in callHandlers
aquarius_1         |     hdlr.handle(record)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 950, in handle
aquarius_1         |     self.emit(record)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1089, in emit
aquarius_1         |     self.handleError(record)
aquarius_1         |   File "/usr/lib/python3.8/logging/__init__.py", line 1012, in handleError
aquarius_1         |     traceback.print_stack(frame, file=sys.stderr)
aquarius_1         |   File "/usr/lib/python3.8/traceback.py", line 190, in print_stack
aquarius_1         |     print_list(extract_stack(f, limit=limit), file=file)
aquarius_1         |   File "/usr/lib/python3.8/traceback.py", line 25, in print_list
aquarius_1         |     print(item, file=file, end="")
aquarius_1         | RuntimeError: reentrant call inside <_io.BufferedWriter name='<stderr>'>
aquarius_1         | Call stack:
aquarius_1         |   File "/usr/local/bin/gunicorn", line 8, in <module>
aquarius_1         |     sys.exit(run())
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/app/wsgiapp.py", line 67, in run
aquarius_1         |     WSGIApplication("%(prog)s [OPTIONS] [APP_MODULE]").run()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/app/base.py", line 231, in run
aquarius_1         |     super().run()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/app/base.py", line 72, in run
aquarius_1         |     Arbiter(self).run()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 211, in run
aquarius_1         |     self.manage_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 551, in manage_workers
aquarius_1         |     self.spawn_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 623, in spawn_workers
aquarius_1         |     time.sleep(0.1 * random.random())
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 242, in handle_chld
aquarius_1         |     self.reap_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 530, in reap_workers
aquarius_1         |     self.log.warning(
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/glogging.py", line 261, in warning
aquarius_1         |     self.error_log.warning(msg, *args, **kwargs)
aquarius_1         | Message: 'Worker with pid %s was terminated due to signal %s'
aquarius_1         | Arguments: (42466, 9)
aquarius_1         | [2022-01-18 03:04:37 +0000] [44788] [INFO] Booting worker with pid: 44788
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/app/wsgiapp.py", line 67, in run
aquarius_1         |     WSGIApplication("%(prog)s [OPTIONS] [APP_MODULE]").run()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/app/base.py", line 231, in run
aquarius_1         |     super().run()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/app/base.py", line 72, in run
aquarius_1         |     Arbiter(self).run()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 211, in run
aquarius_1         |     self.manage_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 551, in manage_workers
aquarius_1         |     self.spawn_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 623, in spawn_workers
aquarius_1         |     time.sleep(0.1 * random.random())
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 242, in handle_chld
aquarius_1         |     self.reap_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 530, in reap_workers
aquarius_1         |     self.log.warning(
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/glogging.py", line 261, in warning
aquarius_1         |     self.error_log.warning(msg, *args, **kwargs)
aquarius_1         | Message: 'Worker with pid %s was terminated due to signal %s'
aquarius_1         | Arguments: (42466, 9)
aquarius_1         | [2022-01-18 03:04:37 +0000] [44790] [INFO] Booting worker with pid: 44790
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/app/wsgiapp.py", line 67, in run
aquarius_1         |     WSGIApplication("%(prog)s [OPTIONS] [APP_MODULE]").run()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/app/base.py", line 231, in run
aquarius_1         |     super().run()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/app/base.py", line 72, in run
aquarius_1         |     Arbiter(self).run()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 211, in run
aquarius_1         |     self.manage_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 551, in manage_workers
aquarius_1         |     self.spawn_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 623, in spawn_workers
aquarius_1         |     time.sleep(0.1 * random.random())
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 242, in handle_chld
aquarius_1         |     self.reap_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 530, in reap_workers
aquarius_1         |     self.log.warning(
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/glogging.py", line 261, in warning
aquarius_1         |     self.error_log.warning(msg, *args, **kwargs)
aquarius_1         | Message: 'Worker with pid %s was terminated due to signal %s'
aquarius_1         | Arguments: (42466, 9)
aquarius_1         | [2022-01-18 03:04:37 +0000] [44792] [INFO] Booting worker with pid: 44792
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/app/wsgiapp.py", line 67, in run
aquarius_1         |     WSGIApplication("%(prog)s [OPTIONS] [APP_MODULE]").run()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/app/base.py", line 231, in run
aquarius_1         |     super().run()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/app/base.py", line 72, in run
aquarius_1         |     Arbiter(self).run()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 211, in run
aquarius_1         |     self.manage_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 551, in manage_workers
aquarius_1         |     self.spawn_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 623, in spawn_workers
aquarius_1         |     time.sleep(0.1 * random.random())
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 242, in handle_chld
aquarius_1         |     self.reap_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 530, in reap_workers
aquarius_1         |     self.log.warning(
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/glogging.py", line 261, in warning
aquarius_1         |     self.error_log.warning(msg, *args, **kwargs)
aquarius_1         | Message: 'Worker with pid %s was terminated due to signal %s'
aquarius_1         | Arguments: (42466, 9)
aquarius_1         | [2022-01-18 03:04:37 +0000] [44794] [INFO] Booting worker with pid: 44794
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/app/wsgiapp.py", line 67, in run
aquarius_1         |     WSGIApplication("%(prog)s [OPTIONS] [APP_MODULE]").run()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/app/base.py", line 231, in run
aquarius_1         |     super().run()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/app/base.py", line 72, in run
aquarius_1         |     Arbiter(self).run()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 211, in run
aquarius_1         |     self.manage_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 551, in manage_workers
aquarius_1         |     self.spawn_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 623, in spawn_workers
aquarius_1         |     time.sleep(0.1 * random.random())
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 242, in handle_chld
aquarius_1         |     self.reap_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 530, in reap_workers
aquarius_1         |     self.log.warning(
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/glogging.py", line 261, in warning
aquarius_1         |     self.error_log.warning(msg, *args, **kwargs)
aquarius_1         | Message: 'Worker with pid %s was terminated due to signal %s'
aquarius_1         | Arguments: (42466, 9)
aquarius_1         | [2022-01-18 03:04:38 +0000] [44796] [INFO] Booting worker with pid: 44796
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/app/wsgiapp.py", line 67, in run
aquarius_1         |     WSGIApplication("%(prog)s [OPTIONS] [APP_MODULE]").run()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/app/base.py", line 231, in run
aquarius_1         |     super().run()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/app/base.py", line 72, in run
aquarius_1         |     Arbiter(self).run()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 211, in run
aquarius_1         |     self.manage_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 551, in manage_workers
aquarius_1         |     self.spawn_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 623, in spawn_workers
aquarius_1         |     time.sleep(0.1 * random.random())
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 242, in handle_chld
aquarius_1         |     self.reap_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 530, in reap_workers
aquarius_1         |     self.log.warning(
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/glogging.py", line 261, in warning
aquarius_1         |     self.error_log.warning(msg, *args, **kwargs)
aquarius_1         | Message: 'Worker with pid %s was terminated due to signal %s'
aquarius_1         | Arguments: (42466, 9)
aquarius_1         | [2022-01-18 03:04:38 +0000] [44798] [INFO] Booting worker with pid: 44798
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/app/wsgiapp.py", line 67, in run
aquarius_1         |     WSGIApplication("%(prog)s [OPTIONS] [APP_MODULE]").run()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/app/base.py", line 231, in run
aquarius_1         |     super().run()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/app/base.py", line 72, in run
aquarius_1         |     Arbiter(self).run()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 211, in run
aquarius_1         |     self.manage_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 551, in manage_workers
aquarius_1         |     self.spawn_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 623, in spawn_workers
aquarius_1         |     time.sleep(0.1 * random.random())
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 242, in handle_chld
aquarius_1         |     self.reap_workers()
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/arbiter.py", line 530, in reap_workers
aquarius_1         |     self.log.warning(
aquarius_1         |   File "/usr/local/lib/python3.8/dist-packages/gunicorn/glogging.py", line 261, in warning
aquarius_1         |     self.error_log.warning(msg, *args, **kwargs)
aquarius_1         | Message: 'Worker with pid %s was terminated due to signal %s'
aquarius_1         | Arguments: (42466, 9)

I do also want to mention that Im on a Mac Mini M1 (ie. Apple Silicon), which I know can give trouble due to architecture; however, I installed ocean-lib with -arch flag, and received no errors.

@md00ux
Copy link

md00ux commented Jan 18, 2022

@tmk1221, could you check if there is any service listening on 5000/TCP before and after starting barge ?

sudo lsof -i :5000

@tmk1221
Copy link

tmk1221 commented Jan 18, 2022

Nothing listen before Barge.

And this listening after starting Barge:

traviskassab@Traviss-Mini ~ % sudo lsof -i :5000
COMMAND    PID         USER   FD   TYPE             DEVICE SIZE/OFF NODE NAME
com.docke 2463 traviskassab   94u  IPv6 0xa87ee3159f44703f      0t0  TCP *:commplex-main (LISTEN)

The first time I tried running Barge, Aquarius failed to launch because a process was already listing to port 5000. It was related to AirPlay, but I turned this setting off, which killed that process, and was able to launch Aquarius afterwards.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Type: Bug Something isn't working
Projects
None yet
Development

No branches or pull requests

5 participants