Can not connect with simulator

[pammirato]

Hi. When I run the basic command, it seems I can not connect with the simulator. Not sure what is happening. I believe the error comes on line 249 in lib/Simulator.py.

Thank you.

$ python3 -m tools.pygame_client

2018-01-09 14:11:00,928 INFO {'sim_id': 'sim00', 'stk_git_hash': '03855da', 'sim_git_hash': '03855da', 'machine': 'bvision4.cs.unc.edu'} Starting simulator... 2018-01-09 14:11:00,953 INFO sim00:Starting sim server at /playpen/ammirato/Documents/Minos/code/minos/server/server.js with port 47129 2018-01-09 14:11:01,964 INFO sim00:sim server has exited with rv 1 2018-01-09 14:11:01,973 WARNING localhost:47129/socket.io [waiting for connection] HTTPConnectionPool(host='localhost', port=47129): Max retries exceeded with url: /socket.io/?EIO=3&transport=polling&t=1515525061965-0 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fd55c02c550>: Failed to establish a new connection: [Errno 111] Connection refused',)) 2018-01-09 14:11:02,978 WARNING localhost:47129/socket.io [waiting for connection] HTTPConnectionPool(host='localhost', port=47129): Max retries exceeded with url: /socket.io/?EIO=3&transport=polling&t=1515525062974-0 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fd55c02c8d0>: Failed to establish a new connection: [Errno 111] Connection refused',)) 2018-01-09 14:11:03,983 WARNING localhost:47129/socket.io [waiting for connection] HTTPConnectionPool(host='localhost', port=47129): Max retries exceeded with url: /socket.io/?EIO=3&transport=polling&t=1515525063979-0 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fd55c0312b0>: Failed to establish a new connection: [Errno 111] Connection refused',)) 2018-01-09 14:11:04,988 WARNING localhost:47129/socket.io [waiting for connection] HTTPConnectionPool(host='localhost', port=47129): Max retries exceeded with url: /socket.io/?EIO=3&transport=polling&t=1515525064984-0 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fd55c02c668>: Failed to establish a new connection: [Errno 111] Connection refused',)) 2018-01-09 14:11:05,992 WARNING localhost:47129/socket.io [waiting for connection] HTTPConnectionPool(host='localhost', port=47129): Max retries exceeded with url: /socket.io/?EIO=3&transport=polling&t=1515525065989-0 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fd55c02cef0>: Failed to establish a new connection: [Errno 111] Connection refused',))

[msavva]

Hi @pammirato,
Thanks for trying out MINOS!
Can you look at the simulator server log files (see #3 (comment)) and quote any error you see in the logs?

[pammirato]

simserver.log:

2018-01-09 14:11:00,963 INFO Finished simserver stdout
2018-01-09 14:11:00,963 INFO Finished simserver stderr
2018-01-09 14:11:01,964 INFO Waiting for simserver stdout to finish
2018-01-09 14:11:01,964 INFO Waiting for simserver stderr to finish

simulator.log:

2018-01-09 14:11:00,928 INFO {'sim_id': 'sim00', 'stk_git_hash': '03855da', 'sim_git_hash': '03855da', 'machine': 'bvision4.cs.unc.edu'}
2018-01-09 14:11:00,953 INFO sim00:Starting sim server at /playpen/ammirato/Documents/Minos/code/minos/server/server.js with port 47129
2018-01-09 14:11:01,964 INFO sim00:sim server has exited with rv 1
2018-01-09 14:11:06,819 INFO sim00:Stopping the simulator
2018-01-09 14:11:06,819 INFO Counter()
2018-01-09 14:11:06,819 INFO sim00:Stopping child servers
2018-01-09 14:11:06,819 INFO sim00:Stopped child servers
2018-01-09 14:11:06,820 INFO sim00:Simulator killed.

[msavva]

The logs seem to indicate that the server module could not boot up. Can you provide output for the following in the same environment within which you are running MINOS:

1. node -v
2. npm -v
3. npm install in server module
4. ./server.js in server module

Can you also confirm that all the steps in https://github.com/minosworld/minos#installing completed without errors? In particular, the above issue might be caused by an error that occurred in step 3 (building the server module using npm).

[msavva]

One additional note: if you have already run npm install and see a message about removed packages when re-running it, please delete the node_modules directory inside server and then try running npm install again. There should be a lerna success Bootstrapped 3 packages message at the end of this command.

[pammirato]

1. node -v
   v8.9.4

2. npm -v
   5.6.0

3. npm install
   $ npm install

[email protected] install /playpen/ammirato/Documents/Minos/code/minos/server/node_modules/node-expat
node-gyp rebuild

make: Entering directory /playpen/ammirato/Documents/Minos/code/minos/server/node_modules/node-expat/build' CC(target) Release/obj.target/expat/deps/libexpat/lib/xmlparse.o ../deps/libexpat/lib/xmlparse.c: In function 'gather_time_entropy': ../deps/libexpat/lib/xmlparse.c:780:7: warning: variable 'gettimeofday_res' set but not used [-Wunused-but-set-variable] int gettimeofday_res; ^ CC(target) Release/obj.target/expat/deps/libexpat/lib/xmltok.o CC(target) Release/obj.target/expat/deps/libexpat/lib/xmlrole.o AR(target) Release/obj.target/deps/libexpat/libexpat.a COPY Release/libexpat.a CXX(target) Release/obj.target/node_expat/node-expat.o SOLINK_MODULE(target) Release/obj.target/node_expat.node COPY Release/node_expat.node make: Leaving directory /playpen/ammirato/Documents/Minos/code/minos/server/node_modules/node-expat/build'

[email protected] postinstall /playpen/ammirato/Documents/Minos/code/minos/server/node_modules/sstk
npm run bootstrap

[email protected] bootstrap /playpen/ammirato/Documents/Minos/code/minos/server/node_modules/sstk
lerna bootstrap --hoist

lerna info version 2.5.1
lerna info Bootstrapping 3 packages
lerna info lifecycle preinstall
lerna info Installing external dependencies
lerna info hoist Installing hoisted dependencies into root
lerna info hoist Pruning hoisted dependencies
lerna info hoist Finished pruning hoisted dependencies
lerna info hoist Finished installing in root
lerna info Symlinking packages and binaries
lerna info lifecycle postinstall
lerna info lifecycle prepublish
lerna info lifecycle prepare
lerna success Bootstrapped 3 packages
added 476 packages in 95.606s

4. ./server.js

$ ./server.js
Configuration { fileCache: { size: 50 },
imageCache: { size: 200 },
imageQueue: { concurrency: 4 },
base_url: 'file:///home/ammirato/work',
assets_url: 'file:///playpen/ammirato/Documents/Minos/code/minos/server/node_modules/sstk/ssc/../server/static' }
Waiting for client connection on port 1234
Cannot register unknown asset 2d3ds
register ../server/static/data/matterport/matterport3d.json
Registered asset group: mp3d
Got 90 assets
register ../server/static/data/suncg/suncg.planner5d.models.json
Replace asset group p5d
Registered asset group: p5d
Got 2623 assets
Loaded lightSpecs for 202 models.
register ../server/static/data/suncg/suncg.planner5d.textures.json
Replace asset group p5dTexture
Registered asset group: p5dTexture
Got 67072 assets
Loaded LightSpecs for 202 models

5. ./server.js then just hangs there. Running python3 -m tools.pygame_client while server.js hangs gives the same error message as before.

6. One other thing to note is that when running source ./bashrc after install nvm I get:

nvm is not compatible with the npm config "prefix" option: currently set to "/playpen/ammirato/.nvm/versions/node/v8.9.4"
Run npm config delete prefix or nvm use --delete-prefix v8.9.4 --silent to unset it

I just added nvm use --delete-prefix v8.9.4 to my ~/.bashrc and it seems to fix this issue

[msavva]

The output of steps 1 - 5 are as expected. ./server.js appears to boot up successfully and wait for a connection on port 1234. The python3 -m tools.pygame_client command should boot up a server on a random port and attempt to connect to it, but the log files you copied don't indicate any connection. The issue in 6. appears unrelated.

Can you try a couple more things:

1. Run ./benchmark.js in the server module. This should take a minute or so and report frame rate statistics at the end. If this runs successfully then the server module is working properly by itself, and the issue must be with the client module not being able to establish a connection to the server.
2. If ./benchmark.js fails, try checking out http://github.com/smartscenes/sstk which is the core library on which the server module depends, build it using the build.sh script in the root of the repository, go into the ssc directory, and try to run ./render.js. This is a more minimal test of the rendering functionality that the server module requires. If this step fails, we can isolate the problem to the core library and an inability to render simulation frames in your environment.

[pammirato]

tldr
It works following stackgl/headless-gl#65. The steps from the last post.

1. ./benchmark.js fails with:

$ ./benchmark.js
Configuration { fileCache: { size: 50 },
imageCache: { size: 200 },
imageQueue: { concurrency: 4 },
base_url: 'file:///home/ammirato/work',
assets_url: 'file:///playpen/ammirato/Documents/Minos/code/minos/server/node_modules/sstk/ssc/../server/static' }
p5dScene.0020d9dab70c6c8cfc0564c139c82dce
register ../server/static/data/suncg/suncg.planner5d.models.json
Replace asset group p5d
Registered asset group: p5d
Got 2623 assets
Loaded lightSpecs for 202 models.
register ../server/static/data/suncg/suncg.planner5d.textures.json
Replace asset group p5dTexture
Registered asset group: p5dTexture
Got 67072 assets
node: symbol lookup error: /playpen/ammirato/Documents/Minos/code/minos/server/node_modules/sstk/node_modules/gl/build/Release/webgl.node: undefined symbol: _Z15XextFindDisplayP15_XExtensionInfoP9_XDisplay

2. I was able to successfully run the code at http://github.com/smartscenes/sstk in the same environment. I was able to access the server through http://localhost:8010 in my browser.

3. I tried to rebuild sstk by running ./build.sh in the minos project, but that did not work.

4. I followed the steps from symbol lookup error on nVidia stackgl/headless-gl#65 and it works.

thanks for your help!

[msavva]

Great to hear. It appears in the end this was the same issue as #3 which is resolved by rebuilding headless-gl.