Too many open files

[digidan]

Versions

Replace the values below with your own:

• GUI Version: v2.0.17
• Operating System: OS X 10.12.1

Expected Behavior

Program will continue to get peers, shard, and use disk space, managing open file limits for relevant OS/File system

Actual Behavior

After extended use the problem of too many files being open throws the error "contracts.db: Too many open files" in the logs (not in the UI any more).

Steps to Reproduce

Please include the steps the reproduce the issue, numbered below. Include as
much detail as possible.

1. Run stojshare app
2. acquire peers, contracts, shards, data
3. after several hours of operation the logs show the error drive path:
   
   contracts.db: Too many open files

Screenshots (Optional)

If the error is graphical in nature it is helpful to provide a screenshot.

[digidan]

Unsure if its related but I’m also gettting this {error} [Sat Nov 05 2016 16:02:06 GMT-0500 (CDT)] Could not get usedSpace: IO error: lock /Volumes/MyBook/Storj/storjshare-f05727/sharddata.kfs/000.s/LOCK: already held by process

[lilyannehall]

Try increasing your system's maximum open files: http://ss64.com/bash/ulimit.html

[digidan]

While I appreciate the instructions for increasing the systems maximum open files, I shouldn't have to change OS native constraints and for most end users this could be risky if they don't know what they are doing. There may be reasons for this limit in OS X and other platforms that need to be taken into consideration before removing limits just to get around an error. It could have unforeseen performance or stability issues. Is there no way for the app to negotiate this via a different method?

For those interested here is a related article in case some people do want to do this:
http://superuser.com/questions/302754/increase-the-maximum-number-of-open-file-descriptors-in-snow-leopard or http://blog.dekstroza.io/ulimit-shenanigans-on-osx-el-capitan/ or http://superuser.com/questions/827984/open-files-limit-does-not-work-as-before-in-osx-yosemite

What I would like is some guidance from the dev's as to how many open files we should set this to as unlimited is no longer an option.

[digidan]

Here is the latest version of the error from the logs:
{error} [Mon Nov 14 2016 13:27:57 GMT-0600 (CST)] Could not get usedSpace: IO error: /Volumes/MyBook/Storj/storjshare-0933a1/sharddata.kfs/005.s/LOCK: Too many open files
{error} [Mon Nov 14 2016 13:29:37 GMT-0600 (CST)] Could not get usedSpace: IO error: /Volumes/MyBook/Storj/storjshare-0933a1/sharddata.kfs/008.s/MANIFEST-000055: Too many open files

[krilson]

The same as this error in storjshare-cli:

https://github.com/Storj/storjshare-cli/issues/206

[digidan]

still getting this in the latest version of Storj Share Gui as of 12/11/16

[lunokhod]

This is still happening on my system [osx] (using storjshare-cli)

StorjShare: 9.0.5
Core:       6.0.8
Protocol:   1.0.0

[arruah]

Same issue.
Ubuntu 16.04
{error} [Tue Dec 13 2016 22:12:12 GMT+0600 ()] Could not get usedSpace: IO error: /media/kamrenov/other/storj/storjshare-20a170/sharddata.kfs/236.s/CURRENT: Too many open files
{error} [Tue Dec 13 2016 22:12:12 GMT+0600 ()] Could not get usedSpace: IO error: /media/kamrenov/other/storj/storjshare-20a170/sharddata.kfs/236.s/CURRENT: Too many open files
{error} [Tue Dec 13 2016 22:12:12 GMT+0600 ()] Could not get usedSpace: IO error: /media/kamrenov/other/storj/storjshare-20a170/sharddata.kfs/236.s/CURRENT: Too many open files
{error} [Tue Dec 13 2016 22:12:12 GMT+0600 ()] Could not get usedSpace: IO error: /media/kamrenov/other/storj/storjshare-20a170/sharddata.kfs/236.s/CURRENT: Too many open files
{error} [Tue Dec 13 2016 22:12:12 GMT+0600 ()] Could not get usedSpace: IO error: /media/kamrenov/other/storj/storjshare-20a170/sharddata.kfs/236.s/CURRENT: Too many open files
{error} [Tue Dec 13 2016 22:12:12 GMT+0600 ()] Could not get usedSpace: IO error: /media/kamrenov/other/storj/storjshare-20a170/sharddata.kfs/236.s/CURRENT: Too many open files
{error} [Tue Dec 13 2016 22:12:12 GMT+0600 ()] Could not get usedSpace: IO error: /media/kamrenov/other/storj/storjshare-20a170/sharddata.kfs/236.s/CURRENT: Too many open files

[scottbourne]

I'm running the 4.0.10 client and am having the same problem:

{error} [Sat Feb 18 2017 10:19:57 GMT-0800 (PST)] Could not get usedSpace: IO error: /home/anonymous/Documents/Storj1-10gb/storjshare-ce5fe1/sharddata.kfs/251.s: Too many open files
{debug} [Sat Feb 18 2017 10:19:57 GMT-0800 (PST)] not sending an offer for the contract
{error} [Sat Feb 18 2017 10:19:57 GMT-0800 (PST)] Could not get usedSpace: IO error: /home/anonymous/Documents/Storj1-10gb/storjshare-ce5fe1/sharddata.kfs/251.s: Too many open files
{debug} [Sat Feb 18 2017 10:19:57 GMT-0800 ()] not sending an offer for the contract
{error} [Sat Feb 18 2017 10:19:57 GMT-0800 ()] Could not get usedSpace: IO error: /home/anonymous/Documents/Storj1-10gb/storjshare-ce5fe1/sharddata.kfs/251.s: Too many open files
{debug} [Sat Feb 18 2017 10:19:57 GMT-0800 ()] not sending an offer for the contract
{error} [Sat Feb 18 2017 10:19:57 GMT-0800 ()] Could not get usedSpace: IO error: /home/anonymous/Documents/Storj1-10gb/storjshare-ce5fe1/sharddata.kfs/251.s: Too many open files
{debug} [Sat Feb 18 2017 10:19:57 GMT-0800 ()] not sending an offer for the contract
{error} [Sat Feb 18 2017 10:19:57 GMT-0800 ()] Could not get usedSpace: IO error: /home/anonymous/Documents/Storj1-10gb/storjshare-ce5fe1/sharddata.kfs/251.s: Too many open files
{debug} [Sat Feb 18 2017 10:19:57 GMT-0800 ()] not sending an offer for the contract
{error} [Sat Feb 18 2017 10:19:57 GMT-0800 ()] Could not get usedSpace: IO error: /home/anonymous/Documents/Storj1-10gb/storjshare-ce5fe1/sharddata.kfs/251.s: Too many open files
{debug} [Sat Feb 18 2017 10:19:57 GMT-0800 ()] not sending an offer for the contract

[littleskunk]

Should be solved in 4.1.0. We have one last issue that we will track in storj-archived/core#666