0.4.5 daemon "too many open files" errors.

[NeoTeo]

Version information:

go-ipfs version: 0.4.5-
Repo version: 5
System version: amd64/darwin
Golang version: go1.7.4

Type:

Bug

Priority:

P2

Description:

Running the daemon using an older converted datastore gives the errors (after a while, not upon startup) as logged below. Also note the final error has been seen for quite a few versions and is related to the host machine sleeping and waking.

teo@muthr-2 ~> ipfs daemon
Initializing daemon...
Adjusting current ulimit to 1024...
Successfully raised file descriptor limit to 1024.
Swarm listening on /ip4/100.100.160.222/tcp/31622
Swarm listening on /ip4/127.0.0.1/tcp/4001
Swarm listening on /ip4/192.168.5.14/tcp/4001
Swarm listening on /ip4/192.168.5.8/tcp/4001
Swarm listening on /ip4/89.23.224.58/tcp/40556
Swarm listening on /ip6/::1/tcp/4001
Swarm listening on /ip6/fd00:e95b:cea7:bd1e:291e:a867:7813:4598/tcp/4001
API server listening on /ip4/127.0.0.1/tcp/5001
Gateway (readonly) server listening on /ip4/127.0.0.1/tcp/8080
Daemon is ready
15:41:16.538 ERROR  providers: deleting provider set: open /Users/teo/.ipfs/datastore/020302.log: too many open files providers.go:209
15:41:16.540 ERROR  providers: deleting provider set: open /Users/teo/.ipfs/datastore/020302.log: too many open files providers.go:209
15:41:16.540 ERROR  providers: deleting provider set: open /Users/teo/.ipfs/datastore/020302.log: too many open files providers.go:209
15:41:16.540 ERROR  providers: deleting provider set: open /Users/teo/.ipfs/datastore/020302.log: too many open files providers.go:209
15:41:16.540 ERROR  providers: deleting provider set: open /Users/teo/.ipfs/datastore/020302.log: too many open files providers.go:209
15:41:16.541 ERROR  providers: deleting provider set: open /Users/teo/.ipfs/datastore/020302.log: too many open files providers.go:209
15:41:16.541 ERROR  providers: deleting provider set: open /Users/teo/.ipfs/datastore/020302.log: too many open files providers.go:209
15:41:16.542 ERROR  providers: deleting provider set: open /Users/teo/.ipfs/datastore/020302.log: too many open files providers.go:209
15:41:16.542 ERROR  providers: deleting provider set: open /Users/teo/.ipfs/datastore/020302.log: too many open files providers.go:209
15:41:16.542 ERROR  providers: deleting provider set: open /Users/teo/.ipfs/datastore/020302.log: too many open files providers.go:209
15:41:16.543 ERROR  providers: deleting provider set: open /Users/teo/.ipfs/datastore/020302.log: too many open files providers.go:209
15:41:16.543 ERROR  providers: deleting provider set: open /Users/teo/.ipfs/datastore/020302.log: too many open files providers.go:209
15:41:16.544 ERROR  providers: deleting provider set: open /Users/teo/.ipfs/datastore/020302.log: too many open files providers.go:209
15:41:16.544 ERROR  providers: deleting provider set: open /Users/teo/.ipfs/datastore/020302.log: too many open files providers.go:209
15:41:16.544 ERROR  providers: deleting provider set: open /Users/teo/.ipfs/datastore/020302.log: too many open files providers.go:209
15:41:16.544 ERROR  providers: deleting provider set: open /Users/teo/.ipfs/datastore/020302.log: too many open files providers.go:209
15:41:20.913 ERROR       mdns: mdns lookup error: failed to bind to any multicast udp port mdns.go:135

[whyrusleeping]

@NeoTeo Thanks for reporting, I think this is the flatfs issue we just resolved. Will post back in a bit with something to try

[whyrusleeping]

@NeoTeo If you don't mind building from source, could you try running this PR #3711 ?

[NeoTeo]

@whyrusleeping Absolutely. I just need something to trigger it consistently. Any ideas?

[whyrusleeping]

@NeoTeo Try doing ipfs refs local a few times with a bunch of connected peers.

[NeoTeo]

Looks good. Not a peep from the daemon.

[Kubuxu]

Reopening, and linking it to #3711

[whyrusleeping]

@NeoTeo Thanks for verifying!

[NeoTeo]

@whyrusleeping Happy to help :)