Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Not able to full sync Ropsten network past block 6491959 #22497

Closed
mdeliadi opened this issue Mar 15, 2021 · 8 comments · Fixed by #22582
Closed

Not able to full sync Ropsten network past block 6491959 #22497

mdeliadi opened this issue Mar 15, 2021 · 8 comments · Fixed by #22582

Comments

@mdeliadi
Copy link

System information

Geth version: Gemini Sigma (v1.10.1)
OS & Version: Debian GNU/Linux 9.6 (stretch)
Commit hash : c2d2f4e

Actual behaviour

I'm syncing Ropsten network from scratch in full mode. I'm not able to get past block 6491959 (found using web3.eth.syncing). Geth stucks there, sometimes it crashes due to out of memory error (please see the backtrace below) sometimes it just restarts syncing from around block 6488206. And then it gets stuck again at block 6491959, restarting the cycle.

Steps to reproduce the behaviour

I've updated Geth to the latest version and then restarted the node. I've also updated Go to version go1.16 linux/amd64.

Backtrace

Mar 15 09:05:28 hostname geth[24509]: fatal error: runtime: out of memory
Mar 15 09:05:28 hostname geth[24509]: runtime stack:
Mar 15 09:05:28 hostname geth[24509]: runtime.throw(0x133b12c, 0x16)
Mar 15 09:05:28 hostname geth[24509]:         runtime/panic.go:1117 +0x72
Mar 15 09:05:28 hostname geth[24509]: runtime.sysMap(0xc3b0000000, 0x40000000, 0x208b770)
Mar 15 09:05:28 hostname geth[24509]:         runtime/mem_linux.go:169 +0xc6
Mar 15 09:05:28 hostname geth[24509]: runtime.(*mheap).sysAlloc(0x20714a0, 0x3d000000, 0x443277, 0x20714a8)
Mar 15 09:05:28 hostname geth[24509]:         runtime/malloc.go:729 +0x1e5
Mar 15 09:05:28 hostname geth[24509]: runtime.(*mheap).grow(0x20714a0, 0x1e620, 0x0)
Mar 15 09:05:28 hostname geth[24509]:         runtime/mheap.go:1346 +0x85
Mar 15 09:05:28 hostname geth[24509]: runtime.(*mheap).allocSpan(0x20714a0, 0x1e620, 0x100, 0x1ff)
Mar 15 09:05:28 hostname geth[24509]:         runtime/mheap.go:1173 +0x609
Mar 15 09:05:28 hostname geth[24509]: runtime.(*mheap).alloc.func1()
Mar 15 09:05:28 hostname geth[24509]:         runtime/mheap.go:910 +0x59
Mar 15 09:05:28 hostname geth[24509]: runtime.systemstack(0x0)
Mar 15 09:05:28 hostname geth[24509]:         runtime/asm_amd64.s:379 +0x66
Mar 15 09:05:28 hostname geth[24509]: runtime.mstart()
Mar 15 09:05:28 hostname geth[24509]:         runtime/proc.go:1246
@holiman
Copy link
Contributor

holiman commented Mar 15, 2021

I don't know what Gemini Sigma (v1.10.1) is -- is that some fork? If so, you should open a ticket with them.
Doh! I haven't learned our release names yet :)
Also, would be good to provide the exact startup command and data about your machine (e..g the amount of RAM you have)

@mdeliadi
Copy link
Author

@holiman Hello!

Startup command:
--ropsten --rpc --rpcaddr "0.0.0.0" --http.corsdomain "*" --http.vhosts "*" --http.port 8545 --http.api db,eth,net,web3,personal,rpc --ws --ws.port 8546 --port 30303 --whitelist 6485846=0x43f0cd1e5b1f9c4d5cda26c240b59ee4f1b510d0a185aa8fd476d091b0097a80 --syncmode full

About my machine:
4 vCPU, 16 GB RAM, 256 GB EBS General Purpose SSD (gp2)

@holiman
Copy link
Contributor

holiman commented Mar 15, 2021

Ok, thanks. Well, that looks ok, so could you provide a bit more of that stacktrace, so we can see where it comes from?

Without knowing any more, one possible source could be if attackers on the internet overloading it with RPC queries.

@mdeliadi
Copy link
Author

Hello @holiman !

I've tried re-syncing everything from scratch, but the exactly same scenario happened, it stucks at block 6491959.

This is the full log, it starts just some minutes before the crash happens:

Mar 17 07:28:52 hostname geth[16136]: INFO [03-17|07:28:52.058] Imported new chain segment               blocks=142   txs=6915   mgas=906.222  elapsed=8.017s    mgasps=113.031 number=6488129 hash="50c7c5…4
Mar 17 07:29:00 hostname geth[16136]: INFO [03-17|07:29:00.256] Imported new chain segment               blocks=127   txs=5126   mgas=740.221  elapsed=8.198s    mgasps=90.292  number=6488256 hash="66e33d…5
Mar 17 07:29:08 hostname geth[16136]: INFO [03-17|07:29:08.287] Imported new chain segment               blocks=68    txs=2123   mgas=443.401  elapsed=8.031s    mgasps=55.207  number=6488324 hash="09bc18…2
Mar 17 07:29:16 hostname geth[16136]: INFO [03-17|07:29:16.291] Imported new chain segment               blocks=145   txs=5445   mgas=932.812  elapsed=8.004s    mgasps=116.541 number=6488469 hash="582db1…9
Mar 17 07:29:24 hostname geth[16136]: INFO [03-17|07:29:24.296] Imported new chain segment               blocks=113   txs=3235   mgas=646.641  elapsed=8.004s    mgasps=80.784  number=6488582 hash="ec8538…f
Mar 17 07:29:32 hostname geth[16136]: INFO [03-17|07:29:32.351] Imported new chain segment               blocks=152   txs=3778   mgas=792.874  elapsed=8.054s    mgasps=98.435  number=6488734 hash="083cc6…d
Mar 17 07:29:40 hostname geth[16136]: INFO [03-17|07:29:40.372] Imported new chain segment               blocks=257   txs=3744   mgas=674.264  elapsed=8.020s    mgasps=84.065  number=6488991 hash="6d6336…7
Mar 17 07:29:48 hostname geth[16136]: INFO [03-17|07:29:48.424] Imported new chain segment               blocks=188   txs=1633   mgas=424.084  elapsed=8.052s    mgasps=52.662  number=6489179 hash="3a4fbf…7
Mar 17 07:29:56 hostname geth[16136]: INFO [03-17|07:29:56.472] Imported new chain segment               blocks=176   txs=1792   mgas=336.025  elapsed=8.047s    mgasps=41.757  number=6489355 hash="de0c38…d
Mar 17 07:30:01 hostname geth[16136]: WARN [03-17|07:30:01.852] Served eth_coinbase                      conn=127.0.0.1:37928 reqid=1 t="37.369µs"  err="etherbase must be explicitly specified"
Mar 17 07:30:04 hostname geth[16136]: INFO [03-17|07:30:04.536] Imported new chain segment               blocks=146   txs=1525   mgas=277.068  elapsed=8.064s    mgasps=34.359  number=6489501 hash="612bd3…1
Mar 17 07:30:12 hostname geth[16136]: INFO [03-17|07:30:12.546] Imported new chain segment               blocks=148   txs=1749   mgas=398.071  elapsed=8.010s    mgasps=49.695  number=6489649 hash="12589e…4
Mar 17 07:30:20 hostname geth[16136]: INFO [03-17|07:30:20.860] Imported new chain segment               blocks=173   txs=1605   mgas=335.635  elapsed=8.314s    mgasps=40.368  number=6489822 hash="c0a3e4…f
Mar 17 07:30:22 hostname geth[16136]: INFO [03-17|07:30:22.515] Imported new chain segment               blocks=44    txs=507    mgas=98.373   elapsed=1.654s    mgasps=59.459  number=6489866 hash="b22aa5…c
Mar 17 07:30:22 hostname geth[16136]: INFO [03-17|07:30:22.833] Unindexed transactions                   blocks=2048  txs=45786  tail=4139867 elapsed=318.008ms
Mar 17 07:30:22 hostname geth[16136]: INFO [03-17|07:30:22.912] Importing heavy sidechain segment        blocks=2048  start=6489867 end=6491914
Mar 17 07:30:30 hostname geth[16136]: INFO [03-17|07:30:30.940] Imported new chain segment               blocks=172   txs=1974   mgas=586.246  elapsed=8.027s    mgasps=73.034  number=6490038 hash="ee3789…6
Mar 17 07:30:32 hostname geth[16136]: ERROR[03-17|07:30:32.052] Snapshot extension registration failed   peer=35ba3061 err="peer connected on snap without compatible eth support"
Mar 17 07:30:38 hostname geth[16136]: INFO [03-17|07:30:38.999] Imported new chain segment               blocks=235   txs=2782   mgas=460.614  elapsed=8.059s    mgasps=57.152  number=6490273 hash="1f35df…e
Mar 17 07:30:47 hostname geth[16136]: INFO [03-17|07:30:47.143] Imported new chain segment               blocks=237   txs=6296   mgas=631.945  elapsed=8.143s    mgasps=77.599  number=6490510 hash="5b9949…2
Mar 17 07:30:53 hostname geth[16136]: ERROR[03-17|07:30:53.910] Snapshot extension registration failed   peer=a05e766c err="peer connected on snap without compatible eth support"
Mar 17 07:30:55 hostname geth[16136]: INFO [03-17|07:30:55.398] Imported new chain segment               blocks=212   txs=5958   mgas=646.733  elapsed=8.255s    mgasps=78.340  number=6490722 hash="3e5f28…2
Mar 17 07:31:03 hostname geth[16136]: INFO [03-17|07:31:03.449] Imported new chain segment               blocks=181   txs=6508   mgas=690.536  elapsed=8.050s    mgasps=85.779  number=6490903 hash="db02aa…f
Mar 17 07:31:11 hostname geth[16136]: INFO [03-17|07:31:11.455] Imported new chain segment               blocks=421   txs=10269  mgas=1045.128 elapsed=8.006s    mgasps=130.532 number=6491324 hash="814038…8
Mar 17 07:31:19 hostname geth[16136]: INFO [03-17|07:31:19.460] Imported new chain segment               blocks=490   txs=13990  mgas=1514.435 elapsed=8.004s    mgasps=189.195 number=6491814 hash="f370a7…8
Mar 17 07:31:20 hostname geth[16136]: INFO [03-17|07:31:20.671] Imported new chain segment               blocks=100   txs=2303   mgas=251.163  elapsed=1.210s    mgasps=207.467 number=6491914 hash="2ab277…4
Mar 17 07:31:20 hostname geth[16136]: INFO [03-17|07:31:20.687] Importing sidechain segment              start=6491915 end=6491980
Mar 17 07:31:20 hostname geth[16136]: INFO [03-17|07:31:20.891] Unindexed transactions                   blocks=2048  txs=35364  tail=4141915 elapsed=219.942ms
Mar 17 07:31:59 hostname geth[16136]: ERROR[03-17|07:31:59.325] Snapshot extension registration failed   peer=a05e766c err="peer connected on snap without compatible eth support"
Mar 17 07:34:45 hostname geth[16136]: ERROR[03-17|07:34:45.909] Snapshot extension registration failed   peer=cbd3f861 err="peer connected on snap without compatible eth support"
Mar 17 07:35:01 hostname geth[16136]: WARN [03-17|07:35:01.664] Served eth_coinbase                      conn=127.0.0.1:44064 reqid=1 t="43.459µs"  err="etherbase must be explicitly specified"
Mar 17 07:35:56 hostname geth[16136]: ERROR[03-17|07:35:56.668] Snapshot extension registration failed   peer=a05e766c err="peer connected on snap without compatible eth support"
Mar 17 07:36:49 hostname geth[16136]: ERROR[03-17|07:36:49.004] Snapshot extension registration failed   peer=a05e766c err="peer connected on snap without compatible eth support"
Mar 17 07:38:16 hostname geth[16136]: WARN [03-17|07:38:16.356] Checkpoint challenge timed out, dropping id=880cfcd966bdcbda conn=dyndial         addr=68.43.147.234:30303 type=Geth/v1.10.1-stable-...
Mar 17 07:38:21 hostname geth[16136]: ERROR[03-17|07:38:21.412] Ethereum peer removal failed             peer=880cfcd9 err="peer not registered"
Mar 17 07:40:02 hostname geth[16136]: WARN [03-17|07:40:02.200] Served eth_coinbase                      conn=127.0.0.1:50574 reqid=1 t="40.728µs"  err="etherbase must be explicitly specified"
Mar 17 07:40:31 hostname geth[16136]: ERROR[03-17|07:40:31.992] Snapshot extension registration failed   peer=35ba3061 err="peer connected on snap without compatible eth support"
Mar 17 07:40:56 hostname geth[16136]: ERROR[03-17|07:40:56.154] Snapshot extension registration failed   peer=a05e766c err="peer connected on snap without compatible eth support"
Mar 17 07:42:24 hostname geth[16136]: ERROR[03-17|07:42:24.328] Snapshot extension registration failed   peer=a05e766c err="peer connected on snap without compatible eth support"
Mar 17 07:44:44 hostname geth[16136]: ERROR[03-17|07:44:44.588] Snapshot extension registration failed   peer=cbd3f861 err="peer connected on snap without compatible eth support"
Mar 17 07:45:01 hostname geth[16136]: WARN [03-17|07:45:01.979] Served eth_coinbase                      conn=127.0.0.1:56258 reqid=1 t="45.134µs"  err="etherbase must be explicitly specified"
Mar 17 07:45:11 hostname geth[16136]: ERROR[03-17|07:45:11.022] Snapshot extension registration failed   peer=3af25a30 err="peer connected on snap without compatible eth support"
Mar 17 07:46:01 hostname geth[16136]: ERROR[03-17|07:46:01.079] Snapshot extension registration failed   peer=3af25a30 err="peer connected on snap without compatible eth support"
Mar 17 07:46:58 hostname geth[16136]: ERROR[03-17|07:46:58.586] Snapshot extension registration failed   peer=a05e766c err="peer connected on snap without compatible eth support"
Mar 17 07:47:42 hostname geth[16136]: ERROR[03-17|07:47:42.896] Snapshot extension registration failed   peer=0c372ee4 err="peer connected on snap without compatible eth support"
Mar 17 07:47:54 hostname geth[16136]: fatal error: runtime: out of memory
Mar 17 07:47:54 hostname geth[16136]: runtime stack:
Mar 17 07:47:54 hostname geth[16136]: runtime.throw(0x133b12c, 0x16)
Mar 17 07:47:54 hostname geth[16136]:         runtime/panic.go:1117 +0x72
Mar 17 07:47:54 hostname geth[16136]: runtime.sysMap(0xc3c8000000, 0x38000000, 0x208b770)
Mar 17 07:47:54 hostname geth[16136]:         runtime/mem_linux.go:169 +0xc6
Mar 17 07:47:54 hostname geth[16136]: runtime.(*mheap).sysAlloc(0x20714a0, 0x34c00000, 0x443277, 0x20714a8)
Mar 17 07:47:54 hostname geth[16136]:         runtime/malloc.go:729 +0x1e5
Mar 17 07:47:54 hostname geth[16136]: runtime.(*mheap).grow(0x20714a0, 0x1a524, 0x0)
Mar 17 07:47:54 hostname geth[16136]:         runtime/mheap.go:1346 +0x85
Mar 17 07:47:54 hostname geth[16136]: runtime.(*mheap).allocSpan(0x20714a0, 0x1a524, 0x100, 0x1ff)
Mar 17 07:47:54 hostname geth[16136]:         runtime/mheap.go:1173 +0x609
Mar 17 07:47:54 hostname geth[16136]: runtime.(*mheap).alloc.func1()
Mar 17 07:47:54 hostname geth[16136]:         runtime/mheap.go:910 +0x59
Mar 17 07:47:54 hostname geth[16136]: runtime.systemstack(0x0)
Mar 17 07:47:54 hostname geth[16136]:         runtime/asm_amd64.s:379 +0x66
Mar 17 07:47:54 hostname geth[16136]: runtime.mstart()
Mar 17 07:47:54 hostname geth[16136]:         runtime/proc.go:1246
Mar 17 07:47:54 hostname geth[16136]: goroutine 930 [running]:
Mar 17 07:47:54 hostname geth[16136]: runtime.systemstack_switch()
Mar 17 07:47:54 hostname geth[16136]:         runtime/asm_amd64.s:339 fp=0xc00624e3e8 sp=0xc00624e3e0 pc=0x487660
Mar 17 07:47:54 hostname geth[16136]: runtime.(*mheap).alloc(0x20714a0, 0x1a524, 0x710101, 0xc03178b090)
Mar 17 07:47:54 hostname geth[16136]:         runtime/mheap.go:904 +0x85 fp=0xc00624e438 sp=0xc00624e3e8 pc=0x43ee25
Mar 17 07:47:54 hostname geth[16136]: runtime.(*mcache).allocLarge(0x7f3103d62a68, 0x34a47661, 0x101, 0x50)
Mar 17 07:47:54 hostname geth[16136]:         runtime/mcache.go:224 +0x97 fp=0xc00624e490 sp=0xc00624e438 pc=0x42f497
Mar 17 07:47:54 hostname geth[16136]: runtime.mallocgc(0x34a47661, 0x1141140, 0xc0638c0101, 0xc00d19b373)
Mar 17 07:47:54 hostname geth[16136]:         runtime/malloc.go:1078 +0x925 fp=0xc00624e518 sp=0xc00624e490 pc=0x424ee5
Mar 17 07:47:54 hostname geth[16136]: runtime.makeslice(0x1141140, 0x34a164f3, 0x34a47661, 0xc00d19b373)
Mar 17 07:47:54 hostname geth[16136]:         runtime/slice.go:98 +0x6c fp=0xc00624e548 sp=0xc00624e518 pc=0x467c8c
Mar 17 07:47:54 hostname geth[16136]: github.com/syndtr/goleveldb/leveldb.(*Batch).grow(...)
Mar 17 07:47:54 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/batch.go:82
Mar 17 07:47:54 hostname geth[16136]: github.com/syndtr/goleveldb/leveldb.(*Batch).appendRec(0xc070165500, 0x0, 0xc02aa49f90, 0x41, 0x50, 0x0, 0x0, 0x0)
Mar 17 07:47:54 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/batch.go:93 +0x48c fp=0xc00624e600 sp=0xc00624e548 pc=0x730fec
Mar 17 07:47:54 hostname geth[16136]: github.com/syndtr/goleveldb/leveldb.(*Batch).Delete(...)
Mar 17 07:47:54 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/batch.go:125
Mar 17 07:47:54 hostname geth[16136]: github.com/ethereum/go-ethereum/ethdb/leveldb.(*batch).Delete(0xc052eb59e0, 0xc02aa49f90, 0x41, 0x50, 0x0, 0x0)
Mar 17 07:47:54 hostname geth[16136]:         github.com/ethereum/go-ethereum/ethdb/leveldb/leveldb.go:460 +0x67 fp=0xc00624e650 sp=0xc00624e600 pc=0x76a807
Mar 17 07:47:54 hostname geth[16136]: github.com/ethereum/go-ethereum/core/state/snapshot.diffToDisk(0xc0296de500, 0xc00e1deed0)
Mar 17 07:47:54 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/state/snapshot/snapshot.go:485 +0x438 fp=0xc00624e9f8 sp=0xc00624e650 pc=0x7ea518
Mar 17 07:47:54 hostname geth[16136]: github.com/ethereum/go-ethereum/core/state/snapshot.(*Tree).cap(0xc00de3c9c0, 0xc028d5f720, 0x80, 0x0)
Mar 17 07:47:54 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/state/snapshot/snapshot.go:436 +0x233 fp=0xc00624ea90 sp=0xc00624e9f8 pc=0x7e9e13
Mar 17 07:47:54 hostname geth[16136]: github.com/ethereum/go-ethereum/core/state/snapshot.(*Tree).Cap(0xc00de3c9c0, 0xf29841dfbafad5c2, 0x7a50e90ab0e884e9, 0x648822bdab46db06, 0xea9bb85f677a8341, 0x80, 0x0
Mar 17 07:47:54 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/state/snapshot/snapshot.go:343 +0x185 fp=0xc00624eec0 sp=0xc00624ea90 pc=0x7e9305
Mar 17 07:47:54 hostname geth[16136]: github.com/ethereum/go-ethereum/core/state.(*StateDB).Commit(0xc072e44000, 0xc0773b7401, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
Mar 17 07:47:54 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/state/statedb.go:977 +0x79e fp=0xc00624f210 sp=0xc00624eec0 pc=0x801b5e
Mar 17 07:47:54 hostname geth[16136]: github.com/ethereum/go-ethereum/core.(*BlockChain).writeBlockWithState(0xc000145900, 0xc04fceab40, 0xc07bd95700, 0xb, 0x10, 0xc016b92400, 0x21, 0x40, 0xc072e44000, 0x0
Mar 17 07:47:54 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/blockchain.go:1530 +0x76c fp=0xc00624f618 sp=0xc00624f210 pc=0x9c37ec
Mar 17 07:47:54 hostname geth[16136]: github.com/ethereum/go-ethereum/core.(*BlockChain).insertChain(0xc000145900, 0xc01048a000, 0x42, 0x900, 0xc080a73800, 0x0, 0x0, 0x0)
Mar 17 07:47:54 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/blockchain.go:1938 +0x1679 fp=0xc0062513d0 sp=0xc00624f618 pc=0x9c7159
Mar 17 07:47:54 hostname geth[16136]: github.com/ethereum/go-ethereum/core.(*BlockChain).insertSideChain(0xc000145900, 0xc0109c1dd0, 0xc0110b0cd0, 0x4, 0xc0110b0c10, 0x4)
Mar 17 07:47:54 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/blockchain.go:2120 +0x1c76 fp=0xc006251ab0 sp=0xc0062513d0 pc=0x9cc7f6
Mar 17 07:47:54 hostname geth[16136]: github.com/ethereum/go-ethereum/core.(*BlockChain).insertChain(0xc000145900, 0xc00cd37d40, 0x2, 0x2, 0xed37fe257de8a901, 0x0, 0x0, 0x0)
Mar 17 07:47:54 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/blockchain.go:1783 +0x725 fp=0xc006253868 sp=0xc006251ab0 pc=0x9c6205
Mar 17 07:47:54 hostname geth[16136]: github.com/ethereum/go-ethereum/core.(*BlockChain).InsertChain(0xc000145900, 0xc00cd37d40, 0x2, 0x2, 0x0, 0x0, 0x0)
Mar 17 07:47:54 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/blockchain.go:1689 +0xcd3 fp=0xc006253bd0 sp=0xc006253868 pc=0x9c59d3
Mar 17 07:47:54 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/downloader.(*Downloader).importBlockResults(0xc0073752c0, 0xc00cd37d00, 0x2, 0x2, 0x2, 0xc00aaf24e0)
Mar 17 07:47:54 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/downloader.go:1734 +0x50b fp=0xc006253f00 sp=0xc006253bd0 pc=0xb21b6b
Mar 17 07:47:54 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/downloader.(*Downloader).processFullSyncContent(0xc0073752c0, 0xc00de3d600, 0xacff00)
Mar 17 07:47:54 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/downloader.go:1708 +0x7d fp=0xc006253f58 sp=0xc006253f00 pc=0xb215dd
Mar 17 07:47:54 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/downloader.(*Downloader).processFullSyncContent-fm(0x1405d90, 0x0)
Mar 17 07:47:54 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/downloader.go:1699 +0x33 fp=0xc006253f80 sp=0xc006253f58 pc=0xb3ceb3
Mar 17 07:47:54 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/downloader.(*Downloader).spawnSync.func1(0xc0073752c0, 0xc010aef6e0, 0xc010cc2290)
Mar 17 07:47:54 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/downloader.go:584 +0x5b fp=0xc006253fc8 sp=0xc006253f80 pc=0xb38d5b
Mar 17 07:47:54 hostname geth[16136]: runtime.goexit()
Mar 17 07:47:54 hostname geth[16136]:         runtime/asm_amd64.s:1371 +0x1 fp=0xc006253fd0 sp=0xc006253fc8 pc=0x4894a1
Mar 17 07:47:54 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth/downloader.(*Downloader).spawnSync
Mar 17 07:47:54 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/downloader.go:584 +0xaf
Mar 17 07:47:54 hostname geth[16136]: goroutine 1 [chan receive, 28 minutes]:
Mar 17 07:47:54 hostname geth[16136]: github.com/ethereum/go-ethereum/node.(*Node).Wait(...)
Mar 17 07:47:54 hostname geth[16136]:         github.com/ethereum/go-ethereum/node/node.go:420
Mar 17 07:47:54 hostname geth[16136]: main.geth(0xc00015c420, 0x0, 0x0)
Mar 17 07:47:54 hostname geth[16136]:         github.com/ethereum/go-ethereum/cmd/geth/main.go:343 +0x157
Mar 17 07:47:54 hostname geth[16136]: gopkg.in/urfave/cli%2ev1.HandleAction(0x1151740, 0x1405548, 0xc00015c420, 0xc00007b740, 0x0)
Mar 17 07:47:54 hostname geth[16136]:         gopkg.in/urfave/[email protected]/app.go:490 +0x82
Mar 17 07:47:54 hostname geth[16136]: gopkg.in/urfave/cli%2ev1.(*App).Run(0xc00011e340, 0xc00011e4e0, 0x19, 0x1a, 0x0, 0x0)
Mar 17 07:47:54 hostname geth[16136]:         gopkg.in/urfave/[email protected]/app.go:264 +0x5f5
Mar 17 07:47:54 hostname geth[16136]: main.main()
Mar 17 07:47:54 hostname geth[16136]:         github.com/ethereum/go-ethereum/cmd/geth/main.go:260 +0x55
Mar 17 07:47:54 hostname geth[16136]: goroutine 19 [chan receive, 29 minutes]:
Mar 17 07:47:54 hostname geth[16136]: github.com/rjeczalik/notify.(*nonrecursiveTree).dispatch(0xc0001362a0, 0xc0001361e0)
Mar 17 07:47:54 hostname geth[16136]:         github.com/rjeczalik/[email protected]/tree_nonrecursive.go:36 +0xb6
Mar 17 07:47:54 hostname geth[16136]: created by github.com/rjeczalik/notify.newNonrecursiveTree
Mar 17 07:47:54 hostname geth[16136]:         github.com/rjeczalik/[email protected]/tree_nonrecursive.go:29 +0xe5
Mar 17 07:47:54 hostname geth[16136]: goroutine 20 [chan receive, 29 minutes]:
Mar 17 07:47:54 hostname geth[16136]: github.com/rjeczalik/notify.(*nonrecursiveTree).internal(0xc0001362a0, 0xc000136240)
Mar 17 07:47:54 hostname geth[16136]:         github.com/rjeczalik/[email protected]/tree_nonrecursive.go:81 +0x58
Mar 17 07:47:54 hostname geth[16136]: created by github.com/rjeczalik/notify.newNonrecursiveTree
Mar 17 07:47:54 hostname geth[16136]:         github.com/rjeczalik/[email protected]/tree_nonrecursive.go:30 +0x111
Mar 17 07:47:54 hostname geth[16136]: goroutine 797 [select, 28 minutes]:
Mar 17 07:47:54 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.(*Peer).broadcastTransactions(0xc00aef5a00)
Mar 17 07:47:54 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/broadcast.go:105 +0x4ba
Mar 17 07:47:54 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth/protocols/eth.NewPeer
Mar 17 07:47:54 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/peer.go:110 +0x3b8
Mar 17 07:47:54 hostname geth[16136]: goroutine 88 [select, 28 minutes]:
Mar 17 07:47:54 hostname geth[16136]: github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc00c9ce000)
Mar 17 07:47:54 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/db_compaction.go:91 +0xb1
Mar 17 07:47:54 hostname geth[16136]: created by github.com/syndtr/goleveldb/leveldb.openDB
Mar 17 07:47:54 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/db.go:148 +0x429
Mar 17 07:47:54 hostname geth[16136]: goroutine 36 [chan receive, 16 minutes]:
Mar 17 07:47:54 hostname geth[16136]: github.com/ethereum/go-ethereum/core.(*txSenderCacher).cache(0xc000093ee0)
Mar 17 07:47:54 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/tx_cacher.go:63 +0x97
Mar 17 07:47:54 hostname geth[16136]: created by github.com/ethereum/go-ethereum/core.newTxSenderCacher
Mar 17 07:47:54 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/tx_cacher.go:55 +0x9f
Mar 17 07:47:54 hostname geth[16136]: goroutine 37 [chan receive, 16 minutes]:
Mar 17 07:47:54 hostname geth[16136]: github.com/ethereum/go-ethereum/core.(*txSenderCacher).cache(0xc000093ee0)
Mar 17 07:47:54 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/tx_cacher.go:63 +0x97
Mar 17 07:47:54 hostname geth[16136]: created by github.com/ethereum/go-ethereum/core.newTxSenderCacher
Mar 17 07:47:54 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/tx_cacher.go:55 +0x9f
Mar 17 07:47:54 hostname geth[16136]: goroutine 38 [chan receive, 16 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/core.(*txSenderCacher).cache(0xc000093ee0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/tx_cacher.go:63 +0x97
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/core.newTxSenderCacher
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/tx_cacher.go:55 +0x9f
Mar 17 07:47:55 hostname geth[16136]: goroutine 39 [chan receive, 16 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/core.(*txSenderCacher).cache(0xc000093ee0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/tx_cacher.go:63 +0x97
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/core.newTxSenderCacher
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/tx_cacher.go:55 +0x9f
Mar 17 07:47:55 hostname geth[16136]: goroutine 40 [chan receive]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/metrics.(*meterArbiter).tick(0x204cbc0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/metrics/meter.go:290 +0x7d
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/metrics.NewMeterForced
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/metrics/meter.go:71 +0x105
Mar 17 07:47:55 hostname geth[16136]: goroutine 41 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/consensus/ethash.(*remoteSealer).loop(0xc000222000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/consensus/ethash/sealer.go:278 +0x20c
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/consensus/ethash.startRemoteSealer
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/consensus/ethash/sealer.go:262 +0x2b2
Mar 17 07:47:55 hostname geth[16136]: goroutine 87 [select, 3 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/syndtr/goleveldb/leveldb.(*session).refLoop(0xc00fcfa0f0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/session_util.go:189 +0x5b2
Mar 17 07:47:55 hostname geth[16136]: created by github.com/syndtr/goleveldb/leveldb.newSession
Mar 17 07:47:55 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/session.go:93 +0x2ca
Mar 17 07:47:55 hostname geth[16136]: goroutine 22 [select, 29 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/accounts/keystore.(*watcher).loop(0xc0004ebd60)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/accounts/keystore/watch.go:94 +0x3aa
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/accounts/keystore.(*watcher).start
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/accounts/keystore/watch.go:52 +0x59
Mar 17 07:47:55 hostname geth[16136]: goroutine 47 [syscall, 29 minutes]:
Mar 17 07:47:55 hostname geth[16136]: syscall.Syscall6(0xe8, 0x8, 0xc00004bf9c, 0x1, 0xffffffffffffffff, 0x0, 0x0, 0x1140ec0, 0xc000092000, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         syscall/asm_linux_amd64.s:43 +0x5
Mar 17 07:47:55 hostname geth[16136]: golang.org/x/sys/unix.EpollWait(0x8, 0xc00004bf9c, 0x1, 0x1, 0xffffffffffffffff, 0x0, 0x0, 0xc0004ebd60)
Mar 17 07:47:55 hostname geth[16136]:         golang.org/x/[email protected]/unix/zsyscall_linux_amd64.go:76 +0x72
Mar 17 07:47:55 hostname geth[16136]: github.com/rjeczalik/notify.(*inotify).loop(0xc000180000, 0xc0000c0000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/rjeczalik/[email protected]/watcher_inotify.go:194 +0x79
Mar 17 07:47:55 hostname geth[16136]: created by github.com/rjeczalik/notify.(*inotify).lazyinit
Mar 17 07:47:55 hostname geth[16136]:         github.com/rjeczalik/[email protected]/watcher_inotify.go:134 +0x145
Mar 17 07:47:55 hostname geth[16136]: goroutine 23 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/accounts/keystore.(*KeyStore).updater(0xc0002225a0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/accounts/keystore/keystore.go:209 +0x9f
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/accounts/keystore.(*KeyStore).Subscribe
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/accounts/keystore/keystore.go:196 +0x12f
Mar 17 07:47:55 hostname geth[16136]: goroutine 24 [select, 29 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/accounts.(*Manager).update(0xc000400750)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/accounts/manager.go:111 +0x185
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/accounts.NewManager
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/accounts/manager.go:79 +0x4e5
Mar 17 07:47:55 hostname geth[16136]: goroutine 48 [chan receive, 29 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/rjeczalik/notify.(*inotify).send(0xc000180000, 0xc0000c0000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/rjeczalik/[email protected]/watcher_inotify.go:254 +0xab
Mar 17 07:47:55 hostname geth[16136]: created by github.com/rjeczalik/notify.(*inotify).lazyinit
Mar 17 07:47:55 hostname geth[16136]:         github.com/rjeczalik/[email protected]/watcher_inotify.go:137 +0x19a
Mar 17 07:47:55 hostname geth[16136]: goroutine 49 [chan receive, 29 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/rjeczalik/notify.(*inotify).send(0xc000180000, 0xc0000c0000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/rjeczalik/[email protected]/watcher_inotify.go:254 +0xab
Mar 17 07:47:55 hostname geth[16136]: created by github.com/rjeczalik/notify.(*inotify).lazyinit
Mar 17 07:47:55 hostname geth[16136]:         github.com/rjeczalik/[email protected]/watcher_inotify.go:137 +0x19a
Mar 17 07:47:55 hostname geth[16136]: goroutine 25 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/syndtr/goleveldb/leveldb/util.(*BufferPool).drain(0xc000220d20)
Mar 17 07:47:55 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/util/buffer_pool.go:209 +0x105
Mar 17 07:47:55 hostname geth[16136]: created by github.com/syndtr/goleveldb/leveldb/util.NewBufferPool
Mar 17 07:47:55 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/util/buffer_pool.go:240 +0x18c
Mar 17 07:47:55 hostname geth[16136]: goroutine 26 [select, 1 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/syndtr/goleveldb/leveldb.(*session).refLoop(0xc000222690)
Mar 17 07:47:55 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/session_util.go:189 +0x5b2
Mar 17 07:47:55 hostname geth[16136]: created by github.com/syndtr/goleveldb/leveldb.newSession
Mar 17 07:47:55 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/session.go:93 +0x2ca
Mar 17 07:47:55 hostname geth[16136]: goroutine 50 [select, 16 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc000160000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/db_compaction.go:91 +0xb1
Mar 17 07:47:55 hostname geth[16136]: created by github.com/syndtr/goleveldb/leveldb.openDB
Mar 17 07:47:55 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/db.go:148 +0x429
Mar 17 07:47:55 hostname geth[16136]: goroutine 51 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc000160000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/db_state.go:101 +0xd7
Mar 17 07:47:55 hostname geth[16136]: created by github.com/syndtr/goleveldb/leveldb.openDB
Mar 17 07:47:55 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/db.go:149 +0x44b
Mar 17 07:47:55 hostname geth[16136]: goroutine 52 [select, 16 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc000160000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/db_compaction.go:836 +0x228
Mar 17 07:47:55 hostname geth[16136]: created by github.com/syndtr/goleveldb/leveldb.openDB
Mar 17 07:47:55 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/db.go:155 +0x5a5
Mar 17 07:47:55 hostname geth[16136]: goroutine 53 [select, 16 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc000160000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/db_compaction.go:773 +0x125
Mar 17 07:47:55 hostname geth[16136]: created by github.com/syndtr/goleveldb/leveldb.openDB
Mar 17 07:47:55 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/db.go:156 +0x5c7
Mar 17 07:47:55 hostname geth[16136]: goroutine 54 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/ethdb/leveldb.(*Database).meter(0xc0000a0900, 0xb2d05e00)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/ethdb/leveldb/leveldb.go:428 +0x194f
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/ethdb/leveldb.NewCustom
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/ethdb/leveldb/leveldb.go:144 +0xa05
Mar 17 07:47:55 hostname geth[16136]: goroutine 55 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/core/rawdb.(*freezer).freeze(0xc00007c1e0, 0x155bf78, 0xc0000a0900)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/rawdb/freezer.go:287 +0x295d
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/core/rawdb.NewDatabaseWithFreezer
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/rawdb/database.go:195 +0x27b
Mar 17 07:47:55 hostname geth[16136]: goroutine 10 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/core.(*ChainIndexer).updateLoop(0xc000222780)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/chain_indexer.go:311 +0xdb
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/core.NewChainIndexer
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/chain_indexer.go:119 +0x24d
Mar 17 07:47:55 hostname geth[16136]: goroutine 37939 [select, 22 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.(*Peer).announceTransactions(0xc06444fa00)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/broadcast.go:172 +0x38c
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth/protocols/eth.NewPeer
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/peer.go:112 +0x40b
Mar 17 07:47:55 hostname geth[16136]: goroutine 80165 [select, 17 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.(*Peer).broadcastBlocks(0xc0579c4680)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/broadcast.go:44 +0xe5
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth/protocols/eth.NewPeer
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/peer.go:109 +0x393
Mar 17 07:47:55 hostname geth[16136]: goroutine 133 [IO wait]:
Mar 17 07:47:55 hostname geth[16136]: internal/poll.runtime_pollWait(0x7f30d9c177a8, 0x72, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         runtime/netpoll.go:222 +0x55
Mar 17 07:47:55 hostname geth[16136]: internal/poll.(*pollDesc).wait(0xc00379c498, 0x72, 0x500, 0x500, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         internal/poll/fd_poll_runtime.go:87 +0x45
Mar 17 07:47:55 hostname geth[16136]: internal/poll.(*pollDesc).waitRead(...)
Mar 17 07:47:55 hostname geth[16136]:         internal/poll/fd_poll_runtime.go:92
Mar 17 07:47:55 hostname geth[16136]: internal/poll.(*FD).ReadFrom(0xc00379c480, 0xc00c482a00, 0x500, 0x500, 0x0, 0x0, 0x0, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         internal/poll/fd_unix.go:222 +0x1e6
Mar 17 07:47:55 hostname geth[16136]: net.(*netFD).readFrom(0xc00379c480, 0xc00c482a00, 0x500, 0x500, 0x13defbbdb23c95ef, 0xd8686721d7d352fa, 0x4f04e1ebea2e6246, 0x273c4b0f6b616892, 0x283e91a8310740d7)
Mar 17 07:47:55 hostname geth[16136]:         net/fd_posix.go:61 +0x5b
Mar 17 07:47:55 hostname geth[16136]: net.(*UDPConn).readFrom(0xc00c06a170, 0xc00c482a00, 0x500, 0x500, 0xc00021e450, 0xc02c309c20, 0xc0004ebd20, 0x15439c0)
Mar 17 07:47:55 hostname geth[16136]:         net/udpsock_posix.go:47 +0x6a
Mar 17 07:47:55 hostname geth[16136]: net.(*UDPConn).ReadFromUDP(0xc00c06a170, 0xc00c482a00, 0x500, 0x500, 0x500, 0x15346a0, 0xc00021e450, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         net/udpsock.go:106 +0x5d
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p/discover.(*UDPv4).readLoop(0xc00c9be120, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/discover/v4_udp.go:524 +0x111
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p/discover.ListenV4
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/discover/v4_udp.go:155 +0x345
Mar 17 07:47:55 hostname geth[16136]: goroutine 131 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p/discover.(*Table).loop(0xc00c998140)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/discover/table.go:236 +0x2e9
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p/discover.ListenV4
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/discover/v4_udp.go:151 +0x2d9
Mar 17 07:47:55 hostname geth[16136]: goroutine 86 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/syndtr/goleveldb/leveldb/util.(*BufferPool).drain(0xc00c9808c0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/util/buffer_pool.go:209 +0x105
Mar 17 07:47:55 hostname geth[16136]: created by github.com/syndtr/goleveldb/leveldb/util.NewBufferPool
Mar 17 07:47:55 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/util/buffer_pool.go:240 +0x18c
Mar 17 07:47:55 hostname geth[16136]: goroutine 792 [IO wait]:
Mar 17 07:47:55 hostname geth[16136]: internal/poll.runtime_pollWait(0x7f30d9c16e98, 0x72, 0xffffffffffffffff)
Mar 17 07:47:55 hostname geth[16136]:         runtime/netpoll.go:222 +0x55
Mar 17 07:47:55 hostname geth[16136]: internal/poll.(*pollDesc).wait(0xc0105a1018, 0x72, 0x0, 0x20, 0xffffffffffffffff)
Mar 17 07:47:55 hostname geth[16136]:         internal/poll/fd_poll_runtime.go:87 +0x45
Mar 17 07:47:55 hostname geth[16136]: internal/poll.(*pollDesc).waitRead(...)
Mar 17 07:47:55 hostname geth[16136]:         internal/poll/fd_poll_runtime.go:92
Mar 17 07:47:55 hostname geth[16136]: internal/poll.(*FD).Read(0xc0105a1000, 0xc06a22fba0, 0x20, 0x20, 0x0, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         internal/poll/fd_unix.go:166 +0x1d5
Mar 17 07:47:55 hostname geth[16136]: net.(*netFD).Read(0xc0105a1000, 0xc06a22fba0, 0x20, 0x20, 0x3, 0xc00e813ba0, 0x41cc45)
Mar 17 07:47:55 hostname geth[16136]:         net/fd_posix.go:55 +0x4f
Mar 17 07:47:55 hostname geth[16136]: net.(*conn).Read(0xc00c8f9f10, 0xc06a22fba0, 0x20, 0x20, 0x0, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         net/net.go:183 +0x91
Mar 17 07:47:55 hostname geth[16136]: io.ReadAtLeast(0x1535f80, 0xc00c8f9f10, 0xc06a22fba0, 0x20, 0x20, 0x20, 0x1535f80, 0xc00c8af21caef495, 0x19e41869479)
Mar 17 07:47:55 hostname geth[16136]:         io/io.go:328 +0x87
Mar 17 07:47:55 hostname geth[16136]: io.ReadFull(...)
Mar 17 07:47:55 hostname geth[16136]:         io/io.go:347
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p/rlpx.(*handshakeState).readFrame(0xc0107f0190, 0x1535f80, 0xc00c8f9f10, 0x1535f80, 0xc00c8f9f10, 0xc0105a1000, 0x1405298, 0xc00e813
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/rlpx/rlpx.go:131 +0x9c
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p/rlpx.(*Conn).Read(0xc00d218ab0, 0xc00c8af21caef495, 0x19e41869479, 0x20541a0, 0x0, 0x0, 0x20541a0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/rlpx/rlpx.go:103 +0x92
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*rlpxTransport).ReadMsg(0xc00bdf0d80, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/transport.go:63 +0x13e
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*Peer).readLoop(0xc0107cb680, 0xc0107cb740)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/peer.go:294 +0xb5
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p.(*Peer).run
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/peer.go:231 +0xfb
Mar 17 07:47:55 hostname geth[16136]: goroutine 130 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p/enode.(*DB).expirer(0xc00d2c1680)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/enode/nodedb.go:315 +0xdb
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p/enode.(*DB).ensureExpirer.func1
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/enode/nodedb.go:306 +0x3e
Mar 17 07:47:55 hostname geth[16136]: goroutine 9 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/consensus/ethash.(*remoteSealer).loop(0xc0002220f0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/consensus/ethash/sealer.go:278 +0x20c
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/consensus/ethash.startRemoteSealer
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/consensus/ethash/sealer.go:262 +0x2b2
Mar 17 07:47:55 hostname geth[16136]: goroutine 15647 [select, 24 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/downloader.(*Downloader).deliver(0xc0073752c0, 0xc00c770900, 0x154aaf8, 0xc0412fced0, 0x155b5b8, 0x20884d0, 0x155b5b8, 0x20884d0, 0
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/downloader.go:2016 +0x1a5
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/downloader.(*Downloader).DeliverHeaders(...)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/downloader.go:1956
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*ethHandler).handleHeaders(0xc0067da300, 0xc002755930, 0xc021721ac0, 0x1, 0x1, 0x21b, 0x15343c0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/handler_eth.go:155 +0x4f0
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*ethHandler).Handle(0xc0067da300, 0xc002755930, 0x1543268, 0xc02fc5cd98, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/handler_eth.go:68 +0x2ce
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.handleBlockHeaders(0x1559078, 0xc0067da300, 0x1544fa0, 0xc051b87320, 0xc002755930, 0xc00c89762034e500, 0x3c5dfd24e4)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/handlers.go:321 +0x189
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.handleMessage(0x1559078, 0xc0067da300, 0xc002755930, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/handler.go:246 +0x406
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.Handle(0x1559078, 0xc0067da300, 0xc002755930, 0xc018013180, 0xc000148840)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/handler.go:160 +0x45
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.MakeProtocols.func1.1(0xc002755930, 0x62f756, 0x1)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/handler.go:117 +0x3d
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*handler).runEthPeer(0xc0067da300, 0xc002755930, 0xc0305d2510, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/handler.go:335 +0xada
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*ethHandler).RunPeer(0xc0067da300, 0xc002755930, 0xc0305d2510, 0xc015b4adc0, 0x7f30cb7f8d60)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/handler_eth.go:45 +0x3f
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.MakeProtocols.func1(0xc0302de2a0, 0x15438d0, 0xc015b4adc0, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/handler.go:116 +0x11a
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*Peer).startProtocols.func1(0xc0302de2a0, 0xc015b4adc0, 0x15438d0, 0xc015b4adc0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/peer.go:393 +0x98
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p.(*Peer).startProtocols
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/peer.go:391 +0x205
Mar 17 07:47:55 hostname geth[16136]: goroutine 132 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p/discover.(*UDPv4).loop(0xc00c9be120)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/discover/v4_udp.go:447 +0x4f7
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p/discover.ListenV4
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/discover/v4_udp.go:154 +0x316
Mar 17 07:47:55 hostname geth[16136]: goroutine 15 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/core.(*BlockChain).update(0xc000145900)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/blockchain.go:2297 +0xde
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/core.NewBlockChain
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/blockchain.go:378 +0x1085
Mar 17 07:47:55 hostname geth[16136]: goroutine 16 [select, 16 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/core.(*BlockChain).maintainTxIndex(0xc000145900, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/blockchain.go:2374 +0x205
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/core.NewBlockChain
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/blockchain.go:383 +0x12d7
Mar 17 07:47:55 hostname geth[16136]: goroutine 98 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/trie.(*Database).SaveCachePeriodically(0xc002052000, 0xc000912e10, 0x2e, 0x34630b8a000, 0xc000a264e0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/trie/database.go:888 +0xf8
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/core.NewBlockChain.func1(0xc000145900, 0xc002052000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/blockchain.go:395 +0x8b
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/core.NewBlockChain
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/blockchain.go:393 +0x1145
Mar 17 07:47:55 hostname geth[16136]: goroutine 99 [select, 16 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/core.(*ChainIndexer).eventLoop(0xc000222780, 0xc0000e6d80, 0xc00c7705a0, 0x1543510, 0xc00ba09710)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/chain_indexer.go:211 +0x265
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/core.(*ChainIndexer).Start
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/chain_indexer.go:152 +0xcf
Mar 17 07:47:55 hostname geth[16136]: goroutine 100 [select, 16 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/core.(*TxPool).scheduleReorgLoop(0xc0073750e0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/tx_pool.go:1010 +0x1f9
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/core.NewTxPool
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/tx_pool.go:295 +0x745
Mar 17 07:47:55 hostname geth[16136]: goroutine 101 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/core.(*TxPool).loop(0xc0073750e0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/tx_pool.go:337 +0x285
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/core.NewTxPool
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/core/tx_pool.go:312 +0x7e5
Mar 17 07:47:55 hostname geth[16136]: goroutine 102 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/downloader.(*Downloader).qosTuner(0xc0073752c0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/downloader.go:2039 +0x34b
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth/downloader.New
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/downloader.go:250 +0x499
Mar 17 07:47:55 hostname geth[16136]: goroutine 103 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/downloader.(*Downloader).stateFetcher(0xc0073752c0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/statesync.go:83 +0xae
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth/downloader.New
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/downloader.go:251 +0x4bb
Mar 17 07:47:55 hostname geth[16136]: goroutine 104 [select, 16 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/miner.(*worker).mainLoop(0xc00c6f2900)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/miner/worker.go:439 +0x2a7
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/miner.newWorker
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/miner/worker.go:227 +0x532
Mar 17 07:47:55 hostname geth[16136]: goroutine 105 [select, 16 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/miner.(*worker).newWorkLoop(0xc00c6f2900, 0xb2d05e00)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/miner/worker.go:373 +0x247
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/miner.newWorker
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/miner/worker.go:228 +0x55e
Mar 17 07:47:55 hostname geth[16136]: goroutine 106 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/miner.(*worker).resultLoop(0xc00c6f2900)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/miner/worker.go:584 +0xb8
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/miner.newWorker
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/miner/worker.go:229 +0x585
Mar 17 07:47:55 hostname geth[16136]: goroutine 107 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/miner.(*worker).taskLoop(0xc00c6f2900)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/miner/worker.go:549 +0xd0
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/miner.newWorker
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/miner/worker.go:230 +0x5a7
Mar 17 07:47:55 hostname geth[16136]: goroutine 108 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/miner.(*Miner).update(0xc00c770e40)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/miner/miner.go:98 +0x1fd
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/miner.New
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/miner/miner.go:77 +0x1bb
Mar 17 07:47:55 hostname geth[16136]: goroutine 109 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/downloader.(*PublicDownloaderAPI).eventLoop(0xc00c6c1fa0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/api.go:63 +0x27a
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth/downloader.NewPublicDownloaderAPI
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/api.go:49 +0xca
Mar 17 07:47:55 hostname geth[16136]: goroutine 110 [select, 16 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/filters.(*EventSystem).eventLoop(0xc00016b970)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/filters/filter_system.go:459 +0x43d
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth/filters.NewEventSystem
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/filters/filter_system.go:138 +0x345
Mar 17 07:47:55 hostname geth[16136]: goroutine 111 [chan receive, 3 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/filters.(*PublicFilterAPI).timeoutLoop(0xc00c5d67d0, 0x45d964b800)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/filters/api.go:82 +0x28b
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth/filters.NewPublicFilterAPI
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/filters/api.go:70 +0x112
Mar 17 07:47:55 hostname geth[16136]: goroutine 89 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc00c9ce000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/db_state.go:101 +0xd7
Mar 17 07:47:55 hostname geth[16136]: created by github.com/syndtr/goleveldb/leveldb.openDB
Mar 17 07:47:55 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/db.go:149 +0x44b
Mar 17 07:47:55 hostname geth[16136]: goroutine 90 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc00c9ce000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/db_compaction.go:836 +0x228
Mar 17 07:47:55 hostname geth[16136]: created by github.com/syndtr/goleveldb/leveldb.openDB
Mar 17 07:47:55 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/db.go:155 +0x5a5
Mar 17 07:47:55 hostname geth[16136]: goroutine 91 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc00c9ce000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/db_compaction.go:773 +0x125
Mar 17 07:47:55 hostname geth[16136]: created by github.com/syndtr/goleveldb/leveldb.openDB
Mar 17 07:47:55 hostname geth[16136]:         github.com/syndtr/[email protected]/leveldb/db.go:156 +0x5c7
Mar 17 07:47:55 hostname geth[16136]: goroutine 794 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*protoRW).ReadMsg(0xc010263c20, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/peer.go:450 +0xcf
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.handleMessage(0x1559078, 0xc0067da300, 0xc00aef5a00, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/handler.go:229 +0xad
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.Handle(0x1559078, 0xc0067da300, 0xc00aef5a00, 0xc0105a1180, 0xc000148840)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/handler.go:160 +0x45
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.MakeProtocols.func1.1(0xc00aef5a00, 0x62f756, 0x1)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/handler.go:117 +0x3d
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*handler).runEthPeer(0xc0067da300, 0xc00aef5a00, 0xc00d59f518, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/handler.go:335 +0xada
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*ethHandler).RunPeer(0xc0067da300, 0xc00aef5a00, 0xc00d59f518, 0xc010263c20, 0x7f30cb7f8d60)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/handler_eth.go:45 +0x3f
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.MakeProtocols.func1(0xc0107cb680, 0x15438d0, 0xc010263c20, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/handler.go:116 +0x11a
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*Peer).startProtocols.func1(0xc0107cb680, 0xc010263c20, 0x15438d0, 0xc010263c20)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/peer.go:393 +0x98
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p.(*Peer).startProtocols
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/peer.go:391 +0x205
Mar 17 07:47:55 hostname geth[16136]: goroutine 93 [select, 8 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p/nat.Map(0x1550b58, 0xc0004e8700, 0xc0000c0840, 0x1324504, 0x3, 0x765f, 0x765f, 0x132e736, 0xc)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/nat/nat.go:113 +0x42a
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*Server).setupListening.func1(0xc0004ee780, 0xc00edf4ff0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/server.go:673 +0x8b
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p.(*Server).setupListening
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/server.go:672 +0x245
Mar 17 07:47:55 hostname geth[16136]: goroutine 94 [IO wait]:
Mar 17 07:47:55 hostname geth[16136]: internal/poll.runtime_pollWait(0x7f30d9c17890, 0x72, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         runtime/netpoll.go:222 +0x55
Mar 17 07:47:55 hostname geth[16136]: internal/poll.(*pollDesc).wait(0xc00379c418, 0x72, 0x0, 0x0, 0x13281f7)
Mar 17 07:47:55 hostname geth[16136]:         internal/poll/fd_poll_runtime.go:87 +0x45
Mar 17 07:47:55 hostname geth[16136]: internal/poll.(*pollDesc).waitRead(...)
Mar 17 07:47:55 hostname geth[16136]:         internal/poll/fd_poll_runtime.go:92
Mar 17 07:47:55 hostname geth[16136]: internal/poll.(*FD).Accept(0xc00379c400, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         internal/poll/fd_unix.go:401 +0x212
Mar 17 07:47:55 hostname geth[16136]: net.(*netFD).accept(0xc00379c400, 0xc0000c1c18, 0x1add240, 0x1e25e80)
Mar 17 07:47:55 hostname geth[16136]:         net/fd_unix.go:172 +0x45
Mar 17 07:47:55 hostname geth[16136]: net.(*TCPListener).accept(0xc00bb584e0, 0x41d26b, 0xc0000c1bc0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         net/tcpsock_posix.go:139 +0x32
Mar 17 07:47:55 hostname geth[16136]: net.(*TCPListener).Accept(0xc00bb584e0, 0x0, 0xc0004ee780, 0x155b458, 0xc07cc82048)
Mar 17 07:47:55 hostname geth[16136]:         net/tcpsock.go:261 +0x65
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*Server).listenLoop(0xc0004ee780)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/server.go:862 +0x24f
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p.(*Server).setupListening
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/server.go:680 +0x16d
Mar 17 07:47:55 hostname geth[16136]: goroutine 95 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p/enode.(*FairMix).runSource(0xc00fcf9200, 0xc0000c18c0, 0xc00d2c16a0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/enode/iter.go:281 +0x176
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p/enode.(*FairMix).AddSource
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/enode/iter.go:180 +0x153
Mar 17 07:47:55 hostname geth[16136]: goroutine 96 [select, 8 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p/nat.Map(0x1550b58, 0xc0004e8700, 0xc0000c0840, 0x1324513, 0x3, 0x765f, 0x765f, 0x1335391, 0x12)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/nat/nat.go:113 +0x42a
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*Server).setupDiscovery.func1(0xc0004ee780, 0xc00edf50e0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/server.go:566 +0x8b
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p.(*Server).setupDiscovery
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/server.go:565 +0x825
Mar 17 07:47:55 hostname geth[16136]: goroutine 101277 [select, 13 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*Peer).run(0xc03702f500, 0x110a0a0, 0xc037875980, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/peer.go:241 +0x265
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*Server).runPeer(0xc0004ee780, 0xc03702f500)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/server.go:1039 +0x1de
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p.(*Server).launchPeer
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/server.go:1022 +0xc5
Mar 17 07:47:55 hostname geth[16136]: goroutine 118441 [select, 8 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.(*Peer).broadcastTransactions(0xc05f8444e0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/broadcast.go:105 +0x4ba
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth/protocols/eth.NewPeer
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/peer.go:110 +0x3b8
Mar 17 07:47:55 hostname geth[16136]: goroutine 42349 [select, 21 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.(*Peer).broadcastTransactions(0xc04c2f71e0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/broadcast.go:105 +0x4ba
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth/protocols/eth.NewPeer
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/peer.go:110 +0x3b8
Mar 17 07:47:55 hostname geth[16136]: goroutine 7721 [select, 26 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.(*Peer).broadcastTransactions(0xc0388e3d40)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/broadcast.go:105 +0x4ba
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth/protocols/eth.NewPeer
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/peer.go:110 +0x3b8
Mar 17 07:47:55 hostname geth[16136]: goroutine 134 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p/enode.(*FairMix).runSource(0xc00fcf9200, 0xc0000c18c0, 0xc006afeda0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/enode/iter.go:281 +0x176
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p/enode.(*FairMix).AddSource
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/enode/iter.go:180 +0x153
Mar 17 07:47:55 hostname geth[16136]: goroutine 135 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*dialScheduler).readNodes(0xc0064fbce0, 0x154ae28, 0xc00fcf9200)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/dial.go:323 +0x14c
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p.newDialScheduler
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/dial.go:180 +0x365
Mar 17 07:47:55 hostname geth[16136]: goroutine 136 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*dialScheduler).loop(0xc0064fbce0, 0x154ae28, 0xc00fcf9200)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/dial.go:243 +0x2e7
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p.newDialScheduler
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/dial.go:181 +0x3a5
Mar 17 07:47:55 hostname geth[16136]: goroutine 137 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*Server).run(0xc0004ee780)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/server.go:714 +0x519
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p.(*Server).Start
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/server.go:487 +0x38c
Mar 17 07:47:55 hostname geth[16136]: goroutine 23429 [select, 23 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*Peer).handle(0xc076244900, 0x18, 0x22, 0x15343c0, 0xc070b03290, 0xc00c898935449232, 0x4e2500ca09, 0x20541a0, 0x0, 0x0, ...)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/peer.go:332 +0x134
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*Peer).readLoop(0xc076244900, 0xc0762449c0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/peer.go:300 +0x198
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p.(*Peer).run
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/peer.go:231 +0xfb
Mar 17 07:47:55 hostname geth[16136]: goroutine 7152 [semacquire, 23 minutes]:
Mar 17 07:47:55 hostname geth[16136]: sync.runtime_Semacquire(0xc01aa23d70)
Mar 17 07:47:55 hostname geth[16136]:         runtime/sema.go:56 +0x45
Mar 17 07:47:55 hostname geth[16136]: sync.(*WaitGroup).Wait(0xc01aa23d68)
Mar 17 07:47:55 hostname geth[16136]:         sync/waitgroup.go:130 +0x65
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*Peer).run(0xc01aa23d40, 0x110a0a0, 0xc037874280, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/peer.go:269 +0x333
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*Server).runPeer(0xc0004ee780, 0xc01aa23d40)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/server.go:1039 +0x1de
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p.(*Server).launchPeer
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/server.go:1022 +0xc5
Mar 17 07:47:55 hostname geth[16136]: goroutine 101299 [select, 13 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.(*Peer).announceTransactions(0xc0804fc410)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/broadcast.go:172 +0x38c
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth/protocols/eth.NewPeer
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/peer.go:112 +0x40b
Mar 17 07:47:55 hostname geth[16136]: goroutine 45620 [select, 21 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*Peer).handle(0xc02c1abbc0, 0x11, 0x27, 0x15343c0, 0xc05a069e60, 0xc00c89ac73188e74, 0x6ef716086a, 0x20541a0, 0x0, 0x0, ...)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/peer.go:332 +0x134
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*Peer).readLoop(0xc02c1abbc0, 0xc02c1abda0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/peer.go:300 +0x198
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p.(*Peer).run
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/peer.go:231 +0xfb
Mar 17 07:47:55 hostname geth[16136]: goroutine 13012 [semacquire, 2 minutes]:
Mar 17 07:47:55 hostname geth[16136]: sync.runtime_Semacquire(0xc05da0bf50)
Mar 17 07:47:55 hostname geth[16136]:         runtime/sema.go:56 +0x45
Mar 17 07:47:55 hostname geth[16136]: sync.(*WaitGroup).Wait(0xc05da0bf48)
Mar 17 07:47:55 hostname geth[16136]:         sync/waitgroup.go:130 +0x65
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*Peer).run(0xc05da0bf20, 0x110a0a0, 0xc05d803c80, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/peer.go:269 +0x333
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*Server).runPeer(0xc0004ee780, 0xc05da0bf20)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/server.go:1039 +0x1de
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p.(*Server).launchPeer
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/server.go:1022 +0xc5
Mar 17 07:47:55 hostname geth[16136]: goroutine 4725 [select, 27 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.(*Peer).broadcastTransactions(0xc00a775ba0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/broadcast.go:105 +0x4ba
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth/protocols/eth.NewPeer
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/peer.go:110 +0x3b8
Mar 17 07:47:55 hostname geth[16136]: goroutine 138 [IO wait, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: internal/poll.runtime_pollWait(0x7f30d9c16db0, 0x72, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         runtime/netpoll.go:222 +0x55
Mar 17 07:47:55 hostname geth[16136]: internal/poll.(*pollDesc).wait(0xc00decdc18, 0x72, 0x0, 0x0, 0x13281f7)
Mar 17 07:47:55 hostname geth[16136]:         internal/poll/fd_poll_runtime.go:87 +0x45
Mar 17 07:47:55 hostname geth[16136]: internal/poll.(*pollDesc).waitRead(...)
Mar 17 07:47:55 hostname geth[16136]:         internal/poll/fd_poll_runtime.go:92
Mar 17 07:47:55 hostname geth[16136]: internal/poll.(*FD).Accept(0xc00decdc00, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         internal/poll/fd_unix.go:401 +0x212
Mar 17 07:47:55 hostname geth[16136]: net.(*netFD).accept(0xc00decdc00, 0x1844082705a0b5d2, 0x7be0bf9813fa7203, 0x49be44cca0444fcd)
Mar 17 07:47:55 hostname geth[16136]:         net/fd_unix.go:172 +0x45
Mar 17 07:47:55 hostname geth[16136]: net.(*UnixListener).accept(0xc008aeed20, 0x223550a3a4f607, 0x1c10eb6cd3b968d, 0x38273c8d5fa02980)
Mar 17 07:47:55 hostname geth[16136]:         net/unixsock_posix.go:162 +0x32
Mar 17 07:47:55 hostname geth[16136]: net.(*UnixListener).Accept(0xc008aeed20, 0x8c5437eb23dd16b5, 0x38e88764b3758308, 0x18367f84335799d, 0x83005ed0b2847e30)
Mar 17 07:47:55 hostname geth[16136]:         net/unixsock.go:260 +0x65
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/rpc.(*Server).ServeListener(0xc008952420, 0x154b668, 0xc008aeed20, 0x0, 0x2)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/rpc/ipc.go:30 +0x49
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/rpc.StartIPCEndpoint
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/rpc/endpoints.go:50 +0x376
Mar 17 07:47:55 hostname geth[16136]: goroutine 139 [IO wait, 2 minutes]:
Mar 17 07:47:55 hostname geth[16136]: internal/poll.runtime_pollWait(0x7f30d9c16cc8, 0x72, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         runtime/netpoll.go:222 +0x55
Mar 17 07:47:55 hostname geth[16136]: internal/poll.(*pollDesc).wait(0xc00e162098, 0x72, 0x0, 0x0, 0x13281f7)
Mar 17 07:47:55 hostname geth[16136]:         internal/poll/fd_poll_runtime.go:87 +0x45
Mar 17 07:47:55 hostname geth[16136]: internal/poll.(*pollDesc).waitRead(...)
Mar 17 07:47:55 hostname geth[16136]:         internal/poll/fd_poll_runtime.go:92
Mar 17 07:47:55 hostname geth[16136]: internal/poll.(*FD).Accept(0xc00e162080, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         internal/poll/fd_unix.go:401 +0x212
Mar 17 07:47:55 hostname geth[16136]: net.(*netFD).accept(0xc00e162080, 0x87e36262a8fbf2bc, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         net/fd_unix.go:172 +0x45
Mar 17 07:47:55 hostname geth[16136]: net.(*TCPListener).accept(0xc00be30e10, 0x6051b37d, 0xc00e5bbe50, 0x4ed546)
Mar 17 07:47:55 hostname geth[16136]:         net/tcpsock_posix.go:139 +0x32
Mar 17 07:47:55 hostname geth[16136]: net.(*TCPListener).Accept(0xc00be30e10, 0xc00e5bbea0, 0x18, 0xc00ce77800, 0x90217b)
Mar 17 07:47:55 hostname geth[16136]:         net/tcpsock.go:261 +0x65
Mar 17 07:47:55 hostname geth[16136]: net/http.(*Server).Serve(0xc00dbd7ea0, 0x154b638, 0xc00be30e10, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         net/http/server.go:2981 +0x285
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/node.(*httpServer).start
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/node/rpcstack.go:145 +0x205
Mar 17 07:47:55 hostname geth[16136]: goroutine 139005 [IO wait]:
Mar 17 07:47:55 hostname geth[16136]: internal/poll.runtime_pollWait(0x7f30d9c17320, 0x77, 0xc00c785680)
Mar 17 07:47:55 hostname geth[16136]:         runtime/netpoll.go:222 +0x55
Mar 17 07:47:55 hostname geth[16136]: internal/poll.(*pollDesc).wait(0xc07b71bf98, 0x77, 0x1550300, 0xc078e57380, 0xc07b71bf80)
Mar 17 07:47:55 hostname geth[16136]:         internal/poll/fd_poll_runtime.go:87 +0x45
Mar 17 07:47:55 hostname geth[16136]: internal/poll.(*pollDesc).waitWrite(...)
Mar 17 07:47:55 hostname geth[16136]:         internal/poll/fd_poll_runtime.go:96
Mar 17 07:47:55 hostname geth[16136]: internal/poll.(*FD).WaitWrite(...)
Mar 17 07:47:55 hostname geth[16136]:         internal/poll/fd_unix.go:528
Mar 17 07:47:55 hostname geth[16136]: net.(*netFD).connect(0xc07b71bf80, 0x1550308, 0xc078e57380, 0x0, 0x0, 0x15364a0, 0xc04dcb7120, 0x0, 0x0, 0x0, ...)
Mar 17 07:47:55 hostname geth[16136]:         net/fd_unix.go:141 +0x27b
Mar 17 07:47:55 hostname geth[16136]: net.(*netFD).dial(0xc07b71bf80, 0x1550308, 0xc078e57380, 0x1557440, 0x0, 0x1557440, 0xc0242db800, 0x0, 0x7f30a4453648, 0x10)
Mar 17 07:47:55 hostname geth[16136]:         net/sock_posix.go:149 +0x10b
Mar 17 07:47:55 hostname geth[16136]: net.socket(0x1550308, 0xc078e57380, 0x1324504, 0x3, 0x2, 0x1, 0x0, 0x0, 0x1557440, 0x0, ...)
Mar 17 07:47:55 hostname geth[16136]:         net/sock_posix.go:70 +0x1c5
Mar 17 07:47:55 hostname geth[16136]: net.internetSocket(0x1550308, 0xc078e57380, 0x1324504, 0x3, 0x1557440, 0x0, 0x1557440, 0xc0242db800, 0x1, 0x0, ...)
Mar 17 07:47:55 hostname geth[16136]:         net/ipsock_posix.go:141 +0x145
Mar 17 07:47:55 hostname geth[16136]: net.(*sysDialer).doDialTCP(0xc07b71bf00, 0x1550308, 0xc078e57380, 0x0, 0xc0242db800, 0x11a2120, 0x20884d0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         net/tcpsock_posix.go:65 +0xc5
Mar 17 07:47:55 hostname geth[16136]: net.(*sysDialer).dialTCP(0xc07b71bf00, 0x1550308, 0xc078e57380, 0x0, 0xc0242db800, 0x4895c7, 0x41c33d, 0x60)
Mar 17 07:47:55 hostname geth[16136]:         net/tcpsock_posix.go:61 +0xd7
Mar 17 07:47:55 hostname geth[16136]: net.(*sysDialer).dialSingle(0xc07b71bf00, 0x1550308, 0xc078e57380, 0x15444b0, 0xc0242db800, 0x0, 0x0, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         net/dial.go:580 +0x5e8
Mar 17 07:47:55 hostname geth[16136]: net.(*sysDialer).dialSerial(0xc07b71bf00, 0x1550308, 0xc078e57380, 0xc07048a900, 0x1, 0x1, 0x0, 0x0, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         net/dial.go:548 +0x15e
Mar 17 07:47:55 hostname geth[16136]: net.(*Dialer).DialContext(0xc00dbe6780, 0x1550308, 0xc078e57380, 0x1324504, 0x3, 0xc04831d6a0, 0xf, 0x0, 0x0, 0x0, ...)
Mar 17 07:47:55 hostname geth[16136]:         net/dial.go:425 +0x6e5
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.tcpDialer.Dial(0xc00dbe6780, 0x1550298, 0xc00f185340, 0xc00993c930, 0xc06f0a4d90, 0x70, 0x18, 0xc010479601)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/dial.go:67 +0x91
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*dialTask).dial(0xc0242db4d0, 0xc0064fbce0, 0xc00993c930, 0xc0002879c0, 0x5561a1d282c7ab73)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/dial.go:538 +0x75
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*dialTask).run(0xc0242db4d0, 0xc0064fbce0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/dial.go:488 +0x59
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*dialScheduler).startDial.func1(0xc0242db4d0, 0xc0064fbce0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/dial.go:459 +0x35
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p.(*dialScheduler).startDial
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/dial.go:458 +0x3fc
Mar 17 07:47:55 hostname geth[16136]: goroutine 7720 [select, 26 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.(*Peer).broadcastBlocks(0xc0388e3d40)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/broadcast.go:44 +0xe5
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth/protocols/eth.NewPeer
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/peer.go:109 +0x393
Mar 17 07:47:55 hostname geth[16136]: goroutine 35560 [select, 22 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.(*Peer).broadcastBlocks(0xc06b1b91e0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/broadcast.go:44 +0xe5
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth/protocols/eth.NewPeer
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/peer.go:109 +0x393
Mar 17 07:47:55 hostname geth[16136]: goroutine 4242 [select, 27 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.(*Peer).broadcastTransactions(0xc01738d790)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/broadcast.go:105 +0x4ba
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth/protocols/eth.NewPeer
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/peer.go:110 +0x3b8
Mar 17 07:47:55 hostname geth[16136]: goroutine 140 [IO wait, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: internal/poll.runtime_pollWait(0x7f30cb7f8b00, 0x72, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         runtime/netpoll.go:222 +0x55
Mar 17 07:47:55 hostname geth[16136]: internal/poll.(*pollDesc).wait(0xc00e162218, 0x72, 0x0, 0x0, 0x13281f7)
Mar 17 07:47:55 hostname geth[16136]:         internal/poll/fd_poll_runtime.go:87 +0x45
Mar 17 07:47:55 hostname geth[16136]: internal/poll.(*pollDesc).waitRead(...)
Mar 17 07:47:55 hostname geth[16136]:         internal/poll/fd_poll_runtime.go:92
Mar 17 07:47:55 hostname geth[16136]: internal/poll.(*FD).Accept(0xc00e162200, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         internal/poll/fd_unix.go:401 +0x212
Mar 17 07:47:55 hostname geth[16136]: net.(*netFD).accept(0xc00e162200, 0x30, 0x30, 0x7f3103d62f18)
Mar 17 07:47:55 hostname geth[16136]:         net/fd_unix.go:172 +0x45
Mar 17 07:47:55 hostname geth[16136]: net.(*TCPListener).accept(0xc00be30e28, 0xc00e5c0e50, 0x425078, 0x30)
Mar 17 07:47:55 hostname geth[16136]:         net/tcpsock_posix.go:139 +0x32
Mar 17 07:47:55 hostname geth[16136]: net.(*TCPListener).Accept(0xc00be30e28, 0x12736c0, 0xc0090b1170, 0x1186d00, 0x1dd64b0)
Mar 17 07:47:55 hostname geth[16136]:         net/tcpsock.go:261 +0x65
Mar 17 07:47:55 hostname geth[16136]: net/http.(*Server).Serve(0xc00e24c0e0, 0x154b638, 0xc00be30e28, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         net/http/server.go:2981 +0x285
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/node.(*httpServer).start
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/node/rpcstack.go:145 +0x205
Mar 17 07:47:55 hostname geth[16136]: goroutine 111805 [semacquire, 9 minutes]:
Mar 17 07:47:55 hostname geth[16136]: sync.runtime_Semacquire(0xc019f53b90)
Mar 17 07:47:55 hostname geth[16136]:         runtime/sema.go:56 +0x45
Mar 17 07:47:55 hostname geth[16136]: sync.(*WaitGroup).Wait(0xc019f53b88)
Mar 17 07:47:55 hostname geth[16136]:         sync/waitgroup.go:130 +0x65
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*Peer).run(0xc019f53b60, 0x110a0a0, 0xc00cf7a480, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/peer.go:269 +0x333
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*Server).runPeer(0xc0004ee780, 0xc019f53b60)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/server.go:1039 +0x1de
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p.(*Server).launchPeer
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/server.go:1022 +0xc5
Mar 17 07:47:55 hostname geth[16136]: goroutine 141 [select, 16 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.StartENRUpdater.func1(0x1543510, 0xc00be30e40, 0xc00e142f00, 0xc00c980b60, 0xc000145900)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/discovery.go:48 +0x105
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth/protocols/eth.StartENRUpdater
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/discovery.go:45 +0x8d
Mar 17 07:47:55 hostname geth[16136]: goroutine 142 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers.func1(0xc000222ff0, 0x1000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:50 +0x315
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:48 +0x53
Mar 17 07:47:55 hostname geth[16136]: goroutine 143 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers.func1(0xc000222ff0, 0x1000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:50 +0x315
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:48 +0x53
Mar 17 07:47:55 hostname geth[16136]: goroutine 144 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers.func1(0xc000222ff0, 0x1000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:50 +0x315
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:48 +0x53
Mar 17 07:47:55 hostname geth[16136]: goroutine 145 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers.func1(0xc000222ff0, 0x1000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:50 +0x315
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:48 +0x53
Mar 17 07:47:55 hostname geth[16136]: goroutine 162 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers.func1(0xc000222ff0, 0x1000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:50 +0x315
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:48 +0x53
Mar 17 07:47:55 hostname geth[16136]: goroutine 163 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers.func1(0xc000222ff0, 0x1000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:50 +0x315
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:48 +0x53
Mar 17 07:47:55 hostname geth[16136]: goroutine 164 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers.func1(0xc000222ff0, 0x1000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:50 +0x315
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:48 +0x53
Mar 17 07:47:55 hostname geth[16136]: goroutine 165 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers.func1(0xc000222ff0, 0x1000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:50 +0x315
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:48 +0x53
Mar 17 07:47:55 hostname geth[16136]: goroutine 166 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers.func1(0xc000222ff0, 0x1000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:50 +0x315
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:48 +0x53
Mar 17 07:47:55 hostname geth[16136]: goroutine 167 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers.func1(0xc000222ff0, 0x1000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:50 +0x315
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:48 +0x53
Mar 17 07:47:55 hostname geth[16136]: goroutine 168 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers.func1(0xc000222ff0, 0x1000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:50 +0x315
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:48 +0x53
Mar 17 07:47:55 hostname geth[16136]: goroutine 169 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers.func1(0xc000222ff0, 0x1000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:50 +0x315
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:48 +0x53
Mar 17 07:47:55 hostname geth[16136]: goroutine 170 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers.func1(0xc000222ff0, 0x1000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:50 +0x315
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:48 +0x53
Mar 17 07:47:55 hostname geth[16136]: goroutine 171 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers.func1(0xc000222ff0, 0x1000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:50 +0x315
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:48 +0x53
Mar 17 07:47:55 hostname geth[16136]: goroutine 172 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers.func1(0xc000222ff0, 0x1000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:50 +0x315
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:48 +0x53
Mar 17 07:47:55 hostname geth[16136]: goroutine 173 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers.func1(0xc000222ff0, 0x1000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:50 +0x315
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth.(*Ethereum).startBloomHandlers
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/bloombits.go:48 +0x53
Mar 17 07:47:55 hostname geth[16136]: goroutine 174 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*handler).txBroadcastLoop(0xc0067da300)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/handler.go:522 +0x139
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth.(*handler).Start
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/handler.go:394 +0xe5
Mar 17 07:47:55 hostname geth[16136]: goroutine 175 [chan receive, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*handler).minedBroadcastLoop(0xc0067da300)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/handler.go:510 +0x85
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth.(*handler).Start
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/handler.go:399 +0x185
Mar 17 07:47:55 hostname geth[16136]: goroutine 176 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*chainSyncer).loop(0xc00ead3d10)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/sync.go:213 +0x217
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth.(*handler).Start
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/handler.go:403 +0x1c5
Mar 17 07:47:55 hostname geth[16136]: goroutine 177 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*handler).txsyncLoop64(0xc0067da300)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/sync.go:134 +0x251
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth.(*handler).Start
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/handler.go:404 +0x1e7
Mar 17 07:47:55 hostname geth[16136]: goroutine 178 [chan receive, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/cmd/utils.StartNode.func1(0xc00015c420, 0xc00011de10)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/cmd/utils/cmd.go:88 +0x185
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/cmd/utils.StartNode
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/cmd/utils/cmd.go:73 +0xbe
Mar 17 07:47:55 hostname geth[16136]: goroutine 179 [chan receive, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/rpc.(*Server).ServeCodec(0xc000283e90, 0x1553238, 0xc00d8734a0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/rpc/server.go:87 +0x145
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/rpc.DialInProc.func1
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/rpc/inproc.go:29 +0xbd
Mar 17 07:47:55 hostname geth[16136]: goroutine 157 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/fetcher.(*BlockFetcher).loop(0xc00c7742a0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/fetcher/block_fetcher.go:375 +0x734
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth/fetcher.(*BlockFetcher).Start
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/fetcher/block_fetcher.go:231 +0x3f
Mar 17 07:47:55 hostname geth[16136]: goroutine 158 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/fetcher.(*TxFetcher).loop(0xc00016b8c0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/fetcher/tx_fetcher.go:355 +0x5ac
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth/fetcher.(*TxFetcher).Start
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/fetcher/tx_fetcher.go:337 +0x3f
Mar 17 07:47:55 hostname geth[16136]: goroutine 125 [syscall, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: os/signal.signal_recv(0x1403c00)
Mar 17 07:47:55 hostname geth[16136]:         runtime/sigqueue.go:168 +0xa5
Mar 17 07:47:55 hostname geth[16136]: os/signal.loop()
Mar 17 07:47:55 hostname geth[16136]:         os/signal/signal_unix.go:23 +0x25
Mar 17 07:47:55 hostname geth[16136]: created by os/signal.Notify.func1.1
Mar 17 07:47:55 hostname geth[16136]:         os/signal/signal.go:151 +0x45
Mar 17 07:47:55 hostname geth[16136]: goroutine 180 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/rpc.(*Client).dispatch(0xc00e162380, 0x1553238, 0xc00d873540)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/rpc/client.go:561 +0x27d
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/rpc.initClient
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/rpc/client.go:223 +0x2c5
Mar 17 07:47:55 hostname geth[16136]: goroutine 181 [chan receive, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: main.startNode.func1(0xc00011de10, 0xc00e1430e0, 0xc00c780c50)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/cmd/geth/main.go:378 +0xff
Mar 17 07:47:55 hostname geth[16136]: created by main.startNode
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/cmd/geth/main.go:370 +0x151
Mar 17 07:47:55 hostname geth[16136]: goroutine 182 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/rpc.(*Client).dispatch(0xc00e162400, 0x1553238, 0xc00d8734a0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/rpc/client.go:561 +0x27d
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/rpc.initClient
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/rpc/client.go:223 +0x2c5
Mar 17 07:47:55 hostname geth[16136]: goroutine 183 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: net.(*pipe).read(0xc00e162280, 0xc00697e600, 0x200, 0x200, 0xc0003ba000, 0xc000052800, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         net/pipe.go:159 +0x185
Mar 17 07:47:55 hostname geth[16136]: net.(*pipe).Read(0xc00e162280, 0xc00697e600, 0x200, 0x200, 0x944d07, 0x1550340, 0xc008d9a450)
Mar 17 07:47:55 hostname geth[16136]:         net/pipe.go:142 +0x56
Mar 17 07:47:55 hostname geth[16136]: encoding/json.(*Decoder).refill(0xc0064fbe40, 0xc00e7a4640, 0x42491b)
Mar 17 07:47:55 hostname geth[16136]:         encoding/json/stream.go:165 +0xeb
Mar 17 07:47:55 hostname geth[16136]: encoding/json.(*Decoder).readValue(0xc0064fbe40, 0x0, 0x0, 0xc00be30ea0)
Mar 17 07:47:55 hostname geth[16136]:         encoding/json/stream.go:140 +0x1ff
Mar 17 07:47:55 hostname geth[16136]: encoding/json.(*Decoder).Decode(0xc0064fbe40, 0x11a57a0, 0xc00be30ea0, 0x98a73e58d9210f01, 0xc00be30ea0)
Mar 17 07:47:55 hostname geth[16136]:         encoding/json/stream.go:63 +0x7c
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/rpc.(*jsonCodec).readBatch(0xc00d8734a0, 0x208c11afc7ffffff, 0x18ef70606050c00, 0xd8ffffffffffffff, 0x6050c0023d211cf, 0xffffffff0117fa
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/rpc/json.go:209 +0x57
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/rpc.(*Client).read(0xc00e162400, 0x1553238, 0xc00d8734a0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/rpc/client.go:634 +0xca
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/rpc.(*Client).dispatch
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/rpc/client.go:558 +0x10f
Mar 17 07:47:55 hostname geth[16136]: goroutine 184 [select, 28 minutes]:
Mar 17 07:47:55 hostname geth[16136]: net.(*pipe).read(0xc00e162300, 0xc00697e800, 0x200, 0x200, 0xc0003ba000, 0xc000052800, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         net/pipe.go:159 +0x185
Mar 17 07:47:55 hostname geth[16136]: net.(*pipe).Read(0xc00e162300, 0xc00697e800, 0x200, 0x200, 0x944d07, 0x1550340, 0xc008d9a600)
Mar 17 07:47:55 hostname geth[16136]:         net/pipe.go:142 +0x56
Mar 17 07:47:55 hostname geth[16136]: encoding/json.(*Decoder).refill(0xc00e2c0000, 0xc00e7ab640, 0x42491b)
Mar 17 07:47:55 hostname geth[16136]:         encoding/json/stream.go:165 +0xeb
Mar 17 07:47:55 hostname geth[16136]: encoding/json.(*Decoder).readValue(0xc00e2c0000, 0x0, 0x0, 0xc00be30f00)
Mar 17 07:47:55 hostname geth[16136]:         encoding/json/stream.go:140 +0x1ff
Mar 17 07:47:55 hostname geth[16136]: encoding/json.(*Decoder).Decode(0xc00e2c0000, 0x11a57a0, 0xc00be30f00, 0x1, 0xc00be30f00)
Mar 17 07:47:55 hostname geth[16136]:         encoding/json/stream.go:63 +0x7c
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/rpc.(*jsonCodec).readBatch(0xc00d873540, 0x20a1078300c817a8, 0xd442cdffbbfa094, 0x329b0dc313af766c, 0xc4b8806aea2d9d0f, 0x87177f190d1b0
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/rpc/json.go:209 +0x57
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/rpc.(*Client).read(0xc00e162380, 0x1553238, 0xc00d873540)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/rpc/client.go:634 +0xca
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/rpc.(*Client).dispatch
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/rpc/client.go:558 +0x10f
Mar 17 07:47:55 hostname geth[16136]: goroutine 159 [sleep]:
Mar 17 07:47:55 hostname geth[16136]: time.Sleep(0xdf8475800)
Mar 17 07:47:55 hostname geth[16136]:         runtime/time.go:193 +0xd2
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/cmd/utils.monitorFreeDiskSpace(0xc00dd56000, 0xc00d2cec30, 0x24, 0x10000000)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/cmd/utils/cmd.go:116 +0x47
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/cmd/utils.StartNode.func1
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/cmd/utils/cmd.go:85 +0x336
Mar 17 07:47:55 hostname geth[16136]: goroutine 4726 [select, 27 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.(*Peer).announceTransactions(0xc00a775ba0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/broadcast.go:172 +0x38c
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth/protocols/eth.NewPeer
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/peer.go:112 +0x40b
Mar 17 07:47:55 hostname geth[16136]: goroutine 7719 [select, 26 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/downloader.(*Downloader).deliver(0xc0073752c0, 0xc00c770900, 0x154aaf8, 0xc03d2ce330, 0x155b5b8, 0x20884d0, 0x155b5b8, 0x20884d0, 0
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/downloader.go:2016 +0x1a5
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/downloader.(*Downloader).DeliverHeaders(...)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/downloader.go:1956
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*ethHandler).handleHeaders(0xc0067da300, 0xc0388e3d40, 0xc0374114a0, 0x1, 0x1, 0x21b, 0x15343c0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/handler_eth.go:155 +0x4f0
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*ethHandler).Handle(0xc0067da300, 0xc0388e3d40, 0x1543268, 0xc03765a750, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/handler_eth.go:68 +0x2ce
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.handleBlockHeaders(0x1559078, 0xc0067da300, 0x1544fa0, 0xc0373bd6e0, 0xc0388e3d40, 0xc00c895e843c0926, 0x265f2e1d0a)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/handlers.go:321 +0x189
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.handleMessage(0x1559078, 0xc0067da300, 0xc0388e3d40, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/handler.go:246 +0x406
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.Handle(0x1559078, 0xc0067da300, 0xc0388e3d40, 0xc030583100, 0xc000148840)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/handler.go:160 +0x45
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.MakeProtocols.func1.1(0xc0388e3d40, 0x62f756, 0x1)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/handler.go:117 +0x3d
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*handler).runEthPeer(0xc0067da300, 0xc0388e3d40, 0xc04a69e210, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/handler.go:335 +0xada
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*ethHandler).RunPeer(0xc0067da300, 0xc0388e3d40, 0xc04a69e210, 0xc01e1d5cc0, 0x7f30cb7f8d60)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/handler_eth.go:45 +0x3f
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.MakeProtocols.func1(0xc0304e2d20, 0x15438d0, 0xc01e1d5cc0, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/handler.go:116 +0x11a
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*Peer).startProtocols.func1(0xc0304e2d20, 0xc01e1d5cc0, 0x15438d0, 0xc01e1d5cc0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/peer.go:393 +0x98
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p.(*Peer).startProtocols
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/peer.go:391 +0x205
Mar 17 07:47:55 hostname geth[16136]: goroutine 13017 [select, 25 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.(*Peer).broadcastBlocks(0xc05dde0410)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/broadcast.go:44 +0xe5
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth/protocols/eth.NewPeer
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/peer.go:109 +0x393
Mar 17 07:47:55 hostname geth[16136]: goroutine 139111 [IO wait]:
Mar 17 07:47:55 hostname geth[16136]: internal/poll.runtime_pollWait(0x7f30a17b9a08, 0x77, 0xc00dd6e780)
Mar 17 07:47:55 hostname geth[16136]:         runtime/netpoll.go:222 +0x55
Mar 17 07:47:55 hostname geth[16136]: internal/poll.(*pollDesc).wait(0xc00f7d3518, 0x77, 0x1550300, 0xc015dcc120, 0xc00f7d3500)
Mar 17 07:47:55 hostname geth[16136]:         internal/poll/fd_poll_runtime.go:87 +0x45
Mar 17 07:47:55 hostname geth[16136]: internal/poll.(*pollDesc).waitWrite(...)
Mar 17 07:47:55 hostname geth[16136]:         internal/poll/fd_poll_runtime.go:96
Mar 17 07:47:55 hostname geth[16136]: internal/poll.(*FD).WaitWrite(...)
Mar 17 07:47:55 hostname geth[16136]:         internal/poll/fd_unix.go:528
Mar 17 07:47:55 hostname geth[16136]: net.(*netFD).connect(0xc00f7d3500, 0x1550308, 0xc015dcc120, 0x0, 0x0, 0x15364a0, 0xc04c229560, 0x0, 0x0, 0x0, ...)
Mar 17 07:47:55 hostname geth[16136]:         net/fd_unix.go:141 +0x27b
Mar 17 07:47:55 hostname geth[16136]: net.(*netFD).dial(0xc00f7d3500, 0x1550308, 0xc015dcc120, 0x1557440, 0x0, 0x1557440, 0xc06ba8aed0, 0x0, 0x7f30a1267a00, 0x10)
Mar 17 07:47:55 hostname geth[16136]:         net/sock_posix.go:149 +0x10b
Mar 17 07:47:55 hostname geth[16136]: net.socket(0x1550308, 0xc015dcc120, 0x1324504, 0x3, 0x2, 0x1, 0x0, 0x0, 0x1557440, 0x0, ...)
Mar 17 07:47:55 hostname geth[16136]:         net/sock_posix.go:70 +0x1c5
Mar 17 07:47:55 hostname geth[16136]: net.internetSocket(0x1550308, 0xc015dcc120, 0x1324504, 0x3, 0x1557440, 0x0, 0x1557440, 0xc06ba8aed0, 0x1, 0x0, ...)
Mar 17 07:47:55 hostname geth[16136]:         net/ipsock_posix.go:141 +0x145
Mar 17 07:47:55 hostname geth[16136]: net.(*sysDialer).doDialTCP(0xc00f7d3480, 0x1550308, 0xc015dcc120, 0x0, 0xc06ba8aed0, 0x11a2120, 0x20884d0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         net/tcpsock_posix.go:65 +0xc5
Mar 17 07:47:55 hostname geth[16136]: net.(*sysDialer).dialTCP(0xc00f7d3480, 0x1550308, 0xc015dcc120, 0x0, 0xc06ba8aed0, 0xc0051c8b58, 0x41c3d0, 0x60)
Mar 17 07:47:55 hostname geth[16136]:         net/tcpsock_posix.go:61 +0xd7
Mar 17 07:47:55 hostname geth[16136]: net.(*sysDialer).dialSingle(0xc00f7d3480, 0x1550308, 0xc015dcc120, 0x15444b0, 0xc06ba8aed0, 0x0, 0x0, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         net/dial.go:580 +0x5e8
Mar 17 07:47:55 hostname geth[16136]: net.(*sysDialer).dialSerial(0xc00f7d3480, 0x1550308, 0xc015dcc120, 0xc0766a9630, 0x1, 0x1, 0x0, 0x0, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         net/dial.go:548 +0x15e
Mar 17 07:47:55 hostname geth[16136]: net.(*Dialer).DialContext(0xc00dbe6780, 0x1550308, 0xc015dcc120, 0x1324504, 0x3, 0xc03b305d40, 0x12, 0x0, 0x0, 0x0, ...)
Mar 17 07:47:55 hostname geth[16136]:         net/dial.go:425 +0x6e5
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.tcpDialer.Dial(0xc00dbe6780, 0x1550298, 0xc00f185340, 0xc0788047e0, 0xc0005fb6e8, 0x41ca25, 0xc070298360, 0xc0005fb760)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/dial.go:67 +0x91
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*dialTask).dial(0xc06ba8adb0, 0xc0064fbce0, 0xc0788047e0, 0x110a260, 0xc0077de0e0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/dial.go:538 +0x75
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*dialTask).run(0xc06ba8adb0, 0xc0064fbce0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/dial.go:488 +0x59
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*dialScheduler).startDial.func1(0xc06ba8adb0, 0xc0064fbce0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/dial.go:459 +0x35
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p.(*dialScheduler).startDial
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/dial.go:458 +0x3fc
Mar 17 07:47:55 hostname geth[16136]: goroutine 896 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/downloader.(*Downloader).fetchParts(0xc0073752c0, 0xc00c7709c0, 0xc00cfb6ea0, 0xc00c0d22a0, 0xc00cfb6e90, 0xc00cfb6ef0, 0xc00cfb6ee
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/downloader.go:1363 +0x185
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/downloader.(*Downloader).fetchReceipts(0xc0073752c0, 0x630f4b, 0xc00e89cf98, 0xacff39)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/downloader.go:1316 +0x2c5
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/downloader.(*Downloader).syncWithPeer.func5(0xc0102dc360, 0xc0105a9f80)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/downloader.go:562 +0x36
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/downloader.(*Downloader).spawnSync.func1(0xc0073752c0, 0xc010aef6e0, 0xc00e4ab2a8)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/downloader.go:584 +0x5b
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth/downloader.(*Downloader).spawnSync
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/downloader.go:584 +0xaf
Mar 17 07:47:55 hostname geth[16136]: goroutine 897 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/downloader.(*Downloader).processHeaders(0xc0073752c0, 0x63afcb, 0xc010b27380, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/downloader.go:1663 +0x290
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/downloader.(*Downloader).syncWithPeer.func6(0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/downloader.go:563 +0x3f
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/downloader.(*Downloader).spawnSync.func1(0xc0073752c0, 0xc010aef6e0, 0xc010af2e20)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/downloader.go:584 +0x5b
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/eth/downloader.(*Downloader).spawnSync
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/downloader.go:584 +0xaf
Mar 17 07:47:55 hostname geth[16136]: goroutine 2415 [select]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*protoRW).ReadMsg(0xc0296de460, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/peer.go:450 +0xcf
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.handleMessage(0x1559078, 0xc0067da300, 0xc019376ea0, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/handler.go:229 +0xad
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.Handle(0x1559078, 0xc0067da300, 0xc019376ea0, 0xc00f241500, 0xc000148840)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/handler.go:160 +0x45
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.MakeProtocols.func1.1(0xc019376ea0, 0x62f756, 0x1)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/handler.go:117 +0x3d
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*handler).runEthPeer(0xc0067da300, 0xc019376ea0, 0xc0205091b8, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/handler.go:335 +0xada
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*ethHandler).RunPeer(0xc0067da300, 0xc019376ea0, 0xc0205091b8, 0xc0296de460, 0x7f30cb7f8d60)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/handler_eth.go:45 +0x3f
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.MakeProtocols.func1(0xc010a0bf20, 0x15438d0, 0xc0296de460, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/handler.go:116 +0x11a
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/p2p.(*Peer).startProtocols.func1(0xc010a0bf20, 0xc0296de460, 0x15438d0, 0xc0296de460)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/peer.go:393 +0x98
Mar 17 07:47:55 hostname geth[16136]: created by github.com/ethereum/go-ethereum/p2p.(*Peer).startProtocols
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/p2p/peer.go:391 +0x205
Mar 17 07:47:55 hostname geth[16136]: goroutine 42346 [select, 21 minutes]:
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/downloader.(*Downloader).deliver(0xc0073752c0, 0xc00c770900, 0x154aaf8, 0xc010ebe150, 0x155b5b8, 0x20884d0, 0x155b5b8, 0x20884d0, 0
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/downloader.go:2016 +0x1a5
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/downloader.(*Downloader).DeliverHeaders(...)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/downloader/downloader.go:1956
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*ethHandler).handleHeaders(0xc0067da300, 0xc04c2f71e0, 0xc014e41e40, 0x1, 0x1, 0x227, 0x15343c0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/handler_eth.go:155 +0x4f0
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth.(*ethHandler).Handle(0xc0067da300, 0xc04c2f71e0, 0x1543268, 0xc014e41e28, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/handler_eth.go:68 +0x2ce
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.handleBlockHeaders66(0x1559078, 0xc0067da300, 0x1544fa0, 0xc027c201e0, 0xc04c2f71e0, 0xc00c89a55d0e4cec, 0x685c1daed1
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/handlers.go:330 +0x18d
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.handleMessage(0x1559078, 0xc0067da300, 0xc04c2f71e0, 0x0, 0x0)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/handler.go:246 +0x406
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.Handle(0x1559078, 0xc0067da300, 0xc04c2f71e0, 0xc054e70c80, 0xc000148840)
Mar 17 07:47:55 hostname geth[16136]:         github.com/ethereum/go-ethereum/eth/protocols/eth/handler.go:160 +0x45
Mar 17 07:47:55 hostname geth[16136]: github.com/ethereum/go-ethereum/eth/protocols/eth.MakeProtocols.func1.1(0xc04c2f71e0, 0x62f756, 0x1)
Mar 17 07:47:56 hostname systemd[1]: geth.service: Main process exited, code=exited, status=2/INVALIDARGUMENT
Mar 17 07:47:56 hostname systemd[1]: geth.service: Unit entered failed state.
Mar 17 07:47:56 hostname systemd[1]: geth.service: Failed with result 'exit-code'.
Mar 17 07:48:11 hostname systemd[1]: geth.service: Service hold-off time over, scheduling restart.
Mar 17 07:48:11 hostname systemd[1]: Stopped Ethereum smart contracts network client daemon - Geth.
Mar 17 07:48:11 hostname systemd[1]: Started Ethereum smart contracts network client daemon - Geth.
Mar 17 07:48:13 hostname geth[16367]: INFO [03-17|07:48:13.349] Disk storage enabled for ethash caches   dir=/var/lib/geth/.ethereum/ropsten/geth/ethash count=3
Mar 17 07:48:13 hostname geth[16367]: INFO [03-17|07:48:13.349] Disk storage enabled for ethash DAGs     dir=/var/lib/geth/.ethash count=2
Mar 17 07:48:13 hostname geth[16367]: INFO [03-17|07:48:13.361] Initialising Ethereum protocol           network=3 dbversion=8
Mar 17 07:48:14 hostname geth[16367]: INFO [03-17|07:48:14.046] Loaded most recent local header          number=6491959 hash="73abc7…e9537f" td=23353306715460591 age=1y5mo3w
Mar 17 07:48:14 hostname geth[16367]: INFO [03-17|07:48:14.046] Loaded most recent local full block      number=6491959 hash="73abc7…e9537f" td=23353306715460591 age=1y5mo3w
Mar 17 07:48:14 hostname geth[16367]: INFO [03-17|07:48:14.046] Loaded most recent local fast block      number=6491959 hash="73abc7…e9537f" td=23353306715460591 age=1y5mo3w
Mar 17 07:48:14 hostname geth[16367]: WARN [03-17|07:48:14.059] Head state missing, repairing            number=6491959 hash="73abc7…e9537f" snaproot="024792…b51a5d"
Mar 17 07:48:53 hostname geth[16367]: INFO [03-17|07:48:53.886] Loaded most recent local header          number=6491959 hash="73abc7…e9537f" td=23353306715460591 age=1y5mo3w
Mar 17 07:48:53 hostname geth[16367]: INFO [03-17|07:48:53.886] Loaded most recent local full block      number=6479626 hash="00c5ba…9fb5ae" td=23346718251425909 age=1y5mo3w
Mar 17 07:48:53 hostname geth[16367]: INFO [03-17|07:48:53.886] Loaded most recent local fast block      number=6491959 hash="73abc7…e9537f" td=23353306715460591 age=1y5mo3w
Mar 17 07:48:53 hostname geth[16367]: WARN [03-17|07:48:53.891] Enabling snapshot recovery               chainhead=6479626 diskbase=6490474
Mar 17 07:48:53 hostname geth[16367]: WARN [03-17|07:48:53.891] Loaded snapshot journal                  diskroot="024792…b51a5d" diffs=missing
Mar 17 07:48:53 hostname geth[16367]: WARN [03-17|07:48:53.891] Snapshot is not continuous with chain    snaproot="024792…b51a5d" chainroot="fe45c4…fd96ed"
Mar 17 07:48:53 hostname geth[16367]: INFO [03-17|07:48:53.891] Loaded local transaction journal         transactions=0 dropped=0
Mar 17 07:48:53 hostname geth[16367]: INFO [03-17|07:48:53.892] Regenerated local transaction journal    transactions=0 accounts=0
Mar 17 07:48:53 hostname geth[16367]: WARN [03-17|07:48:53.895] Unclean shutdown detected                booted=2021-03-15T11:14:24+0000 age=1d20h34m
Mar 17 07:48:53 hostname geth[16367]: WARN [03-17|07:48:53.895] Unclean shutdown detected                booted=2021-03-17T03:42:31+0000 age=4h6m22s
Mar 17 07:48:53 hostname geth[16367]: WARN [03-17|07:48:53.895] Unclean shutdown detected                booted=2021-03-17T04:16:09+0000 age=3h32m44s
Mar 17 07:48:53 hostname geth[16367]: WARN [03-17|07:48:53.895] Unclean shutdown detected                booted=2021-03-17T04:42:05+0000 age=3h6m48s
Mar 17 07:48:53 hostname geth[16367]: WARN [03-17|07:48:53.895] Unclean shutdown detected                booted=2021-03-17T05:06:57+0000 age=2h41m56s
Mar 17 07:48:53 hostname geth[16367]: WARN [03-17|07:48:53.895] Unclean shutdown detected                booted=2021-03-17T05:32:01+0000 age=2h16m52s
Mar 17 07:48:53 hostname geth[16367]: WARN [03-17|07:48:53.895] Unclean shutdown detected                booted=2021-03-17T05:56:35+0000 age=1h52m18s
Mar 17 07:48:53 hostname geth[16367]: WARN [03-17|07:48:53.895] Unclean shutdown detected                booted=2021-03-17T06:23:20+0000 age=1h25m33s
Mar 17 07:48:53 hostname geth[16367]: WARN [03-17|07:48:53.895] Unclean shutdown detected                booted=2021-03-17T06:51:26+0000 age=57m27s
Mar 17 07:48:53 hostname geth[16367]: WARN [03-17|07:48:53.895] Unclean shutdown detected                booted=2021-03-17T07:19:28+0000 age=29m25s
Mar 17 07:48:53 hostname geth[16367]: INFO [03-17|07:48:53.895] Starting peer-to-peer node               instance=Geth/v1.10.1-stable-c2d2f4ed/linux-amd64/go1.16
Mar 17 07:48:53 hostname geth[16367]: INFO [03-17|07:48:53.960] New local node record                    seq=28 id=709117e314775173 ip=127.0.0.1 udp=30303 tcp=30303
Mar 17 07:48:53 hostname geth[16367]: INFO [03-17|07:48:53.961] Started P2P networking                   self=enode://69019af98d2b13f90bb08ff8df738417c368d5f6a8a1bbc6e7d443ca137082b41bcc12e9a831713620df0a0
Mar 17 07:48:53 hostname geth[16367]: INFO [03-17|07:48:53.963] IPC endpoint opened                      url=/var/lib/geth/.ethereum/ropsten/geth.ipc
Mar 17 07:48:53 hostname geth[16367]: ERROR[03-17|07:48:53.963] Unavailable modules in HTTP API list     unavailable=[db] available="[admin debug web3 eth txpool personal ethash miner net]"
Mar 17 07:48:53 hostname geth[16367]: INFO [03-17|07:48:53.963] HTTP server started                      endpoint=[::]:8545 prefix= cors=* vhosts=*
Mar 17 07:48:53 hostname geth[16367]: INFO [03-17|07:48:53.963] WebSocket enabled                        url=ws://127.0.0.1:8546
Mar 17 07:49:03 hostname geth[16367]: INFO [03-17|07:49:03.964] Block synchronisation started
Mar 17 07:49:04 hostname geth[16367]: INFO [03-17|07:49:04.139] Looking for peers                        peercount=1 tried=60 static=0
Mar 17 07:49:08 hostname geth[16367]: INFO [03-17|07:49:08.917] New local node record                    seq=29 id=709117e314775173 ip=3.122.185.13 udp=30303 tcp=30303
Mar 17 07:49:11 hostname geth[16367]: INFO [03-17|07:49:11.336] Downloader queue stats                   receiptTasks=0 blockTasks=374 itemSize=1.26KiB throttle=8192
Mar 17 07:49:14 hostname geth[16367]: INFO [03-17|07:49:14.182] Looking for peers                        peercount=1 tried=58 static=0
Mar 17 07:49:14 hostname geth[16367]: INFO [03-17|07:49:14.187] Importing heavy sidechain segment        blocks=2048 start=6479627 end=6481674
Mar 17 07:49:22 hostname geth[16367]: INFO [03-17|07:49:22.297] Imported new chain segment               blocks=14   txs=340 mgas=66.703 elapsed=8.110s mgasps=8.225 number=6479640 hash="ceca81…84f2ba" age=
Mar 17 07:49:24 hostname geth[16367]: INFO [03-17|07:49:24.271] Looking for peers                        peercount=1 tried=48 static=0
Mar 17 07:49:30 hostname geth[16367]: INFO [03-17|07:49:30.638] Imported new chain segment               blocks=27   txs=1147 mgas=161.173 elapsed=8.341s mgasps=19.322 number=6479667 hash="822a98…0c259d" a
Mar 17 07:49:34 hostname geth[16367]: INFO [03-17|07:49:34.271] Looking for peers                        peercount=1 tried=26 static=0
Mar 17 07:49:38 hostname geth[16367]: INFO [03-17|07:49:38.891] Imported new chain segment               blocks=37   txs=1013 mgas=194.521 elapsed=8.252s mgasps=23.570 number=6479704 hash="9ff5ef…caba6e" a
Mar 17 07:49:44 hostname geth[16367]: INFO [03-17|07:49:44.272] Looking for peers                        peercount=1 tried=68 static=0
Mar 17 07:49:46 hostname geth[16367]: INFO [03-17|07:49:46.906] Imported new chain segment               blocks=35   txs=1158 mgas=214.207 elapsed=8.014s mgasps=26.727 number=6479739 hash="2eb966…f695b8" a
Mar 17 07:49:54 hostname geth[16367]: INFO [03-17|07:49:54.292] Looking for peers                        peercount=1 tried=61 static=0

@mdeliadi
Copy link
Author

@holiman Could this issue be related to #22502 ?

@mdeliadi
Copy link
Author

Just a quick update, using --snapshot=false solved my issue and made me able to full sync the Ropsten network!

@holiman
Copy link
Contributor

holiman commented Mar 30, 2021

Story time
The ropsten BitlleGasStation was self-destructed at block 6490899, in this tx .

Before it was destructed, a total of 307,430 txs had made use of it. That block is 1060 blocks earlier than the block we got stuck at (6491959). But some lag is to be expected since it's the bottom layer diffToDisk which caused the hang.

Previously, without snapshot, a large contract going away was not a problem -- we just set the stateroot to emptyRoot and that's that. Since we have no disk-pruner, we did not actually delete the slots. With snapshots, however, the case is different, and we need to actually remove all those storage slot in a key-range. So the problem is that a gas-wise small execution can have basically unbounded writes.

I suspect that the same scenario may cause problems for other clients, e.g. turbo-geth, which have some concept of flat-database and/or reverse state diffs, hence the write-up. So cc @AlexeyAkhunov @draganrakita @RatanRSur @tkstanczak -- this ropsten transaction is a pretty good test for how the client handles that.

@RatanRSur
Copy link

cc @matkt

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants