Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Geth 1.9.8 stopped syncing since 06Dec 2019 #20435

Closed
ankita-p17 opened this issue Dec 9, 2019 · 19 comments
Closed

Geth 1.9.8 stopped syncing since 06Dec 2019 #20435

ankita-p17 opened this issue Dec 9, 2019 · 19 comments
Assignees
@fjl

Comments

@ankita-p17
Copy link

ankita-p17 commented Dec 9, 2019 •
edited
Loading

Hi,
i started geth 1.9.8 to sync one week back. State entries were syncing till 06-Dec then gets stopped.

System information

Geth version: 1.9.8
OS & Version: Linux

Expected behaviour

It should sync

Actual behaviour

06Dec logs :
Dec 06 09:22:56 dcx-geth geth[28807]: INFO [12-06|09:22:56.601] Regenerated local transaction journal transactions=0 accounts=0
Dec 06 08:55:03 dcx-geth geth[28807]: WARN [12-06|08:55:03.449] Synchronisation failed, dropping peer peer=8708e04b2712b6db err="retrieved hash chain is invalid"

Current logs :
Dec 09 06:00:54 a-geth geth[10090]: WARN [12-09|06:00:54.526] Served eth_coinbase reqid=3 t=53.945µs err="etherbase must be explicitly specified"
Dec 09 05:45:54 a-geth geth[10090]: INFO [12-09|05:45:54.779] Regenerated local transaction journal transactions=0 accounts=0
Dec 09 04:45:54 a-geth geth[10090]: INFO [12-09|04:45:54.779] Regenerated local transaction journal transactions=0 accounts=0
Dec 09 03:45:54 a-geth geth[10090]: INFO [12-09|03:45:54.779] Regenerated local transaction journal transactions=0 accounts=0
Dec 09 02:45:54 a-geth geth[10090]: INFO [12-09|02:45:54.779] Regenerated local transaction journal transactions=0 accounts=0
Dec 09 01:45:54 a-geth geth[10090]: INFO [12-09|01:45:54.779] Regenerated local transaction journal transactions=0 accounts=0

Is it because of the recent hard fork?
Any help appreciated.
@wh0am111
Copy link

wh0am111 commented Dec 9, 2019

i have same problem

@ligi
Copy link
Member

ligi commented Dec 10, 2019

Yes - this date correlates with the Hardfork and if you run geth 1.9.6 you will need to update

@ankita-p17
Copy link
Author

Yes - this date correlates with the Hardfork and if you run geth 1.9.6 you will need to update

I am running geth 1.9.8

@wh0am111
Copy link

wh0am111 commented Dec 10, 2019 via email

@ankita-p17
Copy link
Author

ankita-p17 commented Dec 10, 2019 •
edited
Loading

It started to sync but soon stopped.
Dec 10 15:19:47 dcx-geth geth[10090]: WARN [12-10|15:19:47.872] Served eth_coinbase reqid=3 t=228.184µs err="etherbase must be explicitly specified"
Dec 10 14:45:54 dcx-geth geth[10090]: INFO [12-10|14:45:54.779] Regenerated local transaction journal transactions=0 accounts=0
Dec 10 13:45:54 dcx-geth geth[10090]: INFO [12-10|13:45:54.779] Regenerated local transaction journal transactions=0 accounts=0
Dec 10 13:31:29 dcx-geth geth[10090]: WARN [12-10|13:31:29.451] Synchronisation failed, dropping peer peer=0c6253589a8d244d err="retrieved hash chain is invalid"
Dec 10 13:31:29 dcx-geth geth[10090]: INFO [12-10|13:31:29.451] Imported new state entries count=1572 elapsed=11.569ms processed=29603495 pending=21014 retry=0 duplicate=0 unexpected=0
Dec 10 13:31:29 dcx-geth geth[10090]: INFO [12-10|13:31:29.439] Imported new block receipts count=31 elapsed=99.140ms number=9065382 hash=06b500…aa56bf age=3d4h24m size=1.27MiB
Dec 10 13:31:29 dcx-geth geth[10090]: WARN [12-10|13:31:29.439] Rolled back headers count=2052 header=9083387->9081339 fast=9065351->9065351 block=0->0
Dec 10 13:31:25 dcx-geth geth[10090]: INFO [12-10|13:31:25.017] Imported new block receipts count=32 elapsed=56.044ms number=9065351 hash=edc4a3…3453a3 age=3d4h32m size=1.09MiB
Dec 10 13:31:21 dcx-geth geth[10090]: INFO [12-10|13:31:21.039] Imported new block headers count=192 elapsed=340.891ms number=9083387 hash=75263f…e399ed

@karalabe @ligi Can you help on this.
Also, Where can I get list of peer to add to my geth node.?

@Heliosmaster
Copy link

We were having the same issue. We removed the peers from the config in order to let geth get the peers automatically and that seemed to help.

@ankita-p17
Copy link
Author

We were having the same issue. We removed the peers from the config in order to let geth get the peers automatically and that seemed to help.

admin.peers
[]
net.peerCount
0

Is there any other option to remove peers from? It is halted since two days.

@fjl
Copy link
Contributor

fjl commented Dec 11, 2019

Would be good to get a stack trace from a hanging node. To get the trace, run geth attach --exec 'debug.stacks()' > stacktrace.txt.

@karalabe
Copy link
Member

Please also paste the command you use to run Geth.

@ankita-p17
Copy link
Author

Would be good to get a stack trace from a hanging node. To get the trace, run geth attach --exec 'debug.stacks()' > stacktrace.txt.

stacktrace.txt
please look into this file
@karalabe @fjl

Command to run geth : /path/to/geth/geth1.9.8/geth-linux-amd64-1.9.8-d62e9b28/geth --datadir=/home/dcx/EthereumMainnet/ --cache 4096 --rpc --rpcapi eth,web3,net,ssh,db,debug,personal,admin --rpcaddr 10.128.0.3 --rpcport 8545 --port 35556

@ankita-p17
Copy link
Author

Hi, any help??

@ligi ligi assigned fjl Dec 19, 2019
@rjl493456442
Copy link
Member

It seems Geth node doesn't have any p2p level activity for 1 hour.

goroutine 105 [select, 53 minutes]:
github.com/ethereum/go-ethereum/p2p.(*Server).run(0xc00028ca00, 0x13f9f40, 0xc000988240)
	/home/travis/gopath/src/github.com/ethereum/go-ethereum/p2p/server.go:696 +0x745
created by github.com/ethereum/go-ethereum/p2p.(*Server).Start
	/home/travis/gopath/src/github.com/ethereum/go-ethereum/p2p/server.go:483 +0x48f

@holiman
Copy link
Contributor

holiman commented Dec 19, 2019

@fjl the stack trace contains


goroutine 104 [select]:
github.com/ethereum/go-ethereum/p2p/discover.(*lookup).slowdown(0xc0001c4cf0)
	/home/travis/gopath/src/github.com/ethereum/go-ethereum/p2p/discover/lookup.go:137 +0xf9
github.com/ethereum/go-ethereum/p2p/discover.(*lookup).startQueries(0xc0001c4cf0, 0x45de3da70ebf13ab)
	/home/travis/gopath/src/github.com/ethereum/go-ethereum/p2p/discover/lookup.go:114 +0x2b4
github.com/ethereum/go-ethereum/p2p/discover.(*lookup).advance(0xc0001c4cf0, 0x0)
	/home/travis/gopath/src/github.com/ethereum/go-ethereum/p2p/discover/lookup.go:69 +0x28e
github.com/ethereum/go-ethereum/p2p/discover.(*lookupIterator).Next(0xc0001bbe00, 0xc000607eb4)
	/home/travis/gopath/src/github.com/ethereum/go-ethereum/p2p/discover/lookup.go:213 +0xac
github.com/ethereum/go-ethereum/p2p/enode.(*FairMix).runSource(0xc0001953e0, 0xc0030882a0, 0xc0001b9660)
	/home/travis/gopath/src/github.com/ethereum/go-ethereum/p2p/enode/iter.go:277 +0xc5
created by github.com/ethereum/go-ethereum/p2p/enode.(*FairMix).AddSource
	/home/travis/gopath/src/github.com/ethereum/go-ethereum/p2p/enode/iter.go:178 +0x17a

You modified that 23 days ago: #20389 . PTAL?

@ankita-p17
Copy link
Author

stacktrace.txt
find the latest stack trace attached

@ankita-p17
Copy link
Author

Hi @fjl, any update?

@ankita-p17
Copy link
Author

ankita-p17 commented Dec 31, 2019 •
edited
Loading

Hi @karalabe, @ligi @fjl, @holiman, any update on this??
For Muir Glacier fork, I need to upgrade the existing 1.9.8 to 1.9.9, correct if not. How an unsynced node will get affected?

@ankita-p17 ankita-p17 mentioned this issue Jan 3, 2020
Closed
@BadMachine
Copy link

Same problem here!
Tried to remove db and start sync from scratch, after 3 hours syncing i`ve got same result
"Syncronization failed, dropping peer"

@fjl
Copy link
Contributor

fjl commented Jan 16, 2020

Here is why this issue is happening:

  • The peer discovery table is empty. Reasons for this can be firewall misconfiguration (e.g. UDP blocked) or system time not being synchronized with NTP.
  • The subsystem which creates peer connections is stuck waiting for discovery results and is hanging in p2p.Server.run.

We can fix the software bug where it's hanging, but sync will not work properly unless you ensure UDP connectivity is working.

@holiman
Copy link
Contributor

holiman commented Jun 3, 2021

Geth 1.9.8 is very very old by now, and this issue is not relevant any longer. Closing

@holiman holiman closed this as completed Jun 3, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@fjl fjl

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
10 participants
@fjl @ligi @karalabe @holiman @adamschmideg @Heliosmaster @rjl493456442 @ankita-p17 @wh0am111 @BadMachine