Feb 05 21:00:23 production-nomad-consul-server nomad[2650]:     2018/02/05 21:00:23 [WARN] raft: Failed to contact 10.0.31.24:4647 in 995.287049ms
Feb 06 01:07:59 production-nomad-consul-server nomad[2650]:     2018/02/06 01:07:59 [WARN] raft: Failed to contact 10.0.21.253:4647 in 500.171744ms
Feb 06 01:45:29 production-nomad-consul-server nomad[2650]:     2018/02/06 01:45:29 [WARN] raft: Failed to contact 10.0.31.24:4647 in 500.213568ms
Feb 06 02:15:50 production-nomad-consul-server nomad[2650]:     2018/02/06 02:15:50 [WARN] raft: Failed to contact 10.0.21.253:4647 in 500.17764ms
Feb 06 02:43:36 production-nomad-consul-server nomad[2650]:     2018/02/06 02:43:36 [WARN] raft: Failed to contact 10.0.21.253:4647 in 500.211246ms
Feb 06 02:43:37 production-nomad-consul-server nomad[2650]:     2018/02/06 02:43:37 [WARN] raft: Failed to contact 10.0.21.253:4647 in 500.11082ms
Feb 06 05:01:34 production-nomad-consul-server nomad[2650]:     2018/02/06 05:01:34 [WARN] raft: Failed to contact 10.0.21.253:4647 in 500.200948ms
Feb 06 08:11:55 production-nomad-consul-server nomad[2650]:     2018/02/06 08:11:55.499777 [ERR] http: Request /v1/node/10c2833f-3417-0973-9cff-be2e2a278868?region=eu-west-1&stale=&wait=120000ms, error: node not found
Feb 06 08:58:19 production-nomad-consul-server nomad[2650]:     2018/02/06 08:58:19 [WARN] raft: Failed to contact 10.0.21.253:4647 in 500.175112ms
Feb 06 08:58:19 production-nomad-consul-server nomad[2650]:     2018/02/06 08:58:19 [WARN] raft: Failed to contact 10.0.21.253:4647 in 988.119154ms
Feb 06 09:51:30 production-nomad-consul-server nomad[2650]:     2018/02/06 09:51:30 [WARN] raft: Failed to contact 10.0.21.253:4647 in 500.202098ms
Feb 06 09:51:30 production-nomad-consul-server nomad[2650]:     2018/02/06 09:51:30 [WARN] raft: Failed to contact 10.0.21.253:4647 in 960.252739ms
Feb 06 09:51:31 production-nomad-consul-server nomad[2650]:     2018/02/06 09:51:31 [WARN] raft: Failed to contact 10.0.21.253:4647 in 1.435432455s
Feb 06 09:51:33 production-nomad-consul-server nomad[2650]:     2018/02/06 09:51:33 [WARN] raft: Rejecting vote request from 10.0.21.253:4647 since we have a leader: 10.0.11.177:4647
Feb 06 09:51:33 production-nomad-consul-server nomad[2650]:     2018/02/06 09:51:33 [ERR] raft: peer {Voter 10.0.21.253:4647 10.0.21.253:4647} has newer term, stopping replication
Feb 06 09:51:33 production-nomad-consul-server nomad[2650]:     2018/02/06 09:51:33 [INFO] raft: aborting pipeline replication to peer {Voter 10.0.21.253:4647 10.0.21.253:4647}
Feb 06 09:51:33 production-nomad-consul-server nomad[2650]:     2018/02/06 09:51:33 [INFO] raft: Node at 10.0.11.177:4647 [Follower] entering Follower state (Leader: "")
Feb 06 09:51:33 production-nomad-consul-server nomad[2650]:     2018/02/06 09:51:33 [INFO] raft: aborting pipeline replication to peer {Voter 10.0.31.24:4647 10.0.31.24:4647}
Feb 06 09:51:33 production-nomad-consul-server nomad[2650]:     2018/02/06 09:51:33.233756 [INFO] nomad: cluster leadership lost
Feb 06 09:51:33 production-nomad-consul-server nomad[2650]:     2018/02/06 09:51:33.233794 [ERR] worker: failed to dequeue evaluation: eval broker disabled
Feb 06 16:40:46 production-nomad-consul-server nomad[2650]:     2018/02/06 16:40:46 [WARN] raft: Heartbeat timeout from "10.0.21.253:4647" reached, starting election
Feb 06 16:40:46 production-nomad-consul-server nomad[2650]:     2018/02/06 16:40:46 [INFO] raft: Node at 10.0.11.177:4647 [Candidate] entering Candidate state in term 30
Feb 06 16:40:47 production-nomad-consul-server nomad[2650]:     2018/02/06 16:40:47 [INFO] raft: Duplicate RequestVote for same term: 30
Feb 06 16:40:48 production-nomad-consul-server nomad[2650]:     2018/02/06 16:40:48 [INFO] raft: Node at 10.0.11.177:4647 [Follower] entering Follower state (Leader: "")
Feb 06 16:40:48 production-nomad-consul-server nomad[2650]:     2018/02/06 16:40:48.090852 [ERR] worker: failed to dequeue evaluation: rpc error: eval broker disabled
Feb 06 16:40:48 production-nomad-consul-server nomad[2650]:     2018/02/06 16:40:48.090919 [ERR] worker: failed to dequeue evaluation: rpc error: eval broker disabled
Feb 06 16:40:48 production-nomad-consul-server nomad[2650]:     2018/02/06 16:40:48 [WARN] raft: Rejecting vote request from 10.0.21.253:4647 since we have a leader: 10.0.31.24:4647
Feb 06 16:58:59 production-nomad-consul-server nomad[2650]:     2018/02/06 16:58:59 [WARN] raft: Rejecting vote request from 10.0.21.253:4647 since we have a leader: 10.0.31.24:4647
Feb 06 16:58:59 production-nomad-consul-server nomad[2650]:     2018/02/06 16:58:59 [WARN] raft: Rejecting vote request from 10.0.21.253:4647 since we have a leader: 10.0.31.24:4647
Feb 06 16:58:59 production-nomad-consul-server nomad[2650]:     2018/02/06 16:58:59.784181 [ERR] worker: failed to dequeue evaluation: rpc error: eval broker disabled
Feb 06 16:58:59 production-nomad-consul-server nomad[2650]:     2018/02/06 16:58:59.784201 [ERR] worker: failed to dequeue evaluation: rpc error: eval broker disabled
Feb 06 16:59:00 production-nomad-consul-server nomad[2650]:     2018/02/06 16:59:00 [WARN] raft: Rejecting vote request from 10.0.21.253:4647 since we have a leader: 10.0.31.24:4647
Feb 06 16:59:10 production-nomad-consul-server nomad[2650]:     2018/02/06 16:59:10.151937 [ERR] worker: failed to dequeue evaluation: rpc error: eval broker disabled
Feb 06 16:59:12 production-nomad-consul-server nomad[2650]:     2018/02/06 16:59:12 [WARN] raft: Heartbeat timeout from "10.0.21.253:4647" reached, starting election
Feb 06 16:59:12 production-nomad-consul-server nomad[2650]:     2018/02/06 16:59:12 [INFO] raft: Node at 10.0.11.177:4647 [Candidate] entering Candidate state in term 37
Feb 06 16:59:12 production-nomad-consul-server nomad[2650]:     2018/02/06 16:59:12 [INFO] raft: Duplicate RequestVote for same term: 37
Feb 06 16:59:13 production-nomad-consul-server nomad[2650]:     2018/02/06 16:59:13 [INFO] raft: Node at 10.0.11.177:4647 [Follower] entering Follower state (Leader: "")
Feb 06 16:59:13 production-nomad-consul-server nomad[2650]:     2018/02/06 16:59:13 [WARN] raft: Rejecting vote request from 10.0.21.253:4647 since we have a leader: 10.0.31.24:4647
Feb 06 16:59:14 production-nomad-consul-server nomad[2650]:     2018/02/06 16:59:14 [WARN] raft: Rejecting vote request from 10.0.21.253:4647 since we have a leader: 10.0.31.24:4647