Restart resilience for retrievals

[dirkmc]

This issue is an Epic to keep track of tasks that must be completed in order for a retrieval deal to resume after the network goes down or the client / provider is restarted.

Currently go-fil-markets does not recover from a network failure, or a peer going down during a retrieval.

Tasks:

• Create integration test that bounces the network connection during data transfer in a retrieval deal Integration test: retrieval deal restart during transfer go-fil-markets#533 [WIP] Support Retrieval Restarts go-data-transfer#193
• Create integration test that bounces the network connection during all significant retrieval deal states Integration Test: Retrieval deal restart all states go-fil-markets#534
• Understand and implement go-fil-markets changes
  • Request validator needs to support reading state from an existing deal (instead of always creating a new one)
  • Voucher accounting must sync on client and provider Voucher processing go-data-transfer#151 Don't double count data sent on restart go-data-transfer#184 [WIP] Support Retrieval Restarts go-data-transfer#193
• Implement changes to go-data-transfer
  • Channel monitor should restart retrieval deal when connection goes down Channel monitor watches for errors instead of measuring data rate go-data-transfer#190
  • Fix voucher / data sent accounting for retrieval deals [WIP] Support Retrieval Restarts go-data-transfer#193
• Create integration tests in go-fil-markets for retrieval with unseal price > 0 Create integration tests for retrieval with > 0 unseal price go-fil-markets#527
• Create testground tests for deal data transfer restarts Create testground tests for deal data transfer restarts #5740

[dirkmc]

Fixed by #6149