Implement FIP-0076 Direct data onboarding

[anorth]

This issue is to track the prototype implementation of direct data onboarding and FIL+. See FIP discussion filecoin-project/FIPs#730 and the draft technical design.

Work is landing in https://github.com/filecoin-project/builtin-actors/tree/integration/direct-onboarding

Some of this prototyping will precede or be in parallel to drafting of the complete FIP.

Tasks

Beta Give feedback

1. Add market actor SectorDeals state, and maintain it at deal activation/termination Implement sector->deal mapping in built-in market actor #1347
2. Require CommD at sector pre-commit always Remove old precommit methods #1352
3. Add market actor handler for SectorContentChanged that activates deals Implements SectorContentChanged method in built-in market actor #1353
4. Clean up verify/activate deals params and return Adds CommD as option in return value from ActivateDeals #1361
5. Refactor to unify and prepare ConfirmSectorProofsValid and ProveReplicaUpdateInner for new flows Refactor sector proving methods to a unified activate_deals data activation  #1370, Refactor: extract precommit validation and svi conversion to shared method #1375, Refactor replica update sector info to new method #1376
6. New ProveCommit method (batch + aggregate) with piece activation manifests, check piece commitments, claim FIL+ allocations Implements new ProveCommit batch+aggregate for direct onboarding #1380
7. Add new ReplicaUpdateBatch/Aggregate method with piece activation manifests Implement new ProveReplicaUpdates3 for direct data onboarding. #1385
8. Send notifications (only to f05) at data activation from new PC/PRU methods Send SectorContentChanged from new onboarding methods #1386
9. Confirm sector termination to notify market of all sectors with non-zero data Miner notifies market of termination only of sectors with non-zero data #1387
10. Implement batch return pattern for new activation methods Compute batch returns for direct onboarding methods #1393
11. Deprecate prove_replica_updates2 and remove CommD checking Deprecate unused Prove Replica update 2 #1401
12. Deprecate use of SectorOnChainInfo.Deals Deprecate Deal IDs #1402
13. Delete deal state verified_claim Remove allocation id from market deal state. Clean up and improve state checks. #1403
14. Unit tests for new onboarding methods, and for notification sending
15. State check verify that live data sectors match deals
16. Integration test for f05 deal activation via new ProveCommit
17. Integration test for f05 deal activation via new ReplicaUpdate
18. Tune market provider_sectors HAMT parameters

ETA: 2024-02-22

[anorth]

Note depends on filecoin-project/ref-fvm#1852 for correct gas accounting.