util/chunk: optimize (*ListInDisk).GetChunk and add a fast row container reader

[YangKeao]

What problem does this PR solve?

Issue Number: close #45125

Problem Summary:

The existing reading method of RowContainer (GetChunk(...)) is not fast enough for dumping a lot of rows from disk (for the cursorFetch use case).

The existing Iterator4RowContainer is even slower, as it allocates a new chunk for each row 🤦.

This PR is extracted from #44730 (with a some refractor).

What is changed and how it works?

This PR pipelines the IO and CPU calculation, to make full use of the IO bandwidth. It should also help other features using rowContainer, as GetChunk is now much faster.

The performance of existing benchmark BenchmarkListInDisk_GetChunk increases from 2877471ns/op to 462864ns/op

Check List

Tests

• Unit test
• Integration test
• Manual test (add detailed scripts or steps below)
• No code

[YangKeao]

As tested, spawning a new goroutine to read is faster for long row, but slower for short rows. It's because creating a new goroutine to just read 64KB is a waste 🤦.

4096            1024            512             64
8562687 ns/op   2573457 ns/op   1363930 ns/op   370070 ns/op    (serial)
6035161 ns/op   2086350 ns/op   1249451 ns/op   439846 ns/op    (parallel)
10592875 ns/op  3968269 ns/op   3223435 ns/op   2217039 ns/op   (master)

But both method is much faster than the original implementation.

[wshwsh12]

What the test means? seems the same as the last one?

[YangKeao]

It only reads 8.5 chunks, but doesn't drain out the whole row container. It tests whether the reader can be closed successfully (and no goroutine leaks) when it doesn't reach the end.

[YangKeao]

/retest

[YangKeao]

/retest

[ti-chi-bot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: wshwsh12, xhebox

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [wshwsh12,xhebox]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[ti-chi-bot]

[LGTM Timeline notifier]

Timeline:

• 2023-07-04 06:52:48.292586709 +0000 UTC m=+100400.226220123: ☑️ agreed by wshwsh12.
• 2023-07-04 09:33:27.626487348 +0000 UTC m=+110039.560120770: ☑️ agreed by xhebox.

[ti-chi-bot]

In response to a cherrypick label: new pull request created to branch release-7.1: #45203.

[ti-chi-bot]

In response to a cherrypick label: new pull request created to branch release-6.5: #45204.

[ti-chi-bot]

In response to a cherrypick label: new pull request created to branch release-7.2: #45205.