feat!: reduce sorted runs during compaction (GreptimeTeam#3702)

* feat: add functions to find and merge sorted runs

* chore: refactor code

* chore: remove some duplicates

* chore: remove one clone

* refactor: change max_active_window_files to max_active_window_runs

* feat: integrate with sorted runs

* fix: unit tests

* feat: limit num of sorted runs during compaction

* fix: some test

* fix: some cr comments

* feat: use smallvec

* chore: rebase main

* feat/reduce-sorted-runs:
 Refactor compaction logic and update test configurations

 - Refactored `merge_all_runs` function to use `sort_ranged_items` for sorting.
 - Improved item merging logic by iterating with `into_iter` and handling overlaps.
 - Updated test configurations to use `max_active_window_runs` instead of `max_active_window_files` for consistency.

---------

Co-authored-by: tison <[email protected]>

src/mito2/src/compaction.rs

@@ -15,6 +15,7 @@
 mod buckets;
 pub mod compactor;
 pub mod picker;
+mod run;
 mod task;
 #[cfg(test)]
 mod test_util;

src/mito2/src/compaction/picker.rs

@@ -132,8 +132,8 @@ pub fn new_picker(
     } else {
         match compaction_options {
             CompactionOptions::Twcs(twcs_opts) => Arc::new(TwcsPicker::new(
-                twcs_opts.max_active_window_files,
-                twcs_opts.max_inactive_window_files,
+                twcs_opts.max_active_window_runs,
+                twcs_opts.max_inactive_window_runs,
                 twcs_opts.time_window_seconds(),
             )) as Arc<_>,
         }