Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

update proxy of release-8.1 to raftstore-proxy-8.1 #9408

Closed
wants to merge 175 commits into from
Closed

update proxy of release-8.1 to raftstore-proxy-8.1 #9408

wants to merge 175 commits into from

Conversation

CalvinNeo
Copy link
Member

What problem does this PR solve?

Issue Number: ref #4982

Problem Summary:
update proxy to raftstore-proxy-8.1
Proxy PR:
Including:\nSubmodule contrib/tiflash-proxy 7dc50b4eb0..4ebe44d321:

Fix build on macos (#388)
Fix the compile issue on arm64 (#387)
Enable /debug/pprof/heap (#384)
Fix some warnings and errors on mac (#383)
Disable enable_heap_profiling and improve some codes (#380)
Skip proxy build time (#379)
Merge pull request #377 from CalvinNeo/upd-redact-log
Enable heap profiling (#376)
Fix slog and slog-global (#375)
Merge pull request #374 from CalvinNeo/upgrade-near-8.2
Add approvers (#373)
Strengthen configuration change approval (#371)
Add log for current ReadIndex mechanism (#370)
Add some tests for replica read (#369)

What is changed and how it works?

Check List

Tests

  • Unit test
  • Integration test
  • Manual test (add detailed scripts or steps below)
  • No code

Side effects

  • Performance regression: Consumes more CPU
  • Performance regression: Consumes more Memory
  • Breaking backward compatibility

Documentation

  • Affects user behaviors
  • Contains syntax changes
  • Contains variable changes
  • Contains experimental features
  • Changes MySQL compatibility

Release note

None

CalvinNeo and others added 30 commits April 9, 2024 08:36
@CalvinNeo
Proxy: Reduce proxy's size by compressing some debug sections (pingca…
6bd9e6b 
…p#8915)

close pingcap#7256
@JinheLin
Disagg: fix used size metrics of FileCache (pingcap#8921)
da10aa6 
close pingcap#8920
@JaySon-Huang
tests: Add code coverage scripts (pingcap#8922)
adc57e2 
ref pingcap#8889
@CalvinNeo
KVStore: Fix test of async tasks (pingcap#8928)
8cec573 
close pingcap#8926
@Lloyd-Pottiger
Add insertMany interface for IColumn (pingcap#8925)
df29f84 
ref pingcap#8904
@JaySon-Huang
*: Keep clang13 (pingcap#8930)
94f15d1 
ref pingcap#7193
@JinheLin
Storages: log region applied status when write (pingcap#8932)
08c3ea1 
ref pingcap#8864
@guo-shaoge
catch exception of LocalAdmissionController::stop() (pingcap#8942)
0b0cc45 
close pingcap#8860
@JaySon-Huang
*: Fix compile error (pingcap#8944)
1df6e16 
close pingcap#8860
@Lloyd-Pottiger
build: Suppress warnings (pingcap#8948)
73f37f6 
ref pingcap#7193
@guo-shaoge
fix GeneratedColumnPlaceHolderTransformAction header (pingcap#8951)
91c5892 
close pingcap#8787
@Lloyd-Pottiger
tests: add tests for timestamp with timezone (pingcap#8950)
8a09075 
ref pingcap#6233
@CalvinNeo
Fix AsyncTasks cancel deadlock (pingcap#8953)
14a1278 
close pingcap#8952
@Lloyd-Pottiger
Support Delta/RLE encoding and multiple compression (pingcap#8820)
bdbc345 
close pingcap#8789
@JaySon-Huang
ddl: Fix logging cause by non-dropped table (pingcap#8955)
d145b00 
close pingcap#8911
@Lloyd-Pottiger
*: fix release build when enable PCH (pingcap#8959)
b454a90 
ref pingcap#6233
@CalvinNeo
*: introduce not_null as a submodule (pingcap#8802)
5cba983 
close pingcap#8933
@JinheLin
Storages: Refine log (pingcap#8963)
4da9e96 
close pingcap#8864
@JinheLin
Storages: Change CompressionCodecPtr from shared_ptr to unique_ptr (p…
9f6f61a 
…ingcap#8964)

ref pingcap#8789
@Lloyd-Pottiger
*: some streams do not need to inherit IProfilingBlockInputStream (pi…
536390a 
…ngcap#8965)

ref pingcap#6233
@JaySon-Huang
*: Refine the code in settings (pingcap#8970)
c32c428
@JinheLin
Storages: Remove some DBMS_PUBLIC_GTEST hacks (pingcap#8971)
2c0db29 
ref pingcap#6233
@JaySon-Huang
tests: Fix unstable schema test (pingcap#8972)
4412105 
close pingcap#8911, close pingcap#8968
@JaySon-Huang
Storage: Refine logging about reading snap, place index, index to wait (
a3e48e4 
pingcap#8973)

ref pingcap#8864
@CalvinNeo
KVStore: Add some log for Learner Read (pingcap#8979)
3cd21c0 
ref pingcap#8845
@Lloyd-Pottiger
Common: support bitpacking (pingcap#8969)
71faa8d 
ref pingcap#8789
@SeaRise
Pipeline: fix the missing task_ptr->profile_info.elapsedAwaitTime(); (
f1ac329 
pingcap#8986)

ref pingcap#6233
@gengliqi
Parallelize the converting hash table to two level process after fini…
a239275 
…shing hash agg build (pingcap#8957)

close pingcap#8956
@CalvinNeo
KVStore: Fix exception in FAP worker (pingcap#8989)
b77839b 
close pingcap#8988
@CalvinNeo
KVStore: Log when meets any commit_ts < observed max_read_tso (pingca…
89d1d73 
…p#8991)

ref pingcap#8845
EricZequan and others added 18 commits August 26, 2024 07:40
@EricZequan @JaySon-Huang
libcommon: Provide RSS details metrics (pingcap#9218)
bfb8c5d 
ref pingcap#9032

Signed-off-by: “EricZequan” <[email protected]>

Co-authored-by: JaySon <[email protected]>
@Lloyd-Pottiger
Storage: support restore segments from checkpoint with format version…
f7e0a01 
… V7 (pingcap#9343)

ref pingcap#9036

Storage: support restore segments from checkpoint with format version V7

Signed-off-by: Lloyd-Pottiger <[email protected]>
@dependabot @CalvinNeo @ti-chi-bot
build: bump contrib/tiflash-proxy from 4ebe44d to f2e5fb8 (pingca…
81cd947 
…p#9363)

ref pingcap#4982

Signed-off-by: dependabot[bot] <[email protected]>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Calvin Neo <[email protected]>
Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
@Lloyd-Pottiger @breezewish @JaySon-Huang
storage: Add keyspace_id to DT system tables (pingcap#9371)
d113404 
ref pingcap#9032

Signed-off-by: Wish <[email protected]>

Co-authored-by: Wenxuan <[email protected]>
Co-authored-by: JaySon <[email protected]>
@Lloyd-Pottiger @breezewish
@JaySon-Huang @ti-chi-bot
storage: Fix TiFlash system tables cannot query in Keyspace Mode (pin…
d94b18a 
…gcap#9370)

ref pingcap#9032

Signed-off-by: Wish <[email protected]>

Co-authored-by: Wenxuan <[email protected]>
Co-authored-by: JaySon <[email protected]>
Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
@JinheLin @JaySon-Huang
Storages: Fix comparing null in MinMaxIndex (pingcap#9373)
6664c0e 
close pingcap#9374

In `MinMaxIndex`, if the input value is null, return `RSResult::NoneNull`.

Co-authored-by: JaySon <[email protected]>
@CalvinNeo @ti-chi-bot
build: Fix duplicate symbol error of string.h (pingcap#9366)
9afd0b2 
close pingcap#9367

Fix compilation fails on RockyLinux 8 arm64 arch

Signed-off-by: Calvin Neo <[email protected]>

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
@JinheLin @Lloyd-Pottiger
tests: update the number of read threads in unittest (pingcap#9381)
975c3e0 
ref pingcap#6233

Co-authored-by: Lloyd-Pottiger <[email protected]>
@JinheLin @Lloyd-Pottiger
Disagg: Wait tasks in thread pool finished before return (pingcap#9382)
0772e36 
ref pingcap#9378

Co-authored-by: Lloyd-Pottiger <[email protected]>
@SeaRise @ti-chi-bot
Pipeline: use notify instead of polling for AggregateRestoreSourceOp (
637501a 
pingcap#9082)

ref pingcap#8869

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
@Lloyd-Pottiger @ti-chi-bot
storage: refine DeltaMergeStore (pingcap#9380)
4cc2c02 
ref pingcap#6233

storage: refine DeltaMergeStore

Signed-off-by: Lloyd-Pottiger <[email protected]>

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
@JinheLin
unittest: Fix ASAN reports of SkippableBlockInputStreamTest (pingcap#…
20baf5e 
…9386)

ref pingcap#6233
@Lloyd-Pottiger
tests: Refine the README of running integration tests (pingcap#9390)
897a9da 
ref pingcap#6233

tests: Refine the README of running integration tests

Signed-off-by: Lloyd-Pottiger <[email protected]>
@SeaRise @ti-chi-bot
Pipeline: use notify instead of polling for ExchangeSender (pingcap…
0a80ae0 
…#9072)

ref pingcap#8869

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
@JinheLin @ti-chi-bot
Disagg: Set the waiting time for thread pool. (pingcap#9393)
738aade 
close pingcap#9392

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
@CalvinNeo @ti-chi-bot
Disagg: Add nullptr check on S3LockLocalManager (pingcap#9387)
0761d45 
ref pingcap#8673, ref pingcap#9394

Signed-off-by: Calvin Neo <[email protected]>

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
@xzhangxian1008 @ti-chi-bot
Improve the performance of length and ascii functions (pingcap#9345)
b30c1f5 
close pingcap#9344

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
@CalvinNeo
update tiflash proxy to proxy_up/raftstore-proxy-8.1
d54afa5 
Signed-off-by: CalvinNeo <[email protected]>
@ti-chi-bot ti-chi-bot bot added do-not-merge/cherry-pick-not-approved release-note-none Denotes a PR that doesn't merit a release note. labels Sep 4, 2024
@ti-chi-bot ti-chi-bot
Copy link
Contributor

ti-chi-bot bot commented Sep 4, 2024

This cherry pick PR is for a release branch and has not yet been approved by triage owners.
Adding the do-not-merge/cherry-pick-not-approved label.

To merge this cherry pick:

  1. It must be approved by the approvers firstly.
  2. AFTER it has been approved by approvers, please wait for the cherry-pick merging approval from triage owners.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@ti-chi-bot ti-chi-bot
Copy link
Contributor

ti-chi-bot bot commented Sep 4, 2024

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please ask for approval from calvinneo, ensuring that each of them provides their approval before proceeding. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@ti-chi-bot ti-chi-bot bot added the size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files. label Sep 4, 2024
@CalvinNeo CalvinNeo requested review from JinheLin, JaySon-Huang and Lloyd-Pottiger and removed request for JinheLin and JaySon-Huang September 4, 2024 06:57
@CalvinNeo CalvinNeo closed this Sep 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@JinheLin JinheLin Awaiting requested review from JinheLin

@Lloyd-Pottiger Lloyd-Pottiger Awaiting requested review from Lloyd-Pottiger

Assignees
No one assigned
Labels
do-not-merge/cherry-pick-not-approved release-note-none Denotes a PR that doesn't merit a release note. size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.