Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add random failpoint in critical paths #4876

Merged
merged 18 commits into from
Jun 22, 2022
Merged

Add random failpoint in critical paths #4876

merged 18 commits into from
Jun 22, 2022

Conversation

yibin87
Copy link
Contributor

@yibin87 yibin87 commented May 12, 2022

What problem does this PR solve?

Issue Number: close #4807

Problem Summary:

What is changed and how it works?

Check List

Tests

  • Unit test
  • Integration test
  • Manual test (add detailed scripts or steps below)
  • No code

Side effects

  • Performance regression: Consumes more CPU
  • Performance regression: Consumes more Memory
  • Breaking backward compatibility

Documentation

  • Affects user behaviors
  • Contains syntax changes
  • Contains variable changes
  • Contains experimental features
  • Changes MySQL compatibility

Release note

None

@yibin87 yibin87 requested a review from windtalker May 12, 2022 07:11
@ti-chi-bot
Copy link
Member

ti-chi-bot commented May 12, 2022

[REVIEW NOTIFICATION]

This pull request has been approved by:

  • LittleFall
  • windtalker

To complete the pull request process, please ask the reviewers in the list to review by filling /cc @reviewer in the comment.
After your PR has acquired the required number of LGTMs, you can assign this pull request to the committer in the list by filling /assign @committer in the comment to help you merge this pull request.

The full list of commands accepted by this bot can be found here.

Reviewer can indicate their review by submitting an approval review.
Reviewer can cancel approval by submitting a request changes review.

@ti-chi-bot ti-chi-bot added release-note-none Denotes a PR that doesn't merit a release note. size/M Denotes a PR that changes 30-99 lines, ignoring generated files. labels May 12, 2022
@yibin87 yibin87 changed the title Add random failpoint in critical paths [DNM] Add random failpoint in critical paths May 12, 2022
@ti-chi-bot ti-chi-bot added size/L Denotes a PR that changes 100-499 lines, ignoring generated files. and removed size/M Denotes a PR that changes 30-99 lines, ignoring generated files. labels May 12, 2022
@ti-chi-bot ti-chi-bot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label May 26, 2022
@ti-chi-bot ti-chi-bot removed the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Jun 15, 2022
@yibin87 yibin87 changed the title [DNM] Add random failpoint in critical paths Add random failpoint in critical paths Jun 15, 2022
@yibin87
Copy link
Contributor Author

yibin87 commented Jun 15, 2022

/run-all-tests

@yibin87 yibin87 requested a review from LittleFall June 15, 2022 08:01
@sre-bot
Copy link
Collaborator

sre-bot commented Jun 15, 2022

Coverage for changed files

Filename                                      Regions    Missed Regions     Cover   Functions  Missed Functions  Executed       Lines      Missed Lines     Cover    Branches   Missed Branches     Cover
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Common/FailPoint.cpp                              587               177    69.85%           8                 2    75.00%          83                31    62.65%         200               100    50.00%
Common/wrapInvocable.h                              4                 0   100.00%           2                 0   100.00%          17                 0   100.00%           2                 0   100.00%
DataStreams/SharedQueryBlockInputStream.h          60                11    81.67%          12                 1    91.67%         100                16    84.00%          26                 6    76.92%
DataStreams/SizeLimits.cpp                         22                11    50.00%           1                 0   100.00%          21                14    33.33%          16                12    25.00%
Flash/Mpp/ExchangeReceiver.cpp                    330               330     0.00%          32                32     0.00%         490               490     0.00%         196               196     0.00%
Flash/Mpp/MPPTask.cpp                             462               462     0.00%          24                24     0.00%         400               400     0.00%         206               206     0.00%
Flash/Mpp/MPPTaskManager.cpp                      109               108     0.92%          12                11     8.33%         177               176     0.56%          72                72     0.00%
Flash/Mpp/MPPTunnel.cpp                           348                89    74.43%          17                 1    94.12%         254                27    89.37%         140                53    62.14%
Flash/Mpp/MinTSOScheduler.cpp                     322               289    10.25%           7                 6    14.29%         195               173    11.28%         164               159     3.05%
Interpreters/Aggregator.cpp                      2686              2643     1.60%          74                70     5.41%        1609              1537     4.47%        1206              1180     2.16%
Interpreters/Join.cpp                            1298               966    25.58%          82                47    42.68%        1427               928    34.97%         868               656    24.42%
Interpreters/executeQuery.cpp                     207               135    34.78%          15                 8    46.67%         410               213    48.05%         138               113    18.12%

Files which contain no functions:
Common/FailPoint.h                                  0                 0         -           0                 0         -           0                 0         -           0                 0         -
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
TOTAL                                            6435              5221    18.87%         286               202    29.37%        5183              4005    22.73%        3234              2753    14.87%

Coverage summary

Functions  MissedFunctions  Executed  Lines   MissedLines  Cover
18327      9655             47.32%    205832  96689        53.03%

full coverage report (for internal network access only)

yibin87 added 2 commits June 15, 2022 17:47
Signed-off-by: yibin <[email protected]>
Signed-off-by: yibin <[email protected]>
@yibin87
Copy link
Contributor Author

yibin87 commented Jun 16, 2022

/run-all-tests

@sre-bot
Copy link
Collaborator

sre-bot commented Jun 16, 2022

Coverage for changed files

Filename                                      Regions    Missed Regions     Cover   Functions  Missed Functions  Executed       Lines      Missed Lines     Cover    Branches   Missed Branches     Cover
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Common/FailPoint.cpp                              587               177    69.85%           8                 2    75.00%          83                31    62.65%         200               100    50.00%
Common/wrapInvocable.h                              4                 0   100.00%           2                 0   100.00%          17                 0   100.00%           2                 0   100.00%
DataStreams/SharedQueryBlockInputStream.h          60                11    81.67%          12                 1    91.67%         100                16    84.00%          26                 6    76.92%
DataStreams/SizeLimits.cpp                         22                11    50.00%           1                 0   100.00%          23                16    30.43%          16                12    25.00%
Flash/Mpp/ExchangeReceiver.cpp                    330               330     0.00%          32                32     0.00%         490               490     0.00%         196               196     0.00%
Flash/Mpp/MPPTask.cpp                             462               462     0.00%          24                24     0.00%         400               400     0.00%         206               206     0.00%
Flash/Mpp/MPPTaskManager.cpp                      109               108     0.92%          12                11     8.33%         177               176     0.56%          72                72     0.00%
Flash/Mpp/MPPTunnel.cpp                           348                89    74.43%          17                 1    94.12%         254                27    89.37%         140                53    62.14%
Flash/Mpp/MinTSOScheduler.cpp                     322               289    10.25%           7                 6    14.29%         195               173    11.28%         164               159     3.05%
Interpreters/Aggregator.cpp                      2686              2643     1.60%          74                70     5.41%        1609              1537     4.47%        1206              1180     2.16%
Interpreters/Join.cpp                            1298               966    25.58%          82                47    42.68%        1427               928    34.97%         868               656    24.42%
Interpreters/executeQuery.cpp                     207               135    34.78%          15                 8    46.67%         410               213    48.05%         138               113    18.12%

Files which contain no functions:
Common/FailPoint.h                                  0                 0         -           0                 0         -           0                 0         -           0                 0         -
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
TOTAL                                            6435              5221    18.87%         286               202    29.37%        5185              4007    22.72%        3234              2753    14.87%

Coverage summary

Functions  MissedFunctions  Executed  Lines   MissedLines  Cover
18327      9655             47.32%    205834  96685        53.03%

full coverage report (for internal network access only)

Signed-off-by: yibin <[email protected]>
@yibin87
Copy link
Contributor Author

yibin87 commented Jun 16, 2022

/run-all-tests

@sre-bot
Copy link
Collaborator

sre-bot commented Jun 16, 2022

Coverage for changed files

Filename                                      Regions    Missed Regions     Cover   Functions  Missed Functions  Executed       Lines      Missed Lines     Cover    Branches   Missed Branches     Cover
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Common/FailPoint.cpp                              587               177    69.85%           8                 2    75.00%          83                31    62.65%         200               100    50.00%
Common/wrapInvocable.h                              4                 0   100.00%           2                 0   100.00%          17                 0   100.00%           2                 0   100.00%
DataStreams/SharedQueryBlockInputStream.h          60                11    81.67%          12                 1    91.67%         100                16    84.00%          26                 6    76.92%
DataStreams/SizeLimits.cpp                         22                11    50.00%           1                 0   100.00%          23                16    30.43%          16                12    25.00%
Flash/Mpp/ExchangeReceiver.cpp                    330               330     0.00%          32                32     0.00%         490               490     0.00%         196               196     0.00%
Flash/Mpp/MPPTask.cpp                             462               462     0.00%          24                24     0.00%         400               400     0.00%         206               206     0.00%
Flash/Mpp/MPPTaskManager.cpp                      109               108     0.92%          12                11     8.33%         177               176     0.56%          72                72     0.00%
Flash/Mpp/MPPTunnel.cpp                           348                89    74.43%          17                 1    94.12%         254                27    89.37%         140                53    62.14%
Flash/Mpp/MinTSOScheduler.cpp                     322               289    10.25%           7                 6    14.29%         195               173    11.28%         164               159     3.05%
Interpreters/Aggregator.cpp                      2686              2643     1.60%          74                70     5.41%        1609              1537     4.47%        1206              1180     2.16%
Interpreters/Join.cpp                            1298               966    25.58%          82                47    42.68%        1427               928    34.97%         868               656    24.42%
Interpreters/executeQuery.cpp                     207               135    34.78%          15                 8    46.67%         410               213    48.05%         138               113    18.12%

Files which contain no functions:
Common/FailPoint.h                                  0                 0         -           0                 0         -           0                 0         -           0                 0         -
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
TOTAL                                            6435              5221    18.87%         286               202    29.37%        5185              4007    22.72%        3234              2753    14.87%

Coverage summary

Functions  MissedFunctions  Executed  Lines   MissedLines  Cover
18327      9655             47.32%    205834  96696        53.02%

full coverage report (for internal network access only)

Remove useless head files

Co-authored-by: JaySon <[email protected]>
@yibin87 yibin87 requested a review from JaySon-Huang June 20, 2022 02:07
@yibin87 yibin87 requested a review from windtalker June 20, 2022 03:36

void FailPointHelper::enableRandomFailPoint(const String & fail_point_name, double rate)
{
#define SUB_M(NAME) \
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

need an #undef?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice, done.


void FailPointHelper::initRandomFailPoints(Poco::Util::LayeredConfiguration & config, Poco::Logger * log)
{
String random_fail_point_cfg = config.getString("flash.random_fail_points", "");
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

are there some test plans? how about open failpoint for ci test

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Plan to add a regular cluster test, since some failpoints need to be test under parrel workloads.

@ti-chi-bot ti-chi-bot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Jun 20, 2022
Signed-off-by: yibin <[email protected]>
@yibin87 yibin87 requested a review from LittleFall June 21, 2022 04:29
Copy link
Contributor

@windtalker windtalker left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Others LGTM

@@ -16,6 +16,7 @@
#include <Common/FailPoint.h>
#include <Common/ThreadFactory.h>
#include <Common/TiFlashMetrics.h>
#include <Common/randomSeed.h>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

useless header file?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removed

@ti-chi-bot ti-chi-bot added the status/LGT1 Indicates that a PR has LGTM 1. label Jun 21, 2022
@ti-chi-bot ti-chi-bot added status/LGT2 Indicates that a PR has LGTM 2. and removed status/LGT1 Indicates that a PR has LGTM 1. labels Jun 21, 2022
@ti-chi-bot ti-chi-bot removed the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Jun 22, 2022
@yibin87
Copy link
Contributor Author

yibin87 commented Jun 22, 2022

/merge

@ti-chi-bot
Copy link
Member

@yibin87: It seems you want to merge this PR, I will help you trigger all the tests:

/run-all-tests

You only need to trigger /merge once, and if the CI test fails, you just re-trigger the test that failed and the bot will merge the PR for you after the CI passes.

If you have any questions about the PR merge process, please refer to pr process.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the ti-community-infra/tichi repository.

@ti-chi-bot
Copy link
Member

This pull request has been accepted and is ready to merge.

Commit hash: 3d986a2

@ti-chi-bot ti-chi-bot added the status/can-merge Indicates a PR has been approved by a committer. label Jun 22, 2022
@sre-bot
Copy link
Collaborator

sre-bot commented Jun 22, 2022

Coverage for changed files

Filename                                      Regions    Missed Regions     Cover   Functions  Missed Functions  Executed       Lines      Missed Lines     Cover    Branches   Missed Branches     Cover
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Common/FailPoint.cpp                              599               184    69.28%           8                 2    75.00%          84                32    61.90%         204               103    49.51%
Common/wrapInvocable.h                              4                 0   100.00%           2                 0   100.00%          17                 0   100.00%           2                 0   100.00%
DataStreams/SharedQueryBlockInputStream.h          60                11    81.67%          12                 1    91.67%         100                16    84.00%          26                 6    76.92%
DataStreams/SizeLimits.cpp                         22                11    50.00%           1                 0   100.00%          23                16    30.43%          16                12    25.00%
Flash/Mpp/ExchangeReceiver.cpp                    330               330     0.00%          32                32     0.00%         490               490     0.00%         196               196     0.00%
Flash/Mpp/MPPTask.cpp                             462               462     0.00%          24                24     0.00%         400               400     0.00%         206               206     0.00%
Flash/Mpp/MPPTaskManager.cpp                      109               108     0.92%          12                11     8.33%         177               176     0.56%          72                72     0.00%
Flash/Mpp/MPPTunnel.cpp                           348                89    74.43%          17                 1    94.12%         254                27    89.37%         140                53    62.14%
Flash/Mpp/MinTSOScheduler.cpp                     322               289    10.25%           7                 6    14.29%         195               173    11.28%         164               159     3.05%
Interpreters/Aggregator.cpp                      2686              2643     1.60%          74                70     5.41%        1605              1533     4.49%        1206              1180     2.16%
Interpreters/Join.cpp                            1298               966    25.58%          82                47    42.68%        1427               928    34.97%         868               656    24.42%
Interpreters/executeQuery.cpp                     207               135    34.78%          15                 8    46.67%         410               213    48.05%         138               113    18.12%

Files which contain no functions:
Common/FailPoint.h                                  0                 0         -           0                 0         -           0                 0         -           0                 0         -
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
TOTAL                                            6447              5228    18.91%         286               202    29.37%        5182              4004    22.73%        3238              2756    14.89%

Coverage summary

Functions  MissedFunctions  Executed  Lines   MissedLines  Cover
18335      9651             47.36%    206227  96648        53.14%

full coverage report (for internal network access only)

@sre-bot
Copy link
Collaborator

sre-bot commented Jun 22, 2022

Coverage for changed files

Filename                                      Regions    Missed Regions     Cover   Functions  Missed Functions  Executed       Lines      Missed Lines     Cover    Branches   Missed Branches     Cover
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Common/FailPoint.cpp                              599               184    69.28%           8                 2    75.00%          84                32    61.90%         204               103    49.51%
Common/wrapInvocable.h                              4                 0   100.00%           2                 0   100.00%          17                 0   100.00%           2                 0   100.00%
DataStreams/SharedQueryBlockInputStream.h          60                11    81.67%          12                 1    91.67%         100                16    84.00%          26                 6    76.92%
DataStreams/SizeLimits.cpp                         22                11    50.00%           1                 0   100.00%          23                16    30.43%          16                12    25.00%
Flash/Mpp/ExchangeReceiver.cpp                    330               330     0.00%          32                32     0.00%         490               490     0.00%         196               196     0.00%
Flash/Mpp/MPPTask.cpp                             462               462     0.00%          24                24     0.00%         400               400     0.00%         206               206     0.00%
Flash/Mpp/MPPTaskManager.cpp                      109               108     0.92%          12                11     8.33%         177               176     0.56%          72                72     0.00%
Flash/Mpp/MPPTunnel.cpp                           348                89    74.43%          17                 1    94.12%         254                27    89.37%         140                53    62.14%
Flash/Mpp/MinTSOScheduler.cpp                     322               289    10.25%           7                 6    14.29%         195               173    11.28%         164               159     3.05%
Interpreters/Aggregator.cpp                      2686              2643     1.60%          74                70     5.41%        1605              1533     4.49%        1206              1180     2.16%
Interpreters/Join.cpp                            1298               966    25.58%          82                47    42.68%        1427               928    34.97%         868               656    24.42%
Interpreters/executeQuery.cpp                     207               135    34.78%          15                 8    46.67%         410               213    48.05%         138               113    18.12%

Files which contain no functions:
Common/FailPoint.h                                  0                 0         -           0                 0         -           0                 0         -           0                 0         -
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
TOTAL                                            6447              5228    18.91%         286               202    29.37%        5182              4004    22.73%        3238              2756    14.89%

Coverage summary

Functions  MissedFunctions  Executed  Lines   MissedLines  Cover
18335      9651             47.36%    206227  96610        53.15%

full coverage report (for internal network access only)

@yibin87
Copy link
Contributor Author

yibin87 commented Jun 22, 2022

/run-unit-tests

1 similar comment
@yibin87
Copy link
Contributor Author

yibin87 commented Jun 22, 2022

/run-unit-tests

@sre-bot
Copy link
Collaborator

sre-bot commented Jun 22, 2022

Coverage for changed files

Filename                                      Regions    Missed Regions     Cover   Functions  Missed Functions  Executed       Lines      Missed Lines     Cover    Branches   Missed Branches     Cover
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Common/FailPoint.cpp                              599               184    69.28%           8                 2    75.00%          84                32    61.90%         204               103    49.51%
Common/wrapInvocable.h                              4                 0   100.00%           2                 0   100.00%          17                 0   100.00%           2                 0   100.00%
DataStreams/SharedQueryBlockInputStream.h          60                11    81.67%          12                 1    91.67%         100                16    84.00%          26                 6    76.92%
DataStreams/SizeLimits.cpp                         22                11    50.00%           1                 0   100.00%          23                16    30.43%          16                12    25.00%
Flash/Mpp/ExchangeReceiver.cpp                    330               330     0.00%          32                32     0.00%         490               490     0.00%         196               196     0.00%
Flash/Mpp/MPPTask.cpp                             461               461     0.00%          24                24     0.00%         397               397     0.00%         204               204     0.00%
Flash/Mpp/MPPTaskManager.cpp                      109               108     0.92%          12                11     8.33%         177               176     0.56%          72                72     0.00%
Flash/Mpp/MPPTunnel.cpp                           348                89    74.43%          17                 1    94.12%         254                27    89.37%         140                53    62.14%
Flash/Mpp/MinTSOScheduler.cpp                     322               289    10.25%           7                 6    14.29%         195               173    11.28%         164               159     3.05%
Interpreters/Aggregator.cpp                      2686              2643     1.60%          74                70     5.41%        1605              1533     4.49%        1206              1180     2.16%
Interpreters/Join.cpp                            1298               966    25.58%          82                47    42.68%        1427               928    34.97%         868               656    24.42%
Interpreters/executeQuery.cpp                     207               135    34.78%          15                 8    46.67%         410               213    48.05%         138               113    18.12%

Files which contain no functions:
Common/FailPoint.h                                  0                 0         -           0                 0         -           0                 0         -           0                 0         -
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
TOTAL                                            6446              5227    18.91%         286               202    29.37%        5179              4001    22.75%        3236              2754    14.89%

Coverage summary

Functions  MissedFunctions  Executed  Lines   MissedLines  Cover
18344      9656             47.36%    206299  96650        53.15%

full coverage report (for internal network access only)

@ti-chi-bot ti-chi-bot merged commit 8a5dc29 into pingcap:master Jun 22, 2022
@sre-bot
Copy link
Collaborator

sre-bot commented Jun 22, 2022

Coverage for changed files

Filename                                      Regions    Missed Regions     Cover   Functions  Missed Functions  Executed       Lines      Missed Lines     Cover    Branches   Missed Branches     Cover
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Common/FailPoint.cpp                              599               184    69.28%           8                 2    75.00%          84                32    61.90%         204               103    49.51%
Common/wrapInvocable.h                              4                 0   100.00%           2                 0   100.00%          17                 0   100.00%           2                 0   100.00%
DataStreams/SharedQueryBlockInputStream.h          60                11    81.67%          12                 1    91.67%         100                16    84.00%          26                 6    76.92%
DataStreams/SizeLimits.cpp                         22                11    50.00%           1                 0   100.00%          23                16    30.43%          16                12    25.00%
Flash/Mpp/ExchangeReceiver.cpp                    330               330     0.00%          32                32     0.00%         490               490     0.00%         196               196     0.00%
Flash/Mpp/MPPTask.cpp                             461               461     0.00%          24                24     0.00%         397               397     0.00%         204               204     0.00%
Flash/Mpp/MPPTaskManager.cpp                      109               108     0.92%          12                11     8.33%         177               176     0.56%          72                72     0.00%
Flash/Mpp/MPPTunnel.cpp                           348                89    74.43%          17                 1    94.12%         254                27    89.37%         140                53    62.14%
Flash/Mpp/MinTSOScheduler.cpp                     322               289    10.25%           7                 6    14.29%         195               173    11.28%         164               159     3.05%
Interpreters/Aggregator.cpp                      2686              2643     1.60%          74                70     5.41%        1605              1533     4.49%        1206              1180     2.16%
Interpreters/Join.cpp                            1298               966    25.58%          82                47    42.68%        1427               928    34.97%         868               656    24.42%
Interpreters/executeQuery.cpp                     207               135    34.78%          15                 8    46.67%         410               213    48.05%         138               113    18.12%

Files which contain no functions:
Common/FailPoint.h                                  0                 0         -           0                 0         -           0                 0         -           0                 0         -
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
TOTAL                                            6446              5227    18.91%         286               202    29.37%        5179              4001    22.75%        3236              2754    14.89%

Coverage summary

Functions  MissedFunctions  Executed  Lines   MissedLines  Cover
18341      9651             47.38%    206253  96564        53.18%

full coverage report (for internal network access only)

Lloyd-Pottiger pushed a commit to Lloyd-Pottiger/tiflash that referenced this pull request Jul 12, 2022
…s in README (pingcap#5182)

close pingcap#5172, ref pingcap#5178

Enhancement: add a integrated test on DDL module (pingcap#5130)

ref pingcap#5129

Revert "Revise default background threads size" (pingcap#5176)

close pingcap#5177

chore: remove extra dyn cast (pingcap#5186)

close pingcap#5185

Add MPPReceiverSet, which includes ExchangeReceiver and CoprocessorReader (pingcap#5175)

ref pingcap#5095

DDL: Use Column Name Instead of Offset to Find the common handle cluster index (pingcap#5166)

close pingcap#5154

Add random failpoint in critical paths (pingcap#4876)

close pingcap#4807

Segment test framework (pingcap#5150)

close pingcap#5151

optimize ps v3 restore (pingcap#5163)

ref pingcap#4914

Fix build failed (pingcap#5196)

close pingcap#5195

feat: delta tree dispatching (pingcap#5199)

close pingcap#5200

feat: introduce specialized API to write fixed length data rapidly (pingcap#5181)

close pingcap#5183

Add gtest for Limit, TopN, Projection (pingcap#5187) (pingcap#5188)

close pingcap#5187

add `MPPTask::handleError()` (pingcap#5202)

ref pingcap#5095

Check result of starting grpc server (pingcap#5257)

close pingcap#5255

feat: add optimized routines for aarch64 (pingcap#5231)

close pingcap#5240

fix: aarch64-quick-fix (pingcap#5259)

close pingcap#5260

Update client-c to support ipv6 (pingcap#5270)

close pingcap#5247

upgrade prometheus-cpp to v1.0.1 (pingcap#5279)

ref pingcap#2103, close pingcap#5278

Fix README type error (pingcap#5273)

ref pingcap#5178

fix(cmake): make sure libc++ is utilized by tiflash-proxy (pingcap#5281)

close pingcap#5282

fix the wrong order of execution summary for list based executors (pingcap#5242)

close pingcap#5241

Schema: allow loading empty schema diff when the version grows up. (pingcap#5245)

close pingcap#5244

Optimize apply speed under heavy write pressure (pingcap#4883)

ref pingcap#4728

update proxy to raftstore-proxy-6.2 (pingcap#5287)

ref pingcap#4982

Flush segment cache when doing the compaction (pingcap#5284)

close pingcap#5179

metrics: Fix incorrect metrics for delta_merge tasks (pingcap#5061)

close pingcap#5055

dep: upgrade jemalloc (pingcap#5197)

close pingcap#5258

*: TiFlash pagectl/dttool use only-decryption mode (pingcap#5271)

close pingcap#5122

suppresion false positive report from tsan (pingcap#5303)

close pingcap#5088

Refine test framework code and tests (pingcap#5261)

close pingcap#5262

feat: add logical cpu cores and memory into grafana (pingcap#5124)

close pingcap#3821

Implement TimeToSec function push down (pingcap#5235)

close pingcap#5116

feat: implement shiftRight function push down (pingcap#5156)

close pingcap#5100

schema : make update to partition tables when 'set tiflash replica' (pingcap#5267)

close pingcap#5266

Replace initializer_list with vector for planner test framework (pingcap#5307)

close pingcap#5295

KVStore: decouple flush region and CompactLog with a new FFI fn_try_flush_data (pingcap#5283)

ref pingcap#5170

refine error message in mpptask (pingcap#5304)

ref pingcap#5095

Implement ReverseUTF8/Reverse function push down (pingcap#5233)

close pingcap#5111

Optimize comparision for collation `UTF8_BIN` and `UTF8MB4_BIN` (pingcap#5299)

ref pingcap#5294

feat : support set tiflash mode ddl action (pingcap#5256)

ref pingcap#5252

Add non-blocking functions for MPMCQueue (pingcap#5311)

close pingcap#5310

add random segment test for CI weekly (pingcap#5300)

close pingcap#5301

*: tidy FunctionString.cpp (pingcap#5312)

close pingcap#5313

ci: fix check-license github action (pingcap#5318)

close pingcap#5317

update proxy to raftstore-proxy-6.2 (pingcap#5316)

ref pingcap#4982

Change one `additional_input_at_end` to many streams in `ParallelInputsProcessor`  (pingcap#5274)

close pingcap#4856, close pingcap#5263

support fine grained shuffle for window function (pingcap#5048)

close pingcap#5142

feat: pushdown get_format into TiFlash (pingcap#5269)

close pingcap#5115

fix: format throw data truncated error (pingcap#5272)

close pingcap#4891

Print content of columns for gtest (pingcap#5243)

close pingcap#5203

*: also enable O3 for aarch64 (pingcap#5338)

close pingcap#5342

Add debug image build target for CentOS7 (pingcap#5344)

close pingcap#5343

*: mini refactor (pingcap#5326)

close pingcap#4739

Refactor initialize of background pool (pingcap#5190)

close pingcap#5189

delete copy/move ctor of MPMCQueue explicitly (pingcap#5328)

close pingcap#5329

Introduce proxy_server and new-mock-engine-store (pingcap#5319)

ref pingcap#5170

fix: incorrect uptime in grafana panel

Signed-off-by: Lloyd-Pottiger <[email protected]>
Lloyd-Pottiger pushed a commit to Lloyd-Pottiger/tiflash that referenced this pull request Jul 19, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
release-note-none Denotes a PR that doesn't merit a release note. size/L Denotes a PR that changes 100-499 lines, ignoring generated files. status/can-merge Indicates a PR has been approved by a committer. status/LGT2 Indicates that a PR has LGTM 2.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Go over main mpp task execution path and add random fail point
6 participants