From 350eaf78cb6fada045c5bc26b2b50152e621bd5a Mon Sep 17 00:00:00 2001 From: ti-srebot <66930949+ti-srebot@users.noreply.github.com> Date: Thu, 24 Feb 2022 15:31:17 +0800 Subject: [PATCH 01/58] releases: add TiDB 5.3.1-15-31-14 release notes * releases: add TiDB 5.3.1-15-31-14 release notes * Update releases/release-5.3.1-15-31-14.md --- releases/release-5.3.1-15-31-14.md | 207 +++++++++++++++++++++++++++++ 1 file changed, 207 insertions(+) create mode 100644 releases/release-5.3.1-15-31-14.md diff --git a/releases/release-5.3.1-15-31-14.md b/releases/release-5.3.1-15-31-14.md new file mode 100644 index 0000000000000..65637b2b20f99 --- /dev/null +++ b/releases/release-5.3.1-15-31-14.md @@ -0,0 +1,207 @@ +--- +title: TiDB 5.3.1 Release Notes +category: Releases +--- + + + +# TiDB 5.3.1 Release Notes + +Release Date: February 24, 2022 + +TiDB version: 5.3.1 + +## __unsorted + ++ PingCAP/TiDB + + - fix date formate identifies '\n' as invalid separator [#32503](https://github.com/pingcap/tidb/pull/32503) + - Fix the bug that lightning may not clean up metadata schema when some of the import contains no source files. [#32389](https://github.com/pingcap/tidb/pull/32389) + - fix `alter column set default` wrongly updates the schema [#32264](https://github.com/pingcap/tidb/pull/32264) + - Fix a bug that caused region unbalanced after restoring. [#32128](https://github.com/pingcap/tidb/pull/32128) + - Fixed a bug that turning on tidb_restricted_read_only won't automatically turn on tidb_super_read_only [#31841](https://github.com/pingcap/tidb/pull/31841) + - fix greatest and least function with collation get wrong result [#31837](https://github.com/pingcap/tidb/pull/31837) + - Fix the crash or error when generating an empty mpp task list. [#31695](https://github.com/pingcap/tidb/pull/31695) + - ```release-note [#31667](https://github.com/pingcap/tidb/pull/31667) + - Fix index join bug caused by innerWorker panic [#31614](https://github.com/pingcap/tidb/pull/31614) + - Fix double column value are different with MySQL after changing column type from float to double [#31572](https://github.com/pingcap/tidb/pull/31572) + - planner: make queries with the extra column `_tidb_rowid` can use PointGet [#31552](https://github.com/pingcap/tidb/pull/31552) + - Fix a data race that may cause "invalid transaction" error when executing a query using index lookup join. [#31350](https://github.com/pingcap/tidb/pull/31350) + - Fix a panic that may happen when using `on duplicate key update`. [#31344](https://github.com/pingcap/tidb/pull/31344) + - Fix the bug that lighting return error if gcs url starts with gs:// [#31169](https://github.com/pingcap/tidb/pull/31169) + - ```release-note [#30999](https://github.com/pingcap/tidb/pull/30999) + - Fix a bug that the `mysql_stmt_field_count` returned to mysql client is incorrect in prepare protocal when handling union statement. [#30997](https://github.com/pingcap/tidb/pull/30997) + - make tidb-lightning pre-check output message clearer [#30888](https://github.com/pingcap/tidb/pull/30888) + - Avoid tikv trigger auto region split by lower the ingest kv count threshold [#30876](https://github.com/pingcap/tidb/pull/30876) + - Fix the but that lightning doesn't report error if s3 storage path not exist. [#30714](https://github.com/pingcap/tidb/pull/30714) + - planner: regard NULL as point when accessing composite index [#30614](https://github.com/pingcap/tidb/pull/30614) + - fix a bug when reducing order by clause for the index which leads to the wrong result. [#30552](https://github.com/pingcap/tidb/pull/30552) + - The TiDB server now maps a user to an entry in the mysql.user table more consistently. [#30450](https://github.com/pingcap/tidb/pull/30450) + - Fix `MaxDays` and `MaxBackups` not working for slow log. [#30172](https://github.com/pingcap/tidb/pull/30172) + - lightning: fix log doesn't output to stdout when passing `--log-file="-"` [#29939](https://github.com/pingcap/tidb/pull/29939) + + ++ TiKV/TiKV + + - Reduce CDC recovery time by reduce the number regions that need resolved lock. [#12000](https://github.com/tikv/tikv/pull/12000) + - Increase the size of write batch for raftlog GC to speed up GC. [#11971](https://github.com/tikv/tikv/pull/11971) + - Fixes the bug that unsafe_destroy_range does not get executed when GC worker is busy [#11913](https://github.com/tikv/tikv/pull/11913) + - Fix a potential panic (#11746) when snapshot files have been deleted but the peer's status is still Applying. [#11908](https://github.com/tikv/tikv/pull/11908) + - fix potential high latency caused by destroying a peer [#11880](https://github.com/tikv/tikv/pull/11880) + - Fix possible QPS drop when `level0_slowdown_trigger` is set explicitly with flow control enabled. [#11857](https://github.com/tikv/tikv/pull/11857) + - ```release-note [#11805](https://github.com/tikv/tikv/pull/11805) + - Fix wrong `any_value` result when there are regions returning empty result [#11744](https://github.com/tikv/tikv/pull/11744) + - update procfs to 0.12.0 [#11726](https://github.com/tikv/tikv/pull/11726) + - Fix the problem that destroying an uninitialized replica may cause a stalled replica be created again. [#11637](https://github.com/tikv/tikv/pull/11637) + - Please add a release note. +None [#11632](https://github.com/tikv/tikv/pull/11632) + - Please add a release note. +If you don't think this PR needs a release note then fill it with None. +If this PR will be picked to release branch, then a release note is probably required. [#11616](https://github.com/tikv/tikv/pull/11616) + - Fix panic when cgroup controller is not mounted [#11582](https://github.com/tikv/tikv/pull/11582) + - Fix metadata corruption in an unlikely condition that prepare merge is triggered after new election without informing an isolated peer [#11568](https://github.com/tikv/tikv/pull/11568) + - Fix deadlock in some rare cases that futures get resolved too fast [#11564](https://github.com/tikv/tikv/pull/11564) + - Fix resolved ts lag increased after stoping a tikv [#11537](https://github.com/tikv/tikv/pull/11537) + - Fix connection abort when too many raft entries are batched into one messages [#11535](https://github.com/tikv/tikv/pull/11535) + - Fix panic in rare conditions when merge, conf change and snapshot happen at the same time [#11513](https://github.com/tikv/tikv/pull/11513) + - Fix the issue that reverse scan can't detect memory locks and may read stale data. [#11456](https://github.com/tikv/tikv/pull/11456) + - Do not panic when RocksDB flush or compaction hits disk capacity [#11428](https://github.com/tikv/tikv/pull/11428) + - make tikv-ctl detect raft db correctly [#11413](https://github.com/tikv/tikv/pull/11413) + - Fix incorrect by-instance gRPC average duration. [#11330](https://github.com/tikv/tikv/pull/11330) + + ++ PingCAP/TiFlash + + - fix error result for function `in` [#4076](https://github.com/pingcap/tics/pull/4076) + - Fix cast to decimal overflow bug [#4073](https://github.com/pingcap/tics/pull/4073) + - fix date format identifies '\n' as invalid separator [#4059](https://github.com/pingcap/tics/pull/4059) + - Fix cannot find column error after add column when remote read was triggered in tiflash [#4027](https://github.com/pingcap/tics/pull/4027) + - Fix str_to_date() function incorrectly handles leading zeros when parsing Microseconds [#3936](https://github.com/pingcap/tics/pull/3936) + - Fix the problem of TiFlash crashing when the memory limit is enabled [#3918](https://github.com/pingcap/tics/pull/3918) + - Fix the bug that castStringAsReal has different behaivor between tiflash and tikv/tidb. [#3757](https://github.com/pingcap/tics/pull/3757) + - Avoid false alert of `DB::Exception: Encode type of coprocessor response is not CHBlock` [#3740](https://github.com/pingcap/tics/pull/3740) + - Fix random `EstablishMPPConnection` fail after TiFlash server restart. [#3708](https://github.com/pingcap/tics/pull/3708) + - Fixed the inconsistent behavior of CastStringAsDecimal between tiflash and tidb/tikv. [#3680](https://github.com/pingcap/tics/pull/3680) + - Fix potential data inconsistency after altering a primary key column to a larger int data type [#3570](https://github.com/pingcap/tics/pull/3570) + - Fix the bug that results of `where ` is wrong because it will be converted to int type. [#3480](https://github.com/pingcap/tics/pull/3480) + - Fix tiflash randomly crash when a mpp query is killed. [#3451](https://github.com/pingcap/tics/pull/3451) + + ++ PD + + - None. [#4663](https://github.com/tikv/pd/pull/4663) + - - fix a bug that operate steps may contain unnecessary or empty JointConsensus steps in certain conditions +- fix a bug when demoting single voter directly [#4552](https://github.com/tikv/pd/pull/4552) + - fix the problem that the hot cache cannot be emptied when the interval is less than 60 [#4435](https://github.com/tikv/pd/pull/4435) + - Improve DR_STATE file content format [#4386](https://github.com/tikv/pd/pull/4386) + - Fix data race when updating replication mode configuration [#4370](https://github.com/tikv/pd/pull/4370) + - Fix the issue that the RLock is not released [#4358](https://github.com/tikv/pd/pull/4358) + + ++ Tools + + + PingCAP/TiCDC + + - `None`. [#4659](https://github.com/pingcap/tiflow/pull/4659) + - Support more data types with default value attribute, and fix potential data inconsistency caused by default value logic [#4652](https://github.com/pingcap/tiflow/pull/4652) + - Fix a bug that long varchar will report error of "Column length too big..." [#4645](https://github.com/pingcap/tiflow/pull/4645) + - `None`. [#4641](https://github.com/pingcap/tiflow/pull/4641) + - `None`. [#4614](https://github.com/pingcap/tiflow/pull/4614) + - `None`. [#4594](https://github.com/pingcap/tiflow/pull/4594) + - `None`. [#4574](https://github.com/pingcap/tiflow/pull/4574) + - Fix a bug that owner exits abnormally when PD leader is killed [#4532](https://github.com/pingcap/tiflow/pull/4532) + - allow user set the configuration of Kafka producer dial/write/read timeout [#4526](https://github.com/pingcap/tiflow/pull/4526) + - Fix a bug that MySQL sink will generate duplicated replace SQL if `batch-replace-enable` is disabled. [#4508](https://github.com/pingcap/tiflow/pull/4508) + - `None`. [#4465](https://github.com/pingcap/tiflow/pull/4465) + - `None`. [#4462](https://github.com/pingcap/tiflow/pull/4462) + - Fix the issue that update statement execute error in safemode may cause DM-worker panic. [#4439](https://github.com/pingcap/tiflow/pull/4439) + - None. [#4430](https://github.com/pingcap/tiflow/pull/4430) + - `None`. [#4398](https://github.com/pingcap/tiflow/pull/4398) + - `None`. [#4345](https://github.com/pingcap/tiflow/pull/4345) + - Add exponential backoff mechanism for restarting a changefeed. [#4339](https://github.com/pingcap/tiflow/pull/4339) + - Fix a bug that upstream metrics won't update if no query-status [#4332](https://github.com/pingcap/tiflow/pull/4332) + - `None`. [#4323](https://github.com/pingcap/tiflow/pull/4323) + - Fix kv client cached region metric could be negative. [#4290](https://github.com/pingcap/tiflow/pull/4290) + - `None` [#4285](https://github.com/pingcap/tiflow/pull/4285) + - `None`. [#4278](https://github.com/pingcap/tiflow/pull/4278) + - Fix the problem that TiCDC cannot send messages when `min.insync.replicas` is less than `replication-factor` [#4271](https://github.com/pingcap/tiflow/pull/4271) + - `None`. [#4254](https://github.com/pingcap/tiflow/pull/4254) + - `None`. [#4227](https://github.com/pingcap/tiflow/pull/4227) + - Support updating table schema when using dmctl binlog to skip some ddls [#4225](https://github.com/pingcap/tiflow/pull/4225) + - `None`. [#4209](https://github.com/pingcap/tiflow/pull/4209) + - Fix the potential panic issue that occurs when changefeed info is removed from etcd. [#4183](https://github.com/pingcap/tiflow/pull/4183) + - `None`. [#4163](https://github.com/pingcap/tiflow/pull/4163) + - `None`. [#4162](https://github.com/pingcap/tiflow/pull/4162) + - Fix a bug that stop-task during load phase will cause the source always tries to transfer to a worker [#4145](https://github.com/pingcap/tiflow/pull/4145) + - `fix a bug that wrong progress in query-status for loader`. [#4143](https://github.com/pingcap/tiflow/pull/4143) + - Fix the bug that http API panic when the processor info we want to get is not exist. [#4123](https://github.com/pingcap/tiflow/pull/4123) + - Reduce "EventFeed retry rate limited" logs [#4111](https://github.com/pingcap/tiflow/pull/4111) + - Fix a bug that can cause changefeed stuck due to a deadlock occurs. [#4099](https://github.com/pingcap/tiflow/pull/4099) + - Manage sink checkpoint per table to avoid checkpointTs advances unexpected. [#4083](https://github.com/pingcap/tiflow/pull/4083) + - `None`. [#4079](https://github.com/pingcap/tiflow/pull/4079) + - Set `max-message-bytes` default to 10M, and use the min value with topic and broker to initialize the producer. [#4063](https://github.com/pingcap/tiflow/pull/4063) + - Fix nil pointer panic encountered when scheduler cleanup finished operations [#4016](https://github.com/pingcap/tiflow/pull/4016) + - Fix a bug that when master and worker restart in a particular order, relay status in DM-master is wrong [#4009](https://github.com/pingcap/tiflow/pull/4009) + - Fix a bug that DM-worker can't boot up after restart [#4005](https://github.com/pingcap/tiflow/pull/4005) + - Fix a bug that DM task will failed when PARTITION DDL cost a long time [#3995](https://github.com/pingcap/tiflow/pull/3995) + - Fix syntax error if DDL has a special comment. [#3978](https://github.com/pingcap/tiflow/pull/3978) + - ```release-note [#3976](https://github.com/pingcap/tiflow/pull/3976) + - Fix the owner may be blocked when initializing the changefeed caused by a bad network connection to the sink [#3964](https://github.com/pingcap/tiflow/pull/3964) + - `None` [#3953](https://github.com/pingcap/tiflow/pull/3953) + - fix a bug that DM may report "invalid sequence" when upstream is MySQL 8.0 +fix a bug that upstream will die on SHOW SLAVE HOSTS [#3934](https://github.com/pingcap/tiflow/pull/3934) + - Fix a bug that redo logs are not cleaned up when removing a paused changefeed. [#3919](https://github.com/pingcap/tiflow/pull/3919) + - Fix timezone related error that cause cdc server can't run in some RHEL release version (6.8, 6.9 etc). [#3906](https://github.com/pingcap/tiflow/pull/3906) + - Fix cli don't work when cli cert's common name was not added in config that use for start cdc server. [#3882](https://github.com/pingcap/tiflow/pull/3882) + - add pre clean up process when s3 enable, fix #3523 [#3878](https://github.com/pingcap/tiflow/pull/3878) + - add redo log related metric [#3877](https://github.com/pingcap/tiflow/pull/3877) + - Fix the issue of changefeed resuming automatically after upgrading cluster [#3865](https://github.com/pingcap/tiflow/pull/3865) + - Fix a bug of data loss when DM does finer grained retry [#3860](https://github.com/pingcap/tiflow/pull/3860) + - Fix mounter default date value not support [#3859](https://github.com/pingcap/tiflow/pull/3859) + - Add an alert rule when ticdc has no owner for more than 10 minutes. [#3832](https://github.com/pingcap/tiflow/pull/3832) + - Reduce log "synchronize is taking too long, report a bug" in some cases. [#3795](https://github.com/pingcap/tiflow/pull/3795) + - Fix the problem that old value is not forced on automatically in `canal-json` and `maxwell` protocols [#3783](https://github.com/pingcap/tiflow/pull/3783) + - `None`. [#3765](https://github.com/pingcap/tiflow/pull/3765) + - `None`. [#3712](https://github.com/pingcap/tiflow/pull/3712) + - Please add a release note. +fix kvclient takes too long time to recover [#3663](https://github.com/pingcap/tiflow/pull/3663) + - The Avro sink was updated to handle JSON columns [#3649](https://github.com/pingcap/tiflow/pull/3649) + - Fix cli don't work when cli cert's common name was not added in config that use for start cdc server. [#3628](https://github.com/pingcap/tiflow/pull/3628) + - fix changefeed checkpoint lag negative value error [#3536](https://github.com/pingcap/tiflow/pull/3536) + - Fix HTTP API not working when there are TiCDC nodes of different versions in one cdc cluster. [#3530](https://github.com/pingcap/tiflow/pull/3530) + - Fix a bug when too often query status is called in Load unit, DM-worker may encounter data race or panic [#3468](https://github.com/pingcap/tiflow/pull/3468) + - Fix OOM in container environments. [#3439](https://github.com/pingcap/tiflow/pull/3439) + - Please add a release note. +If you don't think this PR needs a release note then fill it with `None`. [#3389](https://github.com/pingcap/tiflow/pull/3389) + - Please add a release note. +If you don't think this PR needs a release note then fill it with `None`. [#3256](https://github.com/pingcap/tiflow/pull/3256) + + +## Bug Fixes + ++ PingCAP/TiDB + + - planner: fix wrong range calculation for Nulleq function on Enum values [#32495](https://github.com/pingcap/tidb/pull/32495) + - Fix the bug that indexHashJoin may return the error `send on closed channel`. [#31448](https://github.com/pingcap/tidb/pull/31448) + - Fix the bug that lightning will skip some precheck items when restart [#31183](https://github.com/pingcap/tidb/pull/31183) + - Fix the error that if tidb-lightning doesn't has permission to access mysql.tidb, it will generate kv with wrong format. [#31152](https://github.com/pingcap/tidb/pull/31152) + - Fix concurrent column type changes(with changing data) that cause schema and data inconsistencies. [#31071](https://github.com/pingcap/tidb/pull/31071) + - Add a new config to control whether support incremental import. [#30926](https://github.com/pingcap/tidb/pull/30926) + - executor: fix pipelined window invalid memory address [#30460](https://github.com/pingcap/tidb/pull/30460) + - Fix the problem that window function may return different results when using transaction or not. [#30392](https://github.com/pingcap/tidb/pull/30392) + - Fix wrong flen for CastAsString funtion [#30058](https://github.com/pingcap/tidb/pull/30058) + - expression: Fix the issue that length information is wrong when converting Decimal to String [#30016](https://github.com/pingcap/tidb/pull/30016) + + ++ PingCAP/TiFlash + + - Align unix_timestamp behavior with TiDB and mysql when input is earlier than 1970-01-01 00:00:01 UTC [#3625](https://github.com/pingcap/tics/pull/3625) + + ++ PD + + - Fix the bug that the region scatterer may generate the schedule with too few peers. [#4577](https://github.com/tikv/pd/pull/4577) + - Fix incomplete replicate file [#4394](https://github.com/tikv/pd/pull/4394) + - Fix panic issue after TiKV node scales in [#4382](https://github.com/tikv/pd/pull/4382) + + From 25accb4c0b1777379cf62b4be294b073d526322e Mon Sep 17 00:00:00 2001 From: xixirangrang <35301108+hfxsd@users.noreply.github.com> Date: Thu, 24 Feb 2022 15:55:51 +0800 Subject: [PATCH 02/58] Update release-5.3.1-15-31-14.md --- releases/release-5.3.1-15-31-14.md | 72 ++++++++++++++++++------------ 1 file changed, 44 insertions(+), 28 deletions(-) diff --git a/releases/release-5.3.1-15-31-14.md b/releases/release-5.3.1-15-31-14.md index 65637b2b20f99..91783bc849fca 100644 --- a/releases/release-5.3.1-15-31-14.md +++ b/releases/release-5.3.1-15-31-14.md @@ -3,61 +3,82 @@ title: TiDB 5.3.1 Release Notes category: Releases --- - - # TiDB 5.3.1 Release Notes -Release Date: February 24, 2022 +Release Date: xx, 2022 TiDB version: 5.3.1 +## Compatibility changes + +TiDB + +TiKV + +PD + +TiDB Dashboard + +TiFlash + +Tools + + - Backup & Restore (BR) + + - TiCDC + + - Dumpling + + - TiDB Binlog + + - TiDB Lightning + +## Feature enhancements + + ## __unsorted -+ PingCAP/TiDB ++ TiDB - - fix date formate identifies '\n' as invalid separator [#32503](https://github.com/pingcap/tidb/pull/32503) + - Fix date formate identifies '\n' as invalid separator [#32503](https://github.com/pingcap/tidb/pull/32503) - Fix the bug that lightning may not clean up metadata schema when some of the import contains no source files. [#32389](https://github.com/pingcap/tidb/pull/32389) - - fix `alter column set default` wrongly updates the schema [#32264](https://github.com/pingcap/tidb/pull/32264) + - Fix `alter column set default` wrongly updates the schema [#32264](https://github.com/pingcap/tidb/pull/32264) - Fix a bug that caused region unbalanced after restoring. [#32128](https://github.com/pingcap/tidb/pull/32128) - - Fixed a bug that turning on tidb_restricted_read_only won't automatically turn on tidb_super_read_only [#31841](https://github.com/pingcap/tidb/pull/31841) - - fix greatest and least function with collation get wrong result [#31837](https://github.com/pingcap/tidb/pull/31837) + - Fix a bug that turning on tidb_restricted_read_only won't automatically turn on tidb_super_read_only [#31841](https://github.com/pingcap/tidb/pull/31841) + - Fix greatest and least function with collation get wrong result [#31837](https://github.com/pingcap/tidb/pull/31837) - Fix the crash or error when generating an empty mpp task list. [#31695](https://github.com/pingcap/tidb/pull/31695) - ```release-note [#31667](https://github.com/pingcap/tidb/pull/31667) - Fix index join bug caused by innerWorker panic [#31614](https://github.com/pingcap/tidb/pull/31614) - Fix double column value are different with MySQL after changing column type from float to double [#31572](https://github.com/pingcap/tidb/pull/31572) - - planner: make queries with the extra column `_tidb_rowid` can use PointGet [#31552](https://github.com/pingcap/tidb/pull/31552) + - Planner: make queries with the extra column `_tidb_rowid` can use PointGet [#31552](https://github.com/pingcap/tidb/pull/31552) - Fix a data race that may cause "invalid transaction" error when executing a query using index lookup join. [#31350](https://github.com/pingcap/tidb/pull/31350) - Fix a panic that may happen when using `on duplicate key update`. [#31344](https://github.com/pingcap/tidb/pull/31344) - Fix the bug that lighting return error if gcs url starts with gs:// [#31169](https://github.com/pingcap/tidb/pull/31169) - - ```release-note [#30999](https://github.com/pingcap/tidb/pull/30999) + - [#30999](https://github.com/pingcap/tidb/pull/30999) - Fix a bug that the `mysql_stmt_field_count` returned to mysql client is incorrect in prepare protocal when handling union statement. [#30997](https://github.com/pingcap/tidb/pull/30997) - - make tidb-lightning pre-check output message clearer [#30888](https://github.com/pingcap/tidb/pull/30888) + - Make tidb-lightning pre-check output message clearer [#30888](https://github.com/pingcap/tidb/pull/30888) - Avoid tikv trigger auto region split by lower the ingest kv count threshold [#30876](https://github.com/pingcap/tidb/pull/30876) - Fix the but that lightning doesn't report error if s3 storage path not exist. [#30714](https://github.com/pingcap/tidb/pull/30714) - planner: regard NULL as point when accessing composite index [#30614](https://github.com/pingcap/tidb/pull/30614) - - fix a bug when reducing order by clause for the index which leads to the wrong result. [#30552](https://github.com/pingcap/tidb/pull/30552) + - Fix a bug when reducing order by clause for the index which leads to the wrong result. [#30552](https://github.com/pingcap/tidb/pull/30552) - The TiDB server now maps a user to an entry in the mysql.user table more consistently. [#30450](https://github.com/pingcap/tidb/pull/30450) - Fix `MaxDays` and `MaxBackups` not working for slow log. [#30172](https://github.com/pingcap/tidb/pull/30172) - - lightning: fix log doesn't output to stdout when passing `--log-file="-"` [#29939](https://github.com/pingcap/tidb/pull/29939) - + - Lightning: fix log doesn't output to stdout when passing `--log-file="-"` [#29939](https://github.com/pingcap/tidb/pull/29939) -+ TiKV/TiKV ++ TiKV - Reduce CDC recovery time by reduce the number regions that need resolved lock. [#12000](https://github.com/tikv/tikv/pull/12000) - Increase the size of write batch for raftlog GC to speed up GC. [#11971](https://github.com/tikv/tikv/pull/11971) - - Fixes the bug that unsafe_destroy_range does not get executed when GC worker is busy [#11913](https://github.com/tikv/tikv/pull/11913) + - Fix the bug that unsafe_destroy_range does not get executed when GC worker is busy [#11913](https://github.com/tikv/tikv/pull/11913) - Fix a potential panic (#11746) when snapshot files have been deleted but the peer's status is still Applying. [#11908](https://github.com/tikv/tikv/pull/11908) - - fix potential high latency caused by destroying a peer [#11880](https://github.com/tikv/tikv/pull/11880) + - Fix potential high latency caused by destroying a peer [#11880](https://github.com/tikv/tikv/pull/11880) - Fix possible QPS drop when `level0_slowdown_trigger` is set explicitly with flow control enabled. [#11857](https://github.com/tikv/tikv/pull/11857) - ```release-note [#11805](https://github.com/tikv/tikv/pull/11805) - Fix wrong `any_value` result when there are regions returning empty result [#11744](https://github.com/tikv/tikv/pull/11744) - - update procfs to 0.12.0 [#11726](https://github.com/tikv/tikv/pull/11726) + - Update procfs to 0.12.0 [#11726](https://github.com/tikv/tikv/pull/11726) - Fix the problem that destroying an uninitialized replica may cause a stalled replica be created again. [#11637](https://github.com/tikv/tikv/pull/11637) - - Please add a release note. -None [#11632](https://github.com/tikv/tikv/pull/11632) - - Please add a release note. -If you don't think this PR needs a release note then fill it with None. -If this PR will be picked to release branch, then a release note is probably required. [#11616](https://github.com/tikv/tikv/pull/11616) + - Please add a release note.None [#11632](https://github.com/tikv/tikv/pull/11632) + - Please add a release note. [#11616](https://github.com/tikv/tikv/pull/11616) - Fix panic when cgroup controller is not mounted [#11582](https://github.com/tikv/tikv/pull/11582) - Fix metadata corruption in an unlikely condition that prepare merge is triggered after new election without informing an isolated peer [#11568](https://github.com/tikv/tikv/pull/11568) - Fix deadlock in some rare cases that futures get resolved too fast [#11564](https://github.com/tikv/tikv/pull/11564) @@ -176,7 +197,6 @@ If you don't think this PR needs a release note then fill it with `None`. [#3389 - Please add a release note. If you don't think this PR needs a release note then fill it with `None`. [#3256](https://github.com/pingcap/tiflow/pull/3256) - ## Bug Fixes + PingCAP/TiDB @@ -192,16 +212,12 @@ If you don't think this PR needs a release note then fill it with `None`. [#3256 - Fix wrong flen for CastAsString funtion [#30058](https://github.com/pingcap/tidb/pull/30058) - expression: Fix the issue that length information is wrong when converting Decimal to String [#30016](https://github.com/pingcap/tidb/pull/30016) - + PingCAP/TiFlash - Align unix_timestamp behavior with TiDB and mysql when input is earlier than 1970-01-01 00:00:01 UTC [#3625](https://github.com/pingcap/tics/pull/3625) - + PD - Fix the bug that the region scatterer may generate the schedule with too few peers. [#4577](https://github.com/tikv/pd/pull/4577) - Fix incomplete replicate file [#4394](https://github.com/tikv/pd/pull/4394) - Fix panic issue after TiKV node scales in [#4382](https://github.com/tikv/pd/pull/4382) - - From 8fe29f1edc61253d9bf9ce694988b84100c49ac0 Mon Sep 17 00:00:00 2001 From: xixirangrang <35301108+hfxsd@users.noreply.github.com> Date: Thu, 24 Feb 2022 15:58:52 +0800 Subject: [PATCH 03/58] 5.3.1 --- TOC.md | 1 + ...ase-5.3.1-15-31-14.md => release-5.3.1.md} | 446 +++++++++--------- releases/release-notes.md | 1 + releases/release-timeline.md | 1 + 4 files changed, 226 insertions(+), 223 deletions(-) rename releases/{release-5.3.1-15-31-14.md => release-5.3.1.md} (98%) diff --git a/TOC.md b/TOC.md index 809d639762f97..77503b08e6eb3 100644 --- a/TOC.md +++ b/TOC.md @@ -673,6 +673,7 @@ - [All Releases](/releases/release-notes.md) - [Release Timeline](/releases/release-timeline.md) - v5.3 + - [5.3.1](/releases/release-5.3.1.md) - [5.3.0](/releases/release-5.3.0.md) - v5.2 - [5.2.3](/releases/release-5.2.3.md) diff --git a/releases/release-5.3.1-15-31-14.md b/releases/release-5.3.1.md similarity index 98% rename from releases/release-5.3.1-15-31-14.md rename to releases/release-5.3.1.md index 91783bc849fca..6fc107653e7c5 100644 --- a/releases/release-5.3.1-15-31-14.md +++ b/releases/release-5.3.1.md @@ -1,223 +1,223 @@ ---- -title: TiDB 5.3.1 Release Notes -category: Releases ---- - -# TiDB 5.3.1 Release Notes - -Release Date: xx, 2022 - -TiDB version: 5.3.1 - -## Compatibility changes - -TiDB - -TiKV - -PD - -TiDB Dashboard - -TiFlash - -Tools - - - Backup & Restore (BR) - - - TiCDC - - - Dumpling - - - TiDB Binlog - - - TiDB Lightning - -## Feature enhancements - - -## __unsorted - -+ TiDB - - - Fix date formate identifies '\n' as invalid separator [#32503](https://github.com/pingcap/tidb/pull/32503) - - Fix the bug that lightning may not clean up metadata schema when some of the import contains no source files. [#32389](https://github.com/pingcap/tidb/pull/32389) - - Fix `alter column set default` wrongly updates the schema [#32264](https://github.com/pingcap/tidb/pull/32264) - - Fix a bug that caused region unbalanced after restoring. [#32128](https://github.com/pingcap/tidb/pull/32128) - - Fix a bug that turning on tidb_restricted_read_only won't automatically turn on tidb_super_read_only [#31841](https://github.com/pingcap/tidb/pull/31841) - - Fix greatest and least function with collation get wrong result [#31837](https://github.com/pingcap/tidb/pull/31837) - - Fix the crash or error when generating an empty mpp task list. [#31695](https://github.com/pingcap/tidb/pull/31695) - - ```release-note [#31667](https://github.com/pingcap/tidb/pull/31667) - - Fix index join bug caused by innerWorker panic [#31614](https://github.com/pingcap/tidb/pull/31614) - - Fix double column value are different with MySQL after changing column type from float to double [#31572](https://github.com/pingcap/tidb/pull/31572) - - Planner: make queries with the extra column `_tidb_rowid` can use PointGet [#31552](https://github.com/pingcap/tidb/pull/31552) - - Fix a data race that may cause "invalid transaction" error when executing a query using index lookup join. [#31350](https://github.com/pingcap/tidb/pull/31350) - - Fix a panic that may happen when using `on duplicate key update`. [#31344](https://github.com/pingcap/tidb/pull/31344) - - Fix the bug that lighting return error if gcs url starts with gs:// [#31169](https://github.com/pingcap/tidb/pull/31169) - - [#30999](https://github.com/pingcap/tidb/pull/30999) - - Fix a bug that the `mysql_stmt_field_count` returned to mysql client is incorrect in prepare protocal when handling union statement. [#30997](https://github.com/pingcap/tidb/pull/30997) - - Make tidb-lightning pre-check output message clearer [#30888](https://github.com/pingcap/tidb/pull/30888) - - Avoid tikv trigger auto region split by lower the ingest kv count threshold [#30876](https://github.com/pingcap/tidb/pull/30876) - - Fix the but that lightning doesn't report error if s3 storage path not exist. [#30714](https://github.com/pingcap/tidb/pull/30714) - - planner: regard NULL as point when accessing composite index [#30614](https://github.com/pingcap/tidb/pull/30614) - - Fix a bug when reducing order by clause for the index which leads to the wrong result. [#30552](https://github.com/pingcap/tidb/pull/30552) - - The TiDB server now maps a user to an entry in the mysql.user table more consistently. [#30450](https://github.com/pingcap/tidb/pull/30450) - - Fix `MaxDays` and `MaxBackups` not working for slow log. [#30172](https://github.com/pingcap/tidb/pull/30172) - - Lightning: fix log doesn't output to stdout when passing `--log-file="-"` [#29939](https://github.com/pingcap/tidb/pull/29939) - -+ TiKV - - - Reduce CDC recovery time by reduce the number regions that need resolved lock. [#12000](https://github.com/tikv/tikv/pull/12000) - - Increase the size of write batch for raftlog GC to speed up GC. [#11971](https://github.com/tikv/tikv/pull/11971) - - Fix the bug that unsafe_destroy_range does not get executed when GC worker is busy [#11913](https://github.com/tikv/tikv/pull/11913) - - Fix a potential panic (#11746) when snapshot files have been deleted but the peer's status is still Applying. [#11908](https://github.com/tikv/tikv/pull/11908) - - Fix potential high latency caused by destroying a peer [#11880](https://github.com/tikv/tikv/pull/11880) - - Fix possible QPS drop when `level0_slowdown_trigger` is set explicitly with flow control enabled. [#11857](https://github.com/tikv/tikv/pull/11857) - - ```release-note [#11805](https://github.com/tikv/tikv/pull/11805) - - Fix wrong `any_value` result when there are regions returning empty result [#11744](https://github.com/tikv/tikv/pull/11744) - - Update procfs to 0.12.0 [#11726](https://github.com/tikv/tikv/pull/11726) - - Fix the problem that destroying an uninitialized replica may cause a stalled replica be created again. [#11637](https://github.com/tikv/tikv/pull/11637) - - Please add a release note.None [#11632](https://github.com/tikv/tikv/pull/11632) - - Please add a release note. [#11616](https://github.com/tikv/tikv/pull/11616) - - Fix panic when cgroup controller is not mounted [#11582](https://github.com/tikv/tikv/pull/11582) - - Fix metadata corruption in an unlikely condition that prepare merge is triggered after new election without informing an isolated peer [#11568](https://github.com/tikv/tikv/pull/11568) - - Fix deadlock in some rare cases that futures get resolved too fast [#11564](https://github.com/tikv/tikv/pull/11564) - - Fix resolved ts lag increased after stoping a tikv [#11537](https://github.com/tikv/tikv/pull/11537) - - Fix connection abort when too many raft entries are batched into one messages [#11535](https://github.com/tikv/tikv/pull/11535) - - Fix panic in rare conditions when merge, conf change and snapshot happen at the same time [#11513](https://github.com/tikv/tikv/pull/11513) - - Fix the issue that reverse scan can't detect memory locks and may read stale data. [#11456](https://github.com/tikv/tikv/pull/11456) - - Do not panic when RocksDB flush or compaction hits disk capacity [#11428](https://github.com/tikv/tikv/pull/11428) - - make tikv-ctl detect raft db correctly [#11413](https://github.com/tikv/tikv/pull/11413) - - Fix incorrect by-instance gRPC average duration. [#11330](https://github.com/tikv/tikv/pull/11330) - - -+ PingCAP/TiFlash - - - fix error result for function `in` [#4076](https://github.com/pingcap/tics/pull/4076) - - Fix cast to decimal overflow bug [#4073](https://github.com/pingcap/tics/pull/4073) - - fix date format identifies '\n' as invalid separator [#4059](https://github.com/pingcap/tics/pull/4059) - - Fix cannot find column error after add column when remote read was triggered in tiflash [#4027](https://github.com/pingcap/tics/pull/4027) - - Fix str_to_date() function incorrectly handles leading zeros when parsing Microseconds [#3936](https://github.com/pingcap/tics/pull/3936) - - Fix the problem of TiFlash crashing when the memory limit is enabled [#3918](https://github.com/pingcap/tics/pull/3918) - - Fix the bug that castStringAsReal has different behaivor between tiflash and tikv/tidb. [#3757](https://github.com/pingcap/tics/pull/3757) - - Avoid false alert of `DB::Exception: Encode type of coprocessor response is not CHBlock` [#3740](https://github.com/pingcap/tics/pull/3740) - - Fix random `EstablishMPPConnection` fail after TiFlash server restart. [#3708](https://github.com/pingcap/tics/pull/3708) - - Fixed the inconsistent behavior of CastStringAsDecimal between tiflash and tidb/tikv. [#3680](https://github.com/pingcap/tics/pull/3680) - - Fix potential data inconsistency after altering a primary key column to a larger int data type [#3570](https://github.com/pingcap/tics/pull/3570) - - Fix the bug that results of `where ` is wrong because it will be converted to int type. [#3480](https://github.com/pingcap/tics/pull/3480) - - Fix tiflash randomly crash when a mpp query is killed. [#3451](https://github.com/pingcap/tics/pull/3451) - - -+ PD - - - None. [#4663](https://github.com/tikv/pd/pull/4663) - - - fix a bug that operate steps may contain unnecessary or empty JointConsensus steps in certain conditions -- fix a bug when demoting single voter directly [#4552](https://github.com/tikv/pd/pull/4552) - - fix the problem that the hot cache cannot be emptied when the interval is less than 60 [#4435](https://github.com/tikv/pd/pull/4435) - - Improve DR_STATE file content format [#4386](https://github.com/tikv/pd/pull/4386) - - Fix data race when updating replication mode configuration [#4370](https://github.com/tikv/pd/pull/4370) - - Fix the issue that the RLock is not released [#4358](https://github.com/tikv/pd/pull/4358) - - -+ Tools - - + PingCAP/TiCDC - - - `None`. [#4659](https://github.com/pingcap/tiflow/pull/4659) - - Support more data types with default value attribute, and fix potential data inconsistency caused by default value logic [#4652](https://github.com/pingcap/tiflow/pull/4652) - - Fix a bug that long varchar will report error of "Column length too big..." [#4645](https://github.com/pingcap/tiflow/pull/4645) - - `None`. [#4641](https://github.com/pingcap/tiflow/pull/4641) - - `None`. [#4614](https://github.com/pingcap/tiflow/pull/4614) - - `None`. [#4594](https://github.com/pingcap/tiflow/pull/4594) - - `None`. [#4574](https://github.com/pingcap/tiflow/pull/4574) - - Fix a bug that owner exits abnormally when PD leader is killed [#4532](https://github.com/pingcap/tiflow/pull/4532) - - allow user set the configuration of Kafka producer dial/write/read timeout [#4526](https://github.com/pingcap/tiflow/pull/4526) - - Fix a bug that MySQL sink will generate duplicated replace SQL if `batch-replace-enable` is disabled. [#4508](https://github.com/pingcap/tiflow/pull/4508) - - `None`. [#4465](https://github.com/pingcap/tiflow/pull/4465) - - `None`. [#4462](https://github.com/pingcap/tiflow/pull/4462) - - Fix the issue that update statement execute error in safemode may cause DM-worker panic. [#4439](https://github.com/pingcap/tiflow/pull/4439) - - None. [#4430](https://github.com/pingcap/tiflow/pull/4430) - - `None`. [#4398](https://github.com/pingcap/tiflow/pull/4398) - - `None`. [#4345](https://github.com/pingcap/tiflow/pull/4345) - - Add exponential backoff mechanism for restarting a changefeed. [#4339](https://github.com/pingcap/tiflow/pull/4339) - - Fix a bug that upstream metrics won't update if no query-status [#4332](https://github.com/pingcap/tiflow/pull/4332) - - `None`. [#4323](https://github.com/pingcap/tiflow/pull/4323) - - Fix kv client cached region metric could be negative. [#4290](https://github.com/pingcap/tiflow/pull/4290) - - `None` [#4285](https://github.com/pingcap/tiflow/pull/4285) - - `None`. [#4278](https://github.com/pingcap/tiflow/pull/4278) - - Fix the problem that TiCDC cannot send messages when `min.insync.replicas` is less than `replication-factor` [#4271](https://github.com/pingcap/tiflow/pull/4271) - - `None`. [#4254](https://github.com/pingcap/tiflow/pull/4254) - - `None`. [#4227](https://github.com/pingcap/tiflow/pull/4227) - - Support updating table schema when using dmctl binlog to skip some ddls [#4225](https://github.com/pingcap/tiflow/pull/4225) - - `None`. [#4209](https://github.com/pingcap/tiflow/pull/4209) - - Fix the potential panic issue that occurs when changefeed info is removed from etcd. [#4183](https://github.com/pingcap/tiflow/pull/4183) - - `None`. [#4163](https://github.com/pingcap/tiflow/pull/4163) - - `None`. [#4162](https://github.com/pingcap/tiflow/pull/4162) - - Fix a bug that stop-task during load phase will cause the source always tries to transfer to a worker [#4145](https://github.com/pingcap/tiflow/pull/4145) - - `fix a bug that wrong progress in query-status for loader`. [#4143](https://github.com/pingcap/tiflow/pull/4143) - - Fix the bug that http API panic when the processor info we want to get is not exist. [#4123](https://github.com/pingcap/tiflow/pull/4123) - - Reduce "EventFeed retry rate limited" logs [#4111](https://github.com/pingcap/tiflow/pull/4111) - - Fix a bug that can cause changefeed stuck due to a deadlock occurs. [#4099](https://github.com/pingcap/tiflow/pull/4099) - - Manage sink checkpoint per table to avoid checkpointTs advances unexpected. [#4083](https://github.com/pingcap/tiflow/pull/4083) - - `None`. [#4079](https://github.com/pingcap/tiflow/pull/4079) - - Set `max-message-bytes` default to 10M, and use the min value with topic and broker to initialize the producer. [#4063](https://github.com/pingcap/tiflow/pull/4063) - - Fix nil pointer panic encountered when scheduler cleanup finished operations [#4016](https://github.com/pingcap/tiflow/pull/4016) - - Fix a bug that when master and worker restart in a particular order, relay status in DM-master is wrong [#4009](https://github.com/pingcap/tiflow/pull/4009) - - Fix a bug that DM-worker can't boot up after restart [#4005](https://github.com/pingcap/tiflow/pull/4005) - - Fix a bug that DM task will failed when PARTITION DDL cost a long time [#3995](https://github.com/pingcap/tiflow/pull/3995) - - Fix syntax error if DDL has a special comment. [#3978](https://github.com/pingcap/tiflow/pull/3978) - - ```release-note [#3976](https://github.com/pingcap/tiflow/pull/3976) - - Fix the owner may be blocked when initializing the changefeed caused by a bad network connection to the sink [#3964](https://github.com/pingcap/tiflow/pull/3964) - - `None` [#3953](https://github.com/pingcap/tiflow/pull/3953) - - fix a bug that DM may report "invalid sequence" when upstream is MySQL 8.0 -fix a bug that upstream will die on SHOW SLAVE HOSTS [#3934](https://github.com/pingcap/tiflow/pull/3934) - - Fix a bug that redo logs are not cleaned up when removing a paused changefeed. [#3919](https://github.com/pingcap/tiflow/pull/3919) - - Fix timezone related error that cause cdc server can't run in some RHEL release version (6.8, 6.9 etc). [#3906](https://github.com/pingcap/tiflow/pull/3906) - - Fix cli don't work when cli cert's common name was not added in config that use for start cdc server. [#3882](https://github.com/pingcap/tiflow/pull/3882) - - add pre clean up process when s3 enable, fix #3523 [#3878](https://github.com/pingcap/tiflow/pull/3878) - - add redo log related metric [#3877](https://github.com/pingcap/tiflow/pull/3877) - - Fix the issue of changefeed resuming automatically after upgrading cluster [#3865](https://github.com/pingcap/tiflow/pull/3865) - - Fix a bug of data loss when DM does finer grained retry [#3860](https://github.com/pingcap/tiflow/pull/3860) - - Fix mounter default date value not support [#3859](https://github.com/pingcap/tiflow/pull/3859) - - Add an alert rule when ticdc has no owner for more than 10 minutes. [#3832](https://github.com/pingcap/tiflow/pull/3832) - - Reduce log "synchronize is taking too long, report a bug" in some cases. [#3795](https://github.com/pingcap/tiflow/pull/3795) - - Fix the problem that old value is not forced on automatically in `canal-json` and `maxwell` protocols [#3783](https://github.com/pingcap/tiflow/pull/3783) - - `None`. [#3765](https://github.com/pingcap/tiflow/pull/3765) - - `None`. [#3712](https://github.com/pingcap/tiflow/pull/3712) - - Please add a release note. -fix kvclient takes too long time to recover [#3663](https://github.com/pingcap/tiflow/pull/3663) - - The Avro sink was updated to handle JSON columns [#3649](https://github.com/pingcap/tiflow/pull/3649) - - Fix cli don't work when cli cert's common name was not added in config that use for start cdc server. [#3628](https://github.com/pingcap/tiflow/pull/3628) - - fix changefeed checkpoint lag negative value error [#3536](https://github.com/pingcap/tiflow/pull/3536) - - Fix HTTP API not working when there are TiCDC nodes of different versions in one cdc cluster. [#3530](https://github.com/pingcap/tiflow/pull/3530) - - Fix a bug when too often query status is called in Load unit, DM-worker may encounter data race or panic [#3468](https://github.com/pingcap/tiflow/pull/3468) - - Fix OOM in container environments. [#3439](https://github.com/pingcap/tiflow/pull/3439) - - Please add a release note. -If you don't think this PR needs a release note then fill it with `None`. [#3389](https://github.com/pingcap/tiflow/pull/3389) - - Please add a release note. -If you don't think this PR needs a release note then fill it with `None`. [#3256](https://github.com/pingcap/tiflow/pull/3256) - -## Bug Fixes - -+ PingCAP/TiDB - - - planner: fix wrong range calculation for Nulleq function on Enum values [#32495](https://github.com/pingcap/tidb/pull/32495) - - Fix the bug that indexHashJoin may return the error `send on closed channel`. [#31448](https://github.com/pingcap/tidb/pull/31448) - - Fix the bug that lightning will skip some precheck items when restart [#31183](https://github.com/pingcap/tidb/pull/31183) - - Fix the error that if tidb-lightning doesn't has permission to access mysql.tidb, it will generate kv with wrong format. [#31152](https://github.com/pingcap/tidb/pull/31152) - - Fix concurrent column type changes(with changing data) that cause schema and data inconsistencies. [#31071](https://github.com/pingcap/tidb/pull/31071) - - Add a new config to control whether support incremental import. [#30926](https://github.com/pingcap/tidb/pull/30926) - - executor: fix pipelined window invalid memory address [#30460](https://github.com/pingcap/tidb/pull/30460) - - Fix the problem that window function may return different results when using transaction or not. [#30392](https://github.com/pingcap/tidb/pull/30392) - - Fix wrong flen for CastAsString funtion [#30058](https://github.com/pingcap/tidb/pull/30058) - - expression: Fix the issue that length information is wrong when converting Decimal to String [#30016](https://github.com/pingcap/tidb/pull/30016) - -+ PingCAP/TiFlash - - - Align unix_timestamp behavior with TiDB and mysql when input is earlier than 1970-01-01 00:00:01 UTC [#3625](https://github.com/pingcap/tics/pull/3625) - -+ PD - - - Fix the bug that the region scatterer may generate the schedule with too few peers. [#4577](https://github.com/tikv/pd/pull/4577) - - Fix incomplete replicate file [#4394](https://github.com/tikv/pd/pull/4394) - - Fix panic issue after TiKV node scales in [#4382](https://github.com/tikv/pd/pull/4382) +--- +title: TiDB 5.3.1 Release Notes +category: Releases +--- + +# TiDB 5.3.1 Release Notes + +Release Date: xx, 2022 + +TiDB version: 5.3.1 + +## Compatibility changes + +TiDB + +TiKV + +PD + +TiDB Dashboard + +TiFlash + +Tools + + - Backup & Restore (BR) + + - TiCDC + + - Dumpling + + - TiDB Binlog + + - TiDB Lightning + +## Feature enhancements + + +## __unsorted + ++ TiDB + + - Fix date formate identifies '\n' as invalid separator [#32503](https://github.com/pingcap/tidb/pull/32503) + - Fix the bug that lightning may not clean up metadata schema when some of the import contains no source files. [#32389](https://github.com/pingcap/tidb/pull/32389) + - Fix `alter column set default` wrongly updates the schema [#32264](https://github.com/pingcap/tidb/pull/32264) + - Fix a bug that caused region unbalanced after restoring. [#32128](https://github.com/pingcap/tidb/pull/32128) + - Fix a bug that turning on tidb_restricted_read_only won't automatically turn on tidb_super_read_only [#31841](https://github.com/pingcap/tidb/pull/31841) + - Fix greatest and least function with collation get wrong result [#31837](https://github.com/pingcap/tidb/pull/31837) + - Fix the crash or error when generating an empty mpp task list. [#31695](https://github.com/pingcap/tidb/pull/31695) + - ```release-note [#31667](https://github.com/pingcap/tidb/pull/31667) + - Fix index join bug caused by innerWorker panic [#31614](https://github.com/pingcap/tidb/pull/31614) + - Fix double column value are different with MySQL after changing column type from float to double [#31572](https://github.com/pingcap/tidb/pull/31572) + - Planner: make queries with the extra column `_tidb_rowid` can use PointGet [#31552](https://github.com/pingcap/tidb/pull/31552) + - Fix a data race that may cause "invalid transaction" error when executing a query using index lookup join. [#31350](https://github.com/pingcap/tidb/pull/31350) + - Fix a panic that may happen when using `on duplicate key update`. [#31344](https://github.com/pingcap/tidb/pull/31344) + - Fix the bug that lighting return error if gcs url starts with gs:// [#31169](https://github.com/pingcap/tidb/pull/31169) + - [#30999](https://github.com/pingcap/tidb/pull/30999) + - Fix a bug that the `mysql_stmt_field_count` returned to mysql client is incorrect in prepare protocal when handling union statement. [#30997](https://github.com/pingcap/tidb/pull/30997) + - Make tidb-lightning pre-check output message clearer [#30888](https://github.com/pingcap/tidb/pull/30888) + - Avoid tikv trigger auto region split by lower the ingest kv count threshold [#30876](https://github.com/pingcap/tidb/pull/30876) + - Fix the but that lightning doesn't report error if s3 storage path not exist. [#30714](https://github.com/pingcap/tidb/pull/30714) + - planner: regard NULL as point when accessing composite index [#30614](https://github.com/pingcap/tidb/pull/30614) + - Fix a bug when reducing order by clause for the index which leads to the wrong result. [#30552](https://github.com/pingcap/tidb/pull/30552) + - The TiDB server now maps a user to an entry in the mysql.user table more consistently. [#30450](https://github.com/pingcap/tidb/pull/30450) + - Fix `MaxDays` and `MaxBackups` not working for slow log. [#30172](https://github.com/pingcap/tidb/pull/30172) + - Lightning: fix log doesn't output to stdout when passing `--log-file="-"` [#29939](https://github.com/pingcap/tidb/pull/29939) + ++ TiKV + + - Reduce CDC recovery time by reduce the number regions that need resolved lock. [#12000](https://github.com/tikv/tikv/pull/12000) + - Increase the size of write batch for raftlog GC to speed up GC. [#11971](https://github.com/tikv/tikv/pull/11971) + - Fix the bug that unsafe_destroy_range does not get executed when GC worker is busy [#11913](https://github.com/tikv/tikv/pull/11913) + - Fix a potential panic (#11746) when snapshot files have been deleted but the peer's status is still Applying. [#11908](https://github.com/tikv/tikv/pull/11908) + - Fix potential high latency caused by destroying a peer [#11880](https://github.com/tikv/tikv/pull/11880) + - Fix possible QPS drop when `level0_slowdown_trigger` is set explicitly with flow control enabled. [#11857](https://github.com/tikv/tikv/pull/11857) + - ```release-note [#11805](https://github.com/tikv/tikv/pull/11805) + - Fix wrong `any_value` result when there are regions returning empty result [#11744](https://github.com/tikv/tikv/pull/11744) + - Update procfs to 0.12.0 [#11726](https://github.com/tikv/tikv/pull/11726) + - Fix the problem that destroying an uninitialized replica may cause a stalled replica be created again. [#11637](https://github.com/tikv/tikv/pull/11637) + - Please add a release note.None [#11632](https://github.com/tikv/tikv/pull/11632) + - Please add a release note. [#11616](https://github.com/tikv/tikv/pull/11616) + - Fix panic when cgroup controller is not mounted [#11582](https://github.com/tikv/tikv/pull/11582) + - Fix metadata corruption in an unlikely condition that prepare merge is triggered after new election without informing an isolated peer [#11568](https://github.com/tikv/tikv/pull/11568) + - Fix deadlock in some rare cases that futures get resolved too fast [#11564](https://github.com/tikv/tikv/pull/11564) + - Fix resolved ts lag increased after stoping a tikv [#11537](https://github.com/tikv/tikv/pull/11537) + - Fix connection abort when too many raft entries are batched into one messages [#11535](https://github.com/tikv/tikv/pull/11535) + - Fix panic in rare conditions when merge, conf change and snapshot happen at the same time [#11513](https://github.com/tikv/tikv/pull/11513) + - Fix the issue that reverse scan can't detect memory locks and may read stale data. [#11456](https://github.com/tikv/tikv/pull/11456) + - Do not panic when RocksDB flush or compaction hits disk capacity [#11428](https://github.com/tikv/tikv/pull/11428) + - make tikv-ctl detect raft db correctly [#11413](https://github.com/tikv/tikv/pull/11413) + - Fix incorrect by-instance gRPC average duration. [#11330](https://github.com/tikv/tikv/pull/11330) + + ++ PingCAP/TiFlash + + - fix error result for function `in` [#4076](https://github.com/pingcap/tics/pull/4076) + - Fix cast to decimal overflow bug [#4073](https://github.com/pingcap/tics/pull/4073) + - fix date format identifies '\n' as invalid separator [#4059](https://github.com/pingcap/tics/pull/4059) + - Fix cannot find column error after add column when remote read was triggered in tiflash [#4027](https://github.com/pingcap/tics/pull/4027) + - Fix str_to_date() function incorrectly handles leading zeros when parsing Microseconds [#3936](https://github.com/pingcap/tics/pull/3936) + - Fix the problem of TiFlash crashing when the memory limit is enabled [#3918](https://github.com/pingcap/tics/pull/3918) + - Fix the bug that castStringAsReal has different behaivor between tiflash and tikv/tidb. [#3757](https://github.com/pingcap/tics/pull/3757) + - Avoid false alert of `DB::Exception: Encode type of coprocessor response is not CHBlock` [#3740](https://github.com/pingcap/tics/pull/3740) + - Fix random `EstablishMPPConnection` fail after TiFlash server restart. [#3708](https://github.com/pingcap/tics/pull/3708) + - Fixed the inconsistent behavior of CastStringAsDecimal between tiflash and tidb/tikv. [#3680](https://github.com/pingcap/tics/pull/3680) + - Fix potential data inconsistency after altering a primary key column to a larger int data type [#3570](https://github.com/pingcap/tics/pull/3570) + - Fix the bug that results of `where ` is wrong because it will be converted to int type. [#3480](https://github.com/pingcap/tics/pull/3480) + - Fix tiflash randomly crash when a mpp query is killed. [#3451](https://github.com/pingcap/tics/pull/3451) + + ++ PD + + - None. [#4663](https://github.com/tikv/pd/pull/4663) + - - fix a bug that operate steps may contain unnecessary or empty JointConsensus steps in certain conditions +- fix a bug when demoting single voter directly [#4552](https://github.com/tikv/pd/pull/4552) + - fix the problem that the hot cache cannot be emptied when the interval is less than 60 [#4435](https://github.com/tikv/pd/pull/4435) + - Improve DR_STATE file content format [#4386](https://github.com/tikv/pd/pull/4386) + - Fix data race when updating replication mode configuration [#4370](https://github.com/tikv/pd/pull/4370) + - Fix the issue that the RLock is not released [#4358](https://github.com/tikv/pd/pull/4358) + + ++ Tools + + + PingCAP/TiCDC + + - `None`. [#4659](https://github.com/pingcap/tiflow/pull/4659) + - Support more data types with default value attribute, and fix potential data inconsistency caused by default value logic [#4652](https://github.com/pingcap/tiflow/pull/4652) + - Fix a bug that long varchar will report error of "Column length too big..." [#4645](https://github.com/pingcap/tiflow/pull/4645) + - `None`. [#4641](https://github.com/pingcap/tiflow/pull/4641) + - `None`. [#4614](https://github.com/pingcap/tiflow/pull/4614) + - `None`. [#4594](https://github.com/pingcap/tiflow/pull/4594) + - `None`. [#4574](https://github.com/pingcap/tiflow/pull/4574) + - Fix a bug that owner exits abnormally when PD leader is killed [#4532](https://github.com/pingcap/tiflow/pull/4532) + - allow user set the configuration of Kafka producer dial/write/read timeout [#4526](https://github.com/pingcap/tiflow/pull/4526) + - Fix a bug that MySQL sink will generate duplicated replace SQL if `batch-replace-enable` is disabled. [#4508](https://github.com/pingcap/tiflow/pull/4508) + - `None`. [#4465](https://github.com/pingcap/tiflow/pull/4465) + - `None`. [#4462](https://github.com/pingcap/tiflow/pull/4462) + - Fix the issue that update statement execute error in safemode may cause DM-worker panic. [#4439](https://github.com/pingcap/tiflow/pull/4439) + - None. [#4430](https://github.com/pingcap/tiflow/pull/4430) + - `None`. [#4398](https://github.com/pingcap/tiflow/pull/4398) + - `None`. [#4345](https://github.com/pingcap/tiflow/pull/4345) + - Add exponential backoff mechanism for restarting a changefeed. [#4339](https://github.com/pingcap/tiflow/pull/4339) + - Fix a bug that upstream metrics won't update if no query-status [#4332](https://github.com/pingcap/tiflow/pull/4332) + - `None`. [#4323](https://github.com/pingcap/tiflow/pull/4323) + - Fix kv client cached region metric could be negative. [#4290](https://github.com/pingcap/tiflow/pull/4290) + - `None` [#4285](https://github.com/pingcap/tiflow/pull/4285) + - `None`. [#4278](https://github.com/pingcap/tiflow/pull/4278) + - Fix the problem that TiCDC cannot send messages when `min.insync.replicas` is less than `replication-factor` [#4271](https://github.com/pingcap/tiflow/pull/4271) + - `None`. [#4254](https://github.com/pingcap/tiflow/pull/4254) + - `None`. [#4227](https://github.com/pingcap/tiflow/pull/4227) + - Support updating table schema when using dmctl binlog to skip some ddls [#4225](https://github.com/pingcap/tiflow/pull/4225) + - `None`. [#4209](https://github.com/pingcap/tiflow/pull/4209) + - Fix the potential panic issue that occurs when changefeed info is removed from etcd. [#4183](https://github.com/pingcap/tiflow/pull/4183) + - `None`. [#4163](https://github.com/pingcap/tiflow/pull/4163) + - `None`. [#4162](https://github.com/pingcap/tiflow/pull/4162) + - Fix a bug that stop-task during load phase will cause the source always tries to transfer to a worker [#4145](https://github.com/pingcap/tiflow/pull/4145) + - `fix a bug that wrong progress in query-status for loader`. [#4143](https://github.com/pingcap/tiflow/pull/4143) + - Fix the bug that http API panic when the processor info we want to get is not exist. [#4123](https://github.com/pingcap/tiflow/pull/4123) + - Reduce "EventFeed retry rate limited" logs [#4111](https://github.com/pingcap/tiflow/pull/4111) + - Fix a bug that can cause changefeed stuck due to a deadlock occurs. [#4099](https://github.com/pingcap/tiflow/pull/4099) + - Manage sink checkpoint per table to avoid checkpointTs advances unexpected. [#4083](https://github.com/pingcap/tiflow/pull/4083) + - `None`. [#4079](https://github.com/pingcap/tiflow/pull/4079) + - Set `max-message-bytes` default to 10M, and use the min value with topic and broker to initialize the producer. [#4063](https://github.com/pingcap/tiflow/pull/4063) + - Fix nil pointer panic encountered when scheduler cleanup finished operations [#4016](https://github.com/pingcap/tiflow/pull/4016) + - Fix a bug that when master and worker restart in a particular order, relay status in DM-master is wrong [#4009](https://github.com/pingcap/tiflow/pull/4009) + - Fix a bug that DM-worker can't boot up after restart [#4005](https://github.com/pingcap/tiflow/pull/4005) + - Fix a bug that DM task will failed when PARTITION DDL cost a long time [#3995](https://github.com/pingcap/tiflow/pull/3995) + - Fix syntax error if DDL has a special comment. [#3978](https://github.com/pingcap/tiflow/pull/3978) + - ```release-note [#3976](https://github.com/pingcap/tiflow/pull/3976) + - Fix the owner may be blocked when initializing the changefeed caused by a bad network connection to the sink [#3964](https://github.com/pingcap/tiflow/pull/3964) + - `None` [#3953](https://github.com/pingcap/tiflow/pull/3953) + - fix a bug that DM may report "invalid sequence" when upstream is MySQL 8.0 +fix a bug that upstream will die on SHOW SLAVE HOSTS [#3934](https://github.com/pingcap/tiflow/pull/3934) + - Fix a bug that redo logs are not cleaned up when removing a paused changefeed. [#3919](https://github.com/pingcap/tiflow/pull/3919) + - Fix timezone related error that cause cdc server can't run in some RHEL release version (6.8, 6.9 etc). [#3906](https://github.com/pingcap/tiflow/pull/3906) + - Fix cli don't work when cli cert's common name was not added in config that use for start cdc server. [#3882](https://github.com/pingcap/tiflow/pull/3882) + - add pre clean up process when s3 enable, fix #3523 [#3878](https://github.com/pingcap/tiflow/pull/3878) + - add redo log related metric [#3877](https://github.com/pingcap/tiflow/pull/3877) + - Fix the issue of changefeed resuming automatically after upgrading cluster [#3865](https://github.com/pingcap/tiflow/pull/3865) + - Fix a bug of data loss when DM does finer grained retry [#3860](https://github.com/pingcap/tiflow/pull/3860) + - Fix mounter default date value not support [#3859](https://github.com/pingcap/tiflow/pull/3859) + - Add an alert rule when ticdc has no owner for more than 10 minutes. [#3832](https://github.com/pingcap/tiflow/pull/3832) + - Reduce log "synchronize is taking too long, report a bug" in some cases. [#3795](https://github.com/pingcap/tiflow/pull/3795) + - Fix the problem that old value is not forced on automatically in `canal-json` and `maxwell` protocols [#3783](https://github.com/pingcap/tiflow/pull/3783) + - `None`. [#3765](https://github.com/pingcap/tiflow/pull/3765) + - `None`. [#3712](https://github.com/pingcap/tiflow/pull/3712) + - Please add a release note. +fix kvclient takes too long time to recover [#3663](https://github.com/pingcap/tiflow/pull/3663) + - The Avro sink was updated to handle JSON columns [#3649](https://github.com/pingcap/tiflow/pull/3649) + - Fix cli don't work when cli cert's common name was not added in config that use for start cdc server. [#3628](https://github.com/pingcap/tiflow/pull/3628) + - fix changefeed checkpoint lag negative value error [#3536](https://github.com/pingcap/tiflow/pull/3536) + - Fix HTTP API not working when there are TiCDC nodes of different versions in one cdc cluster. [#3530](https://github.com/pingcap/tiflow/pull/3530) + - Fix a bug when too often query status is called in Load unit, DM-worker may encounter data race or panic [#3468](https://github.com/pingcap/tiflow/pull/3468) + - Fix OOM in container environments. [#3439](https://github.com/pingcap/tiflow/pull/3439) + - Please add a release note. +If you don't think this PR needs a release note then fill it with `None`. [#3389](https://github.com/pingcap/tiflow/pull/3389) + - Please add a release note. +If you don't think this PR needs a release note then fill it with `None`. [#3256](https://github.com/pingcap/tiflow/pull/3256) + +## Bug Fixes + ++ PingCAP/TiDB + + - planner: fix wrong range calculation for Nulleq function on Enum values [#32495](https://github.com/pingcap/tidb/pull/32495) + - Fix the bug that indexHashJoin may return the error `send on closed channel`. [#31448](https://github.com/pingcap/tidb/pull/31448) + - Fix the bug that lightning will skip some precheck items when restart [#31183](https://github.com/pingcap/tidb/pull/31183) + - Fix the error that if tidb-lightning doesn't has permission to access mysql.tidb, it will generate kv with wrong format. [#31152](https://github.com/pingcap/tidb/pull/31152) + - Fix concurrent column type changes(with changing data) that cause schema and data inconsistencies. [#31071](https://github.com/pingcap/tidb/pull/31071) + - Add a new config to control whether support incremental import. [#30926](https://github.com/pingcap/tidb/pull/30926) + - executor: fix pipelined window invalid memory address [#30460](https://github.com/pingcap/tidb/pull/30460) + - Fix the problem that window function may return different results when using transaction or not. [#30392](https://github.com/pingcap/tidb/pull/30392) + - Fix wrong flen for CastAsString funtion [#30058](https://github.com/pingcap/tidb/pull/30058) + - expression: Fix the issue that length information is wrong when converting Decimal to String [#30016](https://github.com/pingcap/tidb/pull/30016) + ++ PingCAP/TiFlash + + - Align unix_timestamp behavior with TiDB and mysql when input is earlier than 1970-01-01 00:00:01 UTC [#3625](https://github.com/pingcap/tics/pull/3625) + ++ PD + + - Fix the bug that the region scatterer may generate the schedule with too few peers. [#4577](https://github.com/tikv/pd/pull/4577) + - Fix incomplete replicate file [#4394](https://github.com/tikv/pd/pull/4394) + - Fix panic issue after TiKV node scales in [#4382](https://github.com/tikv/pd/pull/4382) diff --git a/releases/release-notes.md b/releases/release-notes.md index 3733b0552c39a..1e6b798de2974 100644 --- a/releases/release-notes.md +++ b/releases/release-notes.md @@ -7,6 +7,7 @@ aliases: ['/docs/dev/releases/release-notes/','/docs/dev/releases/rn/'] ## 5.3 +- [5.3.1](/releases/release-5.3.1.md) - [5.3.0](/releases/release-5.3.0.md) ## 5.2 diff --git a/releases/release-timeline.md b/releases/release-timeline.md index e1ef19e83a511..0882893c4be2c 100644 --- a/releases/release-timeline.md +++ b/releases/release-timeline.md @@ -9,6 +9,7 @@ This document shows all the released TiDB versions in reverse chronological orde | Version | Release Date | | :--- | :--- | +| [5.3.1](/releases/release-5.3.1.md) | 2022-xx | | [5.0.6](/releases/release-5.0.6.md) | 2021-12-31 | | [4.0.16](/releases/release-4.0.16.md) | 2021-12-17 | | [5.1.3](/releases/release-5.1.3.md) | 2021-12-03 | From c3d647fe8da6dbe6af88f15cd140fd3ec5005097 Mon Sep 17 00:00:00 2001 From: shichun-0415 Date: Thu, 24 Feb 2022 16:20:46 +0800 Subject: [PATCH 04/58] Update release-timeline.md --- releases/release-timeline.md | 1 + 1 file changed, 1 insertion(+) diff --git a/releases/release-timeline.md b/releases/release-timeline.md index 2693e82775ed5..b2b8e2b33163c 100644 --- a/releases/release-timeline.md +++ b/releases/release-timeline.md @@ -9,6 +9,7 @@ This document shows all the released TiDB versions in reverse chronological orde | Version | Release Date | | :--- | :--- | +| [5.3.1](/releases/release-5.3.1.md) | 2022-xx-xx | | [5.1.4](/releases/release-5.1.4.md) | 2022-02-22 | | [5.4.0](/releases/release-5.4.0.md) | 2022-02-15 | | [5.0.6](/releases/release-5.0.6.md) | 2021-12-31 | From a19e2a10d275d9656085d41b6b4f66134bc0cf20 Mon Sep 17 00:00:00 2001 From: xixirangrang <35301108+hfxsd@users.noreply.github.com> Date: Thu, 24 Feb 2022 16:33:34 +0800 Subject: [PATCH 05/58] Update release-5.3.1.md --- releases/release-5.3.1.md | 12 +++--------- 1 file changed, 3 insertions(+), 9 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 6fc107653e7c5..93169056b9736 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -35,7 +35,6 @@ Tools ## Feature enhancements - ## __unsorted + TiDB @@ -90,7 +89,6 @@ Tools - make tikv-ctl detect raft db correctly [#11413](https://github.com/tikv/tikv/pull/11413) - Fix incorrect by-instance gRPC average duration. [#11330](https://github.com/tikv/tikv/pull/11330) - + PingCAP/TiFlash - fix error result for function `in` [#4076](https://github.com/pingcap/tics/pull/4076) @@ -107,7 +105,6 @@ Tools - Fix the bug that results of `where ` is wrong because it will be converted to int type. [#3480](https://github.com/pingcap/tics/pull/3480) - Fix tiflash randomly crash when a mpp query is killed. [#3451](https://github.com/pingcap/tics/pull/3451) - + PD - None. [#4663](https://github.com/tikv/pd/pull/4663) @@ -118,7 +115,6 @@ Tools - Fix data race when updating replication mode configuration [#4370](https://github.com/tikv/pd/pull/4370) - Fix the issue that the RLock is not released [#4358](https://github.com/tikv/pd/pull/4358) - + Tools + PingCAP/TiCDC @@ -192,14 +188,12 @@ fix kvclient takes too long time to recover [#3663](https://github.com/pingcap/t - Fix HTTP API not working when there are TiCDC nodes of different versions in one cdc cluster. [#3530](https://github.com/pingcap/tiflow/pull/3530) - Fix a bug when too often query status is called in Load unit, DM-worker may encounter data race or panic [#3468](https://github.com/pingcap/tiflow/pull/3468) - Fix OOM in container environments. [#3439](https://github.com/pingcap/tiflow/pull/3439) - - Please add a release note. -If you don't think this PR needs a release note then fill it with `None`. [#3389](https://github.com/pingcap/tiflow/pull/3389) - - Please add a release note. -If you don't think this PR needs a release note then fill it with `None`. [#3256](https://github.com/pingcap/tiflow/pull/3256) + - Please add a release note. If you don't think this PR needs a release note then fill it with `None`. [#3389](https://github.com/pingcap/tiflow/pull/3389) + - Please add a release note. If you don't think this PR needs a release note then fill it with `None`. [#3256](https://github.com/pingcap/tiflow/pull/3256) ## Bug Fixes -+ PingCAP/TiDB ++ TiDB - planner: fix wrong range calculation for Nulleq function on Enum values [#32495](https://github.com/pingcap/tidb/pull/32495) - Fix the bug that indexHashJoin may return the error `send on closed channel`. [#31448](https://github.com/pingcap/tidb/pull/31448) From fd61b5d0c4e495476297fdd4d10cda546e14adf2 Mon Sep 17 00:00:00 2001 From: qiancai Date: Thu, 24 Feb 2022 18:27:41 +0800 Subject: [PATCH 06/58] Update release-5.3.1.md --- releases/release-5.3.1.md | 220 +++++++++++++++++++------------------- 1 file changed, 110 insertions(+), 110 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 93169056b9736..61cced9bf01e8 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -40,54 +40,54 @@ Tools + TiDB - Fix date formate identifies '\n' as invalid separator [#32503](https://github.com/pingcap/tidb/pull/32503) - - Fix the bug that lightning may not clean up metadata schema when some of the import contains no source files. [#32389](https://github.com/pingcap/tidb/pull/32389) - - Fix `alter column set default` wrongly updates the schema [#32264](https://github.com/pingcap/tidb/pull/32264) - - Fix a bug that caused region unbalanced after restoring. [#32128](https://github.com/pingcap/tidb/pull/32128) - - Fix a bug that turning on tidb_restricted_read_only won't automatically turn on tidb_super_read_only [#31841](https://github.com/pingcap/tidb/pull/31841) - - Fix greatest and least function with collation get wrong result [#31837](https://github.com/pingcap/tidb/pull/31837) - - Fix the crash or error when generating an empty mpp task list. [#31695](https://github.com/pingcap/tidb/pull/31695) + - Fix the bug that lightning may not clean up metadata schema when some of the import contains no source files. [#28144](https://github.com/pingcap/tidb/issues/28144) + - Fix `alter column set default` wrongly updates the schema [#31074](https://github.com/pingcap/tidb/issues/31074) + - Fix a bug that caused region unbalanced after restoring. [#31034](https://github.com/pingcap/tidb/issues/31034) + - Fix a bug that turning on tidb_restricted_read_only won't automatically turn on tidb_super_read_only [#31745](https://github.com/pingcap/tidb/issues/31745) + - Fix greatest and least function with collation get wrong result [#31789](https://github.com/pingcap/tidb/issues/31789) + - Fix the crash or error when generating an empty mpp task list. [#31636](https://github.com/pingcap/tidb/issues/31636) - ```release-note [#31667](https://github.com/pingcap/tidb/pull/31667) - - Fix index join bug caused by innerWorker panic [#31614](https://github.com/pingcap/tidb/pull/31614) - - Fix double column value are different with MySQL after changing column type from float to double [#31572](https://github.com/pingcap/tidb/pull/31572) - - Planner: make queries with the extra column `_tidb_rowid` can use PointGet [#31552](https://github.com/pingcap/tidb/pull/31552) - - Fix a data race that may cause "invalid transaction" error when executing a query using index lookup join. [#31350](https://github.com/pingcap/tidb/pull/31350) - - Fix a panic that may happen when using `on duplicate key update`. [#31344](https://github.com/pingcap/tidb/pull/31344) - - Fix the bug that lighting return error if gcs url starts with gs:// [#31169](https://github.com/pingcap/tidb/pull/31169) + - Fix index join bug caused by innerWorker panic [#31494](https://github.com/pingcap/tidb/issues/31494) + - Fix double column value are different with MySQL after changing column type from float to double [#31372](https://github.com/pingcap/tidb/issues/31372) + - Planner: make queries with the extra column `_tidb_rowid` can use PointGet [#31543](https://github.com/pingcap/tidb/issues/31543) + - Fix a data race that may cause "invalid transaction" error when executing a query using index lookup join. [#30468](https://github.com/pingcap/tidb/issues/30468) + - Fix a panic that may happen when using `on duplicate key update`. [#28078](https://github.com/pingcap/tidb/issues/28078) + - Fix the bug that lighting return error if gcs url starts with gs:// [#32591](https://github.com/pingcap/tidb/issues/32591) - [#30999](https://github.com/pingcap/tidb/pull/30999) - - Fix a bug that the `mysql_stmt_field_count` returned to mysql client is incorrect in prepare protocal when handling union statement. [#30997](https://github.com/pingcap/tidb/pull/30997) - - Make tidb-lightning pre-check output message clearer [#30888](https://github.com/pingcap/tidb/pull/30888) - - Avoid tikv trigger auto region split by lower the ingest kv count threshold [#30876](https://github.com/pingcap/tidb/pull/30876) - - Fix the but that lightning doesn't report error if s3 storage path not exist. [#30714](https://github.com/pingcap/tidb/pull/30714) - - planner: regard NULL as point when accessing composite index [#30614](https://github.com/pingcap/tidb/pull/30614) - - Fix a bug when reducing order by clause for the index which leads to the wrong result. [#30552](https://github.com/pingcap/tidb/pull/30552) + - Fix a bug that the `mysql_stmt_field_count` returned to mysql client is incorrect in prepare protocal when handling union statement. [#30971](https://github.com/pingcap/tidb/issues/30971) + - Make tidb-lightning pre-check output message clearer [#30395](https://github.com/pingcap/tidb/issues/30395) + - Avoid tikv trigger auto region split by lower the ingest kv count threshold [#30018](https://github.com/pingcap/tidb/issues/30018) + - Fix the but that lightning doesn't report error if s3 storage path not exist. [#28031](https://github.com/pingcap/tidb/issues/28031) + - planner: regard NULL as point when accessing composite index [#29650](https://github.com/pingcap/tidb/issues/29650) + - Fix a bug when reducing order by clause for the index which leads to the wrong result. [#30271](https://github.com/pingcap/tidb/issues/30271) - The TiDB server now maps a user to an entry in the mysql.user table more consistently. [#30450](https://github.com/pingcap/tidb/pull/30450) - Fix `MaxDays` and `MaxBackups` not working for slow log. [#30172](https://github.com/pingcap/tidb/pull/30172) - - Lightning: fix log doesn't output to stdout when passing `--log-file="-"` [#29939](https://github.com/pingcap/tidb/pull/29939) + - Lightning: fix log doesn't output to stdout when passing `--log-file="-"` [#29876](https://github.com/pingcap/tidb/issues/29876) + TiKV - - Reduce CDC recovery time by reduce the number regions that need resolved lock. [#12000](https://github.com/tikv/tikv/pull/12000) - - Increase the size of write batch for raftlog GC to speed up GC. [#11971](https://github.com/tikv/tikv/pull/11971) - - Fix the bug that unsafe_destroy_range does not get executed when GC worker is busy [#11913](https://github.com/tikv/tikv/pull/11913) - - Fix a potential panic (#11746) when snapshot files have been deleted but the peer's status is still Applying. [#11908](https://github.com/tikv/tikv/pull/11908) - - Fix potential high latency caused by destroying a peer [#11880](https://github.com/tikv/tikv/pull/11880) - - Fix possible QPS drop when `level0_slowdown_trigger` is set explicitly with flow control enabled. [#11857](https://github.com/tikv/tikv/pull/11857) + - Reduce CDC recovery time by reduce the number regions that need resolved lock. [#11993](https://github.com/tikv/tikv/issues/11993) + - Increase the size of write batch for raftlog GC to speed up GC. [#11404](https://github.com/tikv/tikv/issues/11404) + - Fix the bug that unsafe_destroy_range does not get executed when GC worker is busy [#11903](https://github.com/tikv/tikv/issues/11903) + - Fix a potential panic (#11746) when snapshot files have been deleted but the peer's status is still Applying. [#11746](https://github.com/tikv/tikv/issues/11746) + - Fix potential high latency caused by destroying a peer [#10210](https://github.com/tikv/tikv/issues/10210) + - Fix possible QPS drop when `level0_slowdown_trigger` is set explicitly with flow control enabled. [#11424](https://github.com/tikv/tikv/issues/11424) - ```release-note [#11805](https://github.com/tikv/tikv/pull/11805) - - Fix wrong `any_value` result when there are regions returning empty result [#11744](https://github.com/tikv/tikv/pull/11744) - - Update procfs to 0.12.0 [#11726](https://github.com/tikv/tikv/pull/11726) - - Fix the problem that destroying an uninitialized replica may cause a stalled replica be created again. [#11637](https://github.com/tikv/tikv/pull/11637) + - Fix wrong `any_value` result when there are regions returning empty result [#11735](https://github.com/tikv/tikv/issues/11735) + - Update procfs to 0.12.0 [#11702](https://github.com/tikv/tikv/issues/11702) + - Fix the problem that destroying an uninitialized replica may cause a stalled replica be created again. [#10533](https://github.com/tikv/tikv/issues/10533) - Please add a release note.None [#11632](https://github.com/tikv/tikv/pull/11632) - Please add a release note. [#11616](https://github.com/tikv/tikv/pull/11616) - - Fix panic when cgroup controller is not mounted [#11582](https://github.com/tikv/tikv/pull/11582) - - Fix metadata corruption in an unlikely condition that prepare merge is triggered after new election without informing an isolated peer [#11568](https://github.com/tikv/tikv/pull/11568) - - Fix deadlock in some rare cases that futures get resolved too fast [#11564](https://github.com/tikv/tikv/pull/11564) - - Fix resolved ts lag increased after stoping a tikv [#11537](https://github.com/tikv/tikv/pull/11537) - - Fix connection abort when too many raft entries are batched into one messages [#11535](https://github.com/tikv/tikv/pull/11535) - - Fix panic in rare conditions when merge, conf change and snapshot happen at the same time [#11513](https://github.com/tikv/tikv/pull/11513) - - Fix the issue that reverse scan can't detect memory locks and may read stale data. [#11456](https://github.com/tikv/tikv/pull/11456) - - Do not panic when RocksDB flush or compaction hits disk capacity [#11428](https://github.com/tikv/tikv/pull/11428) - - make tikv-ctl detect raft db correctly [#11413](https://github.com/tikv/tikv/pull/11413) - - Fix incorrect by-instance gRPC average duration. [#11330](https://github.com/tikv/tikv/pull/11330) + - Fix panic when cgroup controller is not mounted [#11569](https://github.com/tikv/tikv/issues/11569) + - Fix metadata corruption in an unlikely condition that prepare merge is triggered after new election without informing an isolated peer [#11526](https://github.com/tikv/tikv/issues/11526) + - Fix deadlock in some rare cases that futures get resolved too fast [#11549](https://github.com/tikv/tikv/issues/11549) + - Fix resolved ts lag increased after stoping a tikv [#11351](https://github.com/tikv/tikv/issues/11351) + - Fix connection abort when too many raft entries are batched into one messages [#9714](https://github.com/tikv/tikv/issues/9714) + - Fix panic in rare conditions when merge, conf change and snapshot happen at the same time [#11475](https://github.com/tikv/tikv/issues/11475) + - Fix the issue that reverse scan can't detect memory locks and may read stale data. [#11440](https://github.com/tikv/tikv/issues/11440) + - Do not panic when RocksDB flush or compaction hits disk capacity [#11224](https://github.com/tikv/tikv/issues/11224) + - make tikv-ctl detect raft db correctly [#11393](https://github.com/tikv/tikv/issues/11393) + - Fix incorrect by-instance gRPC average duration. [#11299](https://github.com/tikv/tikv/issues/11299) + PingCAP/TiFlash @@ -109,102 +109,102 @@ Tools - None. [#4663](https://github.com/tikv/pd/pull/4663) - - fix a bug that operate steps may contain unnecessary or empty JointConsensus steps in certain conditions -- fix a bug when demoting single voter directly [#4552](https://github.com/tikv/pd/pull/4552) - - fix the problem that the hot cache cannot be emptied when the interval is less than 60 [#4435](https://github.com/tikv/pd/pull/4435) - - Improve DR_STATE file content format [#4386](https://github.com/tikv/pd/pull/4386) - - Fix data race when updating replication mode configuration [#4370](https://github.com/tikv/pd/pull/4370) - - Fix the issue that the RLock is not released [#4358](https://github.com/tikv/pd/pull/4358) +- fix a bug when demoting single voter directly [#4362](https://github.com/tikv/pd/issues/4362) + - fix the problem that the hot cache cannot be emptied when the interval is less than 60 [#4390](https://github.com/tikv/pd/issues/4390) + - Improve DR_STATE file content format [#4341](https://github.com/tikv/pd/issues/4341) + - Fix data race when updating replication mode configuration [#4325](https://github.com/tikv/pd/issues/4325) + - Fix the issue that the RLock is not released [#4354](https://github.com/tikv/pd/issues/4354) + Tools + PingCAP/TiCDC - - `None`. [#4659](https://github.com/pingcap/tiflow/pull/4659) - - Support more data types with default value attribute, and fix potential data inconsistency caused by default value logic [#4652](https://github.com/pingcap/tiflow/pull/4652) - - Fix a bug that long varchar will report error of "Column length too big..." [#4645](https://github.com/pingcap/tiflow/pull/4645) - - `None`. [#4641](https://github.com/pingcap/tiflow/pull/4641) - - `None`. [#4614](https://github.com/pingcap/tiflow/pull/4614) - - `None`. [#4594](https://github.com/pingcap/tiflow/pull/4594) - - `None`. [#4574](https://github.com/pingcap/tiflow/pull/4574) - - Fix a bug that owner exits abnormally when PD leader is killed [#4532](https://github.com/pingcap/tiflow/pull/4532) - - allow user set the configuration of Kafka producer dial/write/read timeout [#4526](https://github.com/pingcap/tiflow/pull/4526) - - Fix a bug that MySQL sink will generate duplicated replace SQL if `batch-replace-enable` is disabled. [#4508](https://github.com/pingcap/tiflow/pull/4508) - - `None`. [#4465](https://github.com/pingcap/tiflow/pull/4465) - - `None`. [#4462](https://github.com/pingcap/tiflow/pull/4462) - - Fix the issue that update statement execute error in safemode may cause DM-worker panic. [#4439](https://github.com/pingcap/tiflow/pull/4439) - - None. [#4430](https://github.com/pingcap/tiflow/pull/4430) - - `None`. [#4398](https://github.com/pingcap/tiflow/pull/4398) - - `None`. [#4345](https://github.com/pingcap/tiflow/pull/4345) - - Add exponential backoff mechanism for restarting a changefeed. [#4339](https://github.com/pingcap/tiflow/pull/4339) - - Fix a bug that upstream metrics won't update if no query-status [#4332](https://github.com/pingcap/tiflow/pull/4332) - - `None`. [#4323](https://github.com/pingcap/tiflow/pull/4323) + - `None`. [#4660](https://github.com/pingcap/tiflow/issues/4660) + - Support more data types with default value attribute, and fix potential data inconsistency caused by default value logic [#3793](https://github.com/pingcap/tiflow/issues/3793) + - Fix a bug that long varchar will report error of "Column length too big..." [#4637](https://github.com/pingcap/tiflow/issues/4637) + - `None`. [#4385](https://github.com/pingcap/tiflow/issues/4385) + - `None`. [#4607](https://github.com/pingcap/tiflow/issues/4607) + - `None`. [#4588](https://github.com/pingcap/tiflow/issues/4588) + - `None`. [#4561](https://github.com/pingcap/tiflow/issues/4561) + - Fix a bug that owner exits abnormally when PD leader is killed [#4248](https://github.com/pingcap/tiflow/issues/4248) + - allow user set the configuration of Kafka producer dial/write/read timeout [#4385](https://github.com/pingcap/tiflow/issues/4385) + - Fix a bug that MySQL sink will generate duplicated replace SQL if `batch-replace-enable` is disabled. [#4501](https://github.com/pingcap/tiflow/issues/4501) + - `None`. [#4128](https://github.com/pingcap/tiflow/issues/4128) + - `None`. [#4404](https://github.com/pingcap/tiflow/issues/4404) + - Fix the issue that update statement execute error in safemode may cause DM-worker panic. [#4317](https://github.com/pingcap/tiflow/issues/4317) + - None. [#4353](https://github.com/pingcap/tiflow/issues/4353) + - `None`. [#4159](https://github.com/pingcap/tiflow/issues/4159) + - `None`. [#4135](https://github.com/pingcap/tiflow/issues/4135) + - Add exponential backoff mechanism for restarting a changefeed. [#3329](https://github.com/pingcap/tiflow/issues/3329) + - Fix a bug that upstream metrics won't update if no query-status [#4281](https://github.com/pingcap/tiflow/issues/4281) + - `None`. [#3431](https://github.com/pingcap/tiflow/issues/3431) - Fix kv client cached region metric could be negative. [#4290](https://github.com/pingcap/tiflow/pull/4290) - - `None` [#4285](https://github.com/pingcap/tiflow/pull/4285) - - `None`. [#4278](https://github.com/pingcap/tiflow/pull/4278) - - Fix the problem that TiCDC cannot send messages when `min.insync.replicas` is less than `replication-factor` [#4271](https://github.com/pingcap/tiflow/pull/4271) - - `None`. [#4254](https://github.com/pingcap/tiflow/pull/4254) - - `None`. [#4227](https://github.com/pingcap/tiflow/pull/4227) - - Support updating table schema when using dmctl binlog to skip some ddls [#4225](https://github.com/pingcap/tiflow/pull/4225) - - `None`. [#4209](https://github.com/pingcap/tiflow/pull/4209) - - Fix the potential panic issue that occurs when changefeed info is removed from etcd. [#4183](https://github.com/pingcap/tiflow/pull/4183) + - `None` [#4266](https://github.com/pingcap/tiflow/issues/4266) + - `None`. [#4223](https://github.com/pingcap/tiflow/issues/4223) + - Fix the problem that TiCDC cannot send messages when `min.insync.replicas` is less than `replication-factor` [#3994](https://github.com/pingcap/tiflow/issues/3994) + - `None`. [#4159](https://github.com/pingcap/tiflow/issues/4159) + - `None`. [#4173](https://github.com/pingcap/tiflow/issues/4173) + - Support updating table schema when using dmctl binlog to skip some ddls [#4177](https://github.com/pingcap/tiflow/issues/4177) + - `None`. [#3431](https://github.com/pingcap/tiflow/issues/3431) + - Fix the potential panic issue that occurs when changefeed info is removed from etcd. [#3128](https://github.com/pingcap/tiflow/issues/3128) - `None`. [#4163](https://github.com/pingcap/tiflow/pull/4163) - - `None`. [#4162](https://github.com/pingcap/tiflow/pull/4162) - - Fix a bug that stop-task during load phase will cause the source always tries to transfer to a worker [#4145](https://github.com/pingcap/tiflow/pull/4145) - - `fix a bug that wrong progress in query-status for loader`. [#4143](https://github.com/pingcap/tiflow/pull/4143) - - Fix the bug that http API panic when the processor info we want to get is not exist. [#4123](https://github.com/pingcap/tiflow/pull/4123) - - Reduce "EventFeed retry rate limited" logs [#4111](https://github.com/pingcap/tiflow/pull/4111) - - Fix a bug that can cause changefeed stuck due to a deadlock occurs. [#4099](https://github.com/pingcap/tiflow/pull/4099) + - `None`. [#3337](https://github.com/pingcap/tiflow/issues/3337) + - Fix a bug that stop-task during load phase will cause the source always tries to transfer to a worker [#3771](https://github.com/pingcap/tiflow/issues/3771) + - `fix a bug that wrong progress in query-status for loader`. [#3252](https://github.com/pingcap/tiflow/issues/3252) + - Fix the bug that http API panic when the processor info we want to get is not exist. [#3840](https://github.com/pingcap/tiflow/issues/3840) + - Reduce "EventFeed retry rate limited" logs [#4006](https://github.com/pingcap/tiflow/issues/4006) + - Fix a bug that can cause changefeed stuck due to a deadlock occurs. [#4055](https://github.com/pingcap/tiflow/issues/4055) - Manage sink checkpoint per table to avoid checkpointTs advances unexpected. [#4083](https://github.com/pingcap/tiflow/pull/4083) - `None`. [#4079](https://github.com/pingcap/tiflow/pull/4079) - - Set `max-message-bytes` default to 10M, and use the min value with topic and broker to initialize the producer. [#4063](https://github.com/pingcap/tiflow/pull/4063) - - Fix nil pointer panic encountered when scheduler cleanup finished operations [#4016](https://github.com/pingcap/tiflow/pull/4016) - - Fix a bug that when master and worker restart in a particular order, relay status in DM-master is wrong [#4009](https://github.com/pingcap/tiflow/pull/4009) - - Fix a bug that DM-worker can't boot up after restart [#4005](https://github.com/pingcap/tiflow/pull/4005) - - Fix a bug that DM task will failed when PARTITION DDL cost a long time [#3995](https://github.com/pingcap/tiflow/pull/3995) - - Fix syntax error if DDL has a special comment. [#3978](https://github.com/pingcap/tiflow/pull/3978) + - Set `max-message-bytes` default to 10M, and use the min value with topic and broker to initialize the producer. [#4041](https://github.com/pingcap/tiflow/issues/4041) + - Fix nil pointer panic encountered when scheduler cleanup finished operations [#2980](https://github.com/pingcap/tiflow/issues/2980) + - Fix a bug that when master and worker restart in a particular order, relay status in DM-master is wrong [#3478](https://github.com/pingcap/tiflow/issues/3478) + - Fix a bug that DM-worker can't boot up after restart [#3344](https://github.com/pingcap/tiflow/issues/3344) + - Fix a bug that DM task will failed when PARTITION DDL cost a long time [#3854](https://github.com/pingcap/tiflow/issues/3854) + - Fix syntax error if DDL has a special comment. [#3755](https://github.com/pingcap/tiflow/issues/3755) - ```release-note [#3976](https://github.com/pingcap/tiflow/pull/3976) - - Fix the owner may be blocked when initializing the changefeed caused by a bad network connection to the sink [#3964](https://github.com/pingcap/tiflow/pull/3964) + - Fix the owner may be blocked when initializing the changefeed caused by a bad network connection to the sink [#3352](https://github.com/pingcap/tiflow/issues/3352) - `None` [#3953](https://github.com/pingcap/tiflow/pull/3953) - fix a bug that DM may report "invalid sequence" when upstream is MySQL 8.0 -fix a bug that upstream will die on SHOW SLAVE HOSTS [#3934](https://github.com/pingcap/tiflow/pull/3934) +fix a bug that upstream will die on SHOW SLAVE HOSTS [#3847](https://github.com/pingcap/tiflow/issues/3847) - Fix a bug that redo logs are not cleaned up when removing a paused changefeed. [#3919](https://github.com/pingcap/tiflow/pull/3919) - - Fix timezone related error that cause cdc server can't run in some RHEL release version (6.8, 6.9 etc). [#3906](https://github.com/pingcap/tiflow/pull/3906) + - Fix timezone related error that cause cdc server can't run in some RHEL release version (6.8, 6.9 etc). [#3584](https://github.com/pingcap/tiflow/issues/3584) - Fix cli don't work when cli cert's common name was not added in config that use for start cdc server. [#3882](https://github.com/pingcap/tiflow/pull/3882) - add pre clean up process when s3 enable, fix #3523 [#3878](https://github.com/pingcap/tiflow/pull/3878) - add redo log related metric [#3877](https://github.com/pingcap/tiflow/pull/3877) - - Fix the issue of changefeed resuming automatically after upgrading cluster [#3865](https://github.com/pingcap/tiflow/pull/3865) - - Fix a bug of data loss when DM does finer grained retry [#3860](https://github.com/pingcap/tiflow/pull/3860) - - Fix mounter default date value not support [#3859](https://github.com/pingcap/tiflow/pull/3859) - - Add an alert rule when ticdc has no owner for more than 10 minutes. [#3832](https://github.com/pingcap/tiflow/pull/3832) - - Reduce log "synchronize is taking too long, report a bug" in some cases. [#3795](https://github.com/pingcap/tiflow/pull/3795) - - Fix the problem that old value is not forced on automatically in `canal-json` and `maxwell` protocols [#3783](https://github.com/pingcap/tiflow/pull/3783) + - Fix the issue of changefeed resuming automatically after upgrading cluster [#3473](https://github.com/pingcap/tiflow/issues/3473) + - Fix a bug of data loss when DM does finer grained retry [#3487](https://github.com/pingcap/tiflow/issues/3487) + - Fix mounter default date value not support [#3793](https://github.com/pingcap/tiflow/issues/3793) + - Add an alert rule when ticdc has no owner for more than 10 minutes. [#4054](https://github.com/pingcap/tiflow/issues/4054) + - Reduce log "synchronize is taking too long, report a bug" in some cases. [#2706](https://github.com/pingcap/tiflow/issues/2706) + - Fix the problem that old value is not forced on automatically in `canal-json` and `maxwell` protocols [#3676](https://github.com/pingcap/tiflow/issues/3676) - `None`. [#3765](https://github.com/pingcap/tiflow/pull/3765) - `None`. [#3712](https://github.com/pingcap/tiflow/pull/3712) - Please add a release note. -fix kvclient takes too long time to recover [#3663](https://github.com/pingcap/tiflow/pull/3663) - - The Avro sink was updated to handle JSON columns [#3649](https://github.com/pingcap/tiflow/pull/3649) +fix kvclient takes too long time to recover [#3191](https://github.com/pingcap/tiflow/issues/3191) + - The Avro sink was updated to handle JSON columns [#3624](https://github.com/pingcap/tiflow/issues/3624) - Fix cli don't work when cli cert's common name was not added in config that use for start cdc server. [#3628](https://github.com/pingcap/tiflow/pull/3628) - - fix changefeed checkpoint lag negative value error [#3536](https://github.com/pingcap/tiflow/pull/3536) - - Fix HTTP API not working when there are TiCDC nodes of different versions in one cdc cluster. [#3530](https://github.com/pingcap/tiflow/pull/3530) - - Fix a bug when too often query status is called in Load unit, DM-worker may encounter data race or panic [#3468](https://github.com/pingcap/tiflow/pull/3468) + - fix changefeed checkpoint lag negative value error [#3010](https://github.com/pingcap/tiflow/issues/3010) + - Fix HTTP API not working when there are TiCDC nodes of different versions in one cdc cluster. [#3483](https://github.com/pingcap/tiflow/issues/3483) + - Fix a bug when too often query status is called in Load unit, DM-worker may encounter data race or panic [#3457](https://github.com/pingcap/tiflow/issues/3457) - Fix OOM in container environments. [#3439](https://github.com/pingcap/tiflow/pull/3439) - - Please add a release note. If you don't think this PR needs a release note then fill it with `None`. [#3389](https://github.com/pingcap/tiflow/pull/3389) + - Please add a release note. If you don't think this PR needs a release note then fill it with `None`. [#3868](https://github.com/pingcap/tiflow/pull/3868) - Please add a release note. If you don't think this PR needs a release note then fill it with `None`. [#3256](https://github.com/pingcap/tiflow/pull/3256) ## Bug Fixes + TiDB - - planner: fix wrong range calculation for Nulleq function on Enum values [#32495](https://github.com/pingcap/tidb/pull/32495) - - Fix the bug that indexHashJoin may return the error `send on closed channel`. [#31448](https://github.com/pingcap/tidb/pull/31448) - - Fix the bug that lightning will skip some precheck items when restart [#31183](https://github.com/pingcap/tidb/pull/31183) - - Fix the error that if tidb-lightning doesn't has permission to access mysql.tidb, it will generate kv with wrong format. [#31152](https://github.com/pingcap/tidb/pull/31152) - - Fix concurrent column type changes(with changing data) that cause schema and data inconsistencies. [#31071](https://github.com/pingcap/tidb/pull/31071) - - Add a new config to control whether support incremental import. [#30926](https://github.com/pingcap/tidb/pull/30926) - - executor: fix pipelined window invalid memory address [#30460](https://github.com/pingcap/tidb/pull/30460) - - Fix the problem that window function may return different results when using transaction or not. [#30392](https://github.com/pingcap/tidb/pull/30392) - - Fix wrong flen for CastAsString funtion [#30058](https://github.com/pingcap/tidb/pull/30058) - - expression: Fix the issue that length information is wrong when converting Decimal to String [#30016](https://github.com/pingcap/tidb/pull/30016) + - planner: fix wrong range calculation for Nulleq function on Enum values [#32428](https://github.com/pingcap/tidb/issues/32428) + - Fix the bug that indexHashJoin may return the error `send on closed channel`. [#31129](https://github.com/pingcap/tidb/issues/31129) + - Fix the bug that lightning will skip some precheck items when restart [#30772](https://github.com/pingcap/tidb/issues/30772) + - Fix the error that if tidb-lightning doesn't has permission to access mysql.tidb, it will generate kv with wrong format. [#31088](https://github.com/pingcap/tidb/issues/31088) + - Fix concurrent column type changes(with changing data) that cause schema and data inconsistencies. [#31048](https://github.com/pingcap/tidb/issues/31048) + - Add a new config to control whether support incremental import. [#27919](https://github.com/pingcap/tidb/issues/27919) + - executor: fix pipelined window invalid memory address [#30326](https://github.com/pingcap/tidb/issues/30326) + - Fix the problem that window function may return different results when using transaction or not. [#29947](https://github.com/pingcap/tidb/issues/29947) + - Fix wrong flen for CastAsString funtion [#29513](https://github.com/pingcap/tidb/issues/29513) + - expression: Fix the issue that length information is wrong when converting Decimal to String [#29417](https://github.com/pingcap/tidb/issues/29417) + PingCAP/TiFlash @@ -212,6 +212,6 @@ fix kvclient takes too long time to recover [#3663](https://github.com/pingcap/t + PD - - Fix the bug that the region scatterer may generate the schedule with too few peers. [#4577](https://github.com/tikv/pd/pull/4577) - - Fix incomplete replicate file [#4394](https://github.com/tikv/pd/pull/4394) - - Fix panic issue after TiKV node scales in [#4382](https://github.com/tikv/pd/pull/4382) + - Fix the bug that the region scatterer may generate the schedule with too few peers. [#4565](https://github.com/tikv/pd/issues/4565) + - Fix incomplete replicate file [#4328](https://github.com/tikv/pd/issues/4328) + - Fix panic issue after TiKV node scales in [#4344](https://github.com/tikv/pd/issues/4344) From 71226456f7b3beb38144b774798a701f0ec67931 Mon Sep 17 00:00:00 2001 From: xixirangrang <35301108+hfxsd@users.noreply.github.com> Date: Thu, 24 Feb 2022 20:28:08 +0800 Subject: [PATCH 07/58] Update release-5.3.1.md --- releases/release-5.3.1.md | 42 +++++++++++++++++++-------------------- 1 file changed, 20 insertions(+), 22 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 61cced9bf01e8..d7f40a20737f5 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -46,7 +46,7 @@ Tools - Fix a bug that turning on tidb_restricted_read_only won't automatically turn on tidb_super_read_only [#31745](https://github.com/pingcap/tidb/issues/31745) - Fix greatest and least function with collation get wrong result [#31789](https://github.com/pingcap/tidb/issues/31789) - Fix the crash or error when generating an empty mpp task list. [#31636](https://github.com/pingcap/tidb/issues/31636) - - ```release-note [#31667](https://github.com/pingcap/tidb/pull/31667) + - release-note [#31667](https://github.com/pingcap/tidb/pull/31667) - Fix index join bug caused by innerWorker panic [#31494](https://github.com/pingcap/tidb/issues/31494) - Fix double column value are different with MySQL after changing column type from float to double [#31372](https://github.com/pingcap/tidb/issues/31372) - Planner: make queries with the extra column `_tidb_rowid` can use PointGet [#31543](https://github.com/pingcap/tidb/issues/31543) @@ -72,7 +72,7 @@ Tools - Fix a potential panic (#11746) when snapshot files have been deleted but the peer's status is still Applying. [#11746](https://github.com/tikv/tikv/issues/11746) - Fix potential high latency caused by destroying a peer [#10210](https://github.com/tikv/tikv/issues/10210) - Fix possible QPS drop when `level0_slowdown_trigger` is set explicitly with flow control enabled. [#11424](https://github.com/tikv/tikv/issues/11424) - - ```release-note [#11805](https://github.com/tikv/tikv/pull/11805) + - release-note [#11805](https://github.com/tikv/tikv/pull/11805) - Fix wrong `any_value` result when there are regions returning empty result [#11735](https://github.com/tikv/tikv/issues/11735) - Update procfs to 0.12.0 [#11702](https://github.com/tikv/tikv/issues/11702) - Fix the problem that destroying an uninitialized replica may cause a stalled replica be created again. [#10533](https://github.com/tikv/tikv/issues/10533) @@ -86,14 +86,14 @@ Tools - Fix panic in rare conditions when merge, conf change and snapshot happen at the same time [#11475](https://github.com/tikv/tikv/issues/11475) - Fix the issue that reverse scan can't detect memory locks and may read stale data. [#11440](https://github.com/tikv/tikv/issues/11440) - Do not panic when RocksDB flush or compaction hits disk capacity [#11224](https://github.com/tikv/tikv/issues/11224) - - make tikv-ctl detect raft db correctly [#11393](https://github.com/tikv/tikv/issues/11393) + - Make tikv-ctl detect raft db correctly [#11393](https://github.com/tikv/tikv/issues/11393) - Fix incorrect by-instance gRPC average duration. [#11299](https://github.com/tikv/tikv/issues/11299) + PingCAP/TiFlash - - fix error result for function `in` [#4076](https://github.com/pingcap/tics/pull/4076) + - Fix error result for function `in` [#4076](https://github.com/pingcap/tics/pull/4076) - Fix cast to decimal overflow bug [#4073](https://github.com/pingcap/tics/pull/4073) - - fix date format identifies '\n' as invalid separator [#4059](https://github.com/pingcap/tics/pull/4059) + - Fix date format identifies '\n' as invalid separator [#4059](https://github.com/pingcap/tics/pull/4059) - Fix cannot find column error after add column when remote read was triggered in tiflash [#4027](https://github.com/pingcap/tics/pull/4027) - Fix str_to_date() function incorrectly handles leading zeros when parsing Microseconds [#3936](https://github.com/pingcap/tics/pull/3936) - Fix the problem of TiFlash crashing when the memory limit is enabled [#3918](https://github.com/pingcap/tics/pull/3918) @@ -108,16 +108,16 @@ Tools + PD - None. [#4663](https://github.com/tikv/pd/pull/4663) - - - fix a bug that operate steps may contain unnecessary or empty JointConsensus steps in certain conditions -- fix a bug when demoting single voter directly [#4362](https://github.com/tikv/pd/issues/4362) - - fix the problem that the hot cache cannot be emptied when the interval is less than 60 [#4390](https://github.com/tikv/pd/issues/4390) + - Fix a bug that operate steps may contain unnecessary or empty JointConsensus steps in certain conditions + - Fix a bug when demoting single voter directly [#4362](https://github.com/tikv/pd/issues/4362) + - Fix the problem that the hot cache cannot be emptied when the interval is less than 60 [#4390](https://github.com/tikv/pd/issues/4390) - Improve DR_STATE file content format [#4341](https://github.com/tikv/pd/issues/4341) - Fix data race when updating replication mode configuration [#4325](https://github.com/tikv/pd/issues/4325) - Fix the issue that the RLock is not released [#4354](https://github.com/tikv/pd/issues/4354) + Tools - + PingCAP/TiCDC + + TiCDC - `None`. [#4660](https://github.com/pingcap/tiflow/issues/4660) - Support more data types with default value attribute, and fix potential data inconsistency caused by default value logic [#3793](https://github.com/pingcap/tiflow/issues/3793) @@ -127,7 +127,7 @@ Tools - `None`. [#4588](https://github.com/pingcap/tiflow/issues/4588) - `None`. [#4561](https://github.com/pingcap/tiflow/issues/4561) - Fix a bug that owner exits abnormally when PD leader is killed [#4248](https://github.com/pingcap/tiflow/issues/4248) - - allow user set the configuration of Kafka producer dial/write/read timeout [#4385](https://github.com/pingcap/tiflow/issues/4385) + - Allow user set the configuration of Kafka producer dial/write/read timeout [#4385](https://github.com/pingcap/tiflow/issues/4385) - Fix a bug that MySQL sink will generate duplicated replace SQL if `batch-replace-enable` is disabled. [#4501](https://github.com/pingcap/tiflow/issues/4501) - `None`. [#4128](https://github.com/pingcap/tiflow/issues/4128) - `None`. [#4404](https://github.com/pingcap/tiflow/issues/4404) @@ -150,7 +150,7 @@ Tools - `None`. [#4163](https://github.com/pingcap/tiflow/pull/4163) - `None`. [#3337](https://github.com/pingcap/tiflow/issues/3337) - Fix a bug that stop-task during load phase will cause the source always tries to transfer to a worker [#3771](https://github.com/pingcap/tiflow/issues/3771) - - `fix a bug that wrong progress in query-status for loader`. [#3252](https://github.com/pingcap/tiflow/issues/3252) + - Fix a bug that wrong progress in query-status for loader [#3252](https://github.com/pingcap/tiflow/issues/3252) - Fix the bug that http API panic when the processor info we want to get is not exist. [#3840](https://github.com/pingcap/tiflow/issues/3840) - Reduce "EventFeed retry rate limited" logs [#4006](https://github.com/pingcap/tiflow/issues/4006) - Fix a bug that can cause changefeed stuck due to a deadlock occurs. [#4055](https://github.com/pingcap/tiflow/issues/4055) @@ -162,16 +162,15 @@ Tools - Fix a bug that DM-worker can't boot up after restart [#3344](https://github.com/pingcap/tiflow/issues/3344) - Fix a bug that DM task will failed when PARTITION DDL cost a long time [#3854](https://github.com/pingcap/tiflow/issues/3854) - Fix syntax error if DDL has a special comment. [#3755](https://github.com/pingcap/tiflow/issues/3755) - - ```release-note [#3976](https://github.com/pingcap/tiflow/pull/3976) + - release-note [#3976](https://github.com/pingcap/tiflow/pull/3976) - Fix the owner may be blocked when initializing the changefeed caused by a bad network connection to the sink [#3352](https://github.com/pingcap/tiflow/issues/3352) - `None` [#3953](https://github.com/pingcap/tiflow/pull/3953) - - fix a bug that DM may report "invalid sequence" when upstream is MySQL 8.0 -fix a bug that upstream will die on SHOW SLAVE HOSTS [#3847](https://github.com/pingcap/tiflow/issues/3847) + - Fix a bug that DM may report "invalid sequence" when upstream is MySQL 8.0. Fix a bug that upstream will die on SHOW SLAVE HOSTS [#3847](https://github.com/pingcap/tiflow/issues/3847) - Fix a bug that redo logs are not cleaned up when removing a paused changefeed. [#3919](https://github.com/pingcap/tiflow/pull/3919) - Fix timezone related error that cause cdc server can't run in some RHEL release version (6.8, 6.9 etc). [#3584](https://github.com/pingcap/tiflow/issues/3584) - Fix cli don't work when cli cert's common name was not added in config that use for start cdc server. [#3882](https://github.com/pingcap/tiflow/pull/3882) - - add pre clean up process when s3 enable, fix #3523 [#3878](https://github.com/pingcap/tiflow/pull/3878) - - add redo log related metric [#3877](https://github.com/pingcap/tiflow/pull/3877) + - Add pre clean up process when s3 enable, fix #3523 [#3878](https://github.com/pingcap/tiflow/pull/3878) + - Add redo log related metric [#3877](https://github.com/pingcap/tiflow/pull/3877) - Fix the issue of changefeed resuming automatically after upgrading cluster [#3473](https://github.com/pingcap/tiflow/issues/3473) - Fix a bug of data loss when DM does finer grained retry [#3487](https://github.com/pingcap/tiflow/issues/3487) - Fix mounter default date value not support [#3793](https://github.com/pingcap/tiflow/issues/3793) @@ -180,11 +179,10 @@ fix a bug that upstream will die on SHOW SLAVE HOSTS [#3847](https://github.com/ - Fix the problem that old value is not forced on automatically in `canal-json` and `maxwell` protocols [#3676](https://github.com/pingcap/tiflow/issues/3676) - `None`. [#3765](https://github.com/pingcap/tiflow/pull/3765) - `None`. [#3712](https://github.com/pingcap/tiflow/pull/3712) - - Please add a release note. -fix kvclient takes too long time to recover [#3191](https://github.com/pingcap/tiflow/issues/3191) + - Please add a release note. Fix kvclient takes too long time to recover [#3191](https://github.com/pingcap/tiflow/issues/3191) - The Avro sink was updated to handle JSON columns [#3624](https://github.com/pingcap/tiflow/issues/3624) - Fix cli don't work when cli cert's common name was not added in config that use for start cdc server. [#3628](https://github.com/pingcap/tiflow/pull/3628) - - fix changefeed checkpoint lag negative value error [#3010](https://github.com/pingcap/tiflow/issues/3010) + - Fix changefeed checkpoint lag negative value error [#3010](https://github.com/pingcap/tiflow/issues/3010) - Fix HTTP API not working when there are TiCDC nodes of different versions in one cdc cluster. [#3483](https://github.com/pingcap/tiflow/issues/3483) - Fix a bug when too often query status is called in Load unit, DM-worker may encounter data race or panic [#3457](https://github.com/pingcap/tiflow/issues/3457) - Fix OOM in container environments. [#3439](https://github.com/pingcap/tiflow/pull/3439) @@ -195,16 +193,16 @@ fix kvclient takes too long time to recover [#3191](https://github.com/pingcap/t + TiDB - - planner: fix wrong range calculation for Nulleq function on Enum values [#32428](https://github.com/pingcap/tidb/issues/32428) + - Planner: fix wrong range calculation for Nulleq function on Enum values [#32428](https://github.com/pingcap/tidb/issues/32428) - Fix the bug that indexHashJoin may return the error `send on closed channel`. [#31129](https://github.com/pingcap/tidb/issues/31129) - Fix the bug that lightning will skip some precheck items when restart [#30772](https://github.com/pingcap/tidb/issues/30772) - Fix the error that if tidb-lightning doesn't has permission to access mysql.tidb, it will generate kv with wrong format. [#31088](https://github.com/pingcap/tidb/issues/31088) - Fix concurrent column type changes(with changing data) that cause schema and data inconsistencies. [#31048](https://github.com/pingcap/tidb/issues/31048) - Add a new config to control whether support incremental import. [#27919](https://github.com/pingcap/tidb/issues/27919) - - executor: fix pipelined window invalid memory address [#30326](https://github.com/pingcap/tidb/issues/30326) + - Executor: fix pipelined window invalid memory address [#30326](https://github.com/pingcap/tidb/issues/30326) - Fix the problem that window function may return different results when using transaction or not. [#29947](https://github.com/pingcap/tidb/issues/29947) - Fix wrong flen for CastAsString funtion [#29513](https://github.com/pingcap/tidb/issues/29513) - - expression: Fix the issue that length information is wrong when converting Decimal to String [#29417](https://github.com/pingcap/tidb/issues/29417) + - Expression: Fix the issue that length information is wrong when converting Decimal to String [#29417](https://github.com/pingcap/tidb/issues/29417) + PingCAP/TiFlash From 263e12181cad0ec7a408d807bceb221ac1337376 Mon Sep 17 00:00:00 2001 From: xixirangrang <35301108+hfxsd@users.noreply.github.com> Date: Thu, 24 Feb 2022 20:30:24 +0800 Subject: [PATCH 08/58] Update release-5.3.1.md --- releases/release-5.3.1.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index d7f40a20737f5..5ec4acaba0667 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -89,7 +89,7 @@ Tools - Make tikv-ctl detect raft db correctly [#11393](https://github.com/tikv/tikv/issues/11393) - Fix incorrect by-instance gRPC average duration. [#11299](https://github.com/tikv/tikv/issues/11299) -+ PingCAP/TiFlash ++ TiFlash - Fix error result for function `in` [#4076](https://github.com/pingcap/tics/pull/4076) - Fix cast to decimal overflow bug [#4073](https://github.com/pingcap/tics/pull/4073) @@ -204,7 +204,7 @@ Tools - Fix wrong flen for CastAsString funtion [#29513](https://github.com/pingcap/tidb/issues/29513) - Expression: Fix the issue that length information is wrong when converting Decimal to String [#29417](https://github.com/pingcap/tidb/issues/29417) -+ PingCAP/TiFlash ++ TiFlash - Align unix_timestamp behavior with TiDB and mysql when input is earlier than 1970-01-01 00:00:01 UTC [#3625](https://github.com/pingcap/tics/pull/3625) From c6f8c49b4f8c855571d6e27d9c9c4766294ee7e9 Mon Sep 17 00:00:00 2001 From: qiancai Date: Thu, 24 Feb 2022 23:42:26 +0800 Subject: [PATCH 09/58] update_duplicated_notes --- releases/release-5.3.1.md | 102 +++++++++++++++++++------------------- 1 file changed, 51 insertions(+), 51 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 61cced9bf01e8..77c674b829d4c 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -51,13 +51,13 @@ Tools - Fix double column value are different with MySQL after changing column type from float to double [#31372](https://github.com/pingcap/tidb/issues/31372) - Planner: make queries with the extra column `_tidb_rowid` can use PointGet [#31543](https://github.com/pingcap/tidb/issues/31543) - Fix a data race that may cause "invalid transaction" error when executing a query using index lookup join. [#30468](https://github.com/pingcap/tidb/issues/30468) - - Fix a panic that may happen when using `on duplicate key update`. [#28078](https://github.com/pingcap/tidb/issues/28078) + (dup) - Fix the issue that executing the `INSERT ... SELECT ... ON DUPLICATE KEY UPDATE` statement gets panic [#28078](https://github.com/pingcap/tidb/issues/28078) - Fix the bug that lighting return error if gcs url starts with gs:// [#32591](https://github.com/pingcap/tidb/issues/32591) - [#30999](https://github.com/pingcap/tidb/pull/30999) - Fix a bug that the `mysql_stmt_field_count` returned to mysql client is incorrect in prepare protocal when handling union statement. [#30971](https://github.com/pingcap/tidb/issues/30971) - Make tidb-lightning pre-check output message clearer [#30395](https://github.com/pingcap/tidb/issues/30395) - Avoid tikv trigger auto region split by lower the ingest kv count threshold [#30018](https://github.com/pingcap/tidb/issues/30018) - - Fix the but that lightning doesn't report error if s3 storage path not exist. [#28031](https://github.com/pingcap/tidb/issues/28031) + (dup) - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist [#28031](https://github.com/pingcap/tidb/issues/28031) [#30709](https://github.com/pingcap/tidb/issues/30709) - planner: regard NULL as point when accessing composite index [#29650](https://github.com/pingcap/tidb/issues/29650) - Fix a bug when reducing order by clause for the index which leads to the wrong result. [#30271](https://github.com/pingcap/tidb/issues/30271) - The TiDB server now maps a user to an entry in the mysql.user table more consistently. [#30450](https://github.com/pingcap/tidb/pull/30450) @@ -68,26 +68,26 @@ Tools - Reduce CDC recovery time by reduce the number regions that need resolved lock. [#11993](https://github.com/tikv/tikv/issues/11993) - Increase the size of write batch for raftlog GC to speed up GC. [#11404](https://github.com/tikv/tikv/issues/11404) - - Fix the bug that unsafe_destroy_range does not get executed when GC worker is busy [#11903](https://github.com/tikv/tikv/issues/11903) + (dup) - Fix a bug that TiKV cannot delete a range of data (`unsafe_destroy_range` cannot be executed) when the GC worker is busy [#11903](https://github.com/tikv/tikv/issues/11903) - Fix a potential panic (#11746) when snapshot files have been deleted but the peer's status is still Applying. [#11746](https://github.com/tikv/tikv/issues/11746) - - Fix potential high latency caused by destroying a peer [#10210](https://github.com/tikv/tikv/issues/10210) + (dup) - Fix the issue that destroying a peer might cause high latency [#10210](https://github.com/tikv/tikv/issues/10210) - Fix possible QPS drop when `level0_slowdown_trigger` is set explicitly with flow control enabled. [#11424](https://github.com/tikv/tikv/issues/11424) - ```release-note [#11805](https://github.com/tikv/tikv/pull/11805) - - Fix wrong `any_value` result when there are regions returning empty result [#11735](https://github.com/tikv/tikv/issues/11735) - - Update procfs to 0.12.0 [#11702](https://github.com/tikv/tikv/issues/11702) - - Fix the problem that destroying an uninitialized replica may cause a stalled replica be created again. [#10533](https://github.com/tikv/tikv/issues/10533) + (dup) - Fix a bug that the `any_value` function returns a wrong result when regions are empty [#11735](https://github.com/tikv/tikv/issues/11735) + (dup) - Update the proc filesystem (procfs) to v0.12.0 [#11702](https://github.com/tikv/tikv/issues/11702) + (dup) - Fix the issue that deleting an uninitialized replica might cause an old replica to be recreated [#10533](https://github.com/tikv/tikv/issues/10533) - Please add a release note.None [#11632](https://github.com/tikv/tikv/pull/11632) - Please add a release note. [#11616](https://github.com/tikv/tikv/pull/11616) - Fix panic when cgroup controller is not mounted [#11569](https://github.com/tikv/tikv/issues/11569) - - Fix metadata corruption in an unlikely condition that prepare merge is triggered after new election without informing an isolated peer [#11526](https://github.com/tikv/tikv/issues/11526) - - Fix deadlock in some rare cases that futures get resolved too fast [#11549](https://github.com/tikv/tikv/issues/11549) - - Fix resolved ts lag increased after stoping a tikv [#11351](https://github.com/tikv/tikv/issues/11351) - - Fix connection abort when too many raft entries are batched into one messages [#9714](https://github.com/tikv/tikv/issues/9714) - - Fix panic in rare conditions when merge, conf change and snapshot happen at the same time [#11475](https://github.com/tikv/tikv/issues/11475) - - Fix the issue that reverse scan can't detect memory locks and may read stale data. [#11440](https://github.com/tikv/tikv/issues/11440) - - Do not panic when RocksDB flush or compaction hits disk capacity [#11224](https://github.com/tikv/tikv/issues/11224) - - make tikv-ctl detect raft db correctly [#11393](https://github.com/tikv/tikv/issues/11393) - - Fix incorrect by-instance gRPC average duration. [#11299](https://github.com/tikv/tikv/issues/11299) + (dup) - Fix the metadata corruption issue when `Prepare Merge` is triggered after a new election is finished but the isolated peer is not informed [#11526](https://github.com/tikv/tikv/issues/11526) + (dup) - Fix the deadlock issue that happens occasionally when coroutines run too fast [#11549](https://github.com/tikv/tikv/issues/11549) + (dup) - Fix the issue that a down TiKV node causes the resolved timestamp to lag [#11351](https://github.com/tikv/tikv/issues/11351) + (dup) - Fix the issue that batch messages are too large in Raft client implementation [#9714](https://github.com/tikv/tikv/issues/9714) + (dup) - Fix a panic issue that occurs when Region merge, ConfChange, and Snapshot happen at the same time in extreme conditions [#11475](https://github.com/tikv/tikv/issues/11475) + (dup) - Fix the issue that TiKV cannot detect the memory lock when TiKV perform a reverse table scan [#11440](https://github.com/tikv/tikv/issues/11440) + (dup) - Fix the issue that RocksDB flush or compaction causes panic when the disk capacity is full [#11224](https://github.com/tikv/tikv/issues/11224) + (dup) - Fix a bug that tikv-ctl cannot return the correct Region-related information [#11393](https://github.com/tikv/tikv/issues/11393) + (dup) - Fix the issue that the average latency of the by-instance gRPC requests is inaccurate in TiKV metrics [#11299](https://github.com/tikv/tikv/issues/11299) + PingCAP/TiFlash @@ -110,7 +110,7 @@ Tools - None. [#4663](https://github.com/tikv/pd/pull/4663) - - fix a bug that operate steps may contain unnecessary or empty JointConsensus steps in certain conditions - fix a bug when demoting single voter directly [#4362](https://github.com/tikv/pd/issues/4362) - - fix the problem that the hot cache cannot be emptied when the interval is less than 60 [#4390](https://github.com/tikv/pd/issues/4390) + (dup) - Fix the issue that the cold hotspot data cannot be deleted from the hotspot statistics [#4390](https://github.com/tikv/pd/issues/4390) - Improve DR_STATE file content format [#4341](https://github.com/tikv/pd/issues/4341) - Fix data race when updating replication mode configuration [#4325](https://github.com/tikv/pd/issues/4325) - Fix the issue that the RLock is not released [#4354](https://github.com/tikv/pd/issues/4354) @@ -120,7 +120,7 @@ Tools + PingCAP/TiCDC - `None`. [#4660](https://github.com/pingcap/tiflow/issues/4660) - - Support more data types with default value attribute, and fix potential data inconsistency caused by default value logic [#3793](https://github.com/pingcap/tiflow/issues/3793) + (dup) - Fix the issue that default values cannot be replicated [#3793](https://github.com/pingcap/tiflow/issues/3793) - Fix a bug that long varchar will report error of "Column length too big..." [#4637](https://github.com/pingcap/tiflow/issues/4637) - `None`. [#4385](https://github.com/pingcap/tiflow/issues/4385) - `None`. [#4607](https://github.com/pingcap/tiflow/issues/4607) @@ -128,63 +128,63 @@ Tools - `None`. [#4561](https://github.com/pingcap/tiflow/issues/4561) - Fix a bug that owner exits abnormally when PD leader is killed [#4248](https://github.com/pingcap/tiflow/issues/4248) - allow user set the configuration of Kafka producer dial/write/read timeout [#4385](https://github.com/pingcap/tiflow/issues/4385) - - Fix a bug that MySQL sink will generate duplicated replace SQL if `batch-replace-enable` is disabled. [#4501](https://github.com/pingcap/tiflow/issues/4501) + (dup) - Fix a bug that MySQL sink generates duplicated `replace` SQL statements if `batch-replace-enable` is disabled [#4501](https://github.com/pingcap/tiflow/issues/4501) - `None`. [#4128](https://github.com/pingcap/tiflow/issues/4128) - `None`. [#4404](https://github.com/pingcap/tiflow/issues/4404) - Fix the issue that update statement execute error in safemode may cause DM-worker panic. [#4317](https://github.com/pingcap/tiflow/issues/4317) - None. [#4353](https://github.com/pingcap/tiflow/issues/4353) - `None`. [#4159](https://github.com/pingcap/tiflow/issues/4159) - `None`. [#4135](https://github.com/pingcap/tiflow/issues/4135) - - Add exponential backoff mechanism for restarting a changefeed. [#3329](https://github.com/pingcap/tiflow/issues/3329) - - Fix a bug that upstream metrics won't update if no query-status [#4281](https://github.com/pingcap/tiflow/issues/4281) - - `None`. [#3431](https://github.com/pingcap/tiflow/issues/3431) + (dup) - Add the exponential backoff mechanism for restarting a changefeed. [#3329](https://github.com/pingcap/tiflow/issues/3329) + (dup) - Fix the issue that syncer metrics are updated only when querying the status [#4281](https://github.com/pingcap/tiflow/issues/4281) + (dup) - Fix the issue that `mq sink write row` does not have monitoring data [#3431](https://github.com/pingcap/tiflow/issues/3431) - Fix kv client cached region metric could be negative. [#4290](https://github.com/pingcap/tiflow/pull/4290) - `None` [#4266](https://github.com/pingcap/tiflow/issues/4266) - `None`. [#4223](https://github.com/pingcap/tiflow/issues/4223) - - Fix the problem that TiCDC cannot send messages when `min.insync.replicas` is less than `replication-factor` [#3994](https://github.com/pingcap/tiflow/issues/3994) + (dup) - Fix the issue that replication cannot be performed when `min.insync.replicas` is smaller than `replication-factor` [#3994](https://github.com/pingcap/tiflow/issues/3994) - `None`. [#4159](https://github.com/pingcap/tiflow/issues/4159) - - `None`. [#4173](https://github.com/pingcap/tiflow/issues/4173) - - Support updating table schema when using dmctl binlog to skip some ddls [#4177](https://github.com/pingcap/tiflow/issues/4177) - - `None`. [#3431](https://github.com/pingcap/tiflow/issues/3431) - - Fix the potential panic issue that occurs when changefeed info is removed from etcd. [#3128](https://github.com/pingcap/tiflow/issues/3128) + (dup) - Fix the issue that the `CREATE VIEW` statement interrupts data replication [#4173](https://github.com/pingcap/tiflow/issues/4173) + (dup) - Fix the issue the schema needs to be reset after a DDL statement is skipped [#4177](https://github.com/pingcap/tiflow/issues/4177) + (dup) - Fix the issue that `mq sink write row` does not have monitoring data [#3431](https://github.com/pingcap/tiflow/issues/3431) + (dup) - Fix the potential panic issue that occurs when a replication task is removed [#3128](https://github.com/pingcap/tiflow/issues/3128) - `None`. [#4163](https://github.com/pingcap/tiflow/pull/4163) - - `None`. [#3337](https://github.com/pingcap/tiflow/issues/3337) + (dup) - Change the default value of Kafka Sink `partition-num` to 3 so that TiCDC distributes messages across Kafka partitions more evenly [#3337](https://github.com/pingcap/tiflow/issues/3337) - Fix a bug that stop-task during load phase will cause the source always tries to transfer to a worker [#3771](https://github.com/pingcap/tiflow/issues/3771) - `fix a bug that wrong progress in query-status for loader`. [#3252](https://github.com/pingcap/tiflow/issues/3252) - Fix the bug that http API panic when the processor info we want to get is not exist. [#3840](https://github.com/pingcap/tiflow/issues/3840) - - Reduce "EventFeed retry rate limited" logs [#4006](https://github.com/pingcap/tiflow/issues/4006) - - Fix a bug that can cause changefeed stuck due to a deadlock occurs. [#4055](https://github.com/pingcap/tiflow/issues/4055) + (dup) - Reduce the count of "EventFeed retry rate limited" logs [#4006](https://github.com/pingcap/tiflow/issues/4006) + (dup) - Fix the potential issue that the deadlock causes a replication task to get stuck [#4055](https://github.com/pingcap/tiflow/issues/4055) - Manage sink checkpoint per table to avoid checkpointTs advances unexpected. [#4083](https://github.com/pingcap/tiflow/pull/4083) - `None`. [#4079](https://github.com/pingcap/tiflow/pull/4079) - - Set `max-message-bytes` default to 10M, and use the min value with topic and broker to initialize the producer. [#4041](https://github.com/pingcap/tiflow/issues/4041) - - Fix nil pointer panic encountered when scheduler cleanup finished operations [#2980](https://github.com/pingcap/tiflow/issues/2980) + (dup) - Set the default value of `max-message-bytes` to 10M [#4041](https://github.com/pingcap/tiflow/issues/4041) + (dup) - Fix the TiCDC panic issue that occurs when manually cleaning the task status in etcd [#2980](https://github.com/pingcap/tiflow/issues/2980) - Fix a bug that when master and worker restart in a particular order, relay status in DM-master is wrong [#3478](https://github.com/pingcap/tiflow/issues/3478) - Fix a bug that DM-worker can't boot up after restart [#3344](https://github.com/pingcap/tiflow/issues/3344) - Fix a bug that DM task will failed when PARTITION DDL cost a long time [#3854](https://github.com/pingcap/tiflow/issues/3854) - - Fix syntax error if DDL has a special comment. [#3755](https://github.com/pingcap/tiflow/issues/3755) + (dup) - Fix the issue that special comments in DDL statements cause the replication task to stop [#3755](https://github.com/pingcap/tiflow/issues/3755) - ```release-note [#3976](https://github.com/pingcap/tiflow/pull/3976) - - Fix the owner may be blocked when initializing the changefeed caused by a bad network connection to the sink [#3352](https://github.com/pingcap/tiflow/issues/3352) + (dup) - Fix the issue of replication stop caused by the incorrect configuration of `config.Metadata.Timeout` [#3352](https://github.com/pingcap/tiflow/issues/3352) - `None` [#3953](https://github.com/pingcap/tiflow/pull/3953) - fix a bug that DM may report "invalid sequence" when upstream is MySQL 8.0 fix a bug that upstream will die on SHOW SLAVE HOSTS [#3847](https://github.com/pingcap/tiflow/issues/3847) - Fix a bug that redo logs are not cleaned up when removing a paused changefeed. [#3919](https://github.com/pingcap/tiflow/pull/3919) - - Fix timezone related error that cause cdc server can't run in some RHEL release version (6.8, 6.9 etc). [#3584](https://github.com/pingcap/tiflow/issues/3584) + (dup) - Fix the issue that the service cannot be started because of a timezone issue in the RHEL release [#3584](https://github.com/pingcap/tiflow/issues/3584) - Fix cli don't work when cli cert's common name was not added in config that use for start cdc server. [#3882](https://github.com/pingcap/tiflow/pull/3882) - add pre clean up process when s3 enable, fix #3523 [#3878](https://github.com/pingcap/tiflow/pull/3878) - add redo log related metric [#3877](https://github.com/pingcap/tiflow/pull/3877) - - Fix the issue of changefeed resuming automatically after upgrading cluster [#3473](https://github.com/pingcap/tiflow/issues/3473) + (dup) - Fix the issue that `stopped` changefeeds resume automatically after a cluster upgrade [#3473](https://github.com/pingcap/tiflow/issues/3473) - Fix a bug of data loss when DM does finer grained retry [#3487](https://github.com/pingcap/tiflow/issues/3487) - - Fix mounter default date value not support [#3793](https://github.com/pingcap/tiflow/issues/3793) - - Add an alert rule when ticdc has no owner for more than 10 minutes. [#4054](https://github.com/pingcap/tiflow/issues/4054) - - Reduce log "synchronize is taking too long, report a bug" in some cases. [#2706](https://github.com/pingcap/tiflow/issues/2706) - - Fix the problem that old value is not forced on automatically in `canal-json` and `maxwell` protocols [#3676](https://github.com/pingcap/tiflow/issues/3676) + (dup) - Fix the issue that default values cannot be replicated [#3793](https://github.com/pingcap/tiflow/issues/3793) + (dup) - Add more Promethous and Grafana monitoring metrics and alerts, including `no owner alert`, `mounter row`, `table sink total row`, and `buffer sink total row` [#4054](https://github.com/pingcap/tiflow/issues/4054) [#1606](https://github.com/pingcap/tiflow/issues/1606) + (dup) - Fix the issue of overly frequent warnings caused by MySQL sink deadlock [#2706](https://github.com/pingcap/tiflow/issues/2706) + (dup) - Fix the bug that the `enable-old-value` configuration item is not automatically set to `true` on Canal and Maxwell protocols [#3676](https://github.com/pingcap/tiflow/issues/3676) - `None`. [#3765](https://github.com/pingcap/tiflow/pull/3765) - `None`. [#3712](https://github.com/pingcap/tiflow/pull/3712) - Please add a release note. fix kvclient takes too long time to recover [#3191](https://github.com/pingcap/tiflow/issues/3191) - - The Avro sink was updated to handle JSON columns [#3624](https://github.com/pingcap/tiflow/issues/3624) + (dup) - Fix the issue that Avro sink does not support parsing JSON type columns [#3624](https://github.com/pingcap/tiflow/issues/3624) - Fix cli don't work when cli cert's common name was not added in config that use for start cdc server. [#3628](https://github.com/pingcap/tiflow/pull/3628) - - fix changefeed checkpoint lag negative value error [#3010](https://github.com/pingcap/tiflow/issues/3010) + (dup) - Fix the negative value error in the changefeed checkpoint lag [#3010](https://github.com/pingcap/tiflow/issues/3010) - Fix HTTP API not working when there are TiCDC nodes of different versions in one cdc cluster. [#3483](https://github.com/pingcap/tiflow/issues/3483) - Fix a bug when too often query status is called in Load unit, DM-worker may encounter data race or panic [#3457](https://github.com/pingcap/tiflow/issues/3457) - Fix OOM in container environments. [#3439](https://github.com/pingcap/tiflow/pull/3439) @@ -196,15 +196,15 @@ fix kvclient takes too long time to recover [#3191](https://github.com/pingcap/t + TiDB - planner: fix wrong range calculation for Nulleq function on Enum values [#32428](https://github.com/pingcap/tidb/issues/32428) - - Fix the bug that indexHashJoin may return the error `send on closed channel`. [#31129](https://github.com/pingcap/tidb/issues/31129) - - Fix the bug that lightning will skip some precheck items when restart [#30772](https://github.com/pingcap/tidb/issues/30772) - - Fix the error that if tidb-lightning doesn't has permission to access mysql.tidb, it will generate kv with wrong format. [#31088](https://github.com/pingcap/tidb/issues/31088) - - Fix concurrent column type changes(with changing data) that cause schema and data inconsistencies. [#31048](https://github.com/pingcap/tidb/issues/31048) + (dup) - Fix the issue that INDEX HASH JOIN returns the `send on closed channel` error [#31129](https://github.com/pingcap/tidb/issues/31129) + (dup) - Fix the issue that some checks are skipped when TiDB Lightning is restarted [#30772](https://github.com/pingcap/tidb/issues/30772) + (dup) - Fix the issue of wrong import result that occurs when TiDB Lightning does not have the privilege to access the `mysql.tidb` table [#31088](https://github.com/pingcap/tidb/issues/31088) + (dup) - Fix the issue that concurrent column type change causes inconsistency between the schema and the data [#31048](https://github.com/pingcap/tidb/issues/31048) - Add a new config to control whether support incremental import. [#27919](https://github.com/pingcap/tidb/issues/27919) - executor: fix pipelined window invalid memory address [#30326](https://github.com/pingcap/tidb/issues/30326) - - Fix the problem that window function may return different results when using transaction or not. [#29947](https://github.com/pingcap/tidb/issues/29947) - - Fix wrong flen for CastAsString funtion [#29513](https://github.com/pingcap/tidb/issues/29513) - - expression: Fix the issue that length information is wrong when converting Decimal to String [#29417](https://github.com/pingcap/tidb/issues/29417) + (dup) - Fix the issue that window functions might return different results when using a transaction or not [#29947](https://github.com/pingcap/tidb/issues/29947) + (dup) - Fix the issue that the SQL statements that contain `cast(integer as char) union string` return wrong results [#29513](https://github.com/pingcap/tidb/issues/29513) + (dup) - Fix the issue that the length information is wrong when casting `Decimal` to `String` [#29417](https://github.com/pingcap/tidb/issues/29417) + PingCAP/TiFlash @@ -212,6 +212,6 @@ fix kvclient takes too long time to recover [#3191](https://github.com/pingcap/t + PD - - Fix the bug that the region scatterer may generate the schedule with too few peers. [#4565](https://github.com/tikv/pd/issues/4565) + (dup) - Fix a bug that the schedule generated by the region scatterer might decrease the number of peers [#4565](https://github.com/tikv/pd/issues/4565) - Fix incomplete replicate file [#4328](https://github.com/tikv/pd/issues/4328) - - Fix panic issue after TiKV node scales in [#4344](https://github.com/tikv/pd/issues/4344) + (dup) - Fix a panic issue that occurs after the TiKV node is removed [#4344](https://github.com/tikv/pd/issues/4344) From af4e5b725e88b10a99e2ab0abe7da82b81bf0c2b Mon Sep 17 00:00:00 2001 From: qiancai Date: Thu, 24 Feb 2022 23:44:17 +0800 Subject: [PATCH 10/58] Revert "update_duplicated_notes" This reverts commit c6f8c49b4f8c855571d6e27d9c9c4766294ee7e9. --- releases/release-5.3.1.md | 102 +++++++++++++++++++------------------- 1 file changed, 51 insertions(+), 51 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 77c674b829d4c..61cced9bf01e8 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -51,13 +51,13 @@ Tools - Fix double column value are different with MySQL after changing column type from float to double [#31372](https://github.com/pingcap/tidb/issues/31372) - Planner: make queries with the extra column `_tidb_rowid` can use PointGet [#31543](https://github.com/pingcap/tidb/issues/31543) - Fix a data race that may cause "invalid transaction" error when executing a query using index lookup join. [#30468](https://github.com/pingcap/tidb/issues/30468) - (dup) - Fix the issue that executing the `INSERT ... SELECT ... ON DUPLICATE KEY UPDATE` statement gets panic [#28078](https://github.com/pingcap/tidb/issues/28078) + - Fix a panic that may happen when using `on duplicate key update`. [#28078](https://github.com/pingcap/tidb/issues/28078) - Fix the bug that lighting return error if gcs url starts with gs:// [#32591](https://github.com/pingcap/tidb/issues/32591) - [#30999](https://github.com/pingcap/tidb/pull/30999) - Fix a bug that the `mysql_stmt_field_count` returned to mysql client is incorrect in prepare protocal when handling union statement. [#30971](https://github.com/pingcap/tidb/issues/30971) - Make tidb-lightning pre-check output message clearer [#30395](https://github.com/pingcap/tidb/issues/30395) - Avoid tikv trigger auto region split by lower the ingest kv count threshold [#30018](https://github.com/pingcap/tidb/issues/30018) - (dup) - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist [#28031](https://github.com/pingcap/tidb/issues/28031) [#30709](https://github.com/pingcap/tidb/issues/30709) + - Fix the but that lightning doesn't report error if s3 storage path not exist. [#28031](https://github.com/pingcap/tidb/issues/28031) - planner: regard NULL as point when accessing composite index [#29650](https://github.com/pingcap/tidb/issues/29650) - Fix a bug when reducing order by clause for the index which leads to the wrong result. [#30271](https://github.com/pingcap/tidb/issues/30271) - The TiDB server now maps a user to an entry in the mysql.user table more consistently. [#30450](https://github.com/pingcap/tidb/pull/30450) @@ -68,26 +68,26 @@ Tools - Reduce CDC recovery time by reduce the number regions that need resolved lock. [#11993](https://github.com/tikv/tikv/issues/11993) - Increase the size of write batch for raftlog GC to speed up GC. [#11404](https://github.com/tikv/tikv/issues/11404) - (dup) - Fix a bug that TiKV cannot delete a range of data (`unsafe_destroy_range` cannot be executed) when the GC worker is busy [#11903](https://github.com/tikv/tikv/issues/11903) + - Fix the bug that unsafe_destroy_range does not get executed when GC worker is busy [#11903](https://github.com/tikv/tikv/issues/11903) - Fix a potential panic (#11746) when snapshot files have been deleted but the peer's status is still Applying. [#11746](https://github.com/tikv/tikv/issues/11746) - (dup) - Fix the issue that destroying a peer might cause high latency [#10210](https://github.com/tikv/tikv/issues/10210) + - Fix potential high latency caused by destroying a peer [#10210](https://github.com/tikv/tikv/issues/10210) - Fix possible QPS drop when `level0_slowdown_trigger` is set explicitly with flow control enabled. [#11424](https://github.com/tikv/tikv/issues/11424) - ```release-note [#11805](https://github.com/tikv/tikv/pull/11805) - (dup) - Fix a bug that the `any_value` function returns a wrong result when regions are empty [#11735](https://github.com/tikv/tikv/issues/11735) - (dup) - Update the proc filesystem (procfs) to v0.12.0 [#11702](https://github.com/tikv/tikv/issues/11702) - (dup) - Fix the issue that deleting an uninitialized replica might cause an old replica to be recreated [#10533](https://github.com/tikv/tikv/issues/10533) + - Fix wrong `any_value` result when there are regions returning empty result [#11735](https://github.com/tikv/tikv/issues/11735) + - Update procfs to 0.12.0 [#11702](https://github.com/tikv/tikv/issues/11702) + - Fix the problem that destroying an uninitialized replica may cause a stalled replica be created again. [#10533](https://github.com/tikv/tikv/issues/10533) - Please add a release note.None [#11632](https://github.com/tikv/tikv/pull/11632) - Please add a release note. [#11616](https://github.com/tikv/tikv/pull/11616) - Fix panic when cgroup controller is not mounted [#11569](https://github.com/tikv/tikv/issues/11569) - (dup) - Fix the metadata corruption issue when `Prepare Merge` is triggered after a new election is finished but the isolated peer is not informed [#11526](https://github.com/tikv/tikv/issues/11526) - (dup) - Fix the deadlock issue that happens occasionally when coroutines run too fast [#11549](https://github.com/tikv/tikv/issues/11549) - (dup) - Fix the issue that a down TiKV node causes the resolved timestamp to lag [#11351](https://github.com/tikv/tikv/issues/11351) - (dup) - Fix the issue that batch messages are too large in Raft client implementation [#9714](https://github.com/tikv/tikv/issues/9714) - (dup) - Fix a panic issue that occurs when Region merge, ConfChange, and Snapshot happen at the same time in extreme conditions [#11475](https://github.com/tikv/tikv/issues/11475) - (dup) - Fix the issue that TiKV cannot detect the memory lock when TiKV perform a reverse table scan [#11440](https://github.com/tikv/tikv/issues/11440) - (dup) - Fix the issue that RocksDB flush or compaction causes panic when the disk capacity is full [#11224](https://github.com/tikv/tikv/issues/11224) - (dup) - Fix a bug that tikv-ctl cannot return the correct Region-related information [#11393](https://github.com/tikv/tikv/issues/11393) - (dup) - Fix the issue that the average latency of the by-instance gRPC requests is inaccurate in TiKV metrics [#11299](https://github.com/tikv/tikv/issues/11299) + - Fix metadata corruption in an unlikely condition that prepare merge is triggered after new election without informing an isolated peer [#11526](https://github.com/tikv/tikv/issues/11526) + - Fix deadlock in some rare cases that futures get resolved too fast [#11549](https://github.com/tikv/tikv/issues/11549) + - Fix resolved ts lag increased after stoping a tikv [#11351](https://github.com/tikv/tikv/issues/11351) + - Fix connection abort when too many raft entries are batched into one messages [#9714](https://github.com/tikv/tikv/issues/9714) + - Fix panic in rare conditions when merge, conf change and snapshot happen at the same time [#11475](https://github.com/tikv/tikv/issues/11475) + - Fix the issue that reverse scan can't detect memory locks and may read stale data. [#11440](https://github.com/tikv/tikv/issues/11440) + - Do not panic when RocksDB flush or compaction hits disk capacity [#11224](https://github.com/tikv/tikv/issues/11224) + - make tikv-ctl detect raft db correctly [#11393](https://github.com/tikv/tikv/issues/11393) + - Fix incorrect by-instance gRPC average duration. [#11299](https://github.com/tikv/tikv/issues/11299) + PingCAP/TiFlash @@ -110,7 +110,7 @@ Tools - None. [#4663](https://github.com/tikv/pd/pull/4663) - - fix a bug that operate steps may contain unnecessary or empty JointConsensus steps in certain conditions - fix a bug when demoting single voter directly [#4362](https://github.com/tikv/pd/issues/4362) - (dup) - Fix the issue that the cold hotspot data cannot be deleted from the hotspot statistics [#4390](https://github.com/tikv/pd/issues/4390) + - fix the problem that the hot cache cannot be emptied when the interval is less than 60 [#4390](https://github.com/tikv/pd/issues/4390) - Improve DR_STATE file content format [#4341](https://github.com/tikv/pd/issues/4341) - Fix data race when updating replication mode configuration [#4325](https://github.com/tikv/pd/issues/4325) - Fix the issue that the RLock is not released [#4354](https://github.com/tikv/pd/issues/4354) @@ -120,7 +120,7 @@ Tools + PingCAP/TiCDC - `None`. [#4660](https://github.com/pingcap/tiflow/issues/4660) - (dup) - Fix the issue that default values cannot be replicated [#3793](https://github.com/pingcap/tiflow/issues/3793) + - Support more data types with default value attribute, and fix potential data inconsistency caused by default value logic [#3793](https://github.com/pingcap/tiflow/issues/3793) - Fix a bug that long varchar will report error of "Column length too big..." [#4637](https://github.com/pingcap/tiflow/issues/4637) - `None`. [#4385](https://github.com/pingcap/tiflow/issues/4385) - `None`. [#4607](https://github.com/pingcap/tiflow/issues/4607) @@ -128,63 +128,63 @@ Tools - `None`. [#4561](https://github.com/pingcap/tiflow/issues/4561) - Fix a bug that owner exits abnormally when PD leader is killed [#4248](https://github.com/pingcap/tiflow/issues/4248) - allow user set the configuration of Kafka producer dial/write/read timeout [#4385](https://github.com/pingcap/tiflow/issues/4385) - (dup) - Fix a bug that MySQL sink generates duplicated `replace` SQL statements if `batch-replace-enable` is disabled [#4501](https://github.com/pingcap/tiflow/issues/4501) + - Fix a bug that MySQL sink will generate duplicated replace SQL if `batch-replace-enable` is disabled. [#4501](https://github.com/pingcap/tiflow/issues/4501) - `None`. [#4128](https://github.com/pingcap/tiflow/issues/4128) - `None`. [#4404](https://github.com/pingcap/tiflow/issues/4404) - Fix the issue that update statement execute error in safemode may cause DM-worker panic. [#4317](https://github.com/pingcap/tiflow/issues/4317) - None. [#4353](https://github.com/pingcap/tiflow/issues/4353) - `None`. [#4159](https://github.com/pingcap/tiflow/issues/4159) - `None`. [#4135](https://github.com/pingcap/tiflow/issues/4135) - (dup) - Add the exponential backoff mechanism for restarting a changefeed. [#3329](https://github.com/pingcap/tiflow/issues/3329) - (dup) - Fix the issue that syncer metrics are updated only when querying the status [#4281](https://github.com/pingcap/tiflow/issues/4281) - (dup) - Fix the issue that `mq sink write row` does not have monitoring data [#3431](https://github.com/pingcap/tiflow/issues/3431) + - Add exponential backoff mechanism for restarting a changefeed. [#3329](https://github.com/pingcap/tiflow/issues/3329) + - Fix a bug that upstream metrics won't update if no query-status [#4281](https://github.com/pingcap/tiflow/issues/4281) + - `None`. [#3431](https://github.com/pingcap/tiflow/issues/3431) - Fix kv client cached region metric could be negative. [#4290](https://github.com/pingcap/tiflow/pull/4290) - `None` [#4266](https://github.com/pingcap/tiflow/issues/4266) - `None`. [#4223](https://github.com/pingcap/tiflow/issues/4223) - (dup) - Fix the issue that replication cannot be performed when `min.insync.replicas` is smaller than `replication-factor` [#3994](https://github.com/pingcap/tiflow/issues/3994) + - Fix the problem that TiCDC cannot send messages when `min.insync.replicas` is less than `replication-factor` [#3994](https://github.com/pingcap/tiflow/issues/3994) - `None`. [#4159](https://github.com/pingcap/tiflow/issues/4159) - (dup) - Fix the issue that the `CREATE VIEW` statement interrupts data replication [#4173](https://github.com/pingcap/tiflow/issues/4173) - (dup) - Fix the issue the schema needs to be reset after a DDL statement is skipped [#4177](https://github.com/pingcap/tiflow/issues/4177) - (dup) - Fix the issue that `mq sink write row` does not have monitoring data [#3431](https://github.com/pingcap/tiflow/issues/3431) - (dup) - Fix the potential panic issue that occurs when a replication task is removed [#3128](https://github.com/pingcap/tiflow/issues/3128) + - `None`. [#4173](https://github.com/pingcap/tiflow/issues/4173) + - Support updating table schema when using dmctl binlog to skip some ddls [#4177](https://github.com/pingcap/tiflow/issues/4177) + - `None`. [#3431](https://github.com/pingcap/tiflow/issues/3431) + - Fix the potential panic issue that occurs when changefeed info is removed from etcd. [#3128](https://github.com/pingcap/tiflow/issues/3128) - `None`. [#4163](https://github.com/pingcap/tiflow/pull/4163) - (dup) - Change the default value of Kafka Sink `partition-num` to 3 so that TiCDC distributes messages across Kafka partitions more evenly [#3337](https://github.com/pingcap/tiflow/issues/3337) + - `None`. [#3337](https://github.com/pingcap/tiflow/issues/3337) - Fix a bug that stop-task during load phase will cause the source always tries to transfer to a worker [#3771](https://github.com/pingcap/tiflow/issues/3771) - `fix a bug that wrong progress in query-status for loader`. [#3252](https://github.com/pingcap/tiflow/issues/3252) - Fix the bug that http API panic when the processor info we want to get is not exist. [#3840](https://github.com/pingcap/tiflow/issues/3840) - (dup) - Reduce the count of "EventFeed retry rate limited" logs [#4006](https://github.com/pingcap/tiflow/issues/4006) - (dup) - Fix the potential issue that the deadlock causes a replication task to get stuck [#4055](https://github.com/pingcap/tiflow/issues/4055) + - Reduce "EventFeed retry rate limited" logs [#4006](https://github.com/pingcap/tiflow/issues/4006) + - Fix a bug that can cause changefeed stuck due to a deadlock occurs. [#4055](https://github.com/pingcap/tiflow/issues/4055) - Manage sink checkpoint per table to avoid checkpointTs advances unexpected. [#4083](https://github.com/pingcap/tiflow/pull/4083) - `None`. [#4079](https://github.com/pingcap/tiflow/pull/4079) - (dup) - Set the default value of `max-message-bytes` to 10M [#4041](https://github.com/pingcap/tiflow/issues/4041) - (dup) - Fix the TiCDC panic issue that occurs when manually cleaning the task status in etcd [#2980](https://github.com/pingcap/tiflow/issues/2980) + - Set `max-message-bytes` default to 10M, and use the min value with topic and broker to initialize the producer. [#4041](https://github.com/pingcap/tiflow/issues/4041) + - Fix nil pointer panic encountered when scheduler cleanup finished operations [#2980](https://github.com/pingcap/tiflow/issues/2980) - Fix a bug that when master and worker restart in a particular order, relay status in DM-master is wrong [#3478](https://github.com/pingcap/tiflow/issues/3478) - Fix a bug that DM-worker can't boot up after restart [#3344](https://github.com/pingcap/tiflow/issues/3344) - Fix a bug that DM task will failed when PARTITION DDL cost a long time [#3854](https://github.com/pingcap/tiflow/issues/3854) - (dup) - Fix the issue that special comments in DDL statements cause the replication task to stop [#3755](https://github.com/pingcap/tiflow/issues/3755) + - Fix syntax error if DDL has a special comment. [#3755](https://github.com/pingcap/tiflow/issues/3755) - ```release-note [#3976](https://github.com/pingcap/tiflow/pull/3976) - (dup) - Fix the issue of replication stop caused by the incorrect configuration of `config.Metadata.Timeout` [#3352](https://github.com/pingcap/tiflow/issues/3352) + - Fix the owner may be blocked when initializing the changefeed caused by a bad network connection to the sink [#3352](https://github.com/pingcap/tiflow/issues/3352) - `None` [#3953](https://github.com/pingcap/tiflow/pull/3953) - fix a bug that DM may report "invalid sequence" when upstream is MySQL 8.0 fix a bug that upstream will die on SHOW SLAVE HOSTS [#3847](https://github.com/pingcap/tiflow/issues/3847) - Fix a bug that redo logs are not cleaned up when removing a paused changefeed. [#3919](https://github.com/pingcap/tiflow/pull/3919) - (dup) - Fix the issue that the service cannot be started because of a timezone issue in the RHEL release [#3584](https://github.com/pingcap/tiflow/issues/3584) + - Fix timezone related error that cause cdc server can't run in some RHEL release version (6.8, 6.9 etc). [#3584](https://github.com/pingcap/tiflow/issues/3584) - Fix cli don't work when cli cert's common name was not added in config that use for start cdc server. [#3882](https://github.com/pingcap/tiflow/pull/3882) - add pre clean up process when s3 enable, fix #3523 [#3878](https://github.com/pingcap/tiflow/pull/3878) - add redo log related metric [#3877](https://github.com/pingcap/tiflow/pull/3877) - (dup) - Fix the issue that `stopped` changefeeds resume automatically after a cluster upgrade [#3473](https://github.com/pingcap/tiflow/issues/3473) + - Fix the issue of changefeed resuming automatically after upgrading cluster [#3473](https://github.com/pingcap/tiflow/issues/3473) - Fix a bug of data loss when DM does finer grained retry [#3487](https://github.com/pingcap/tiflow/issues/3487) - (dup) - Fix the issue that default values cannot be replicated [#3793](https://github.com/pingcap/tiflow/issues/3793) - (dup) - Add more Promethous and Grafana monitoring metrics and alerts, including `no owner alert`, `mounter row`, `table sink total row`, and `buffer sink total row` [#4054](https://github.com/pingcap/tiflow/issues/4054) [#1606](https://github.com/pingcap/tiflow/issues/1606) - (dup) - Fix the issue of overly frequent warnings caused by MySQL sink deadlock [#2706](https://github.com/pingcap/tiflow/issues/2706) - (dup) - Fix the bug that the `enable-old-value` configuration item is not automatically set to `true` on Canal and Maxwell protocols [#3676](https://github.com/pingcap/tiflow/issues/3676) + - Fix mounter default date value not support [#3793](https://github.com/pingcap/tiflow/issues/3793) + - Add an alert rule when ticdc has no owner for more than 10 minutes. [#4054](https://github.com/pingcap/tiflow/issues/4054) + - Reduce log "synchronize is taking too long, report a bug" in some cases. [#2706](https://github.com/pingcap/tiflow/issues/2706) + - Fix the problem that old value is not forced on automatically in `canal-json` and `maxwell` protocols [#3676](https://github.com/pingcap/tiflow/issues/3676) - `None`. [#3765](https://github.com/pingcap/tiflow/pull/3765) - `None`. [#3712](https://github.com/pingcap/tiflow/pull/3712) - Please add a release note. fix kvclient takes too long time to recover [#3191](https://github.com/pingcap/tiflow/issues/3191) - (dup) - Fix the issue that Avro sink does not support parsing JSON type columns [#3624](https://github.com/pingcap/tiflow/issues/3624) + - The Avro sink was updated to handle JSON columns [#3624](https://github.com/pingcap/tiflow/issues/3624) - Fix cli don't work when cli cert's common name was not added in config that use for start cdc server. [#3628](https://github.com/pingcap/tiflow/pull/3628) - (dup) - Fix the negative value error in the changefeed checkpoint lag [#3010](https://github.com/pingcap/tiflow/issues/3010) + - fix changefeed checkpoint lag negative value error [#3010](https://github.com/pingcap/tiflow/issues/3010) - Fix HTTP API not working when there are TiCDC nodes of different versions in one cdc cluster. [#3483](https://github.com/pingcap/tiflow/issues/3483) - Fix a bug when too often query status is called in Load unit, DM-worker may encounter data race or panic [#3457](https://github.com/pingcap/tiflow/issues/3457) - Fix OOM in container environments. [#3439](https://github.com/pingcap/tiflow/pull/3439) @@ -196,15 +196,15 @@ fix kvclient takes too long time to recover [#3191](https://github.com/pingcap/t + TiDB - planner: fix wrong range calculation for Nulleq function on Enum values [#32428](https://github.com/pingcap/tidb/issues/32428) - (dup) - Fix the issue that INDEX HASH JOIN returns the `send on closed channel` error [#31129](https://github.com/pingcap/tidb/issues/31129) - (dup) - Fix the issue that some checks are skipped when TiDB Lightning is restarted [#30772](https://github.com/pingcap/tidb/issues/30772) - (dup) - Fix the issue of wrong import result that occurs when TiDB Lightning does not have the privilege to access the `mysql.tidb` table [#31088](https://github.com/pingcap/tidb/issues/31088) - (dup) - Fix the issue that concurrent column type change causes inconsistency between the schema and the data [#31048](https://github.com/pingcap/tidb/issues/31048) + - Fix the bug that indexHashJoin may return the error `send on closed channel`. [#31129](https://github.com/pingcap/tidb/issues/31129) + - Fix the bug that lightning will skip some precheck items when restart [#30772](https://github.com/pingcap/tidb/issues/30772) + - Fix the error that if tidb-lightning doesn't has permission to access mysql.tidb, it will generate kv with wrong format. [#31088](https://github.com/pingcap/tidb/issues/31088) + - Fix concurrent column type changes(with changing data) that cause schema and data inconsistencies. [#31048](https://github.com/pingcap/tidb/issues/31048) - Add a new config to control whether support incremental import. [#27919](https://github.com/pingcap/tidb/issues/27919) - executor: fix pipelined window invalid memory address [#30326](https://github.com/pingcap/tidb/issues/30326) - (dup) - Fix the issue that window functions might return different results when using a transaction or not [#29947](https://github.com/pingcap/tidb/issues/29947) - (dup) - Fix the issue that the SQL statements that contain `cast(integer as char) union string` return wrong results [#29513](https://github.com/pingcap/tidb/issues/29513) - (dup) - Fix the issue that the length information is wrong when casting `Decimal` to `String` [#29417](https://github.com/pingcap/tidb/issues/29417) + - Fix the problem that window function may return different results when using transaction or not. [#29947](https://github.com/pingcap/tidb/issues/29947) + - Fix wrong flen for CastAsString funtion [#29513](https://github.com/pingcap/tidb/issues/29513) + - expression: Fix the issue that length information is wrong when converting Decimal to String [#29417](https://github.com/pingcap/tidb/issues/29417) + PingCAP/TiFlash @@ -212,6 +212,6 @@ fix kvclient takes too long time to recover [#3191](https://github.com/pingcap/t + PD - (dup) - Fix a bug that the schedule generated by the region scatterer might decrease the number of peers [#4565](https://github.com/tikv/pd/issues/4565) + - Fix the bug that the region scatterer may generate the schedule with too few peers. [#4565](https://github.com/tikv/pd/issues/4565) - Fix incomplete replicate file [#4328](https://github.com/tikv/pd/issues/4328) - (dup) - Fix a panic issue that occurs after the TiKV node is removed [#4344](https://github.com/tikv/pd/issues/4344) + - Fix panic issue after TiKV node scales in [#4344](https://github.com/tikv/pd/issues/4344) From 1e79f9373371dbd385edb00acd00d277e41f5425 Mon Sep 17 00:00:00 2001 From: qiancai Date: Fri, 25 Feb 2022 00:07:28 +0800 Subject: [PATCH 11/58] update_for_duplicated_notes --- releases/release-5.3.1.md | 104 +++++++++++++++++++------------------- 1 file changed, 52 insertions(+), 52 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 5ec4acaba0667..586672809b602 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -51,13 +51,13 @@ Tools - Fix double column value are different with MySQL after changing column type from float to double [#31372](https://github.com/pingcap/tidb/issues/31372) - Planner: make queries with the extra column `_tidb_rowid` can use PointGet [#31543](https://github.com/pingcap/tidb/issues/31543) - Fix a data race that may cause "invalid transaction" error when executing a query using index lookup join. [#30468](https://github.com/pingcap/tidb/issues/30468) - - Fix a panic that may happen when using `on duplicate key update`. [#28078](https://github.com/pingcap/tidb/issues/28078) + (dup) - Fix the issue that executing the `INSERT ... SELECT ... ON DUPLICATE KEY UPDATE` statement gets panic [#28078](https://github.com/pingcap/tidb/issues/28078) - Fix the bug that lighting return error if gcs url starts with gs:// [#32591](https://github.com/pingcap/tidb/issues/32591) - [#30999](https://github.com/pingcap/tidb/pull/30999) - Fix a bug that the `mysql_stmt_field_count` returned to mysql client is incorrect in prepare protocal when handling union statement. [#30971](https://github.com/pingcap/tidb/issues/30971) - Make tidb-lightning pre-check output message clearer [#30395](https://github.com/pingcap/tidb/issues/30395) - Avoid tikv trigger auto region split by lower the ingest kv count threshold [#30018](https://github.com/pingcap/tidb/issues/30018) - - Fix the but that lightning doesn't report error if s3 storage path not exist. [#28031](https://github.com/pingcap/tidb/issues/28031) + (dup) - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist [#28031](https://github.com/pingcap/tidb/issues/28031) [#30709](https://github.com/pingcap/tidb/issues/30709) - planner: regard NULL as point when accessing composite index [#29650](https://github.com/pingcap/tidb/issues/29650) - Fix a bug when reducing order by clause for the index which leads to the wrong result. [#30271](https://github.com/pingcap/tidb/issues/30271) - The TiDB server now maps a user to an entry in the mysql.user table more consistently. [#30450](https://github.com/pingcap/tidb/pull/30450) @@ -68,26 +68,26 @@ Tools - Reduce CDC recovery time by reduce the number regions that need resolved lock. [#11993](https://github.com/tikv/tikv/issues/11993) - Increase the size of write batch for raftlog GC to speed up GC. [#11404](https://github.com/tikv/tikv/issues/11404) - - Fix the bug that unsafe_destroy_range does not get executed when GC worker is busy [#11903](https://github.com/tikv/tikv/issues/11903) + (dup) - Fix a bug that TiKV cannot delete a range of data (`unsafe_destroy_range` cannot be executed) when the GC worker is busy [#11903](https://github.com/tikv/tikv/issues/11903) - Fix a potential panic (#11746) when snapshot files have been deleted but the peer's status is still Applying. [#11746](https://github.com/tikv/tikv/issues/11746) - - Fix potential high latency caused by destroying a peer [#10210](https://github.com/tikv/tikv/issues/10210) + (dup) - Fix the issue that destroying a peer might cause high latency [#10210](https://github.com/tikv/tikv/issues/10210) - Fix possible QPS drop when `level0_slowdown_trigger` is set explicitly with flow control enabled. [#11424](https://github.com/tikv/tikv/issues/11424) - release-note [#11805](https://github.com/tikv/tikv/pull/11805) - - Fix wrong `any_value` result when there are regions returning empty result [#11735](https://github.com/tikv/tikv/issues/11735) - - Update procfs to 0.12.0 [#11702](https://github.com/tikv/tikv/issues/11702) - - Fix the problem that destroying an uninitialized replica may cause a stalled replica be created again. [#10533](https://github.com/tikv/tikv/issues/10533) + (dup) - Fix a bug that the `any_value` function returns a wrong result when regions are empty [#11735](https://github.com/tikv/tikv/issues/11735) + (dup) - Update the proc filesystem (procfs) to v0.12.0 [#11702](https://github.com/tikv/tikv/issues/11702) + (dup) - Fix the issue that deleting an uninitialized replica might cause an old replica to be recreated [#10533](https://github.com/tikv/tikv/issues/10533) - Please add a release note.None [#11632](https://github.com/tikv/tikv/pull/11632) - Please add a release note. [#11616](https://github.com/tikv/tikv/pull/11616) - Fix panic when cgroup controller is not mounted [#11569](https://github.com/tikv/tikv/issues/11569) - - Fix metadata corruption in an unlikely condition that prepare merge is triggered after new election without informing an isolated peer [#11526](https://github.com/tikv/tikv/issues/11526) - - Fix deadlock in some rare cases that futures get resolved too fast [#11549](https://github.com/tikv/tikv/issues/11549) - - Fix resolved ts lag increased after stoping a tikv [#11351](https://github.com/tikv/tikv/issues/11351) - - Fix connection abort when too many raft entries are batched into one messages [#9714](https://github.com/tikv/tikv/issues/9714) - - Fix panic in rare conditions when merge, conf change and snapshot happen at the same time [#11475](https://github.com/tikv/tikv/issues/11475) - - Fix the issue that reverse scan can't detect memory locks and may read stale data. [#11440](https://github.com/tikv/tikv/issues/11440) - - Do not panic when RocksDB flush or compaction hits disk capacity [#11224](https://github.com/tikv/tikv/issues/11224) - - Make tikv-ctl detect raft db correctly [#11393](https://github.com/tikv/tikv/issues/11393) - - Fix incorrect by-instance gRPC average duration. [#11299](https://github.com/tikv/tikv/issues/11299) + (dup) - Fix the metadata corruption issue when `Prepare Merge` is triggered after a new election is finished but the isolated peer is not informed [#11526](https://github.com/tikv/tikv/issues/11526) + (dup) - Fix the deadlock issue that happens occasionally when coroutines run too fast [#11549](https://github.com/tikv/tikv/issues/11549) + (dup) - Fix the issue that a down TiKV node causes the resolved timestamp to lag [#11351](https://github.com/tikv/tikv/issues/11351) + (dup) - Fix the issue that batch messages are too large in Raft client implementation [#9714](https://github.com/tikv/tikv/issues/9714) + (dup) - Fix a panic issue that occurs when Region merge, ConfChange, and Snapshot happen at the same time in extreme conditions [#11475](https://github.com/tikv/tikv/issues/11475) + (dup) - Fix the issue that TiKV cannot detect the memory lock when TiKV perform a reverse table scan [#11440](https://github.com/tikv/tikv/issues/11440) + (dup) - Fix the issue that RocksDB flush or compaction causes panic when the disk capacity is full [#11224](https://github.com/tikv/tikv/issues/11224) + (dup) - Fix a bug that tikv-ctl cannot return the correct Region-related information [#11393](https://github.com/tikv/tikv/issues/11393) + (dup) - Fix the issue that the average latency of the by-instance gRPC requests is inaccurate in TiKV metrics [#11299](https://github.com/tikv/tikv/issues/11299) + TiFlash @@ -110,7 +110,7 @@ Tools - None. [#4663](https://github.com/tikv/pd/pull/4663) - Fix a bug that operate steps may contain unnecessary or empty JointConsensus steps in certain conditions - Fix a bug when demoting single voter directly [#4362](https://github.com/tikv/pd/issues/4362) - - Fix the problem that the hot cache cannot be emptied when the interval is less than 60 [#4390](https://github.com/tikv/pd/issues/4390) + (dup) - Fix the issue that the cold hotspot data cannot be deleted from the hotspot statistics [#4390](https://github.com/tikv/pd/issues/4390) - Improve DR_STATE file content format [#4341](https://github.com/tikv/pd/issues/4341) - Fix data race when updating replication mode configuration [#4325](https://github.com/tikv/pd/issues/4325) - Fix the issue that the RLock is not released [#4354](https://github.com/tikv/pd/issues/4354) @@ -120,7 +120,7 @@ Tools + TiCDC - `None`. [#4660](https://github.com/pingcap/tiflow/issues/4660) - - Support more data types with default value attribute, and fix potential data inconsistency caused by default value logic [#3793](https://github.com/pingcap/tiflow/issues/3793) + (dup) - Fix the issue that default values cannot be replicated [#3793](https://github.com/pingcap/tiflow/issues/3793) - Fix a bug that long varchar will report error of "Column length too big..." [#4637](https://github.com/pingcap/tiflow/issues/4637) - `None`. [#4385](https://github.com/pingcap/tiflow/issues/4385) - `None`. [#4607](https://github.com/pingcap/tiflow/issues/4607) @@ -128,61 +128,61 @@ Tools - `None`. [#4561](https://github.com/pingcap/tiflow/issues/4561) - Fix a bug that owner exits abnormally when PD leader is killed [#4248](https://github.com/pingcap/tiflow/issues/4248) - Allow user set the configuration of Kafka producer dial/write/read timeout [#4385](https://github.com/pingcap/tiflow/issues/4385) - - Fix a bug that MySQL sink will generate duplicated replace SQL if `batch-replace-enable` is disabled. [#4501](https://github.com/pingcap/tiflow/issues/4501) + (dup) - Fix a bug that MySQL sink generates duplicated `replace` SQL statements if `batch-replace-enable` is disabled [#4501](https://github.com/pingcap/tiflow/issues/4501) - `None`. [#4128](https://github.com/pingcap/tiflow/issues/4128) - `None`. [#4404](https://github.com/pingcap/tiflow/issues/4404) - Fix the issue that update statement execute error in safemode may cause DM-worker panic. [#4317](https://github.com/pingcap/tiflow/issues/4317) - None. [#4353](https://github.com/pingcap/tiflow/issues/4353) - `None`. [#4159](https://github.com/pingcap/tiflow/issues/4159) - `None`. [#4135](https://github.com/pingcap/tiflow/issues/4135) - - Add exponential backoff mechanism for restarting a changefeed. [#3329](https://github.com/pingcap/tiflow/issues/3329) - - Fix a bug that upstream metrics won't update if no query-status [#4281](https://github.com/pingcap/tiflow/issues/4281) - - `None`. [#3431](https://github.com/pingcap/tiflow/issues/3431) + (dup) - Add the exponential backoff mechanism for restarting a changefeed. [#3329](https://github.com/pingcap/tiflow/issues/3329) + (dup) - Fix the issue that syncer metrics are updated only when querying the status [#4281](https://github.com/pingcap/tiflow/issues/4281) + (dup) - Fix the issue that `mq sink write row` does not have monitoring data [#3431](https://github.com/pingcap/tiflow/issues/3431) - Fix kv client cached region metric could be negative. [#4290](https://github.com/pingcap/tiflow/pull/4290) - `None` [#4266](https://github.com/pingcap/tiflow/issues/4266) - `None`. [#4223](https://github.com/pingcap/tiflow/issues/4223) - - Fix the problem that TiCDC cannot send messages when `min.insync.replicas` is less than `replication-factor` [#3994](https://github.com/pingcap/tiflow/issues/3994) + (dup) - Fix the issue that replication cannot be performed when `min.insync.replicas` is smaller than `replication-factor` [#3994](https://github.com/pingcap/tiflow/issues/3994) - `None`. [#4159](https://github.com/pingcap/tiflow/issues/4159) - - `None`. [#4173](https://github.com/pingcap/tiflow/issues/4173) - - Support updating table schema when using dmctl binlog to skip some ddls [#4177](https://github.com/pingcap/tiflow/issues/4177) - - `None`. [#3431](https://github.com/pingcap/tiflow/issues/3431) - - Fix the potential panic issue that occurs when changefeed info is removed from etcd. [#3128](https://github.com/pingcap/tiflow/issues/3128) + (dup) - Fix the issue that the `CREATE VIEW` statement interrupts data replication [#4173](https://github.com/pingcap/tiflow/issues/4173) + (dup) - Fix the issue the schema needs to be reset after a DDL statement is skipped [#4177](https://github.com/pingcap/tiflow/issues/4177) + (dup) - Fix the issue that `mq sink write row` does not have monitoring data [#3431](https://github.com/pingcap/tiflow/issues/3431) + (dup) - Fix the potential panic issue that occurs when a replication task is removed [#3128](https://github.com/pingcap/tiflow/issues/3128) - `None`. [#4163](https://github.com/pingcap/tiflow/pull/4163) - - `None`. [#3337](https://github.com/pingcap/tiflow/issues/3337) + (dup) - Change the default value of Kafka Sink `partition-num` to 3 so that TiCDC distributes messages across Kafka partitions more evenly [#3337](https://github.com/pingcap/tiflow/issues/3337) - Fix a bug that stop-task during load phase will cause the source always tries to transfer to a worker [#3771](https://github.com/pingcap/tiflow/issues/3771) - Fix a bug that wrong progress in query-status for loader [#3252](https://github.com/pingcap/tiflow/issues/3252) - Fix the bug that http API panic when the processor info we want to get is not exist. [#3840](https://github.com/pingcap/tiflow/issues/3840) - - Reduce "EventFeed retry rate limited" logs [#4006](https://github.com/pingcap/tiflow/issues/4006) - - Fix a bug that can cause changefeed stuck due to a deadlock occurs. [#4055](https://github.com/pingcap/tiflow/issues/4055) + (dup) - Reduce the count of "EventFeed retry rate limited" logs [#4006](https://github.com/pingcap/tiflow/issues/4006) + (dup) - Fix the potential issue that the deadlock causes a replication task to get stuck [#4055](https://github.com/pingcap/tiflow/issues/4055) - Manage sink checkpoint per table to avoid checkpointTs advances unexpected. [#4083](https://github.com/pingcap/tiflow/pull/4083) - `None`. [#4079](https://github.com/pingcap/tiflow/pull/4079) - - Set `max-message-bytes` default to 10M, and use the min value with topic and broker to initialize the producer. [#4041](https://github.com/pingcap/tiflow/issues/4041) - - Fix nil pointer panic encountered when scheduler cleanup finished operations [#2980](https://github.com/pingcap/tiflow/issues/2980) + (dup) - Set the default value of `max-message-bytes` to 10M [#4041](https://github.com/pingcap/tiflow/issues/4041) + (dup) - Fix the TiCDC panic issue that occurs when manually cleaning the task status in etcd [#2980](https://github.com/pingcap/tiflow/issues/2980) - Fix a bug that when master and worker restart in a particular order, relay status in DM-master is wrong [#3478](https://github.com/pingcap/tiflow/issues/3478) - Fix a bug that DM-worker can't boot up after restart [#3344](https://github.com/pingcap/tiflow/issues/3344) - Fix a bug that DM task will failed when PARTITION DDL cost a long time [#3854](https://github.com/pingcap/tiflow/issues/3854) - - Fix syntax error if DDL has a special comment. [#3755](https://github.com/pingcap/tiflow/issues/3755) + (dup) - Fix the issue that special comments in DDL statements cause the replication task to stop [#3755](https://github.com/pingcap/tiflow/issues/3755) - release-note [#3976](https://github.com/pingcap/tiflow/pull/3976) - - Fix the owner may be blocked when initializing the changefeed caused by a bad network connection to the sink [#3352](https://github.com/pingcap/tiflow/issues/3352) + (dup) - Fix the issue of replication stop caused by the incorrect configuration of `config.Metadata.Timeout` [#3352](https://github.com/pingcap/tiflow/issues/3352) - `None` [#3953](https://github.com/pingcap/tiflow/pull/3953) - Fix a bug that DM may report "invalid sequence" when upstream is MySQL 8.0. Fix a bug that upstream will die on SHOW SLAVE HOSTS [#3847](https://github.com/pingcap/tiflow/issues/3847) - Fix a bug that redo logs are not cleaned up when removing a paused changefeed. [#3919](https://github.com/pingcap/tiflow/pull/3919) - - Fix timezone related error that cause cdc server can't run in some RHEL release version (6.8, 6.9 etc). [#3584](https://github.com/pingcap/tiflow/issues/3584) + (dup) - Fix the issue that the service cannot be started because of a timezone issue in the RHEL release [#3584](https://github.com/pingcap/tiflow/issues/3584) - Fix cli don't work when cli cert's common name was not added in config that use for start cdc server. [#3882](https://github.com/pingcap/tiflow/pull/3882) - Add pre clean up process when s3 enable, fix #3523 [#3878](https://github.com/pingcap/tiflow/pull/3878) - Add redo log related metric [#3877](https://github.com/pingcap/tiflow/pull/3877) - - Fix the issue of changefeed resuming automatically after upgrading cluster [#3473](https://github.com/pingcap/tiflow/issues/3473) + (dup) - Fix the issue that `stopped` changefeeds resume automatically after a cluster upgrade [#3473](https://github.com/pingcap/tiflow/issues/3473) - Fix a bug of data loss when DM does finer grained retry [#3487](https://github.com/pingcap/tiflow/issues/3487) - - Fix mounter default date value not support [#3793](https://github.com/pingcap/tiflow/issues/3793) - - Add an alert rule when ticdc has no owner for more than 10 minutes. [#4054](https://github.com/pingcap/tiflow/issues/4054) - - Reduce log "synchronize is taking too long, report a bug" in some cases. [#2706](https://github.com/pingcap/tiflow/issues/2706) - - Fix the problem that old value is not forced on automatically in `canal-json` and `maxwell` protocols [#3676](https://github.com/pingcap/tiflow/issues/3676) + (dup) - Fix the issue that default values cannot be replicated [#3793](https://github.com/pingcap/tiflow/issues/3793) + (dup) - Add more Promethous and Grafana monitoring metrics and alerts, including `no owner alert`, `mounter row`, `table sink total row`, and `buffer sink total row` [#4054](https://github.com/pingcap/tiflow/issues/4054) [#1606](https://github.com/pingcap/tiflow/issues/1606) + (dup) - Fix the issue of overly frequent warnings caused by MySQL sink deadlock [#2706](https://github.com/pingcap/tiflow/issues/2706) + (dup) - Fix the bug that the `enable-old-value` configuration item is not automatically set to `true` on Canal and Maxwell protocols [#3676](https://github.com/pingcap/tiflow/issues/3676) - `None`. [#3765](https://github.com/pingcap/tiflow/pull/3765) - `None`. [#3712](https://github.com/pingcap/tiflow/pull/3712) - - Please add a release note. Fix kvclient takes too long time to recover [#3191](https://github.com/pingcap/tiflow/issues/3191) - - The Avro sink was updated to handle JSON columns [#3624](https://github.com/pingcap/tiflow/issues/3624) + (dup) - Reduce the time for the KV client to recover when a TiKV store is down [#3191](https://github.com/pingcap/tiflow/issues/3191) + (dup) - Fix the issue that Avro sink does not support parsing JSON type columns [#3624](https://github.com/pingcap/tiflow/issues/3624) - Fix cli don't work when cli cert's common name was not added in config that use for start cdc server. [#3628](https://github.com/pingcap/tiflow/pull/3628) - - Fix changefeed checkpoint lag negative value error [#3010](https://github.com/pingcap/tiflow/issues/3010) + (dup) - Fix the negative value error in the changefeed checkpoint lag [#3010](https://github.com/pingcap/tiflow/issues/3010) - Fix HTTP API not working when there are TiCDC nodes of different versions in one cdc cluster. [#3483](https://github.com/pingcap/tiflow/issues/3483) - Fix a bug when too often query status is called in Load unit, DM-worker may encounter data race or panic [#3457](https://github.com/pingcap/tiflow/issues/3457) - Fix OOM in container environments. [#3439](https://github.com/pingcap/tiflow/pull/3439) @@ -194,15 +194,15 @@ Tools + TiDB - Planner: fix wrong range calculation for Nulleq function on Enum values [#32428](https://github.com/pingcap/tidb/issues/32428) - - Fix the bug that indexHashJoin may return the error `send on closed channel`. [#31129](https://github.com/pingcap/tidb/issues/31129) - - Fix the bug that lightning will skip some precheck items when restart [#30772](https://github.com/pingcap/tidb/issues/30772) - - Fix the error that if tidb-lightning doesn't has permission to access mysql.tidb, it will generate kv with wrong format. [#31088](https://github.com/pingcap/tidb/issues/31088) - - Fix concurrent column type changes(with changing data) that cause schema and data inconsistencies. [#31048](https://github.com/pingcap/tidb/issues/31048) + (dup) - Fix the issue that INDEX HASH JOIN returns the `send on closed channel` error [#31129](https://github.com/pingcap/tidb/issues/31129) + (dup) - Fix the issue that some checks are skipped when TiDB Lightning is restarted [#30772](https://github.com/pingcap/tidb/issues/30772) + (dup) - Fix the issue of wrong import result that occurs when TiDB Lightning does not have the privilege to access the `mysql.tidb` table [#31088](https://github.com/pingcap/tidb/issues/31088) + (dup) - Fix the issue that concurrent column type change causes inconsistency between the schema and the data [#31048](https://github.com/pingcap/tidb/issues/31048) - Add a new config to control whether support incremental import. [#27919](https://github.com/pingcap/tidb/issues/27919) - Executor: fix pipelined window invalid memory address [#30326](https://github.com/pingcap/tidb/issues/30326) - - Fix the problem that window function may return different results when using transaction or not. [#29947](https://github.com/pingcap/tidb/issues/29947) - - Fix wrong flen for CastAsString funtion [#29513](https://github.com/pingcap/tidb/issues/29513) - - Expression: Fix the issue that length information is wrong when converting Decimal to String [#29417](https://github.com/pingcap/tidb/issues/29417) + (dup) - Fix the issue that window functions might return different results when using a transaction or not [#29947](https://github.com/pingcap/tidb/issues/29947) + (dup) - Fix the issue that the SQL statements that contain `cast(integer as char) union string` return wrong results [#29513](https://github.com/pingcap/tidb/issues/29513) + (dup) - Fix the issue that the length information is wrong when casting `Decimal` to `String` [#29417](https://github.com/pingcap/tidb/issues/29417) + TiFlash @@ -210,6 +210,6 @@ Tools + PD - - Fix the bug that the region scatterer may generate the schedule with too few peers. [#4565](https://github.com/tikv/pd/issues/4565) + (dup) - Fix a bug that the schedule generated by the region scatterer might decrease the number of peers [#4565](https://github.com/tikv/pd/issues/4565) - Fix incomplete replicate file [#4328](https://github.com/tikv/pd/issues/4328) - - Fix panic issue after TiKV node scales in [#4344](https://github.com/tikv/pd/issues/4344) + (dup) - Fix a panic issue that occurs after the TiKV node is removed [#4344](https://github.com/tikv/pd/issues/4344) From 65f6ae8c1032d84bd20ca82265a6e8b39086ffcc Mon Sep 17 00:00:00 2001 From: xixirangrang <35301108+hfxsd@users.noreply.github.com> Date: Fri, 25 Feb 2022 10:27:50 +0800 Subject: [PATCH 12/58] Update release-5.3.1.md --- releases/release-5.3.1.md | 28 ++++++++++++++-------------- 1 file changed, 14 insertions(+), 14 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 586672809b602..544b7550d7823 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -91,19 +91,19 @@ Tools + TiFlash - - Fix error result for function `in` [#4076](https://github.com/pingcap/tics/pull/4076) - - Fix cast to decimal overflow bug [#4073](https://github.com/pingcap/tics/pull/4073) - - Fix date format identifies '\n' as invalid separator [#4059](https://github.com/pingcap/tics/pull/4059) - - Fix cannot find column error after add column when remote read was triggered in tiflash [#4027](https://github.com/pingcap/tics/pull/4027) - - Fix str_to_date() function incorrectly handles leading zeros when parsing Microseconds [#3936](https://github.com/pingcap/tics/pull/3936) - - Fix the problem of TiFlash crashing when the memory limit is enabled [#3918](https://github.com/pingcap/tics/pull/3918) - - Fix the bug that castStringAsReal has different behaivor between tiflash and tikv/tidb. [#3757](https://github.com/pingcap/tics/pull/3757) - - Avoid false alert of `DB::Exception: Encode type of coprocessor response is not CHBlock` [#3740](https://github.com/pingcap/tics/pull/3740) - - Fix random `EstablishMPPConnection` fail after TiFlash server restart. [#3708](https://github.com/pingcap/tics/pull/3708) - - Fixed the inconsistent behavior of CastStringAsDecimal between tiflash and tidb/tikv. [#3680](https://github.com/pingcap/tics/pull/3680) - - Fix potential data inconsistency after altering a primary key column to a larger int data type [#3570](https://github.com/pingcap/tics/pull/3570) - - Fix the bug that results of `where ` is wrong because it will be converted to int type. [#3480](https://github.com/pingcap/tics/pull/3480) - - Fix tiflash randomly crash when a mpp query is killed. [#3451](https://github.com/pingcap/tics/pull/3451) + - Fix error result for function `in` + - Fix cast to decimal overflow bug + - Fix date format identifies '\n' as invalid separator + - Fix cannot find column error after add column when remote read was triggered in tiflash + - Fix str_to_date() function incorrectly handles leading zeros when parsing Microseconds + - Fix the problem of TiFlash crashing when the memory limit is enabled + - Fix the bug that castStringAsReal has different behaivor between tiflash and tikv/tidb + - Avoid false alert of `DB::Exception: Encode type of coprocessor response is not CHBlock` + - Fix random `EstablishMPPConnection` fail after TiFlash server restart. + - Fixed the inconsistent behavior of CastStringAsDecimal between tiflash and tidb/tikv. + - Fix potential data inconsistency after altering a primary key column to a larger int data type + - Fix the bug that results of `where ` is wrong because it will be converted to int type. + - Fix tiflash randomly crash when a mpp query is killed. + PD @@ -206,7 +206,7 @@ Tools + TiFlash - - Align unix_timestamp behavior with TiDB and mysql when input is earlier than 1970-01-01 00:00:01 UTC [#3625](https://github.com/pingcap/tics/pull/3625) + - Align unix_timestamp behavior with TiDB and mysql when input is earlier than 1970-01-01 00:00:01 UTC + PD From 30ce11b3d16f1eea47322599b9d2bc593194e3a7 Mon Sep 17 00:00:00 2001 From: xixirangrang <35301108+hfxsd@users.noreply.github.com> Date: Mon, 28 Feb 2022 19:53:45 +0800 Subject: [PATCH 13/58] Update release-5.3.1.md --- releases/release-5.3.1.md | 124 +++++++++++++++++++++++++++++--------- 1 file changed, 97 insertions(+), 27 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 544b7550d7823..d4d2e2443d508 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -35,7 +35,102 @@ Tools ## Feature enhancements -## __unsorted +TiKV + + - Reduce CDC recovery time by reduce the number regions that need resolved lock. [#11993](https://github.com/tikv/tikv/issues/11993) + - Increase the size of write batch for raftlog GC to speed up GC. [#11404](https://github.com/tikv/tikv/issues/11404) + +PD + + - Improve DR_STATE file content format [#4341](https://github.com/tikv/pd/issues/4341) + +Tools + + - TiCDC + + - Expose Kafka producer's configuration parameters can be configured [#4385](https://github.com/pingcap/tiflow/issues/4385) + - Fix OOM in container environments. [#3439](https://github.com/pingcap/tiflow/pull/3439) + +## Bug Fixes + ++ TiDB + + - Fix date formate identifies '\n' as invalid separator #32503 + - Fix alter column set default wrongly updates the schema #31074 + - Fix a bug that turning on tidb_restricted_read_only won't automatically turn on tidb_super_read_only #31745 + - Fix greatest and least function with collation get wrong result #31789 + - Fix the crash or error when generating an empty mpp task list. #31636 + - Fix index join bug caused by innerWorker panic #31494 + - Fix double column value are different with MySQL after changing column type from float to double #31372 + - Fix a data race that may cause "invalid transaction" error when executing a query using index lookup join. #30468 + (dup) - Fix the issue that executing the INSERT ... SELECT ... ON DUPLICATE KEY UPDATE statement gets panic #28078 + - Fix a bug when reducing order by clause for the index which leads to the wrong result. #30271 + - The TiDB server now maps a user to an entry in the mysql.user table more consistently. #30450 + - Fix `MaxDays` and `MaxBackups` not working for slow log. [#25716](https://github.com/pingcap/tidb/issues/25716) + +TiKV + + - Fix a potential panic (#11746) when snapshot files have been deleted but the peer's status is still Applying. [#11746](https://github.com/tikv/tikv/issues/11746) + - Fix possible QPS drop when `level0_slowdown_trigger` is set explicitly with flow control enabled. [#11424](https://github.com/tikv/tikv/issues/11424) + - Fix panic when cgroup controller is not mounted [#11569](https://github.com/tikv/tikv/issues/11569) + - Fix resolved ts lag increased after stoping a tikv [#11352](https://github.com/tikv/tikv/pull/11352) + ++ TiFlash + + - Fix the problem that `cast(arg as decimal(x,y))` return wrong result when `arg` overflows the range of `decimal(x,y)` + - Fix the problem of TiFlash crashing when `max_memory_usage` and `max_memory_usage_for_all_queries` are enabled + - Fix the problem that `cast(string ad real)` returns wrong result + - Fixed the problem that cast(string as decimal) returns wrong result + - Fix potential data inconsistency after altering a primary key column to a larger int data type + - Fix the problem that `select (arg0, arg1) in (x,y)` returns wrong result + - Fix the problem that tiflash randomly crash when a mpp query is killed + - Fix the problem that str_to_date return wrong result when the input argument has leading zeros. + - Fix the problem that query gets wrong results when the filter is like `where ` + - Fix the problem that `cast(string as datetime)` return wrong result when the string is of format `%Y-%m-%d\n%H:%i:%s` + ++ PD + + - Fix a bug that the operater steps may contain unnecessary or empty JointConsensus steps in certain conditions [#4362](https://github.com/tikv/pd/issues/4362) + - Fix a bug that the operator could not be executed when demoting single voter directly [#4444](https://github.com/tikv/pd/issues/4444) + - Fix data race when updating replication mode configuration [#4325](https://github.com/tikv/pd/issues/4325) + - Fix a bug that the RLock is not released in certain conditions [#4354](https://github.com/tikv/pd/issues/4354) + +Tools + + - Backup & Restore (BR) + + - Fix a bug that caused region unbalanced after restoring. #31034 + + - TiCDC + + - Fix a bug that long varchar will report error of "Column length too big" [#4637](https://github.com/pingcap/tiflow/issues/4637) + - Fix a bug that owner exits abnormally when PD leader is killed [#4248](https://github.com/pingcap/tiflow/issues/4248) + - Fix the issue that update statement execute error in safemode may cause DM-worker panic [#4317](https://github.com/pingcap/tiflow/issues/4317) + - Fix kv client cached region metric could be negative [#4290](https://github.com/pingcap/tiflow/pull/4290) + - Stopping tasks during load phase won't cause the source to be transfered [#3771](https://github.com/pingcap/tiflow/issues/3771) + - Correct query-staus progress for loader [#3252](https://github.com/pingcap/tiflow/issues/3252) + - Fix the bug that http API panics when the required processor info is not exist [#3840](https://github.com/pingcap/tiflow/issues/3840) + - Manage sink checkpoint per table to avoid checkpoint timestamp advance unexpected [#4083](https://github.com/pingcap/tiflow/pull/4083) + - Fix a bug that when master and worker restart in a particular order, relay status in DM-master is wrong [#3478](https://github.com/pingcap/tiflow/issues/3478) + - Fix a bug that DM-worker can't boot up after restart [#3344](https://github.com/pingcap/tiflow/issues/3344) + - Fix a bug that DM task will failed when PARTITION DDL cost a long time [#3854](https://github.com/pingcap/tiflow/issues/3854) + - Fix a bug that DM may report "invalid sequence" when upstream is MySQL 8.0 [#3847](https://github.com/pingcap/tiflow/issues/3847) + - Fix a bug that redo logs are not cleaned up when removing a paused changefeed. [#3919](https://github.com/pingcap/tiflow/pull/3919) + - CDC client works now when cert's common name was not specified [#3882](https://github.com/pingcap/tiflow/pull/3882) + - Add pre clean up process when s3 enable [#3878](https://github.com/pingcap/tiflow/issues/3523) + - Fix a bug of data loss when DM does finer grained retry [#3487](https://github.com/pingcap/tiflow/issues/3487) + - HTTP API works as expected now if there are TiCDC nodes of different versions in one cdc cluster. [#3483](https://github.com/pingcap/tiflow/issues/3483) + + - TiDB Lightning + + - Fix the bug that lightning may not clean up metadata schema when some of the import contains no source files. #28144 + - Fix the bug that lighting return error if gcs url starts with gs:// #32591 + - Make tidb-lightning pre-check output message clearer #30395 + - Avoid tikv trigger auto region split by lower the ingest kv count threshold #30018 + (dup) - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist #28031 #30709 + - Fix log doesn't output to stdout when passing --log-file="-" #29876 + +# __unsorted + TiDB @@ -108,7 +203,7 @@ Tools + PD - None. [#4663](https://github.com/tikv/pd/pull/4663) - - Fix a bug that operate steps may contain unnecessary or empty JointConsensus steps in certain conditions + - Fix a bug that operate steps may contain unnecessary or empty JointConsensus steps in certain conditions - Fix a bug when demoting single voter directly [#4362](https://github.com/tikv/pd/issues/4362) (dup) - Fix the issue that the cold hotspot data cannot be deleted from the hotspot statistics [#4390](https://github.com/tikv/pd/issues/4390) - Improve DR_STATE file content format [#4341](https://github.com/tikv/pd/issues/4341) @@ -188,28 +283,3 @@ Tools - Fix OOM in container environments. [#3439](https://github.com/pingcap/tiflow/pull/3439) - Please add a release note. If you don't think this PR needs a release note then fill it with `None`. [#3868](https://github.com/pingcap/tiflow/pull/3868) - Please add a release note. If you don't think this PR needs a release note then fill it with `None`. [#3256](https://github.com/pingcap/tiflow/pull/3256) - -## Bug Fixes - -+ TiDB - - - Planner: fix wrong range calculation for Nulleq function on Enum values [#32428](https://github.com/pingcap/tidb/issues/32428) - (dup) - Fix the issue that INDEX HASH JOIN returns the `send on closed channel` error [#31129](https://github.com/pingcap/tidb/issues/31129) - (dup) - Fix the issue that some checks are skipped when TiDB Lightning is restarted [#30772](https://github.com/pingcap/tidb/issues/30772) - (dup) - Fix the issue of wrong import result that occurs when TiDB Lightning does not have the privilege to access the `mysql.tidb` table [#31088](https://github.com/pingcap/tidb/issues/31088) - (dup) - Fix the issue that concurrent column type change causes inconsistency between the schema and the data [#31048](https://github.com/pingcap/tidb/issues/31048) - - Add a new config to control whether support incremental import. [#27919](https://github.com/pingcap/tidb/issues/27919) - - Executor: fix pipelined window invalid memory address [#30326](https://github.com/pingcap/tidb/issues/30326) - (dup) - Fix the issue that window functions might return different results when using a transaction or not [#29947](https://github.com/pingcap/tidb/issues/29947) - (dup) - Fix the issue that the SQL statements that contain `cast(integer as char) union string` return wrong results [#29513](https://github.com/pingcap/tidb/issues/29513) - (dup) - Fix the issue that the length information is wrong when casting `Decimal` to `String` [#29417](https://github.com/pingcap/tidb/issues/29417) - -+ TiFlash - - - Align unix_timestamp behavior with TiDB and mysql when input is earlier than 1970-01-01 00:00:01 UTC - -+ PD - - (dup) - Fix a bug that the schedule generated by the region scatterer might decrease the number of peers [#4565](https://github.com/tikv/pd/issues/4565) - - Fix incomplete replicate file [#4328](https://github.com/tikv/pd/issues/4328) - (dup) - Fix a panic issue that occurs after the TiKV node is removed [#4344](https://github.com/tikv/pd/issues/4344) From ac7b109fa3b883d16b5b28d1d49eb75ea32be5b4 Mon Sep 17 00:00:00 2001 From: xixirangrang <35301108+hfxsd@users.noreply.github.com> Date: Mon, 28 Feb 2022 19:56:23 +0800 Subject: [PATCH 14/58] Update release-5.3.1.md --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index d4d2e2443d508..4a4ccaa7505cb 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -130,7 +130,7 @@ Tools (dup) - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist #28031 #30709 - Fix log doesn't output to stdout when passing --log-file="-" #29876 -# __unsorted +# __unsorted （以下内容是原材料，用于核对检查！请不要动！谢谢） + TiDB From 47999c147e07ea96a7433a2e28262268e9e7fb03 Mon Sep 17 00:00:00 2001 From: xixirangrang <35301108+hfxsd@users.noreply.github.com> Date: Mon, 28 Feb 2022 20:16:01 +0800 Subject: [PATCH 15/58] Update release-5.3.1.md --- releases/release-5.3.1.md | 81 ++++++++++++++++++++++++++++++++------- 1 file changed, 67 insertions(+), 14 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 4a4ccaa7505cb..fb0eb6915efa2 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -35,11 +35,16 @@ Tools ## Feature enhancements +TiDB + - The TiDB server now maps a user to an entry in the mysql.user table more consistently. [#30450](https://github.com/pingcap/tidb/issues/30450) + TiKV - Reduce CDC recovery time by reduce the number regions that need resolved lock. [#11993](https://github.com/tikv/tikv/issues/11993) - Increase the size of write batch for raftlog GC to speed up GC. [#11404](https://github.com/tikv/tikv/issues/11404) + (dup) - Update the proc filesystem (procfs) to v0.12.0 [#11702](https://github.com/tikv/tikv/issues/11702) + PD - Improve DR_STATE file content format [#4341](https://github.com/tikv/pd/issues/4341) @@ -50,24 +55,33 @@ Tools - Expose Kafka producer's configuration parameters can be configured [#4385](https://github.com/pingcap/tiflow/issues/4385) - Fix OOM in container environments. [#3439](https://github.com/pingcap/tiflow/pull/3439) + - Add pre clean up process when s3 enable [#3878](https://github.com/pingcap/tiflow/issues/3523) + - TiCDC client works now when cert's common name was not specified [#3882](https://github.com/pingcap/tiflow/pull/3882) + + (dup) - Add the exponential backoff mechanism for restarting a changefeed. [#3329](https://github.com/pingcap/tiflow/issues/3329) + (dup) - Change the default value of Kafka Sink `partition-num` to 3 so that TiCDC distributes messages across Kafka partitions more evenly [#3337](https://github.com/pingcap/tiflow/issues/3337) + (dup) - Reduce the count of "EventFeed retry rate limited" logs [#4006](https://github.com/pingcap/tiflow/issues/4006) + (dup) - Set the default value of `max-message-bytes` to 10M [#4041](https://github.com/pingcap/tiflow/issues/4041) + (dup) - Add more Promethous and Grafana monitoring metrics and alerts, including `no owner alert`, `mounter row`, `table sink total row`, and `buffer sink total row` [#4054](https://github.com/pingcap/tiflow/issues/4054) [#1606](https://github.com/pingcap/tiflow/issues/1606) + (dup) - Reduce the time for the KV client to recover when a TiKV store is down [#3191](https://github.com/pingcap/tiflow/issues/3191) ## Bug Fixes + TiDB - - Fix date formate identifies '\n' as invalid separator #32503 - - Fix alter column set default wrongly updates the schema #31074 - - Fix a bug that turning on tidb_restricted_read_only won't automatically turn on tidb_super_read_only #31745 - - Fix greatest and least function with collation get wrong result #31789 - - Fix the crash or error when generating an empty mpp task list. #31636 - - Fix index join bug caused by innerWorker panic #31494 - - Fix double column value are different with MySQL after changing column type from float to double #31372 - - Fix a data race that may cause "invalid transaction" error when executing a query using index lookup join. #30468 - (dup) - Fix the issue that executing the INSERT ... SELECT ... ON DUPLICATE KEY UPDATE statement gets panic #28078 - - Fix a bug when reducing order by clause for the index which leads to the wrong result. #30271 - - The TiDB server now maps a user to an entry in the mysql.user table more consistently. #30450 + - Fix date formate identifies '\n' as invalid separator [#32503](https://github.com/pingcap/tidb/issues/32503) + - Fix alter column set default wrongly updates the schema [#31074](https://github.com/pingcap/tidb/issues/31074) + - Fix a bug that turning on tidb_restricted_read_only won't automatically turn on tidb_super_read_only [#31745](https://github.com/pingcap/tidb/issues/31745) + - Fix greatest and least function with collation get wrong result [#31789](https://github.com/pingcap/tidb/issues/31789) + - Fix the crash or error when generating an empty mpp task list. [#31636](https://github.com/pingcap/tidb/issues/31636) + - Fix index join bug caused by innerWorker panic [#31494](https://github.com/pingcap/tidb/issues/31494) + - Fix double column value are different with MySQL after changing column type from float to double [#31372](https://github.com/pingcap/tidb/issues/31372) + - Fix a data race that may cause "invalid transaction" error when executing a query using index lookup join. [#30468](https://github.com/pingcap/tidb/issues/30468) + - Fix a bug when reducing order by clause for the index which leads to the wrong result. [#30271](https://github.com/pingcap/tidb/issues/30271) - Fix `MaxDays` and `MaxBackups` not working for slow log. [#25716](https://github.com/pingcap/tidb/issues/25716) + (dup) - Fix the issue that executing the INSERT ... SELECT ... ON DUPLICATE KEY UPDATE statement gets panic [#28078](https://github.com/pingcap/tidb/issues/28078) + TiKV - Fix a potential panic (#11746) when snapshot files have been deleted but the peer's status is still Applying. [#11746](https://github.com/tikv/tikv/issues/11746) @@ -75,6 +89,20 @@ TiKV - Fix panic when cgroup controller is not mounted [#11569](https://github.com/tikv/tikv/issues/11569) - Fix resolved ts lag increased after stoping a tikv [#11352](https://github.com/tikv/tikv/pull/11352) + (dup) - Fix a bug that TiKV cannot delete a range of data (`unsafe_destroy_range` cannot be executed) when the GC worker is busy [#11903](https://github.com/tikv/tikv/issues/11903) + (dup) - Fix the issue that destroying a peer might cause high latency [#10210](https://github.com/tikv/tikv/issues/10210) + (dup) - Fix a bug that the `any_value` function returns a wrong result when regions are empty [#11735](https://github.com/tikv/tikv/issues/11735) + (dup) - Fix the issue that deleting an uninitialized replica might cause an old replica to be recreated [#10533](https://github.com/tikv/tikv/issues/10533) + (dup) - Fix the metadata corruption issue when `Prepare Merge` is triggered after a new election is finished but the isolated peer is not informed [#11526](https://github.com/tikv/tikv/issues/11526) + (dup) - Fix the deadlock issue that happens occasionally when coroutines run too fast [#11549](https://github.com/tikv/tikv/issues/11549) + (dup) - Fix the issue that a down TiKV node causes the resolved timestamp to lag [#11351](https://github.com/tikv/tikv/issues/11351) + (dup) - Fix the issue that batch messages are too large in Raft client implementation [#9714](https://github.com/tikv/tikv/issues/9714) + (dup) - Fix a panic issue that occurs when Region merge, ConfChange, and Snapshot happen at the same time in extreme conditions [#11475](https://github.com/tikv/tikv/issues/11475) + (dup) - Fix the issue that TiKV cannot detect the memory lock when TiKV perform a reverse table scan [#11440](https://github.com/tikv/tikv/issues/11440) + (dup) - Fix the issue that RocksDB flush or compaction causes panic when the disk capacity is full [#11224](https://github.com/tikv/tikv/issues/11224) + (dup) - Fix a bug that tikv-ctl cannot return the correct Region-related information [#11393](https://github.com/tikv/tikv/issues/11393) + (dup) - Fix the issue that the average latency of the by-instance gRPC requests is inaccurate in TiKV metrics [#11299](https://github.com/tikv/tikv/issues/11299) + + TiFlash - Fix the problem that `cast(arg as decimal(x,y))` return wrong result when `arg` overflows the range of `decimal(x,y)` @@ -88,6 +116,9 @@ TiKV - Fix the problem that query gets wrong results when the filter is like `where ` - Fix the problem that `cast(string as datetime)` return wrong result when the string is of format `%Y-%m-%d\n%H:%i:%s` + (dup) - Fix the issue that executing the `INSERT ... SELECT ... ON DUPLICATE KEY UPDATE` statement gets panic [#28078](https://github.com/pingcap/tidb/issues/28078) + (dup) - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist [#28031](https://github.com/pingcap/tidb/issues/28031) [#30709](https://github.com/pingcap/tidb/issues/30709) + + PD - Fix a bug that the operater steps may contain unnecessary or empty JointConsensus steps in certain conditions [#4362](https://github.com/tikv/pd/issues/4362) @@ -95,6 +126,8 @@ TiKV - Fix data race when updating replication mode configuration [#4325](https://github.com/tikv/pd/issues/4325) - Fix a bug that the RLock is not released in certain conditions [#4354](https://github.com/tikv/pd/issues/4354) + (dup) - Fix the issue that the cold hotspot data cannot be deleted from the hotspot statistics [#4390](https://github.com/tikv/pd/issues/4390) + Tools - Backup & Restore (BR) @@ -116,20 +149,40 @@ Tools - Fix a bug that DM task will failed when PARTITION DDL cost a long time [#3854](https://github.com/pingcap/tiflow/issues/3854) - Fix a bug that DM may report "invalid sequence" when upstream is MySQL 8.0 [#3847](https://github.com/pingcap/tiflow/issues/3847) - Fix a bug that redo logs are not cleaned up when removing a paused changefeed. [#3919](https://github.com/pingcap/tiflow/pull/3919) - - CDC client works now when cert's common name was not specified [#3882](https://github.com/pingcap/tiflow/pull/3882) - - Add pre clean up process when s3 enable [#3878](https://github.com/pingcap/tiflow/issues/3523) - Fix a bug of data loss when DM does finer grained retry [#3487](https://github.com/pingcap/tiflow/issues/3487) - HTTP API works as expected now if there are TiCDC nodes of different versions in one cdc cluster. [#3483](https://github.com/pingcap/tiflow/issues/3483) + (dup) - Fix the issue that default values cannot be replicated [#3793](https://github.com/pingcap/tiflow/issues/3793) + (dup) - Fix a bug that MySQL sink generates duplicated `replace` SQL statements if `batch-replace-enable` is disabled [#4501](https://github.com/pingcap/tiflow/issues/4501) + (dup) - Fix the issue that syncer metrics are updated only when querying the status [#4281](https://github.com/pingcap/tiflow/issues/4281) + (dup) - Fix the issue that `mq sink write row` does not have monitoring data [#3431](https://github.com/pingcap/tiflow/issues/3431) + (dup) - Fix the issue that replication cannot be performed when `min.insync.replicas` is smaller than `replication-factor` [#3994](https://github.com/pingcap/tiflow/issues/3994) + (dup) - Fix the issue that the `CREATE VIEW` statement interrupts data replication [#4173](https://github.com/pingcap/tiflow/issues/4173) + (dup) - Fix the issue the schema needs to be reset after a DDL statement is skipped [#4177](https://github.com/pingcap/tiflow/issues/4177) + (dup) - Fix the issue that `mq sink write row` does not have monitoring data [#3431](https://github.com/pingcap/tiflow/issues/3431) + (dup) - Fix the potential panic issue that occurs when a replication task is removed [#3128](https://github.com/pingcap/tiflow/issues/3128) + (dup) - Fix the potential issue that the deadlock causes a replication task to get stuck [#4055](https://github.com/pingcap/tiflow/issues/4055) + (dup) - Fix the TiCDC panic issue that occurs when manually cleaning the task status in etcd [#2980](https://github.com/pingcap/tiflow/issues/2980) + (dup) - Fix the issue that special comments in DDL statements cause the replication task to stop [#3755](https://github.com/pingcap/tiflow/issues/3755) + (dup) - Fix the issue of replication stop caused by the incorrect configuration of `config.Metadata.Timeout` [#3352](https://github.com/pingcap/tiflow/issues/3352) + (dup) - Fix the issue that the service cannot be started because of a timezone issue in the RHEL release [#3584](https://github.com/pingcap/tiflow/issues/3584) + (dup) - Fix the issue that `stopped` changefeeds resume automatically after a cluster upgrade [#3473](https://github.com/pingcap/tiflow/issues/3473) + (dup) - Fix the issue that default values cannot be replicated [#3793](https://github.com/pingcap/tiflow/issues/3793) + (dup) - Fix the issue of overly frequent warnings caused by MySQL sink deadlock [#2706](https://github.com/pingcap/tiflow/issues/2706) + (dup) - Fix the bug that the `enable-old-value` configuration item is not automatically set to `true` on Canal and Maxwell protocols [#3676](https://github.com/pingcap/tiflow/issues/3676) + (dup) - Fix the issue that Avro sink does not support parsing JSON type columns [#3624](https://github.com/pingcap/tiflow/issues/3624) + (dup) - Fix the negative value error in the changefeed checkpoint lag [#3010](https://github.com/pingcap/tiflow/issues/3010) + - TiDB Lightning - Fix the bug that lightning may not clean up metadata schema when some of the import contains no source files. #28144 - Fix the bug that lighting return error if gcs url starts with gs:// #32591 - Make tidb-lightning pre-check output message clearer #30395 - Avoid tikv trigger auto region split by lower the ingest kv count threshold #30018 - (dup) - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist #28031 #30709 - Fix log doesn't output to stdout when passing --log-file="-" #29876 + (dup) - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist #28031 #30709 + # __unsorted （以下内容是原材料，用于核对检查！请不要动！谢谢） + TiDB From b716eb9be5f6173c103098d3e8c0f86dd11219e2 Mon Sep 17 00:00:00 2001 From: xixirangrang <35301108+hfxsd@users.noreply.github.com> Date: Mon, 28 Feb 2022 20:27:36 +0800 Subject: [PATCH 16/58] Update release-5.3.1.md --- releases/release-5.3.1.md | 183 ++++---------------------------------- 1 file changed, 16 insertions(+), 167 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index fb0eb6915efa2..7323f7f0806b5 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -54,9 +54,11 @@ Tools - TiCDC - Expose Kafka producer's configuration parameters can be configured [#4385](https://github.com/pingcap/tiflow/issues/4385) - - Fix OOM in container environments. [#3439](https://github.com/pingcap/tiflow/pull/3439) - Add pre clean up process when s3 enable [#3878](https://github.com/pingcap/tiflow/issues/3523) - TiCDC client works now when cert's common name was not specified [#3882](https://github.com/pingcap/tiflow/pull/3882) + - HTTP API works as expected now if there are TiCDC nodes of different versions in one cdc cluster. [#3483](https://github.com/pingcap/tiflow/issues/3483) + - Correct query-staus progress for loader [#3252](https://github.com/pingcap/tiflow/issues/3252) + - Manage sink checkpoint per table to avoid checkpoint timestamp advance unexpected [#4083](https://github.com/pingcap/tiflow/pull/4083) (dup) - Add the exponential backoff mechanism for restarting a changefeed. [#3329](https://github.com/pingcap/tiflow/issues/3329) (dup) - Change the default value of Kafka Sink `partition-num` to 3 so that TiCDC distributes messages across Kafka partitions more evenly [#3337](https://github.com/pingcap/tiflow/issues/3337) @@ -65,6 +67,10 @@ Tools (dup) - Add more Promethous and Grafana monitoring metrics and alerts, including `no owner alert`, `mounter row`, `table sink total row`, and `buffer sink total row` [#4054](https://github.com/pingcap/tiflow/issues/4054) [#1606](https://github.com/pingcap/tiflow/issues/1606) (dup) - Reduce the time for the KV client to recover when a TiKV store is down [#3191](https://github.com/pingcap/tiflow/issues/3191) + - Lightning + + - Make tidb-lightning pre-check output message clearer [#30395](https://github.com/pingcap/tiflow/issues/30395) + ## Bug Fixes + TiDB @@ -84,7 +90,7 @@ Tools TiKV - - Fix a potential panic (#11746) when snapshot files have been deleted but the peer's status is still Applying. [#11746](https://github.com/tikv/tikv/issues/11746) + - Fix a potential panic when snapshot files have been deleted but the peer's status is still Applying. [#11746](https://github.com/tikv/tikv/issues/11746) - Fix possible QPS drop when `level0_slowdown_trigger` is set explicitly with flow control enabled. [#11424](https://github.com/tikv/tikv/issues/11424) - Fix panic when cgroup controller is not mounted [#11569](https://github.com/tikv/tikv/issues/11569) - Fix resolved ts lag increased after stoping a tikv [#11352](https://github.com/tikv/tikv/pull/11352) @@ -132,7 +138,7 @@ Tools - Backup & Restore (BR) - - Fix a bug that caused region unbalanced after restoring. #31034 + - Fix a bug that caused region unbalanced after restoring. [#31034](https://github.com/pingcap/tiflow/issues/31034) - TiCDC @@ -140,17 +146,15 @@ Tools - Fix a bug that owner exits abnormally when PD leader is killed [#4248](https://github.com/pingcap/tiflow/issues/4248) - Fix the issue that update statement execute error in safemode may cause DM-worker panic [#4317](https://github.com/pingcap/tiflow/issues/4317) - Fix kv client cached region metric could be negative [#4290](https://github.com/pingcap/tiflow/pull/4290) - - Stopping tasks during load phase won't cause the source to be transfered [#3771](https://github.com/pingcap/tiflow/issues/3771) - - Correct query-staus progress for loader [#3252](https://github.com/pingcap/tiflow/issues/3252) - Fix the bug that http API panics when the required processor info is not exist [#3840](https://github.com/pingcap/tiflow/issues/3840) - - Manage sink checkpoint per table to avoid checkpoint timestamp advance unexpected [#4083](https://github.com/pingcap/tiflow/pull/4083) - Fix a bug that when master and worker restart in a particular order, relay status in DM-master is wrong [#3478](https://github.com/pingcap/tiflow/issues/3478) - Fix a bug that DM-worker can't boot up after restart [#3344](https://github.com/pingcap/tiflow/issues/3344) - Fix a bug that DM task will failed when PARTITION DDL cost a long time [#3854](https://github.com/pingcap/tiflow/issues/3854) - Fix a bug that DM may report "invalid sequence" when upstream is MySQL 8.0 [#3847](https://github.com/pingcap/tiflow/issues/3847) - Fix a bug that redo logs are not cleaned up when removing a paused changefeed. [#3919](https://github.com/pingcap/tiflow/pull/3919) - Fix a bug of data loss when DM does finer grained retry [#3487](https://github.com/pingcap/tiflow/issues/3487) - - HTTP API works as expected now if there are TiCDC nodes of different versions in one cdc cluster. [#3483](https://github.com/pingcap/tiflow/issues/3483) + - Fix OOM in container environments. [#3439](https://github.com/pingcap/tiflow/pull/3439) + - Stopping tasks during load phase won't cause the source to be transfered [#3771](https://github.com/pingcap/tiflow/issues/3771) (dup) - Fix the issue that default values cannot be replicated [#3793](https://github.com/pingcap/tiflow/issues/3793) (dup) - Fix a bug that MySQL sink generates duplicated `replace` SQL statements if `batch-replace-enable` is disabled [#4501](https://github.com/pingcap/tiflow/issues/4501) @@ -175,164 +179,9 @@ Tools - TiDB Lightning - - Fix the bug that lightning may not clean up metadata schema when some of the import contains no source files. #28144 - - Fix the bug that lighting return error if gcs url starts with gs:// #32591 - - Make tidb-lightning pre-check output message clearer #30395 - - Avoid tikv trigger auto region split by lower the ingest kv count threshold #30018 - - Fix log doesn't output to stdout when passing --log-file="-" #29876 - - (dup) - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist #28031 #30709 - -# __unsorted （以下内容是原材料，用于核对检查！请不要动！谢谢） - -+ TiDB - - - Fix date formate identifies '\n' as invalid separator [#32503](https://github.com/pingcap/tidb/pull/32503) - - Fix the bug that lightning may not clean up metadata schema when some of the import contains no source files. [#28144](https://github.com/pingcap/tidb/issues/28144) - - Fix `alter column set default` wrongly updates the schema [#31074](https://github.com/pingcap/tidb/issues/31074) - - Fix a bug that caused region unbalanced after restoring. [#31034](https://github.com/pingcap/tidb/issues/31034) - - Fix a bug that turning on tidb_restricted_read_only won't automatically turn on tidb_super_read_only [#31745](https://github.com/pingcap/tidb/issues/31745) - - Fix greatest and least function with collation get wrong result [#31789](https://github.com/pingcap/tidb/issues/31789) - - Fix the crash or error when generating an empty mpp task list. [#31636](https://github.com/pingcap/tidb/issues/31636) - - release-note [#31667](https://github.com/pingcap/tidb/pull/31667) - - Fix index join bug caused by innerWorker panic [#31494](https://github.com/pingcap/tidb/issues/31494) - - Fix double column value are different with MySQL after changing column type from float to double [#31372](https://github.com/pingcap/tidb/issues/31372) - - Planner: make queries with the extra column `_tidb_rowid` can use PointGet [#31543](https://github.com/pingcap/tidb/issues/31543) - - Fix a data race that may cause "invalid transaction" error when executing a query using index lookup join. [#30468](https://github.com/pingcap/tidb/issues/30468) - (dup) - Fix the issue that executing the `INSERT ... SELECT ... ON DUPLICATE KEY UPDATE` statement gets panic [#28078](https://github.com/pingcap/tidb/issues/28078) - - Fix the bug that lighting return error if gcs url starts with gs:// [#32591](https://github.com/pingcap/tidb/issues/32591) - - [#30999](https://github.com/pingcap/tidb/pull/30999) - - Fix a bug that the `mysql_stmt_field_count` returned to mysql client is incorrect in prepare protocal when handling union statement. [#30971](https://github.com/pingcap/tidb/issues/30971) - - Make tidb-lightning pre-check output message clearer [#30395](https://github.com/pingcap/tidb/issues/30395) - - Avoid tikv trigger auto region split by lower the ingest kv count threshold [#30018](https://github.com/pingcap/tidb/issues/30018) - (dup) - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist [#28031](https://github.com/pingcap/tidb/issues/28031) [#30709](https://github.com/pingcap/tidb/issues/30709) - - planner: regard NULL as point when accessing composite index [#29650](https://github.com/pingcap/tidb/issues/29650) - - Fix a bug when reducing order by clause for the index which leads to the wrong result. [#30271](https://github.com/pingcap/tidb/issues/30271) - - The TiDB server now maps a user to an entry in the mysql.user table more consistently. [#30450](https://github.com/pingcap/tidb/pull/30450) - - Fix `MaxDays` and `MaxBackups` not working for slow log. [#30172](https://github.com/pingcap/tidb/pull/30172) - - Lightning: fix log doesn't output to stdout when passing `--log-file="-"` [#29876](https://github.com/pingcap/tidb/issues/29876) - -+ TiKV - - - Reduce CDC recovery time by reduce the number regions that need resolved lock. [#11993](https://github.com/tikv/tikv/issues/11993) - - Increase the size of write batch for raftlog GC to speed up GC. [#11404](https://github.com/tikv/tikv/issues/11404) - (dup) - Fix a bug that TiKV cannot delete a range of data (`unsafe_destroy_range` cannot be executed) when the GC worker is busy [#11903](https://github.com/tikv/tikv/issues/11903) - - Fix a potential panic (#11746) when snapshot files have been deleted but the peer's status is still Applying. [#11746](https://github.com/tikv/tikv/issues/11746) - (dup) - Fix the issue that destroying a peer might cause high latency [#10210](https://github.com/tikv/tikv/issues/10210) - - Fix possible QPS drop when `level0_slowdown_trigger` is set explicitly with flow control enabled. [#11424](https://github.com/tikv/tikv/issues/11424) - - release-note [#11805](https://github.com/tikv/tikv/pull/11805) - (dup) - Fix a bug that the `any_value` function returns a wrong result when regions are empty [#11735](https://github.com/tikv/tikv/issues/11735) - (dup) - Update the proc filesystem (procfs) to v0.12.0 [#11702](https://github.com/tikv/tikv/issues/11702) - (dup) - Fix the issue that deleting an uninitialized replica might cause an old replica to be recreated [#10533](https://github.com/tikv/tikv/issues/10533) - - Please add a release note.None [#11632](https://github.com/tikv/tikv/pull/11632) - - Please add a release note. [#11616](https://github.com/tikv/tikv/pull/11616) - - Fix panic when cgroup controller is not mounted [#11569](https://github.com/tikv/tikv/issues/11569) - (dup) - Fix the metadata corruption issue when `Prepare Merge` is triggered after a new election is finished but the isolated peer is not informed [#11526](https://github.com/tikv/tikv/issues/11526) - (dup) - Fix the deadlock issue that happens occasionally when coroutines run too fast [#11549](https://github.com/tikv/tikv/issues/11549) - (dup) - Fix the issue that a down TiKV node causes the resolved timestamp to lag [#11351](https://github.com/tikv/tikv/issues/11351) - (dup) - Fix the issue that batch messages are too large in Raft client implementation [#9714](https://github.com/tikv/tikv/issues/9714) - (dup) - Fix a panic issue that occurs when Region merge, ConfChange, and Snapshot happen at the same time in extreme conditions [#11475](https://github.com/tikv/tikv/issues/11475) - (dup) - Fix the issue that TiKV cannot detect the memory lock when TiKV perform a reverse table scan [#11440](https://github.com/tikv/tikv/issues/11440) - (dup) - Fix the issue that RocksDB flush or compaction causes panic when the disk capacity is full [#11224](https://github.com/tikv/tikv/issues/11224) - (dup) - Fix a bug that tikv-ctl cannot return the correct Region-related information [#11393](https://github.com/tikv/tikv/issues/11393) - (dup) - Fix the issue that the average latency of the by-instance gRPC requests is inaccurate in TiKV metrics [#11299](https://github.com/tikv/tikv/issues/11299) + - Fix the bug that lightning may not clean up metadata schema when some of the import contains no source files. [#28144](https://github.com/pingcap/tiflow/issues/28144) + - Fix the bug that lighting return error if gcs url starts with gs:// [#32591](https://github.com/pingcap/tiflow/issues/32591) + - Avoid tikv trigger auto region split by lower the ingest kv count threshold [#30018](https://github.com/pingcap/tiflow/issues/30018) + - Fix log doesn't output to stdout when passing --log-file="-" [#29876](https://github.com/pingcap/tiflow/issues/29876) -+ TiFlash - - - Fix error result for function `in` - - Fix cast to decimal overflow bug - - Fix date format identifies '\n' as invalid separator - - Fix cannot find column error after add column when remote read was triggered in tiflash - - Fix str_to_date() function incorrectly handles leading zeros when parsing Microseconds - - Fix the problem of TiFlash crashing when the memory limit is enabled - - Fix the bug that castStringAsReal has different behaivor between tiflash and tikv/tidb - - Avoid false alert of `DB::Exception: Encode type of coprocessor response is not CHBlock` - - Fix random `EstablishMPPConnection` fail after TiFlash server restart. - - Fixed the inconsistent behavior of CastStringAsDecimal between tiflash and tidb/tikv. - - Fix potential data inconsistency after altering a primary key column to a larger int data type - - Fix the bug that results of `where ` is wrong because it will be converted to int type. - - Fix tiflash randomly crash when a mpp query is killed. - -+ PD - - - None. [#4663](https://github.com/tikv/pd/pull/4663) - - Fix a bug that operate steps may contain unnecessary or empty JointConsensus steps in certain conditions - - Fix a bug when demoting single voter directly [#4362](https://github.com/tikv/pd/issues/4362) - (dup) - Fix the issue that the cold hotspot data cannot be deleted from the hotspot statistics [#4390](https://github.com/tikv/pd/issues/4390) - - Improve DR_STATE file content format [#4341](https://github.com/tikv/pd/issues/4341) - - Fix data race when updating replication mode configuration [#4325](https://github.com/tikv/pd/issues/4325) - - Fix the issue that the RLock is not released [#4354](https://github.com/tikv/pd/issues/4354) - -+ Tools - - + TiCDC - - - `None`. [#4660](https://github.com/pingcap/tiflow/issues/4660) - (dup) - Fix the issue that default values cannot be replicated [#3793](https://github.com/pingcap/tiflow/issues/3793) - - Fix a bug that long varchar will report error of "Column length too big..." [#4637](https://github.com/pingcap/tiflow/issues/4637) - - `None`. [#4385](https://github.com/pingcap/tiflow/issues/4385) - - `None`. [#4607](https://github.com/pingcap/tiflow/issues/4607) - - `None`. [#4588](https://github.com/pingcap/tiflow/issues/4588) - - `None`. [#4561](https://github.com/pingcap/tiflow/issues/4561) - - Fix a bug that owner exits abnormally when PD leader is killed [#4248](https://github.com/pingcap/tiflow/issues/4248) - - Allow user set the configuration of Kafka producer dial/write/read timeout [#4385](https://github.com/pingcap/tiflow/issues/4385) - (dup) - Fix a bug that MySQL sink generates duplicated `replace` SQL statements if `batch-replace-enable` is disabled [#4501](https://github.com/pingcap/tiflow/issues/4501) - - `None`. [#4128](https://github.com/pingcap/tiflow/issues/4128) - - `None`. [#4404](https://github.com/pingcap/tiflow/issues/4404) - - Fix the issue that update statement execute error in safemode may cause DM-worker panic. [#4317](https://github.com/pingcap/tiflow/issues/4317) - - None. [#4353](https://github.com/pingcap/tiflow/issues/4353) - - `None`. [#4159](https://github.com/pingcap/tiflow/issues/4159) - - `None`. [#4135](https://github.com/pingcap/tiflow/issues/4135) - (dup) - Add the exponential backoff mechanism for restarting a changefeed. [#3329](https://github.com/pingcap/tiflow/issues/3329) - (dup) - Fix the issue that syncer metrics are updated only when querying the status [#4281](https://github.com/pingcap/tiflow/issues/4281) - (dup) - Fix the issue that `mq sink write row` does not have monitoring data [#3431](https://github.com/pingcap/tiflow/issues/3431) - - Fix kv client cached region metric could be negative. [#4290](https://github.com/pingcap/tiflow/pull/4290) - - `None` [#4266](https://github.com/pingcap/tiflow/issues/4266) - - `None`. [#4223](https://github.com/pingcap/tiflow/issues/4223) - (dup) - Fix the issue that replication cannot be performed when `min.insync.replicas` is smaller than `replication-factor` [#3994](https://github.com/pingcap/tiflow/issues/3994) - - `None`. [#4159](https://github.com/pingcap/tiflow/issues/4159) - (dup) - Fix the issue that the `CREATE VIEW` statement interrupts data replication [#4173](https://github.com/pingcap/tiflow/issues/4173) - (dup) - Fix the issue the schema needs to be reset after a DDL statement is skipped [#4177](https://github.com/pingcap/tiflow/issues/4177) - (dup) - Fix the issue that `mq sink write row` does not have monitoring data [#3431](https://github.com/pingcap/tiflow/issues/3431) - (dup) - Fix the potential panic issue that occurs when a replication task is removed [#3128](https://github.com/pingcap/tiflow/issues/3128) - - `None`. [#4163](https://github.com/pingcap/tiflow/pull/4163) - (dup) - Change the default value of Kafka Sink `partition-num` to 3 so that TiCDC distributes messages across Kafka partitions more evenly [#3337](https://github.com/pingcap/tiflow/issues/3337) - - Fix a bug that stop-task during load phase will cause the source always tries to transfer to a worker [#3771](https://github.com/pingcap/tiflow/issues/3771) - - Fix a bug that wrong progress in query-status for loader [#3252](https://github.com/pingcap/tiflow/issues/3252) - - Fix the bug that http API panic when the processor info we want to get is not exist. [#3840](https://github.com/pingcap/tiflow/issues/3840) - (dup) - Reduce the count of "EventFeed retry rate limited" logs [#4006](https://github.com/pingcap/tiflow/issues/4006) - (dup) - Fix the potential issue that the deadlock causes a replication task to get stuck [#4055](https://github.com/pingcap/tiflow/issues/4055) - - Manage sink checkpoint per table to avoid checkpointTs advances unexpected. [#4083](https://github.com/pingcap/tiflow/pull/4083) - - `None`. [#4079](https://github.com/pingcap/tiflow/pull/4079) - (dup) - Set the default value of `max-message-bytes` to 10M [#4041](https://github.com/pingcap/tiflow/issues/4041) - (dup) - Fix the TiCDC panic issue that occurs when manually cleaning the task status in etcd [#2980](https://github.com/pingcap/tiflow/issues/2980) - - Fix a bug that when master and worker restart in a particular order, relay status in DM-master is wrong [#3478](https://github.com/pingcap/tiflow/issues/3478) - - Fix a bug that DM-worker can't boot up after restart [#3344](https://github.com/pingcap/tiflow/issues/3344) - - Fix a bug that DM task will failed when PARTITION DDL cost a long time [#3854](https://github.com/pingcap/tiflow/issues/3854) - (dup) - Fix the issue that special comments in DDL statements cause the replication task to stop [#3755](https://github.com/pingcap/tiflow/issues/3755) - - release-note [#3976](https://github.com/pingcap/tiflow/pull/3976) - (dup) - Fix the issue of replication stop caused by the incorrect configuration of `config.Metadata.Timeout` [#3352](https://github.com/pingcap/tiflow/issues/3352) - - `None` [#3953](https://github.com/pingcap/tiflow/pull/3953) - - Fix a bug that DM may report "invalid sequence" when upstream is MySQL 8.0. Fix a bug that upstream will die on SHOW SLAVE HOSTS [#3847](https://github.com/pingcap/tiflow/issues/3847) - - Fix a bug that redo logs are not cleaned up when removing a paused changefeed. [#3919](https://github.com/pingcap/tiflow/pull/3919) - (dup) - Fix the issue that the service cannot be started because of a timezone issue in the RHEL release [#3584](https://github.com/pingcap/tiflow/issues/3584) - - Fix cli don't work when cli cert's common name was not added in config that use for start cdc server. [#3882](https://github.com/pingcap/tiflow/pull/3882) - - Add pre clean up process when s3 enable, fix #3523 [#3878](https://github.com/pingcap/tiflow/pull/3878) - - Add redo log related metric [#3877](https://github.com/pingcap/tiflow/pull/3877) - (dup) - Fix the issue that `stopped` changefeeds resume automatically after a cluster upgrade [#3473](https://github.com/pingcap/tiflow/issues/3473) - - Fix a bug of data loss when DM does finer grained retry [#3487](https://github.com/pingcap/tiflow/issues/3487) - (dup) - Fix the issue that default values cannot be replicated [#3793](https://github.com/pingcap/tiflow/issues/3793) - (dup) - Add more Promethous and Grafana monitoring metrics and alerts, including `no owner alert`, `mounter row`, `table sink total row`, and `buffer sink total row` [#4054](https://github.com/pingcap/tiflow/issues/4054) [#1606](https://github.com/pingcap/tiflow/issues/1606) - (dup) - Fix the issue of overly frequent warnings caused by MySQL sink deadlock [#2706](https://github.com/pingcap/tiflow/issues/2706) - (dup) - Fix the bug that the `enable-old-value` configuration item is not automatically set to `true` on Canal and Maxwell protocols [#3676](https://github.com/pingcap/tiflow/issues/3676) - - `None`. [#3765](https://github.com/pingcap/tiflow/pull/3765) - - `None`. [#3712](https://github.com/pingcap/tiflow/pull/3712) - (dup) - Reduce the time for the KV client to recover when a TiKV store is down [#3191](https://github.com/pingcap/tiflow/issues/3191) - (dup) - Fix the issue that Avro sink does not support parsing JSON type columns [#3624](https://github.com/pingcap/tiflow/issues/3624) - - Fix cli don't work when cli cert's common name was not added in config that use for start cdc server. [#3628](https://github.com/pingcap/tiflow/pull/3628) - (dup) - Fix the negative value error in the changefeed checkpoint lag [#3010](https://github.com/pingcap/tiflow/issues/3010) - - Fix HTTP API not working when there are TiCDC nodes of different versions in one cdc cluster. [#3483](https://github.com/pingcap/tiflow/issues/3483) - - Fix a bug when too often query status is called in Load unit, DM-worker may encounter data race or panic [#3457](https://github.com/pingcap/tiflow/issues/3457) - - Fix OOM in container environments. [#3439](https://github.com/pingcap/tiflow/pull/3439) - - Please add a release note. If you don't think this PR needs a release note then fill it with `None`. [#3868](https://github.com/pingcap/tiflow/pull/3868) - - Please add a release note. If you don't think this PR needs a release note then fill it with `None`. [#3256](https://github.com/pingcap/tiflow/pull/3256) + (dup) - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist #28031 [#30709](https://github.com/pingcap/tiflow/issues/30709) From a024415c67c3ffa497758fbab2e6d02df07b2f73 Mon Sep 17 00:00:00 2001 From: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Date: Mon, 28 Feb 2022 20:48:16 +0800 Subject: [PATCH 17/58] Apply suggestions from code review --- releases/release-5.3.1.md | 4 +--- 1 file changed, 1 insertion(+), 3 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 7323f7f0806b5..ba61c111a6675 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -36,6 +36,7 @@ Tools ## Feature enhancements TiDB + - The TiDB server now maps a user to an entry in the mysql.user table more consistently. [#30450](https://github.com/pingcap/tidb/issues/30450) TiKV @@ -122,9 +123,6 @@ TiKV - Fix the problem that query gets wrong results when the filter is like `where ` - Fix the problem that `cast(string as datetime)` return wrong result when the string is of format `%Y-%m-%d\n%H:%i:%s` - (dup) - Fix the issue that executing the `INSERT ... SELECT ... ON DUPLICATE KEY UPDATE` statement gets panic [#28078](https://github.com/pingcap/tidb/issues/28078) - (dup) - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist [#28031](https://github.com/pingcap/tidb/issues/28031) [#30709](https://github.com/pingcap/tidb/issues/30709) - + PD - Fix a bug that the operater steps may contain unnecessary or empty JointConsensus steps in certain conditions [#4362](https://github.com/tikv/pd/issues/4362) From 9fb15fa02a13b682acb43478453e3bb4acaf77d9 Mon Sep 17 00:00:00 2001 From: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Date: Mon, 28 Feb 2022 20:52:29 +0800 Subject: [PATCH 18/58] Apply suggestions from code review --- releases/release-5.3.1.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index ba61c111a6675..1c59784585801 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -177,8 +177,8 @@ Tools - TiDB Lightning - - Fix the bug that lightning may not clean up metadata schema when some of the import contains no source files. [#28144](https://github.com/pingcap/tiflow/issues/28144) - - Fix the bug that lighting return error if gcs url starts with gs:// [#32591](https://github.com/pingcap/tiflow/issues/32591) + - Fix the bug that lightning may not clean up metadata schema when some of the import contains no source files. [#28144](https://github.com/pingcap/tidb/issues/28144) + - Fix the bug that lighting return error if gcs url starts with gs:// [#30254](https://github.com/pingcap/tidb/pull/30254) - Avoid tikv trigger auto region split by lower the ingest kv count threshold [#30018](https://github.com/pingcap/tiflow/issues/30018) - Fix log doesn't output to stdout when passing --log-file="-" [#29876](https://github.com/pingcap/tiflow/issues/29876) From 55c509a0f985bb0bb21474569a415f911e04aee8 Mon Sep 17 00:00:00 2001 From: xixirangrang Date: Mon, 28 Feb 2022 20:53:38 +0800 Subject: [PATCH 19/58] Apply suggestions from code review --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 1c59784585801..dba186556d59c 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -179,7 +179,7 @@ Tools - Fix the bug that lightning may not clean up metadata schema when some of the import contains no source files. [#28144](https://github.com/pingcap/tidb/issues/28144) - Fix the bug that lighting return error if gcs url starts with gs:// [#30254](https://github.com/pingcap/tidb/pull/30254) - - Avoid tikv trigger auto region split by lower the ingest kv count threshold [#30018](https://github.com/pingcap/tiflow/issues/30018) + - Avoid tikv trigger auto region split by lower the ingest kv count threshold [#30018](https://github.com/pingcap/tidb/issues/30018) - Fix log doesn't output to stdout when passing --log-file="-" [#29876](https://github.com/pingcap/tiflow/issues/29876) (dup) - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist #28031 [#30709](https://github.com/pingcap/tiflow/issues/30709) From fabbef0832792f569ece785c91d42b3f1b21323b Mon Sep 17 00:00:00 2001 From: xixirangrang <35301108+hfxsd@users.noreply.github.com> Date: Mon, 28 Feb 2022 21:33:43 +0800 Subject: [PATCH 20/58] Update release-5.3.1.md --- releases/release-5.3.1.md | 34 ++++++---------------------------- 1 file changed, 6 insertions(+), 28 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index dba186556d59c..99ff1a88fe8a5 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -1,6 +1,5 @@ --- title: TiDB 5.3.1 Release Notes -category: Releases --- # TiDB 5.3.1 Release Notes @@ -11,28 +10,6 @@ TiDB version: 5.3.1 ## Compatibility changes -TiDB - -TiKV - -PD - -TiDB Dashboard - -TiFlash - -Tools - - - Backup & Restore (BR) - - - TiCDC - - - Dumpling - - - TiDB Binlog - - - TiDB Lightning - ## Feature enhancements TiDB @@ -55,10 +32,8 @@ Tools - TiCDC - Expose Kafka producer's configuration parameters can be configured [#4385](https://github.com/pingcap/tiflow/issues/4385) - - Add pre clean up process when s3 enable [#3878](https://github.com/pingcap/tiflow/issues/3523) + - Add pre clean up process when s3 enable [#3878](https://github.com/pingcap/tiflow/issues/3878) - TiCDC client works now when cert's common name was not specified [#3882](https://github.com/pingcap/tiflow/pull/3882) - - HTTP API works as expected now if there are TiCDC nodes of different versions in one cdc cluster. [#3483](https://github.com/pingcap/tiflow/issues/3483) - - Correct query-staus progress for loader [#3252](https://github.com/pingcap/tiflow/issues/3252) - Manage sink checkpoint per table to avoid checkpoint timestamp advance unexpected [#4083](https://github.com/pingcap/tiflow/pull/4083) (dup) - Add the exponential backoff mechanism for restarting a changefeed. [#3329](https://github.com/pingcap/tiflow/issues/3329) @@ -68,7 +43,7 @@ Tools (dup) - Add more Promethous and Grafana monitoring metrics and alerts, including `no owner alert`, `mounter row`, `table sink total row`, and `buffer sink total row` [#4054](https://github.com/pingcap/tiflow/issues/4054) [#1606](https://github.com/pingcap/tiflow/issues/1606) (dup) - Reduce the time for the KV client to recover when a TiKV store is down [#3191](https://github.com/pingcap/tiflow/issues/3191) - - Lightning + Lightning - Make tidb-lightning pre-check output message clearer [#30395](https://github.com/pingcap/tiflow/issues/30395) @@ -153,6 +128,9 @@ Tools - Fix a bug of data loss when DM does finer grained retry [#3487](https://github.com/pingcap/tiflow/issues/3487) - Fix OOM in container environments. [#3439](https://github.com/pingcap/tiflow/pull/3439) - Stopping tasks during load phase won't cause the source to be transfered [#3771](https://github.com/pingcap/tiflow/issues/3771) + - Fix query-staus progress for loader [#3252](https://github.com/pingcap/tiflow/issues/3252) + - Fix HTTP API works as expected now if there are TiCDC nodes of different versions in one cdc cluster. [#3483](https://github.com/pingcap/tiflow/issues/3483) + - 修复了当 CDC Redo Log 配置在 S3 存储上时的异常退出问题 [#3523](https://github.com/pingcap/tiflow/issues/3523) (dup) - Fix the issue that default values cannot be replicated [#3793](https://github.com/pingcap/tiflow/issues/3793) (dup) - Fix a bug that MySQL sink generates duplicated `replace` SQL statements if `batch-replace-enable` is disabled [#4501](https://github.com/pingcap/tiflow/issues/4501) @@ -175,7 +153,7 @@ Tools (dup) - Fix the issue that Avro sink does not support parsing JSON type columns [#3624](https://github.com/pingcap/tiflow/issues/3624) (dup) - Fix the negative value error in the changefeed checkpoint lag [#3010](https://github.com/pingcap/tiflow/issues/3010) - - TiDB Lightning + TiDB Lightning - Fix the bug that lightning may not clean up metadata schema when some of the import contains no source files. [#28144](https://github.com/pingcap/tidb/issues/28144) - Fix the bug that lighting return error if gcs url starts with gs:// [#30254](https://github.com/pingcap/tidb/pull/30254) From 859375d518e6e35268f7e514db5a7991e32b7594 Mon Sep 17 00:00:00 2001 From: xixirangrang Date: Mon, 28 Feb 2022 21:39:41 +0800 Subject: [PATCH 21/58] Update releases/release-5.3.1.md --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 99ff1a88fe8a5..64a971d75426d 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -158,6 +158,6 @@ Tools - Fix the bug that lightning may not clean up metadata schema when some of the import contains no source files. [#28144](https://github.com/pingcap/tidb/issues/28144) - Fix the bug that lighting return error if gcs url starts with gs:// [#30254](https://github.com/pingcap/tidb/pull/30254) - Avoid tikv trigger auto region split by lower the ingest kv count threshold [#30018](https://github.com/pingcap/tidb/issues/30018) - - Fix log doesn't output to stdout when passing --log-file="-" [#29876](https://github.com/pingcap/tiflow/issues/29876) + - Print logs to stdout when passing --log-file="-" [#29876](https://github.com/pingcap/tidb/issues/29876) (dup) - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist #28031 [#30709](https://github.com/pingcap/tiflow/issues/30709) From 7c31026be4bb94bd5c92b1248cc87f951528cdb3 Mon Sep 17 00:00:00 2001 From: xixirangrang Date: Mon, 28 Feb 2022 21:40:38 +0800 Subject: [PATCH 22/58] Update releases/release-5.3.1.md --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 64a971d75426d..8ec330c1c71b7 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -45,7 +45,7 @@ Tools Lightning - - Make tidb-lightning pre-check output message clearer [#30395](https://github.com/pingcap/tiflow/issues/30395) + - Make tidb-lightning pre-check output message clearer [#30395](https://github.com/pingcap/tidb/issues/30395) ## Bug Fixes From 0ff0f065cc64de30498cb1a9667071b641a652b8 Mon Sep 17 00:00:00 2001 From: xixirangrang <35301108+hfxsd@users.noreply.github.com> Date: Mon, 28 Feb 2022 22:00:31 +0800 Subject: [PATCH 23/58] Update release-5.3.1.md --- releases/release-5.3.1.md | 22 +++++++++++----------- 1 file changed, 11 insertions(+), 11 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 99ff1a88fe8a5..45d343b3a8579 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -12,22 +12,22 @@ TiDB version: 5.3.1 ## Feature enhancements -TiDB +- TiDB - The TiDB server now maps a user to an entry in the mysql.user table more consistently. [#30450](https://github.com/pingcap/tidb/issues/30450) -TiKV +- TiKV - Reduce CDC recovery time by reduce the number regions that need resolved lock. [#11993](https://github.com/tikv/tikv/issues/11993) - Increase the size of write batch for raftlog GC to speed up GC. [#11404](https://github.com/tikv/tikv/issues/11404) (dup) - Update the proc filesystem (procfs) to v0.12.0 [#11702](https://github.com/tikv/tikv/issues/11702) -PD +- PD - Improve DR_STATE file content format [#4341](https://github.com/tikv/pd/issues/4341) -Tools +- Tools - TiCDC @@ -43,13 +43,13 @@ Tools (dup) - Add more Promethous and Grafana monitoring metrics and alerts, including `no owner alert`, `mounter row`, `table sink total row`, and `buffer sink total row` [#4054](https://github.com/pingcap/tiflow/issues/4054) [#1606](https://github.com/pingcap/tiflow/issues/1606) (dup) - Reduce the time for the KV client to recover when a TiKV store is down [#3191](https://github.com/pingcap/tiflow/issues/3191) - Lightning + - Lightning - Make tidb-lightning pre-check output message clearer [#30395](https://github.com/pingcap/tiflow/issues/30395) ## Bug Fixes -+ TiDB +- TiDB - Fix date formate identifies '\n' as invalid separator [#32503](https://github.com/pingcap/tidb/issues/32503) - Fix alter column set default wrongly updates the schema [#31074](https://github.com/pingcap/tidb/issues/31074) @@ -64,7 +64,7 @@ Tools (dup) - Fix the issue that executing the INSERT ... SELECT ... ON DUPLICATE KEY UPDATE statement gets panic [#28078](https://github.com/pingcap/tidb/issues/28078) -TiKV +- TiKV - Fix a potential panic when snapshot files have been deleted but the peer's status is still Applying. [#11746](https://github.com/tikv/tikv/issues/11746) - Fix possible QPS drop when `level0_slowdown_trigger` is set explicitly with flow control enabled. [#11424](https://github.com/tikv/tikv/issues/11424) @@ -85,7 +85,7 @@ TiKV (dup) - Fix a bug that tikv-ctl cannot return the correct Region-related information [#11393](https://github.com/tikv/tikv/issues/11393) (dup) - Fix the issue that the average latency of the by-instance gRPC requests is inaccurate in TiKV metrics [#11299](https://github.com/tikv/tikv/issues/11299) -+ TiFlash +- TiFlash - Fix the problem that `cast(arg as decimal(x,y))` return wrong result when `arg` overflows the range of `decimal(x,y)` - Fix the problem of TiFlash crashing when `max_memory_usage` and `max_memory_usage_for_all_queries` are enabled @@ -98,7 +98,7 @@ TiKV - Fix the problem that query gets wrong results when the filter is like `where ` - Fix the problem that `cast(string as datetime)` return wrong result when the string is of format `%Y-%m-%d\n%H:%i:%s` -+ PD +- PD - Fix a bug that the operater steps may contain unnecessary or empty JointConsensus steps in certain conditions [#4362](https://github.com/tikv/pd/issues/4362) - Fix a bug that the operator could not be executed when demoting single voter directly [#4444](https://github.com/tikv/pd/issues/4444) @@ -107,7 +107,7 @@ TiKV (dup) - Fix the issue that the cold hotspot data cannot be deleted from the hotspot statistics [#4390](https://github.com/tikv/pd/issues/4390) -Tools +- Tools - Backup & Restore (BR) @@ -153,7 +153,7 @@ Tools (dup) - Fix the issue that Avro sink does not support parsing JSON type columns [#3624](https://github.com/pingcap/tiflow/issues/3624) (dup) - Fix the negative value error in the changefeed checkpoint lag [#3010](https://github.com/pingcap/tiflow/issues/3010) - TiDB Lightning + - TiDB Lightning - Fix the bug that lightning may not clean up metadata schema when some of the import contains no source files. [#28144](https://github.com/pingcap/tidb/issues/28144) - Fix the bug that lighting return error if gcs url starts with gs:// [#30254](https://github.com/pingcap/tidb/pull/30254) From ccfd74b5f59507e4e696937d28ccf77b5971c389 Mon Sep 17 00:00:00 2001 From: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Date: Tue, 1 Mar 2022 12:20:37 +0800 Subject: [PATCH 24/58] Apply suggestions from code review --- releases/release-5.3.1.md | 38 +++++++++++++++++++------------------- 1 file changed, 19 insertions(+), 19 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 5595398324093..247917f8794e9 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -31,10 +31,10 @@ TiDB version: 5.3.1 - TiCDC - - Expose Kafka producer's configuration parameters can be configured [#4385](https://github.com/pingcap/tiflow/issues/4385) - - Add pre clean up process when s3 enable [#3878](https://github.com/pingcap/tiflow/issues/3878) - - TiCDC client works now when cert's common name was not specified [#3882](https://github.com/pingcap/tiflow/pull/3882) - - Manage sink checkpoint per table to avoid checkpoint timestamp advance unexpected [#4083](https://github.com/pingcap/tiflow/pull/4083) + - Expose configuration parameters of Kafka producer to make them configurable in TiCDC [#4385](https://github.com/pingcap/tiflow/issues/4385) + - Add a pre-cleanup process before S3 is enabled [#3878](https://github.com/pingcap/tiflow/issues/3878) + - TiCDC client works when no certificate name is specified [#3627](https://github.com/pingcap/tiflow/issues/3627) + - Manage sink checkpoints per table to avoid checkpoint timestamps advance unexpected [#3545](https://github.com/pingcap/tiflow/issues/3545) (dup) - Add the exponential backoff mechanism for restarting a changefeed. [#3329](https://github.com/pingcap/tiflow/issues/3329) (dup) - Change the default value of Kafka Sink `partition-num` to 3 so that TiCDC distributes messages across Kafka partitions more evenly [#3337](https://github.com/pingcap/tiflow/issues/3337) @@ -115,22 +115,22 @@ TiDB version: 5.3.1 - TiCDC - - Fix a bug that long varchar will report error of "Column length too big" [#4637](https://github.com/pingcap/tiflow/issues/4637) - - Fix a bug that owner exits abnormally when PD leader is killed [#4248](https://github.com/pingcap/tiflow/issues/4248) - - Fix the issue that update statement execute error in safemode may cause DM-worker panic [#4317](https://github.com/pingcap/tiflow/issues/4317) - - Fix kv client cached region metric could be negative [#4290](https://github.com/pingcap/tiflow/pull/4290) - - Fix the bug that http API panics when the required processor info is not exist [#3840](https://github.com/pingcap/tiflow/issues/3840) - - Fix a bug that when master and worker restart in a particular order, relay status in DM-master is wrong [#3478](https://github.com/pingcap/tiflow/issues/3478) - - Fix a bug that DM-worker can't boot up after restart [#3344](https://github.com/pingcap/tiflow/issues/3344) - - Fix a bug that DM task will failed when PARTITION DDL cost a long time [#3854](https://github.com/pingcap/tiflow/issues/3854) - - Fix a bug that DM may report "invalid sequence" when upstream is MySQL 8.0 [#3847](https://github.com/pingcap/tiflow/issues/3847) - - Fix a bug that redo logs are not cleaned up when removing a paused changefeed. [#3919](https://github.com/pingcap/tiflow/pull/3919) + - Fix a bug that long varchars report error of `Column length too big` [#4637](https://github.com/pingcap/tiflow/issues/4637) + - Fix a bug that a TiCDC node exits abnormally when a PD leader is killed [#4248](https://github.com/pingcap/tiflow/issues/4248) + - Fix the issue that execution errors of the update statement in safemode may cause DM-worker panic [#4317](https://github.com/pingcap/tiflow/issues/4317) + - Fix the issue that cached region metric of the KV client may be negative [#4300](https://github.com/pingcap/tiflow/issues/4300) + - Fix the bug that HTTP API panics when required processor info does not exist [#3840](https://github.com/pingcap/tiflow/issues/3840) + - Fix a bug that relay status in DM-master is wrong after restarting DM-master and DM-worker in a particular order [#3478](https://github.com/pingcap/tiflow/issues/3478) + - Fix a bug that DM-worker fails to boot up after a restart [#3344](https://github.com/pingcap/tiflow/issues/3344) + - Fix a bug that a DM task fails if a PARTITION DDL spends too long time [#3854](https://github.com/pingcap/tiflow/issues/3854) + - Fix a bug that DM may report `invalid sequence` when upstream is MySQL 8.0 [#3847](https://github.com/pingcap/tiflow/issues/3847) + - Fix a bug that redo logs are not cleaned up when removing a paused changefeed [#3919](https://github.com/pingcap/tiflow/pull/3919) - Fix a bug of data loss when DM does finer grained retry [#3487](https://github.com/pingcap/tiflow/issues/3487) - - Fix OOM in container environments. [#3439](https://github.com/pingcap/tiflow/pull/3439) - - Stopping tasks during load phase won't cause the source to be transfered [#3771](https://github.com/pingcap/tiflow/issues/3771) - - Fix query-staus progress for loader [#3252](https://github.com/pingcap/tiflow/issues/3252) - - Fix HTTP API works as expected now if there are TiCDC nodes of different versions in one cdc cluster. [#3483](https://github.com/pingcap/tiflow/issues/3483) - - 修复了当 CDC Redo Log 配置在 S3 存储上时的异常退出问题 [#3523](https://github.com/pingcap/tiflow/issues/3523) + - Fix OOM in container environments [#1798](https://github.com/pingcap/tiflow/issues/1798) + - Fix a bug that stopping a loading task results in unexpected transfer of the task [#3771](https://github.com/pingcap/tiflow/issues/3771) + - Fix wrong progress returned for query-staus on loader [#3252](https://github.com/pingcap/tiflow/issues/3252) + - Fix the issue that HTTP API fails to work if there are TiCDC nodes of different versions in a cluster [#3483](https://github.com/pingcap/tiflow/issues/3483) + - Fix the issue that TiCDC exits abnormally when S3 storage is configured with CDC Redo Log [#3523](https://github.com/pingcap/tiflow/issues/3523) (dup) - Fix the issue that default values cannot be replicated [#3793](https://github.com/pingcap/tiflow/issues/3793) (dup) - Fix a bug that MySQL sink generates duplicated `replace` SQL statements if `batch-replace-enable` is disabled [#4501](https://github.com/pingcap/tiflow/issues/4501) From bdcd740a4245671066ae277017b0e6241af374b7 Mon Sep 17 00:00:00 2001 From: xixirangrang Date: Tue, 1 Mar 2022 17:07:23 +0800 Subject: [PATCH 25/58] Apply suggestions from code review Co-authored-by: TomShawn <41534398+TomShawn@users.noreply.github.com> --- releases/release-5.3.1.md | 10 ++++++++-- 1 file changed, 8 insertions(+), 2 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 247917f8794e9..7afd2a9311027 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -10,6 +10,12 @@ TiDB version: 5.3.1 ## Compatibility changes +- Tools + + + TiDB Lightning + + - Decreate the default region max-keys from 1_440_000 to 1_280_000, to avoid too many empty Regions after data import [#30018](https://github.com/pingcap/tidb/issues/30018) + ## Feature enhancements - TiDB @@ -45,7 +51,7 @@ TiDB version: 5.3.1 - Lightning - - Make tidb-lightning pre-check output message clearer [#30395](https://github.com/pingcap/tidb/issues/30395) + - Refine the output message of the precheck to make it more user-friendly when the local disk space check fails [#30395](https://github.com/pingcap/tidb/issues/30395) ## Bug Fixes @@ -111,7 +117,7 @@ TiDB version: 5.3.1 - Backup & Restore (BR) - - Fix a bug that caused region unbalanced after restoring. [#31034](https://github.com/pingcap/tiflow/issues/31034) + - Fix the potential issue that Regions might be unevenly distributed after a restore operation is finished. [#31034](https://github.com/pingcap/tidb/issues/31034) - TiCDC From 1d42a466f4317721edbc9aaa8ae061f450bcbce0 Mon Sep 17 00:00:00 2001 From: Ran Date: Tue, 1 Mar 2022 17:10:24 +0800 Subject: [PATCH 26/58] Apply suggestions from code review --- releases/release-5.3.1.md | 18 +++++++++--------- 1 file changed, 9 insertions(+), 9 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 7afd2a9311027..048cfb165e23d 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -93,16 +93,16 @@ TiDB version: 5.3.1 - TiFlash - - Fix the problem that `cast(arg as decimal(x,y))` return wrong result when `arg` overflows the range of `decimal(x,y)` - - Fix the problem of TiFlash crashing when `max_memory_usage` and `max_memory_usage_for_all_queries` are enabled - - Fix the problem that `cast(string ad real)` returns wrong result - - Fixed the problem that cast(string as decimal) returns wrong result + - Fix the problem that `cast(arg as decimal(x,y))` returns a wrong result when `arg` overflows the range of `decimal(x,y)` + - Fix the TiFlash crash issue that occurs when `max_memory_usage` and `max_memory_usage_for_all_queries` are enabled + - Fix the issue that `cast(string as real)` returns a wrong result + - Fixed the issue that `cast(string as decimal)` returns a wrong result - Fix potential data inconsistency after altering a primary key column to a larger int data type - - Fix the problem that `select (arg0, arg1) in (x,y)` returns wrong result - - Fix the problem that tiflash randomly crash when a mpp query is killed - - Fix the problem that str_to_date return wrong result when the input argument has leading zeros. - - Fix the problem that query gets wrong results when the filter is like `where ` - - Fix the problem that `cast(string as datetime)` return wrong result when the string is of format `%Y-%m-%d\n%H:%i:%s` + - Fix the bug that when `in` has multiple arguments such as in the `select (arg0, arg1) in (x,y)` statement, `in` returns the wrong result + - (dup) Fix the issue that TiFlash might panic when an MPP query is stopped + - Fix the issue that `str_to_date` returns the wrong result when the input argument has leading zeros. + - Fix the issue that the query gets the wrong result when the filter is like `where ` + - Fix the issue that `cast(string as datetime)` returns the wrong result when the string is in `%Y-%m-%d\n%H:%i:%s` format - PD From 2890c156d3519c36963b94c3ba5196044c83d570 Mon Sep 17 00:00:00 2001 From: xixirangrang Date: Tue, 1 Mar 2022 17:33:41 +0800 Subject: [PATCH 27/58] Update releases/release-5.3.1.md --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 048cfb165e23d..5eee83b4a4dd3 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -14,7 +14,7 @@ TiDB version: 5.3.1 + TiDB Lightning - - Decreate the default region max-keys from 1_440_000 to 1_280_000, to avoid too many empty Regions after data import [#30018](https://github.com/pingcap/tidb/issues/30018) + - Decreate the default value of the region max-keys from 1_440_000 to 1_280_000, to avoid too many empty Regions after data import [#30018](https://github.com/pingcap/tidb/issues/30018) ## Feature enhancements From de26dab9277c4c75ea15ffe4af3ac9ce25e49eca Mon Sep 17 00:00:00 2001 From: xixirangrang Date: Tue, 1 Mar 2022 17:35:01 +0800 Subject: [PATCH 28/58] Update releases/release-5.3.1.md --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 5eee83b4a4dd3..bc8a1affc0758 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -14,7 +14,7 @@ TiDB version: 5.3.1 + TiDB Lightning - - Decreate the default value of the region max-keys from 1_440_000 to 1_280_000, to avoid too many empty Regions after data import [#30018](https://github.com/pingcap/tidb/issues/30018) + - Change the default value of the region max-keys from 1_440_000 to 1_280_000, to avoid too many empty Regions after data import [#30018](https://github.com/pingcap/tidb/issues/30018) ## Feature enhancements From 70c430151adc2ecbdbd6093a5bc2885b3e33542b Mon Sep 17 00:00:00 2001 From: Enwei Date: Tue, 1 Mar 2022 18:58:01 +0800 Subject: [PATCH 29/58] update TiKV and PD parts --- releases/release-5.3.1.md | 32 ++++++++++++++++---------------- 1 file changed, 16 insertions(+), 16 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index bc8a1affc0758..d6aa57a2daf41 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -24,14 +24,14 @@ TiDB version: 5.3.1 - TiKV - - Reduce CDC recovery time by reduce the number regions that need resolved lock. [#11993](https://github.com/tikv/tikv/issues/11993) - - Increase the size of write batch for raftlog GC to speed up GC. [#11404](https://github.com/tikv/tikv/issues/11404) + - Reduces TiCDC recovery time by reducing the number of the Regions that require the Resolve Locks step [#11993](https://github.com/tikv/tikv/issues/11993) + - Speed up the Garbage Collection (GC) process by increasing the write batch size when performing GC to Raft logs [#11404](https://github.com/tikv/tikv/issues/11404) (dup) - Update the proc filesystem (procfs) to v0.12.0 [#11702](https://github.com/tikv/tikv/issues/11702) - PD - - Improve DR_STATE file content format [#4341](https://github.com/tikv/pd/issues/4341) + - Optimize the contents' format of the `DR_STATE` file [#4341](https://github.com/tikv/pd/issues/4341) - Tools @@ -72,10 +72,10 @@ TiDB version: 5.3.1 - TiKV - - Fix a potential panic when snapshot files have been deleted but the peer's status is still Applying. [#11746](https://github.com/tikv/tikv/issues/11746) - - Fix possible QPS drop when `level0_slowdown_trigger` is set explicitly with flow control enabled. [#11424](https://github.com/tikv/tikv/issues/11424) - - Fix panic when cgroup controller is not mounted [#11569](https://github.com/tikv/tikv/issues/11569) - - Fix resolved ts lag increased after stoping a tikv [#11352](https://github.com/tikv/tikv/pull/11352) + - Fix the panic issue caused by deleting snapshot files when the peer status is `Applying` [#11746](https://github.com/tikv/tikv/issues/11746) + - Fix the issue of QPS drop when flow control is enabled and `level0_slowdown_trigger` is set explicitly [#11424](https://github.com/tikv/tikv/issues/11424) + - Fix the panic issue that occurs when the cgroup controller is not mounted [#11569](https://github.com/tikv/tikv/issues/11569) + - Fix the issue that the latency of Resolved TS increases after TiKV stops operating [#11352](https://github.com/tikv/tikv/pull/11352) (dup) - Fix a bug that TiKV cannot delete a range of data (`unsafe_destroy_range` cannot be executed) when the GC worker is busy [#11903](https://github.com/tikv/tikv/issues/11903) (dup) - Fix the issue that destroying a peer might cause high latency [#10210](https://github.com/tikv/tikv/issues/10210) @@ -91,6 +91,15 @@ TiDB version: 5.3.1 (dup) - Fix a bug that tikv-ctl cannot return the correct Region-related information [#11393](https://github.com/tikv/tikv/issues/11393) (dup) - Fix the issue that the average latency of the by-instance gRPC requests is inaccurate in TiKV metrics [#11299](https://github.com/tikv/tikv/issues/11299) +- PD + + - Fix a bug that the scheduling process has the unnecessary JointConsensus steps in certain cases [#4362](https://github.com/tikv/pd/issues/4362) + - Fix a bug that the scheduling cannot be executed when demoting a voter directly [#4444](https://github.com/tikv/pd/issues/4444) + - Fix a data race issue that occurs when updating the configuration of the replication mode of replicas [#4325](https://github.com/tikv/pd/issues/4325) + - Fix a bug that the Read lock is not released in certain cases [#4354](https://github.com/tikv/pd/issues/4354) + + (dup) - Fix the issue that the cold hotspot data cannot be deleted from the hotspot statistics [#4390](https://github.com/tikv/pd/issues/4390) + - TiFlash - Fix the problem that `cast(arg as decimal(x,y))` returns a wrong result when `arg` overflows the range of `decimal(x,y)` @@ -104,15 +113,6 @@ TiDB version: 5.3.1 - Fix the issue that the query gets the wrong result when the filter is like `where ` - Fix the issue that `cast(string as datetime)` returns the wrong result when the string is in `%Y-%m-%d\n%H:%i:%s` format -- PD - - - Fix a bug that the operater steps may contain unnecessary or empty JointConsensus steps in certain conditions [#4362](https://github.com/tikv/pd/issues/4362) - - Fix a bug that the operator could not be executed when demoting single voter directly [#4444](https://github.com/tikv/pd/issues/4444) - - Fix data race when updating replication mode configuration [#4325](https://github.com/tikv/pd/issues/4325) - - Fix a bug that the RLock is not released in certain conditions [#4354](https://github.com/tikv/pd/issues/4354) - - (dup) - Fix the issue that the cold hotspot data cannot be deleted from the hotspot statistics [#4390](https://github.com/tikv/pd/issues/4390) - - Tools - Backup & Restore (BR) From 56b2ba248f29342068928a406680e3ccf98763f4 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Tue, 1 Mar 2022 19:31:43 +0800 Subject: [PATCH 30/58] Apply suggestions from code review Co-authored-by: Grace Cai --- releases/release-5.3.1.md | 22 +++++++++++----------- 1 file changed, 11 insertions(+), 11 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index d6aa57a2daf41..09d345f0e4743 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -20,7 +20,7 @@ TiDB version: 5.3.1 - TiDB - - The TiDB server now maps a user to an entry in the mysql.user table more consistently. [#30450](https://github.com/pingcap/tidb/issues/30450) + - Optimize the mapping logic of user login mode to make the logging more MySQL-compatible [#30450](https://github.com/pingcap/tidb/pull/30450) - TiKV @@ -57,16 +57,16 @@ TiDB version: 5.3.1 - TiDB - - Fix date formate identifies '\n' as invalid separator [#32503](https://github.com/pingcap/tidb/issues/32503) - - Fix alter column set default wrongly updates the schema [#31074](https://github.com/pingcap/tidb/issues/31074) - - Fix a bug that turning on tidb_restricted_read_only won't automatically turn on tidb_super_read_only [#31745](https://github.com/pingcap/tidb/issues/31745) - - Fix greatest and least function with collation get wrong result [#31789](https://github.com/pingcap/tidb/issues/31789) - - Fix the crash or error when generating an empty mpp task list. [#31636](https://github.com/pingcap/tidb/issues/31636) - - Fix index join bug caused by innerWorker panic [#31494](https://github.com/pingcap/tidb/issues/31494) - - Fix double column value are different with MySQL after changing column type from float to double [#31372](https://github.com/pingcap/tidb/issues/31372) - - Fix a data race that may cause "invalid transaction" error when executing a query using index lookup join. [#30468](https://github.com/pingcap/tidb/issues/30468) - - Fix a bug when reducing order by clause for the index which leads to the wrong result. [#30271](https://github.com/pingcap/tidb/issues/30271) - - Fix `MaxDays` and `MaxBackups` not working for slow log. [#25716](https://github.com/pingcap/tidb/issues/25716) + - Fix the issue that `date_format` in TiDB handles `'\n'` in a MySQL-incompatible way [#32503](https://github.com/pingcap/tidb/issues/32503) + - Fix the issue that `alter column set default` wrongly updates the table schema [#31074](https://github.com/pingcap/tidb/issues/31074) + - Fix a bug that `tidb_super_read_only` is not automatically enabled when `tidb_restricted_read_only` is enabled [#31745](https://github.com/pingcap/tidb/issues/31745) + - Fix the issue that the `greatest` or `least` function with collation gets wrong result [#31789](https://github.com/pingcap/tidb/issues/31789) + - Fix the MPP task list empty error when executing a query [#31636](https://github.com/pingcap/tidb/issues/31636) + - Fix wrong results of index join caused by an innerWorker panic [#31494](https://github.com/pingcap/tidb/issues/31494) + - Fix wrong query results after changing the column type from `FLOAT` to `DOUBLE` [#31372](https://github.com/pingcap/tidb/issues/31372) + - Fix the "invalid transaction" error when executing a query using index lookup join [#30468](https://github.com/pingcap/tidb/issues/30468) + - Fix wrong query results due to the optimization of `Order By` [#30271](https://github.com/pingcap/tidb/issues/30271) + - Fix the issue that the configurations of `MaxDays` and `MaxBackups` do not take effect for slow log [#25716](https://github.com/pingcap/tidb/issues/25716) (dup) - Fix the issue that executing the INSERT ... SELECT ... ON DUPLICATE KEY UPDATE statement gets panic [#28078](https://github.com/pingcap/tidb/issues/28078) From 53a262069d70649369659f9bc5ac5e822dbebd9f Mon Sep 17 00:00:00 2001 From: Grace Cai Date: Tue, 1 Mar 2022 19:37:41 +0800 Subject: [PATCH 31/58] Update releases/release-5.3.1.md --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 09d345f0e4743..62689c232396a 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -66,7 +66,7 @@ TiDB version: 5.3.1 - Fix wrong query results after changing the column type from `FLOAT` to `DOUBLE` [#31372](https://github.com/pingcap/tidb/issues/31372) - Fix the "invalid transaction" error when executing a query using index lookup join [#30468](https://github.com/pingcap/tidb/issues/30468) - Fix wrong query results due to the optimization of `Order By` [#30271](https://github.com/pingcap/tidb/issues/30271) - - Fix the issue that the configurations of `MaxDays` and `MaxBackups` do not take effect for slow log [#25716](https://github.com/pingcap/tidb/issues/25716) + - Fix the issue that the configurations of `MaxDays` and `MaxBackups` do not take effect on the slow log [#25716](https://github.com/pingcap/tidb/issues/25716) (dup) - Fix the issue that executing the INSERT ... SELECT ... ON DUPLICATE KEY UPDATE statement gets panic [#28078](https://github.com/pingcap/tidb/issues/28078) From 95d91083433c9f5f285e0279632c5f2f884a2125 Mon Sep 17 00:00:00 2001 From: Grace Cai Date: Tue, 1 Mar 2022 19:39:41 +0800 Subject: [PATCH 32/58] Update releases/release-5.3.1.md --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 62689c232396a..2a4d15a322ae1 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -64,7 +64,7 @@ TiDB version: 5.3.1 - Fix the MPP task list empty error when executing a query [#31636](https://github.com/pingcap/tidb/issues/31636) - Fix wrong results of index join caused by an innerWorker panic [#31494](https://github.com/pingcap/tidb/issues/31494) - Fix wrong query results after changing the column type from `FLOAT` to `DOUBLE` [#31372](https://github.com/pingcap/tidb/issues/31372) - - Fix the "invalid transaction" error when executing a query using index lookup join [#30468](https://github.com/pingcap/tidb/issues/30468) + - Fix the `invalid transaction` error when executing a query using index lookup join [#30468](https://github.com/pingcap/tidb/issues/30468) - Fix wrong query results due to the optimization of `Order By` [#30271](https://github.com/pingcap/tidb/issues/30271) - Fix the issue that the configurations of `MaxDays` and `MaxBackups` do not take effect on the slow log [#25716](https://github.com/pingcap/tidb/issues/25716) From c355be0b15febca21e8cb292d47ed99b47c9377f Mon Sep 17 00:00:00 2001 From: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Date: Tue, 1 Mar 2022 20:03:48 +0800 Subject: [PATCH 33/58] Update a TiCDC bug fix --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 2a4d15a322ae1..5bedc45e22b37 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -40,7 +40,7 @@ TiDB version: 5.3.1 - Expose configuration parameters of Kafka producer to make them configurable in TiCDC [#4385](https://github.com/pingcap/tiflow/issues/4385) - Add a pre-cleanup process before S3 is enabled [#3878](https://github.com/pingcap/tiflow/issues/3878) - TiCDC client works when no certificate name is specified [#3627](https://github.com/pingcap/tiflow/issues/3627) - - Manage sink checkpoints per table to avoid checkpoint timestamps advance unexpected [#3545](https://github.com/pingcap/tiflow/issues/3545) + - Manage sink checkpoints per table to avoid unexpected advance of checkpoint timestamps [#3545](https://github.com/pingcap/tiflow/issues/3545) (dup) - Add the exponential backoff mechanism for restarting a changefeed. [#3329](https://github.com/pingcap/tiflow/issues/3329) (dup) - Change the default value of Kafka Sink `partition-num` to 3 so that TiCDC distributes messages across Kafka partitions more evenly [#3337](https://github.com/pingcap/tiflow/issues/3337) From 978d5eda740897e99a5c5645a53e2c8ca34b89d6 Mon Sep 17 00:00:00 2001 From: xixirangrang Date: Tue, 1 Mar 2022 20:44:17 +0800 Subject: [PATCH 34/58] Apply suggestions from code review --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 5bedc45e22b37..40d8c1f897df0 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -14,7 +14,7 @@ TiDB version: 5.3.1 + TiDB Lightning - - Change the default value of the region max-keys from 1_440_000 to 1_280_000, to avoid too many empty Regions after data import [#30018](https://github.com/pingcap/tidb/issues/30018) + - Change the default value of `regionMaxKeyCount` from 1_440_000 to 1_280_000, to avoid too many empty Regions after data import [#30018](https://github.com/pingcap/tidb/issues/30018) ## Feature enhancements From 49b77024a5c9d976bfad210deaa054f40e7e37cd Mon Sep 17 00:00:00 2001 From: xixirangrang Date: Tue, 1 Mar 2022 21:14:19 +0800 Subject: [PATCH 35/58] Apply suggestions from code review --- releases/release-5.3.1.md | 7 +++---- 1 file changed, 3 insertions(+), 4 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 40d8c1f897df0..179c9577f2ed4 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -161,9 +161,8 @@ TiDB version: 5.3.1 - TiDB Lightning - - Fix the bug that lightning may not clean up metadata schema when some of the import contains no source files. [#28144](https://github.com/pingcap/tidb/issues/28144) - - Fix the bug that lighting return error if gcs url starts with gs:// [#30254](https://github.com/pingcap/tidb/pull/30254) - - Avoid tikv trigger auto region split by lower the ingest kv count threshold [#30018](https://github.com/pingcap/tidb/issues/30018) - - Print logs to stdout when passing --log-file="-" [#29876](https://github.com/pingcap/tidb/issues/29876) + - Fix the bug that Lightning may not delete the metadata schema when some of the import contains no source files. [#28144](https://github.com/pingcap/tidb/issues/28144) + - Fix the bug that Lightning returns an error if the storage URL is "gs://xxx" instead of "gcs://xxx" [#30254](https://github.com/pingcap/tidb/pull/30254) + - Fix the issue that setting --log-file="-" will not print any log to stdout [#29876](https://github.com/pingcap/tidb/issues/29876) (dup) - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist #28031 [#30709](https://github.com/pingcap/tiflow/issues/30709) From e1698db001c4abcebea23ca4e220a408ad216a36 Mon Sep 17 00:00:00 2001 From: Enwei Date: Tue, 1 Mar 2022 21:18:10 +0800 Subject: [PATCH 36/58] Apply suggestions from code review Co-authored-by: Ran --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 179c9577f2ed4..604a6477747e6 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -74,7 +74,7 @@ TiDB version: 5.3.1 - Fix the panic issue caused by deleting snapshot files when the peer status is `Applying` [#11746](https://github.com/tikv/tikv/issues/11746) - Fix the issue of QPS drop when flow control is enabled and `level0_slowdown_trigger` is set explicitly [#11424](https://github.com/tikv/tikv/issues/11424) - - Fix the panic issue that occurs when the cgroup controller is not mounted [#11569](https://github.com/tikv/tikv/issues/11569) + - Fix the panic issue that occurs when the cgroup controller is not mounted [#11569](https://github.com/tikv/tikv/issues/11569) - Fix the issue that the latency of Resolved TS increases after TiKV stops operating [#11352](https://github.com/tikv/tikv/pull/11352) (dup) - Fix a bug that TiKV cannot delete a range of data (`unsafe_destroy_range` cannot be executed) when the GC worker is busy [#11903](https://github.com/tikv/tikv/issues/11903) From 9342f8b7506b642c432021acfee95d29c5e0b306 Mon Sep 17 00:00:00 2001 From: xixirangrang <35301108+hfxsd@users.noreply.github.com> Date: Tue, 1 Mar 2022 22:51:13 +0800 Subject: [PATCH 37/58] Update release-5.3.1.md --- releases/release-5.3.1.md | 24 ++++++++++++------------ 1 file changed, 12 insertions(+), 12 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 604a6477747e6..4669539525e9a 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -13,7 +13,7 @@ TiDB version: 5.3.1 - Tools + TiDB Lightning - + - Change the default value of `regionMaxKeyCount` from 1_440_000 to 1_280_000, to avoid too many empty Regions after data import [#30018](https://github.com/pingcap/tidb/issues/30018) ## Feature enhancements @@ -24,22 +24,22 @@ TiDB version: 5.3.1 - TiKV - - Reduces TiCDC recovery time by reducing the number of the Regions that require the Resolve Locks step [#11993](https://github.com/tikv/tikv/issues/11993) + - Reduce the TiCDC recovery time by reducing the number of the Regions that require the Resolve Locks step [#11993](https://github.com/tikv/tikv/issues/11993) - Speed up the Garbage Collection (GC) process by increasing the write batch size when performing GC to Raft logs [#11404](https://github.com/tikv/tikv/issues/11404) (dup) - Update the proc filesystem (procfs) to v0.12.0 [#11702](https://github.com/tikv/tikv/issues/11702) - PD - - Optimize the contents' format of the `DR_STATE` file [#4341](https://github.com/tikv/pd/issues/4341) + - Optimize the content format of the `DR_STATE` file [#4341](https://github.com/tikv/pd/issues/4341) - Tools - TiCDC - - Expose configuration parameters of Kafka producer to make them configurable in TiCDC [#4385](https://github.com/pingcap/tiflow/issues/4385) + - Expose configuration parameters of the Kafka producer to make them configurable in TiCDC [#4385](https://github.com/pingcap/tiflow/issues/4385) - Add a pre-cleanup process before S3 is enabled [#3878](https://github.com/pingcap/tiflow/issues/3878) - - TiCDC client works when no certificate name is specified [#3627](https://github.com/pingcap/tiflow/issues/3627) + - The TiCDC client works when no certificate name is specified [#3627](https://github.com/pingcap/tiflow/issues/3627) - Manage sink checkpoints per table to avoid unexpected advance of checkpoint timestamps [#3545](https://github.com/pingcap/tiflow/issues/3545) (dup) - Add the exponential backoff mechanism for restarting a changefeed. [#3329](https://github.com/pingcap/tiflow/issues/3329) @@ -51,7 +51,7 @@ TiDB version: 5.3.1 - Lightning - - Refine the output message of the precheck to make it more user-friendly when the local disk space check fails [#30395](https://github.com/pingcap/tidb/issues/30395) + - Refine the output message of the precheck to make it more user-friendly when the local disk space check fails [#30395](https://github.com/pingcap/tidb/issues/30395) ## Bug Fixes @@ -123,12 +123,12 @@ TiDB version: 5.3.1 - Fix a bug that long varchars report error of `Column length too big` [#4637](https://github.com/pingcap/tiflow/issues/4637) - Fix a bug that a TiCDC node exits abnormally when a PD leader is killed [#4248](https://github.com/pingcap/tiflow/issues/4248) - - Fix the issue that execution errors of the update statement in safemode may cause DM-worker panic [#4317](https://github.com/pingcap/tiflow/issues/4317) + - Fix the issue that execution errors of the update statement in safemode may cause the DM-worker panic [#4317](https://github.com/pingcap/tiflow/issues/4317) - Fix the issue that cached region metric of the KV client may be negative [#4300](https://github.com/pingcap/tiflow/issues/4300) - - Fix the bug that HTTP API panics when required processor info does not exist [#3840](https://github.com/pingcap/tiflow/issues/3840) - - Fix a bug that relay status in DM-master is wrong after restarting DM-master and DM-worker in a particular order [#3478](https://github.com/pingcap/tiflow/issues/3478) + - Fix the bug that HTTP API panics when the required processor info does not exist [#3840](https://github.com/pingcap/tiflow/issues/3840) + - Fix a bug that the relay status in the DM-master is wrong after restarting the DM-master and DM-worker in a particular order [#3478](https://github.com/pingcap/tiflow/issues/3478) - Fix a bug that DM-worker fails to boot up after a restart [#3344](https://github.com/pingcap/tiflow/issues/3344) - - Fix a bug that a DM task fails if a PARTITION DDL spends too long time [#3854](https://github.com/pingcap/tiflow/issues/3854) + - Fix a bug that a DM task fails if running a PARTITION DDL takes too long time [#3854](https://github.com/pingcap/tiflow/issues/3854) - Fix a bug that DM may report `invalid sequence` when upstream is MySQL 8.0 [#3847](https://github.com/pingcap/tiflow/issues/3847) - Fix a bug that redo logs are not cleaned up when removing a paused changefeed [#3919](https://github.com/pingcap/tiflow/pull/3919) - Fix a bug of data loss when DM does finer grained retry [#3487](https://github.com/pingcap/tiflow/issues/3487) @@ -162,7 +162,7 @@ TiDB version: 5.3.1 - TiDB Lightning - Fix the bug that Lightning may not delete the metadata schema when some of the import contains no source files. [#28144](https://github.com/pingcap/tidb/issues/28144) - - Fix the bug that Lightning returns an error if the storage URL is "gs://xxx" instead of "gcs://xxx" [#30254](https://github.com/pingcap/tidb/pull/30254) - - Fix the issue that setting --log-file="-" will not print any log to stdout [#29876](https://github.com/pingcap/tidb/issues/29876) + - Fix the bug that Lightning returns an error if the storage URL prefix is "gs://xxx" instead of "gcs://xxx" [#30254](https://github.com/pingcap/tidb/pull/30254) + - Fix the issue that setting --log-file="-" will not print any log to stdout [#29876](https://github.com/pingcap/tidb/issues/29876) (dup) - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist #28031 [#30709](https://github.com/pingcap/tiflow/issues/30709) From a34d68e05724279e5c2148cc9f0fe0b2a1aa5b1f Mon Sep 17 00:00:00 2001 From: Ran Date: Wed, 2 Mar 2022 09:13:05 +0800 Subject: [PATCH 38/58] Apply suggestions from code review Co-authored-by: Enwei --- releases/release-5.3.1.md | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 4669539525e9a..a08579f97512f 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -102,16 +102,16 @@ TiDB version: 5.3.1 - TiFlash - - Fix the problem that `cast(arg as decimal(x,y))` returns a wrong result when `arg` overflows the range of `decimal(x,y)` + - Fix the issue that `cast(arg as decimal(x,y))` returns a wrong result when the input argument `arg` overflows the range of `decimal(x,y)` - Fix the TiFlash crash issue that occurs when `max_memory_usage` and `max_memory_usage_for_all_queries` are enabled - Fix the issue that `cast(string as real)` returns a wrong result - Fixed the issue that `cast(string as decimal)` returns a wrong result - Fix potential data inconsistency after altering a primary key column to a larger int data type - - Fix the bug that when `in` has multiple arguments such as in the `select (arg0, arg1) in (x,y)` statement, `in` returns the wrong result + - Fix the bug that when `in` has multiple arguments in the statements like `select (arg0, arg1) in (x,y)`, `in` returns a wrong result - (dup) Fix the issue that TiFlash might panic when an MPP query is stopped - - Fix the issue that `str_to_date` returns the wrong result when the input argument has leading zeros. - - Fix the issue that the query gets the wrong result when the filter is like `where ` - - Fix the issue that `cast(string as datetime)` returns the wrong result when the string is in `%Y-%m-%d\n%H:%i:%s` format + - Fix the issue that `str_to_date` returns a wrong result when the input argument has leading zeros + - Fix the issue that the query gets a wrong result when the filter is in `where ` format + - Fix the issue that `cast(string as datetime)` returns the wrong result when the input argument `string` is in `%Y-%m-%d\n%H:%i:%s` format - Tools From f12ea2bc3f5a51de8584700f61b030f3c573d229 Mon Sep 17 00:00:00 2001 From: xixirangrang Date: Wed, 2 Mar 2022 09:14:49 +0800 Subject: [PATCH 39/58] Apply suggestions from code review Co-authored-by: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> --- releases/release-5.3.1.md | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index a08579f97512f..e62ed31640240 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -49,7 +49,7 @@ TiDB version: 5.3.1 (dup) - Add more Promethous and Grafana monitoring metrics and alerts, including `no owner alert`, `mounter row`, `table sink total row`, and `buffer sink total row` [#4054](https://github.com/pingcap/tiflow/issues/4054) [#1606](https://github.com/pingcap/tiflow/issues/1606) (dup) - Reduce the time for the KV client to recover when a TiKV store is down [#3191](https://github.com/pingcap/tiflow/issues/3191) - - Lightning + - TiDB Lightning - Refine the output message of the precheck to make it more user-friendly when the local disk space check fails [#30395](https://github.com/pingcap/tidb/issues/30395) @@ -117,7 +117,7 @@ TiDB version: 5.3.1 - Backup & Restore (BR) - - Fix the potential issue that Regions might be unevenly distributed after a restore operation is finished. [#31034](https://github.com/pingcap/tidb/issues/31034) + - Fix the potential issue that Regions might be unevenly distributed after a restore operation is finished [#31034](https://github.com/pingcap/tidb/issues/31034) - TiCDC @@ -161,8 +161,8 @@ TiDB version: 5.3.1 - TiDB Lightning - - Fix the bug that Lightning may not delete the metadata schema when some of the import contains no source files. [#28144](https://github.com/pingcap/tidb/issues/28144) - - Fix the bug that Lightning returns an error if the storage URL prefix is "gs://xxx" instead of "gcs://xxx" [#30254](https://github.com/pingcap/tidb/pull/30254) - - Fix the issue that setting --log-file="-" will not print any log to stdout [#29876](https://github.com/pingcap/tidb/issues/29876) + - Fix the bug that TiDB Lightning may not delete the metadata schema when some imports contain no source files [#28144](https://github.com/pingcap/tidb/issues/28144) + - Fix the bug that TiDB Lightning returns an error if the storage URL prefix is "gs://xxx", instead of "gcs://xxx" [#30254](https://github.com/pingcap/tidb/pull/30254) + - Fix the issue that setting --log-file="-" does not print any log to stdout [#29876](https://github.com/pingcap/tidb/issues/29876) (dup) - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist #28031 [#30709](https://github.com/pingcap/tiflow/issues/30709) From c217778cdb18c5446daa45adbb6f19d31b15e448 Mon Sep 17 00:00:00 2001 From: xixirangrang <35301108+hfxsd@users.noreply.github.com> Date: Wed, 2 Mar 2022 09:38:44 +0800 Subject: [PATCH 40/58] Update release-5.3.1.md --- releases/release-5.3.1.md | 18 +++++++++--------- 1 file changed, 9 insertions(+), 9 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index e62ed31640240..ff61d4caea118 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -105,13 +105,13 @@ TiDB version: 5.3.1 - Fix the issue that `cast(arg as decimal(x,y))` returns a wrong result when the input argument `arg` overflows the range of `decimal(x,y)` - Fix the TiFlash crash issue that occurs when `max_memory_usage` and `max_memory_usage_for_all_queries` are enabled - Fix the issue that `cast(string as real)` returns a wrong result - - Fixed the issue that `cast(string as decimal)` returns a wrong result + - Fix the issue that `cast(string as decimal)` returns a wrong result - Fix potential data inconsistency after altering a primary key column to a larger int data type - Fix the bug that when `in` has multiple arguments in the statements like `select (arg0, arg1) in (x,y)`, `in` returns a wrong result - (dup) Fix the issue that TiFlash might panic when an MPP query is stopped - Fix the issue that `str_to_date` returns a wrong result when the input argument has leading zeros - - Fix the issue that the query gets a wrong result when the filter is in `where ` format - - Fix the issue that `cast(string as datetime)` returns the wrong result when the input argument `string` is in `%Y-%m-%d\n%H:%i:%s` format + - Fix the issue that the query returns a wrong result when the filter is in the `where ` format + - Fix the issue that `cast(string as datetime)` returns a wrong result when the input argument `string` is in the `%Y-%m-%d\n%H:%i:%s` format - Tools @@ -121,13 +121,13 @@ TiDB version: 5.3.1 - TiCDC - - Fix a bug that long varchars report error of `Column length too big` [#4637](https://github.com/pingcap/tiflow/issues/4637) + - Fix a bug that long varchars report an error `Column length too big` [#4637](https://github.com/pingcap/tiflow/issues/4637) - Fix a bug that a TiCDC node exits abnormally when a PD leader is killed [#4248](https://github.com/pingcap/tiflow/issues/4248) - Fix the issue that execution errors of the update statement in safemode may cause the DM-worker panic [#4317](https://github.com/pingcap/tiflow/issues/4317) - - Fix the issue that cached region metric of the KV client may be negative [#4300](https://github.com/pingcap/tiflow/issues/4300) - - Fix the bug that HTTP API panics when the required processor info does not exist [#3840](https://github.com/pingcap/tiflow/issues/3840) + - Fix the issue that cached region metric of the TiKV client may be negative [#4300](https://github.com/pingcap/tiflow/issues/4300) + - Fix the bug that HTTP API panics when the required processor infomation does not exist [#3840](https://github.com/pingcap/tiflow/issues/3840) - Fix a bug that the relay status in the DM-master is wrong after restarting the DM-master and DM-worker in a particular order [#3478](https://github.com/pingcap/tiflow/issues/3478) - - Fix a bug that DM-worker fails to boot up after a restart [#3344](https://github.com/pingcap/tiflow/issues/3344) + - Fix a bug that the DM-worker fails to boot up after a restart [#3344](https://github.com/pingcap/tiflow/issues/3344) - Fix a bug that a DM task fails if running a PARTITION DDL takes too long time [#3854](https://github.com/pingcap/tiflow/issues/3854) - Fix a bug that DM may report `invalid sequence` when upstream is MySQL 8.0 [#3847](https://github.com/pingcap/tiflow/issues/3847) - Fix a bug that redo logs are not cleaned up when removing a paused changefeed [#3919](https://github.com/pingcap/tiflow/pull/3919) @@ -136,7 +136,7 @@ TiDB version: 5.3.1 - Fix a bug that stopping a loading task results in unexpected transfer of the task [#3771](https://github.com/pingcap/tiflow/issues/3771) - Fix wrong progress returned for query-staus on loader [#3252](https://github.com/pingcap/tiflow/issues/3252) - Fix the issue that HTTP API fails to work if there are TiCDC nodes of different versions in a cluster [#3483](https://github.com/pingcap/tiflow/issues/3483) - - Fix the issue that TiCDC exits abnormally when S3 storage is configured with CDC Redo Log [#3523](https://github.com/pingcap/tiflow/issues/3523) + - Fix the issue that TiCDC exits abnormally when the S3 storage is configured with TiCDC Redo Log [#3523](https://github.com/pingcap/tiflow/issues/3523) (dup) - Fix the issue that default values cannot be replicated [#3793](https://github.com/pingcap/tiflow/issues/3793) (dup) - Fix a bug that MySQL sink generates duplicated `replace` SQL statements if `batch-replace-enable` is disabled [#4501](https://github.com/pingcap/tiflow/issues/4501) @@ -161,7 +161,7 @@ TiDB version: 5.3.1 - TiDB Lightning - - Fix the bug that TiDB Lightning may not delete the metadata schema when some imports contain no source files [#28144](https://github.com/pingcap/tidb/issues/28144) + - Fix the bug that TiDB Lightning may not delete the metadata schema when some import tasks do not contain source files [#28144](https://github.com/pingcap/tidb/issues/28144) - Fix the bug that TiDB Lightning returns an error if the storage URL prefix is "gs://xxx", instead of "gcs://xxx" [#30254](https://github.com/pingcap/tidb/pull/30254) - Fix the issue that setting --log-file="-" does not print any log to stdout [#29876](https://github.com/pingcap/tidb/issues/29876) From 4e60e4bddecb6c49d399fbc70bf81226603384dd Mon Sep 17 00:00:00 2001 From: xixirangrang <35301108+hfxsd@users.noreply.github.com> Date: Wed, 2 Mar 2022 10:38:47 +0800 Subject: [PATCH 41/58] Update release-5.3.1.md --- releases/release-5.3.1.md | 95 ++++++++++++++++++--------------------- 1 file changed, 44 insertions(+), 51 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index ff61d4caea118..bb3ea01033fe1 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -26,8 +26,7 @@ TiDB version: 5.3.1 - Reduce the TiCDC recovery time by reducing the number of the Regions that require the Resolve Locks step [#11993](https://github.com/tikv/tikv/issues/11993) - Speed up the Garbage Collection (GC) process by increasing the write batch size when performing GC to Raft logs [#11404](https://github.com/tikv/tikv/issues/11404) - - (dup) - Update the proc filesystem (procfs) to v0.12.0 [#11702](https://github.com/tikv/tikv/issues/11702) + - Update the proc filesystem (procfs) to v0.12.0 [#11702](https://github.com/tikv/tikv/issues/11702) - PD @@ -41,13 +40,12 @@ TiDB version: 5.3.1 - Add a pre-cleanup process before S3 is enabled [#3878](https://github.com/pingcap/tiflow/issues/3878) - The TiCDC client works when no certificate name is specified [#3627](https://github.com/pingcap/tiflow/issues/3627) - Manage sink checkpoints per table to avoid unexpected advance of checkpoint timestamps [#3545](https://github.com/pingcap/tiflow/issues/3545) - - (dup) - Add the exponential backoff mechanism for restarting a changefeed. [#3329](https://github.com/pingcap/tiflow/issues/3329) - (dup) - Change the default value of Kafka Sink `partition-num` to 3 so that TiCDC distributes messages across Kafka partitions more evenly [#3337](https://github.com/pingcap/tiflow/issues/3337) - (dup) - Reduce the count of "EventFeed retry rate limited" logs [#4006](https://github.com/pingcap/tiflow/issues/4006) - (dup) - Set the default value of `max-message-bytes` to 10M [#4041](https://github.com/pingcap/tiflow/issues/4041) - (dup) - Add more Promethous and Grafana monitoring metrics and alerts, including `no owner alert`, `mounter row`, `table sink total row`, and `buffer sink total row` [#4054](https://github.com/pingcap/tiflow/issues/4054) [#1606](https://github.com/pingcap/tiflow/issues/1606) - (dup) - Reduce the time for the KV client to recover when a TiKV store is down [#3191](https://github.com/pingcap/tiflow/issues/3191) + - Add the exponential backoff mechanism for restarting a changefeed. [#3329](https://github.com/pingcap/tiflow/issues/3329) + - Change the default value of Kafka Sink `partition-num` to 3 so that TiCDC distributes messages across Kafka partitions more evenly [#3337](https://github.com/pingcap/tiflow/issues/3337) + - Reduce the count of "EventFeed retry rate limited" logs [#4006](https://github.com/pingcap/tiflow/issues/4006) + - Set the default value of `max-message-bytes` to 10M [#4041](https://github.com/pingcap/tiflow/issues/4041) + - Add more Promethous and Grafana monitoring metrics and alerts, including `no owner alert`, `mounter row`, `table sink total row`, and `buffer sink total row` [#4054](https://github.com/pingcap/tiflow/issues/4054) [#1606](https://github.com/pingcap/tiflow/issues/1606) + - Reduce the time for the KV client to recover when a TiKV store is down [#3191](https://github.com/pingcap/tiflow/issues/3191) - TiDB Lightning @@ -67,8 +65,7 @@ TiDB version: 5.3.1 - Fix the `invalid transaction` error when executing a query using index lookup join [#30468](https://github.com/pingcap/tidb/issues/30468) - Fix wrong query results due to the optimization of `Order By` [#30271](https://github.com/pingcap/tidb/issues/30271) - Fix the issue that the configurations of `MaxDays` and `MaxBackups` do not take effect on the slow log [#25716](https://github.com/pingcap/tidb/issues/25716) - - (dup) - Fix the issue that executing the INSERT ... SELECT ... ON DUPLICATE KEY UPDATE statement gets panic [#28078](https://github.com/pingcap/tidb/issues/28078) + - Fix the issue that executing the INSERT ... SELECT ... ON DUPLICATE KEY UPDATE statement gets panic [#28078](https://github.com/pingcap/tidb/issues/28078) - TiKV @@ -76,20 +73,19 @@ TiDB version: 5.3.1 - Fix the issue of QPS drop when flow control is enabled and `level0_slowdown_trigger` is set explicitly [#11424](https://github.com/tikv/tikv/issues/11424) - Fix the panic issue that occurs when the cgroup controller is not mounted [#11569](https://github.com/tikv/tikv/issues/11569) - Fix the issue that the latency of Resolved TS increases after TiKV stops operating [#11352](https://github.com/tikv/tikv/pull/11352) - - (dup) - Fix a bug that TiKV cannot delete a range of data (`unsafe_destroy_range` cannot be executed) when the GC worker is busy [#11903](https://github.com/tikv/tikv/issues/11903) - (dup) - Fix the issue that destroying a peer might cause high latency [#10210](https://github.com/tikv/tikv/issues/10210) - (dup) - Fix a bug that the `any_value` function returns a wrong result when regions are empty [#11735](https://github.com/tikv/tikv/issues/11735) - (dup) - Fix the issue that deleting an uninitialized replica might cause an old replica to be recreated [#10533](https://github.com/tikv/tikv/issues/10533) - (dup) - Fix the metadata corruption issue when `Prepare Merge` is triggered after a new election is finished but the isolated peer is not informed [#11526](https://github.com/tikv/tikv/issues/11526) - (dup) - Fix the deadlock issue that happens occasionally when coroutines run too fast [#11549](https://github.com/tikv/tikv/issues/11549) - (dup) - Fix the issue that a down TiKV node causes the resolved timestamp to lag [#11351](https://github.com/tikv/tikv/issues/11351) - (dup) - Fix the issue that batch messages are too large in Raft client implementation [#9714](https://github.com/tikv/tikv/issues/9714) - (dup) - Fix a panic issue that occurs when Region merge, ConfChange, and Snapshot happen at the same time in extreme conditions [#11475](https://github.com/tikv/tikv/issues/11475) - (dup) - Fix the issue that TiKV cannot detect the memory lock when TiKV perform a reverse table scan [#11440](https://github.com/tikv/tikv/issues/11440) - (dup) - Fix the issue that RocksDB flush or compaction causes panic when the disk capacity is full [#11224](https://github.com/tikv/tikv/issues/11224) - (dup) - Fix a bug that tikv-ctl cannot return the correct Region-related information [#11393](https://github.com/tikv/tikv/issues/11393) - (dup) - Fix the issue that the average latency of the by-instance gRPC requests is inaccurate in TiKV metrics [#11299](https://github.com/tikv/tikv/issues/11299) + - Fix a bug that TiKV cannot delete a range of data (`unsafe_destroy_range` cannot be executed) when the GC worker is busy [#11903](https://github.com/tikv/tikv/issues/11903) + - Fix the issue that destroying a peer might cause high latency [#10210](https://github.com/tikv/tikv/issues/10210) + - Fix a bug that the `any_value` function returns a wrong result when regions are empty [#11735](https://github.com/tikv/tikv/issues/11735) + - Fix the issue that deleting an uninitialized replica might cause an old replica to be recreated [#10533](https://github.com/tikv/tikv/issues/10533) + - Fix the metadata corruption issue when `Prepare Merge` is triggered after a new election is finished but the isolated peer is not informed [#11526](https://github.com/tikv/tikv/issues/11526) + - Fix the deadlock issue that happens occasionally when coroutines run too fast [#11549](https://github.com/tikv/tikv/issues/11549) + - Fix the issue that a down TiKV node causes the resolved timestamp to lag [#11351](https://github.com/tikv/tikv/issues/11351) + - Fix the issue that batch messages are too large in Raft client implementation [#9714](https://github.com/tikv/tikv/issues/9714) + - Fix a panic issue that occurs when Region merge, ConfChange, and Snapshot happen at the same time in extreme conditions [#11475](https://github.com/tikv/tikv/issues/11475) + - Fix the issue that TiKV cannot detect the memory lock when TiKV perform a reverse table scan [#11440](https://github.com/tikv/tikv/issues/11440) + - Fix the issue that RocksDB flush or compaction causes panic when the disk capacity is full [#11224](https://github.com/tikv/tikv/issues/11224) + - Fix a bug that tikv-ctl cannot return the correct Region-related information [#11393](https://github.com/tikv/tikv/issues/11393) + - Fix the issue that the average latency of the by-instance gRPC requests is inaccurate in TiKV metrics [#11299](https://github.com/tikv/tikv/issues/11299) - PD @@ -97,8 +93,7 @@ TiDB version: 5.3.1 - Fix a bug that the scheduling cannot be executed when demoting a voter directly [#4444](https://github.com/tikv/pd/issues/4444) - Fix a data race issue that occurs when updating the configuration of the replication mode of replicas [#4325](https://github.com/tikv/pd/issues/4325) - Fix a bug that the Read lock is not released in certain cases [#4354](https://github.com/tikv/pd/issues/4354) - - (dup) - Fix the issue that the cold hotspot data cannot be deleted from the hotspot statistics [#4390](https://github.com/tikv/pd/issues/4390) + - Fix the issue that the cold hotspot data cannot be deleted from the hotspot statistics [#4390](https://github.com/tikv/pd/issues/4390) - TiFlash @@ -108,7 +103,7 @@ TiDB version: 5.3.1 - Fix the issue that `cast(string as decimal)` returns a wrong result - Fix potential data inconsistency after altering a primary key column to a larger int data type - Fix the bug that when `in` has multiple arguments in the statements like `select (arg0, arg1) in (x,y)`, `in` returns a wrong result - - (dup) Fix the issue that TiFlash might panic when an MPP query is stopped + - Fix the issue that TiFlash might panic when an MPP query is stopped - Fix the issue that `str_to_date` returns a wrong result when the input argument has leading zeros - Fix the issue that the query returns a wrong result when the filter is in the `where ` format - Fix the issue that `cast(string as datetime)` returns a wrong result when the input argument `string` is in the `%Y-%m-%d\n%H:%i:%s` format @@ -137,32 +132,30 @@ TiDB version: 5.3.1 - Fix wrong progress returned for query-staus on loader [#3252](https://github.com/pingcap/tiflow/issues/3252) - Fix the issue that HTTP API fails to work if there are TiCDC nodes of different versions in a cluster [#3483](https://github.com/pingcap/tiflow/issues/3483) - Fix the issue that TiCDC exits abnormally when the S3 storage is configured with TiCDC Redo Log [#3523](https://github.com/pingcap/tiflow/issues/3523) - - (dup) - Fix the issue that default values cannot be replicated [#3793](https://github.com/pingcap/tiflow/issues/3793) - (dup) - Fix a bug that MySQL sink generates duplicated `replace` SQL statements if `batch-replace-enable` is disabled [#4501](https://github.com/pingcap/tiflow/issues/4501) - (dup) - Fix the issue that syncer metrics are updated only when querying the status [#4281](https://github.com/pingcap/tiflow/issues/4281) - (dup) - Fix the issue that `mq sink write row` does not have monitoring data [#3431](https://github.com/pingcap/tiflow/issues/3431) - (dup) - Fix the issue that replication cannot be performed when `min.insync.replicas` is smaller than `replication-factor` [#3994](https://github.com/pingcap/tiflow/issues/3994) - (dup) - Fix the issue that the `CREATE VIEW` statement interrupts data replication [#4173](https://github.com/pingcap/tiflow/issues/4173) - (dup) - Fix the issue the schema needs to be reset after a DDL statement is skipped [#4177](https://github.com/pingcap/tiflow/issues/4177) - (dup) - Fix the issue that `mq sink write row` does not have monitoring data [#3431](https://github.com/pingcap/tiflow/issues/3431) - (dup) - Fix the potential panic issue that occurs when a replication task is removed [#3128](https://github.com/pingcap/tiflow/issues/3128) - (dup) - Fix the potential issue that the deadlock causes a replication task to get stuck [#4055](https://github.com/pingcap/tiflow/issues/4055) - (dup) - Fix the TiCDC panic issue that occurs when manually cleaning the task status in etcd [#2980](https://github.com/pingcap/tiflow/issues/2980) - (dup) - Fix the issue that special comments in DDL statements cause the replication task to stop [#3755](https://github.com/pingcap/tiflow/issues/3755) - (dup) - Fix the issue of replication stop caused by the incorrect configuration of `config.Metadata.Timeout` [#3352](https://github.com/pingcap/tiflow/issues/3352) - (dup) - Fix the issue that the service cannot be started because of a timezone issue in the RHEL release [#3584](https://github.com/pingcap/tiflow/issues/3584) - (dup) - Fix the issue that `stopped` changefeeds resume automatically after a cluster upgrade [#3473](https://github.com/pingcap/tiflow/issues/3473) - (dup) - Fix the issue that default values cannot be replicated [#3793](https://github.com/pingcap/tiflow/issues/3793) - (dup) - Fix the issue of overly frequent warnings caused by MySQL sink deadlock [#2706](https://github.com/pingcap/tiflow/issues/2706) - (dup) - Fix the bug that the `enable-old-value` configuration item is not automatically set to `true` on Canal and Maxwell protocols [#3676](https://github.com/pingcap/tiflow/issues/3676) - (dup) - Fix the issue that Avro sink does not support parsing JSON type columns [#3624](https://github.com/pingcap/tiflow/issues/3624) - (dup) - Fix the negative value error in the changefeed checkpoint lag [#3010](https://github.com/pingcap/tiflow/issues/3010) + - Fix the issue that default values cannot be replicated [#3793](https://github.com/pingcap/tiflow/issues/3793) + - Fix a bug that MySQL sink generates duplicated `replace` SQL statements if `batch-replace-enable` is disabled [#4501](https://github.com/pingcap/tiflow/issues/4501) + - Fix the issue that syncer metrics are updated only when querying the status [#4281](https://github.com/pingcap/tiflow/issues/4281) + - Fix the issue that `mq sink write row` does not have monitoring data [#3431](https://github.com/pingcap/tiflow/issues/3431) + - Fix the issue that replication cannot be performed when `min.insync.replicas` is smaller than `replication-factor` [#3994](https://github.com/pingcap/tiflow/issues/3994) + - Fix the issue that the `CREATE VIEW` statement interrupts data replication [#4173](https://github.com/pingcap/tiflow/issues/4173) + - Fix the issue the schema needs to be reset after a DDL statement is skipped [#4177](https://github.com/pingcap/tiflow/issues/4177) + - Fix the issue that `mq sink write row` does not have monitoring data [#3431](https://github.com/pingcap/tiflow/issues/3431) + - Fix the potential panic issue that occurs when a replication task is removed [#3128](https://github.com/pingcap/tiflow/issues/3128) + - Fix the potential issue that the deadlock causes a replication task to get stuck [#4055](https://github.com/pingcap/tiflow/issues/4055) + - Fix the TiCDC panic issue that occurs when manually cleaning the task status in etcd [#2980](https://github.com/pingcap/tiflow/issues/2980) + - Fix the issue that special comments in DDL statements cause the replication task to stop [#3755](https://github.com/pingcap/tiflow/issues/3755) + - Fix the issue of replication stop caused by the incorrect configuration of `config.Metadata.Timeout` [#3352](https://github.com/pingcap/tiflow/issues/3352) + - Fix the issue that the service cannot be started because of a timezone issue in the RHEL release [#3584](https://github.com/pingcap/tiflow/issues/3584) + - Fix the issue that `stopped` changefeeds resume automatically after a cluster upgrade [#3473](https://github.com/pingcap/tiflow/issues/3473) + - Fix the issue that default values cannot be replicated [#3793](https://github.com/pingcap/tiflow/issues/3793) + - Fix the issue of overly frequent warnings caused by MySQL sink deadlock [#2706](https://github.com/pingcap/tiflow/issues/2706) + - Fix the bug that the `enable-old-value` configuration item is not automatically set to `true` on Canal and Maxwell protocols [#3676](https://github.com/pingcap/tiflow/issues/3676) + - Fix the issue that Avro sink does not support parsing JSON type columns [#3624](https://github.com/pingcap/tiflow/issues/3624) + - Fix the negative value error in the changefeed checkpoint lag [#3010](https://github.com/pingcap/tiflow/issues/3010) - TiDB Lightning - Fix the bug that TiDB Lightning may not delete the metadata schema when some import tasks do not contain source files [#28144](https://github.com/pingcap/tidb/issues/28144) - Fix the bug that TiDB Lightning returns an error if the storage URL prefix is "gs://xxx", instead of "gcs://xxx" [#30254](https://github.com/pingcap/tidb/pull/30254) - Fix the issue that setting --log-file="-" does not print any log to stdout [#29876](https://github.com/pingcap/tidb/issues/29876) - - (dup) - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist #28031 [#30709](https://github.com/pingcap/tiflow/issues/30709) + - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist #28031 [#30709](https://github.com/pingcap/tiflow/issues/30709) From 3ab0c92bbcc9b7631ae08858ed085ec1d8d9e51c Mon Sep 17 00:00:00 2001 From: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Date: Wed, 2 Mar 2022 10:58:12 +0800 Subject: [PATCH 42/58] fix query-status --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index bb3ea01033fe1..8076a5bf588cf 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -129,7 +129,7 @@ TiDB version: 5.3.1 - Fix a bug of data loss when DM does finer grained retry [#3487](https://github.com/pingcap/tiflow/issues/3487) - Fix OOM in container environments [#1798](https://github.com/pingcap/tiflow/issues/1798) - Fix a bug that stopping a loading task results in unexpected transfer of the task [#3771](https://github.com/pingcap/tiflow/issues/3771) - - Fix wrong progress returned for query-staus on loader [#3252](https://github.com/pingcap/tiflow/issues/3252) + - Fix the issue that wrong progress is returned for the `query-status` command on loader [#3252](https://github.com/pingcap/tiflow/issues/3252) - Fix the issue that HTTP API fails to work if there are TiCDC nodes of different versions in a cluster [#3483](https://github.com/pingcap/tiflow/issues/3483) - Fix the issue that TiCDC exits abnormally when the S3 storage is configured with TiCDC Redo Log [#3523](https://github.com/pingcap/tiflow/issues/3523) - Fix the issue that default values cannot be replicated [#3793](https://github.com/pingcap/tiflow/issues/3793) From 4689218f77ec63f5bd5b6ec6a7cf6798e10ca34a Mon Sep 17 00:00:00 2001 From: xixirangrang <35301108+hfxsd@users.noreply.github.com> Date: Wed, 2 Mar 2022 11:31:31 +0800 Subject: [PATCH 43/58] Update release-5.3.1.md --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 8076a5bf588cf..2e1f7c303a057 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -158,4 +158,4 @@ TiDB version: 5.3.1 - Fix the bug that TiDB Lightning may not delete the metadata schema when some import tasks do not contain source files [#28144](https://github.com/pingcap/tidb/issues/28144) - Fix the bug that TiDB Lightning returns an error if the storage URL prefix is "gs://xxx", instead of "gcs://xxx" [#30254](https://github.com/pingcap/tidb/pull/30254) - Fix the issue that setting --log-file="-" does not print any log to stdout [#29876](https://github.com/pingcap/tidb/issues/29876) - - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist #28031 [#30709](https://github.com/pingcap/tiflow/issues/30709) + - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist [#28031](https://github.com/pingcap/tidb/issues/28031) [#30709](https://github.com/pingcap/tiflow/issues/30709) From 6938898ebe36007dda1a87e76ce0781f3e79729a Mon Sep 17 00:00:00 2001 From: xixirangrang <35301108+hfxsd@users.noreply.github.com> Date: Wed, 2 Mar 2022 11:50:12 +0800 Subject: [PATCH 44/58] Update release-5.3.1.md --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 2e1f7c303a057..ea12b9aa896ee 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -158,4 +158,4 @@ TiDB version: 5.3.1 - Fix the bug that TiDB Lightning may not delete the metadata schema when some import tasks do not contain source files [#28144](https://github.com/pingcap/tidb/issues/28144) - Fix the bug that TiDB Lightning returns an error if the storage URL prefix is "gs://xxx", instead of "gcs://xxx" [#30254](https://github.com/pingcap/tidb/pull/30254) - Fix the issue that setting --log-file="-" does not print any log to stdout [#29876](https://github.com/pingcap/tidb/issues/29876) - - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist [#28031](https://github.com/pingcap/tidb/issues/28031) [#30709](https://github.com/pingcap/tiflow/issues/30709) + - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist [#30709](https://github.com/pingcap/tiflow/issues/30709) From f1480b492f9950501a28ebf5b512bad4ac26788f Mon Sep 17 00:00:00 2001 From: xixirangrang <35301108+hfxsd@users.noreply.github.com> Date: Wed, 2 Mar 2022 15:00:12 +0800 Subject: [PATCH 45/58] Update release-5.3.1.md --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index ea12b9aa896ee..23aa644bd9a79 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -14,7 +14,7 @@ TiDB version: 5.3.1 + TiDB Lightning - - Change the default value of `regionMaxKeyCount` from 1_440_000 to 1_280_000, to avoid too many empty Regions after data import [#30018](https://github.com/pingcap/tidb/issues/30018) + - Change the default value of `regionMaxKeyCount` from 1_440_000 to 1_280_000, to avoid too many empty Regions after data import [#30018](https://github.com/pingcap/tidb/issues/30018) ## Feature enhancements From 4f1873579c45608ba93735a145206c580bfd3b79 Mon Sep 17 00:00:00 2001 From: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Date: Wed, 2 Mar 2022 15:19:01 +0800 Subject: [PATCH 46/58] fix pre-cleanup --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 23aa644bd9a79..94152deeee4a5 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -37,7 +37,7 @@ TiDB version: 5.3.1 - TiCDC - Expose configuration parameters of the Kafka producer to make them configurable in TiCDC [#4385](https://github.com/pingcap/tiflow/issues/4385) - - Add a pre-cleanup process before S3 is enabled [#3878](https://github.com/pingcap/tiflow/issues/3878) + - Add a pre-cleanup process upon TiCDC startup if S3 is used as backend storage [#3878](https://github.com/pingcap/tiflow/issues/3878) - The TiCDC client works when no certificate name is specified [#3627](https://github.com/pingcap/tiflow/issues/3627) - Manage sink checkpoints per table to avoid unexpected advance of checkpoint timestamps [#3545](https://github.com/pingcap/tiflow/issues/3545) - Add the exponential backoff mechanism for restarting a changefeed. [#3329](https://github.com/pingcap/tiflow/issues/3329) From d743276253db7a221029c051b378f1de0b5977c2 Mon Sep 17 00:00:00 2001 From: Enwei Date: Wed, 2 Mar 2022 15:28:17 +0800 Subject: [PATCH 47/58] Apply suggestions from code review --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 94152deeee4a5..6fa64d43d2098 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -72,7 +72,7 @@ TiDB version: 5.3.1 - Fix the panic issue caused by deleting snapshot files when the peer status is `Applying` [#11746](https://github.com/tikv/tikv/issues/11746) - Fix the issue of QPS drop when flow control is enabled and `level0_slowdown_trigger` is set explicitly [#11424](https://github.com/tikv/tikv/issues/11424) - Fix the panic issue that occurs when the cgroup controller is not mounted [#11569](https://github.com/tikv/tikv/issues/11569) - - Fix the issue that the latency of Resolved TS increases after TiKV stops operating [#11352](https://github.com/tikv/tikv/pull/11352) + - Fix the issue that the latency of Resolved TS increases after TiKV stops operating [#11351](https://github.com/tikv/tikv/issues/11351) - Fix a bug that TiKV cannot delete a range of data (`unsafe_destroy_range` cannot be executed) when the GC worker is busy [#11903](https://github.com/tikv/tikv/issues/11903) - Fix the issue that destroying a peer might cause high latency [#10210](https://github.com/tikv/tikv/issues/10210) - Fix a bug that the `any_value` function returns a wrong result when regions are empty [#11735](https://github.com/tikv/tikv/issues/11735) From b89fb3b984fe1c855b12c780a8ce4f7b03456e26 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Wed, 2 Mar 2022 15:33:35 +0800 Subject: [PATCH 48/58] Update releases/release-5.3.1.md --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 6fa64d43d2098..32ea6f3cb21e2 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -20,7 +20,7 @@ TiDB version: 5.3.1 - TiDB - - Optimize the mapping logic of user login mode to make the logging more MySQL-compatible [#30450](https://github.com/pingcap/tidb/pull/30450) + - Optimize the mapping logic of user login mode to make the logging more MySQL-compatible [#30450](https://github.com/pingcap/tidb/issues/32648) - TiKV From 4fe4ead47c77e70c90b7ef31efd45f0ac52c967d Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Wed, 2 Mar 2022 15:50:13 +0800 Subject: [PATCH 49/58] Update releases/release-5.3.1.md --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 32ea6f3cb21e2..d349652e7a1d7 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -55,7 +55,7 @@ TiDB version: 5.3.1 - TiDB - - Fix the issue that `date_format` in TiDB handles `'\n'` in a MySQL-incompatible way [#32503](https://github.com/pingcap/tidb/issues/32503) + - Fix the issue that `date_format` in TiDB handles `'\n'` in a MySQL-incompatible way [#32232](https://github.com/pingcap/tidb/issues/32232) - Fix the issue that `alter column set default` wrongly updates the table schema [#31074](https://github.com/pingcap/tidb/issues/31074) - Fix a bug that `tidb_super_read_only` is not automatically enabled when `tidb_restricted_read_only` is enabled [#31745](https://github.com/pingcap/tidb/issues/31745) - Fix the issue that the `greatest` or `least` function with collation gets wrong result [#31789](https://github.com/pingcap/tidb/issues/31789) From 6c9fadfab5dab2260067dd9729aeb96e4f5b7e91 Mon Sep 17 00:00:00 2001 From: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Date: Wed, 2 Mar 2022 15:51:12 +0800 Subject: [PATCH 50/58] replace two PRs with issues --- releases/release-5.3.1.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index d349652e7a1d7..49f3de4748bc1 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -125,7 +125,7 @@ TiDB version: 5.3.1 - Fix a bug that the DM-worker fails to boot up after a restart [#3344](https://github.com/pingcap/tiflow/issues/3344) - Fix a bug that a DM task fails if running a PARTITION DDL takes too long time [#3854](https://github.com/pingcap/tiflow/issues/3854) - Fix a bug that DM may report `invalid sequence` when upstream is MySQL 8.0 [#3847](https://github.com/pingcap/tiflow/issues/3847) - - Fix a bug that redo logs are not cleaned up when removing a paused changefeed [#3919](https://github.com/pingcap/tiflow/pull/3919) + - Fix a bug that redo logs are not cleaned up when removing a paused changefeed [#4740](https://github.com/pingcap/tiflow/issues/4740) - Fix a bug of data loss when DM does finer grained retry [#3487](https://github.com/pingcap/tiflow/issues/3487) - Fix OOM in container environments [#1798](https://github.com/pingcap/tiflow/issues/1798) - Fix a bug that stopping a loading task results in unexpected transfer of the task [#3771](https://github.com/pingcap/tiflow/issues/3771) @@ -156,6 +156,6 @@ TiDB version: 5.3.1 - TiDB Lightning - Fix the bug that TiDB Lightning may not delete the metadata schema when some import tasks do not contain source files [#28144](https://github.com/pingcap/tidb/issues/28144) - - Fix the bug that TiDB Lightning returns an error if the storage URL prefix is "gs://xxx", instead of "gcs://xxx" [#30254](https://github.com/pingcap/tidb/pull/30254) + - Fix the bug that TiDB Lightning returns an error if the storage URL prefix is "gs://xxx", instead of "gcs://xxx" [#32742](https://github.com/pingcap/tidb/issues/32742) - Fix the issue that setting --log-file="-" does not print any log to stdout [#29876](https://github.com/pingcap/tidb/issues/29876) - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist [#30709](https://github.com/pingcap/tiflow/issues/30709) From 16ac086c9eee079fc2d1d487525155efbf63218c Mon Sep 17 00:00:00 2001 From: xixirangrang <35301108+hfxsd@users.noreply.github.com> Date: Wed, 2 Mar 2022 16:29:06 +0800 Subject: [PATCH 51/58] Update release-5.3.1.md --- releases/release-5.3.1.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 49f3de4748bc1..bdd89c10833e6 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -44,8 +44,8 @@ TiDB version: 5.3.1 - Change the default value of Kafka Sink `partition-num` to 3 so that TiCDC distributes messages across Kafka partitions more evenly [#3337](https://github.com/pingcap/tiflow/issues/3337) - Reduce the count of "EventFeed retry rate limited" logs [#4006](https://github.com/pingcap/tiflow/issues/4006) - Set the default value of `max-message-bytes` to 10M [#4041](https://github.com/pingcap/tiflow/issues/4041) - - Add more Promethous and Grafana monitoring metrics and alerts, including `no owner alert`, `mounter row`, `table sink total row`, and `buffer sink total row` [#4054](https://github.com/pingcap/tiflow/issues/4054) [#1606](https://github.com/pingcap/tiflow/issues/1606) - - Reduce the time for the KV client to recover when a TiKV store is down [#3191](https://github.com/pingcap/tiflow/issues/3191) + - Add more Promethous and Grafana monitoring metrics and alerts, including `no owner alert`, `mounter row`, `table sink total row`, and `buffer sink total row` [#4054](https://github.com/pingcap/tiflow/issues/4054) [#1606](https://github.com/pingcap/tiflow/issues/1606) + - Reduce the time for the KV client to recover when a TiKV store is down [#3191](https://github.com/pingcap/tiflow/issues/3191) - TiDB Lightning From 59f3f4ee3ed03f730421b9d7f9c3afb033ab0015 Mon Sep 17 00:00:00 2001 From: xixirangrang Date: Thu, 3 Mar 2022 09:35:21 +0800 Subject: [PATCH 52/58] Update releases/release-5.3.1.md Co-authored-by: Grace Cai --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index bdd89c10833e6..8988ecd9f1994 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -58,7 +58,7 @@ TiDB version: 5.3.1 - Fix the issue that `date_format` in TiDB handles `'\n'` in a MySQL-incompatible way [#32232](https://github.com/pingcap/tidb/issues/32232) - Fix the issue that `alter column set default` wrongly updates the table schema [#31074](https://github.com/pingcap/tidb/issues/31074) - Fix a bug that `tidb_super_read_only` is not automatically enabled when `tidb_restricted_read_only` is enabled [#31745](https://github.com/pingcap/tidb/issues/31745) - - Fix the issue that the `greatest` or `least` function with collation gets wrong result [#31789](https://github.com/pingcap/tidb/issues/31789) + - Fix the issue that the `greatest` or `least` function with collation gets a wrong result [#31789](https://github.com/pingcap/tidb/issues/31789) - Fix the MPP task list empty error when executing a query [#31636](https://github.com/pingcap/tidb/issues/31636) - Fix wrong results of index join caused by an innerWorker panic [#31494](https://github.com/pingcap/tidb/issues/31494) - Fix wrong query results after changing the column type from `FLOAT` to `DOUBLE` [#31372](https://github.com/pingcap/tidb/issues/31372) From 0ff36a2e3d9fc466381a2e67300ee7c3ee685ae6 Mon Sep 17 00:00:00 2001 From: xixirangrang <35301108+hfxsd@users.noreply.github.com> Date: Thu, 3 Mar 2022 09:51:34 +0800 Subject: [PATCH 53/58] Update release-5.3.1.md --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 8988ecd9f1994..a8052d6d2fac7 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -158,4 +158,4 @@ TiDB version: 5.3.1 - Fix the bug that TiDB Lightning may not delete the metadata schema when some import tasks do not contain source files [#28144](https://github.com/pingcap/tidb/issues/28144) - Fix the bug that TiDB Lightning returns an error if the storage URL prefix is "gs://xxx", instead of "gcs://xxx" [#32742](https://github.com/pingcap/tidb/issues/32742) - Fix the issue that setting --log-file="-" does not print any log to stdout [#29876](https://github.com/pingcap/tidb/issues/29876) - - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist [#30709](https://github.com/pingcap/tiflow/issues/30709) + - Fix the issue that TiDB Lightning does not report errors when the S3 storage path does not exist [#30709](https://github.com/pingcap/tidb/issues/30709) From 73d40425f9f797feea52652ad3b2176bf3f74694 Mon Sep 17 00:00:00 2001 From: xixirangrang <35301108+hfxsd@users.noreply.github.com> Date: Thu, 3 Mar 2022 10:27:34 +0800 Subject: [PATCH 54/58] Update release-5.3.1.md --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index a8052d6d2fac7..6c45bb8c656ff 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -82,7 +82,7 @@ TiDB version: 5.3.1 - Fix the issue that a down TiKV node causes the resolved timestamp to lag [#11351](https://github.com/tikv/tikv/issues/11351) - Fix the issue that batch messages are too large in Raft client implementation [#9714](https://github.com/tikv/tikv/issues/9714) - Fix a panic issue that occurs when Region merge, ConfChange, and Snapshot happen at the same time in extreme conditions [#11475](https://github.com/tikv/tikv/issues/11475) - - Fix the issue that TiKV cannot detect the memory lock when TiKV perform a reverse table scan [#11440](https://github.com/tikv/tikv/issues/11440) + - Fix the issue that TiKV cannot detect the memory lock when TiKV performs a reverse table scan [#11440](https://github.com/tikv/tikv/issues/11440) - Fix the issue that RocksDB flush or compaction causes panic when the disk capacity is full [#11224](https://github.com/tikv/tikv/issues/11224) - Fix a bug that tikv-ctl cannot return the correct Region-related information [#11393](https://github.com/tikv/tikv/issues/11393) - Fix the issue that the average latency of the by-instance gRPC requests is inaccurate in TiKV metrics [#11299](https://github.com/tikv/tikv/issues/11299) From 75fc202aadf8746adc268a2734072f1e58b2eb8d Mon Sep 17 00:00:00 2001 From: xixirangrang <35301108+hfxsd@users.noreply.github.com> Date: Thu, 3 Mar 2022 10:41:10 +0800 Subject: [PATCH 55/58] add date --- releases/release-5.3.1.md | 2 +- releases/release-timeline.md | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 6c45bb8c656ff..657bcfa61b6ab 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -4,7 +4,7 @@ title: TiDB 5.3.1 Release Notes # TiDB 5.3.1 Release Notes -Release Date: xx, 2022 +Release Date: March 3, 2022 TiDB version: 5.3.1 diff --git a/releases/release-timeline.md b/releases/release-timeline.md index b2b8e2b33163c..a5a87d1278ba0 100644 --- a/releases/release-timeline.md +++ b/releases/release-timeline.md @@ -9,7 +9,7 @@ This document shows all the released TiDB versions in reverse chronological orde | Version | Release Date | | :--- | :--- | -| [5.3.1](/releases/release-5.3.1.md) | 2022-xx-xx | +| [5.3.1](/releases/release-5.3.1.md) | 2022-03-03 | | [5.1.4](/releases/release-5.1.4.md) | 2022-02-22 | | [5.4.0](/releases/release-5.4.0.md) | 2022-02-15 | | [5.0.6](/releases/release-5.0.6.md) | 2021-12-31 | From 8b21ece17d50452c229e2f21e97465f621ecc467 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 3 Mar 2022 12:00:28 +0800 Subject: [PATCH 56/58] Update releases/release-5.3.1.md --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 657bcfa61b6ab..a8e6cf77cbc43 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -65,7 +65,7 @@ TiDB version: 5.3.1 - Fix the `invalid transaction` error when executing a query using index lookup join [#30468](https://github.com/pingcap/tidb/issues/30468) - Fix wrong query results due to the optimization of `Order By` [#30271](https://github.com/pingcap/tidb/issues/30271) - Fix the issue that the configurations of `MaxDays` and `MaxBackups` do not take effect on the slow log [#25716](https://github.com/pingcap/tidb/issues/25716) - - Fix the issue that executing the INSERT ... SELECT ... ON DUPLICATE KEY UPDATE statement gets panic [#28078](https://github.com/pingcap/tidb/issues/28078) + - Fix the issue that executing the `INSERT ... SELECT ... ON DUPLICATE KEY UPDATE` statement gets panic [#28078](https://github.com/pingcap/tidb/issues/28078) - TiKV From 043cf608a10db5624bee5dc055ee719fa1ed79b4 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 3 Mar 2022 13:08:04 +0800 Subject: [PATCH 57/58] Update releases/release-5.3.1.md --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index a8e6cf77cbc43..8ad5e53afd84f 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -51,7 +51,7 @@ TiDB version: 5.3.1 - Refine the output message of the precheck to make it more user-friendly when the local disk space check fails [#30395](https://github.com/pingcap/tidb/issues/30395) -## Bug Fixes +## Bug fixes - TiDB From 273b33e35de28b2565a971e38ead003903b78079 Mon Sep 17 00:00:00 2001 From: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Date: Thu, 3 Mar 2022 18:49:35 +0800 Subject: [PATCH 58/58] Update releases/release-5.3.1.md --- releases/release-5.3.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.3.1.md b/releases/release-5.3.1.md index 8ad5e53afd84f..ddaed7f4c16ca 100644 --- a/releases/release-5.3.1.md +++ b/releases/release-5.3.1.md @@ -145,7 +145,7 @@ TiDB version: 5.3.1 - Fix the TiCDC panic issue that occurs when manually cleaning the task status in etcd [#2980](https://github.com/pingcap/tiflow/issues/2980) - Fix the issue that special comments in DDL statements cause the replication task to stop [#3755](https://github.com/pingcap/tiflow/issues/3755) - Fix the issue of replication stop caused by the incorrect configuration of `config.Metadata.Timeout` [#3352](https://github.com/pingcap/tiflow/issues/3352) - - Fix the issue that the service cannot be started because of a timezone issue in the RHEL release [#3584](https://github.com/pingcap/tiflow/issues/3584) + - Fix the issue that the service cannot be started because of a timezone issue in some RHEL releases [#3584](https://github.com/pingcap/tiflow/issues/3584) - Fix the issue that `stopped` changefeeds resume automatically after a cluster upgrade [#3473](https://github.com/pingcap/tiflow/issues/3473) - Fix the issue that default values cannot be replicated [#3793](https://github.com/pingcap/tiflow/issues/3793) - Fix the issue of overly frequent warnings caused by MySQL sink deadlock [#2706](https://github.com/pingcap/tiflow/issues/2706)