Skip to content
This repository has been archived by the owner on Dec 16, 2022. It is now read-only.

Serry deploy #140

Closed
wants to merge 142 commits into from
Closed

Serry deploy #140

wants to merge 142 commits into from

Conversation

spark4
Copy link

@spark4 spark4 commented Nov 5, 2019

Overview

This PR merges the latest upstream from vitessio/vitess to our fork.

Testing

Jenkins build: https://jenkins.tinyspeck.com/job/slack-vitess/368/

Benchmarking results (performed on loadtest)

Starting test threads
Average Rows Returned: 1
Average Query Time: 2.565334ms
Total Test Time: 25.7596702s
QPS (Per Thread): 388.2037278567332
QPS (Total): 9705.093196418331
Query Timings:
500µs-1ms: 79
1ms-5ms: 239505
5ms-10ms: 10207
10ms-50ms: 209

Dev rollout notes

tbd ...!

JIRA

https://jira.tinyspeck.com/browse/VITESS-424

Changes

Relevant vitess release notes: https://github.com/vitessio/vitess/releases

To view all commits introduced by this PR, please refer to commits.txt

For all PRs included in this deploy, please refer to this page.

Noteworthy changes
vitessio/vitess#5000: check replication lag on state change before starting query service
vitessio/vitess#5143: Orc basic auth with vttablet flags
vitessio/vitess#5151: make TabletExternallyReparented more robust
vitessio/vitess#5160: Point in time recovery (part 1)
vitessio/vitess#5143: Orc basic auth with vttablet flags
vitessio/vitess#5203: Add startup argument to stop tablet from reparent
vitessio/vitess#5216: vstream: best effort option for field events
vitessio/vitess#5226: PlannedReparentShard: Allow retrying PRS to the existing master
vitessio/vitess#5316: InitTablet should not update master alias on shard record
vitessio/vitess#5360: vttablet-up and vtgate-up should block until ready
vitessio/vitess#5363: EmergencyReparentShard does not need to update shard master
vitessio/vitess#5376: Fix more known-recoverable problems
vitessio/vitess#5391: Make reparents more robust

Slack changes:
@rafael vitessio/vitess#5197: Redact password from error log
@demmer vitessio/vitess#5139: vtexplain support select distinct and other expressions

Non-test/documentation/kube related changes:
vitessio/vitess#4978: consistent lookup: handle insert ignore
vitessio/vitess#5000: check replication lag on state change before starting query service
vitessio/vitess#5103: Allow setting key/value in a metadata stored in the topology
vitessio/vitess#5109: Switch to go modules
vitessio/vitess#5118: Make it possible to send span context over the MySQL end point
vitessio/vitess#5120: make vtgate query_plans endpoint return json; also fix comment typos
vitessio/vitess#5130: vreplication: improved rowstreamer
vitessio/vitess#5136: Only override session.TargetString if it has not been set
vitessio/vitess#5139: vtexplain support select distinct and other expressions
vitessio/vitess#5140: Subtraction operation implementation
vitessio/vitess#5141: Execute "ALTER VSCHEMA" statements without specifying keyspace in the target connection
vitessio/vitess#5143: Orc basic auth with vttablet flags
vitessio/vitess#5145: Delete vitess metadata by setting empty key
vitessio/vitess#5147: vtbackup: Make initial backup idempotent again
vitessio/vitess#5149: Handle case where mysqld replies to Initial Handshake Packet with an ERR packet
vitessio/vitess#5150: Handle more situations with empty results and no grouping keys
vitessio/vitess#5151: make TabletExternallyReparented more robust
vitessio/vitess#5153: vtbackup: Stop slave before trying to change master address
vitessio/vitess#5157: Don't try to reparent to yourself
vitessio/vitess#5159:vreplication: refactor table_plan_builder
vitessio/vitess#5160: Point in time recovery (part 1)
vitessio/vitess#5163: vreplication: ability to exclude tables
vitessio/vitess#5165: RefreshMaster on both source and target before turning off query service on source during splitting
vitessio/vitess#5177: xtrabackup: Make sure all files are closed before writing MANIFEST
vitessio/vitess#5178: migrater: identify shard migration differently
vitessio/vitess#5179: vreplication: more VReplicationExec constructs
vitessio/vitess#5184:Track number of times pool reached zero available slots
vitessio/vitess#5186:Multiplication operation expression
vitessio/vitess#5192: vtbackup: Retry fetching master position
vitessio/vitess#5193: xtrabackup: Add a timeout on closing backup files
vitessio/vitess#5194: vreplication: migrate source streams to target shards on MigrateWrites
vitessio/vitess#5197: Redact password from error log
vitessio/vitess#5198: Enable selecting consistent snapshot during resharding workflows via vtctld ui
vitessio/vitess#5203: Add startup argument to stop tablet from reparent
vitessio/vitess#5210: TER should not demote current master if it is run with current master
vitessio/vitess#5213: Added exclude_tables flag in workflow and pass it down to vtworker
vitessio/vitess#5216: vstream: best effort option for field events
vitessio/vitess#5219: Add support for COM_RESET_CONNECTION
vitessio/vitess#5225: Do not do mysql_flavor detection for external/unmanaged tablets
vitessio/vitess#5226: PlannedReparentShard: Allow retrying PRS to the existing master
vitessio/vitess#5236: Reparent: add ability to watch shard data
vitessio#5238): Transaction BEGIN statements should use the query timeout rather than… the transaction pool timeout
vitessio/vitess#5244: topology_watcher: Allow tablets to reuse old tablet addresses
vitessio/vitess#5251: Simplify replication lag selection logic
vitessio/vitess#5254: Don't abort restore if master is unreachable
vitessio/vitess#5259: Make StatementType a type alias instead of an int
vitessio/vitess#5262: VtCompose - Local Vitess Cluster (Docker) Auto-Setup
vitessio/vitess#5264: tabletmanager: Keep tablet and shard in sync.
vitessio/vitess#5268: treat the type of 'dual' table as 'TypeReference'
vitessio/vitess#5271: Fix invocation of deferred function for loading schema
vitessio/vitess#5277: add support for DEFAULT in insert statements for sequences to the query planner
vitessio/vitess#5280: Move vtCompose into own directory to avoid conflicting main() functions
vitessio/vitess#5290: MultiSplitDiff support in workflow
vitessio/vitess#5293: Make DemoteMaster idempotent
vitessio/vitess#5301: Added support for CHECK in Parser Grammar
vitessio/vitess#5312:split unit and unit_race between different shards, reduce load on shard 0
vitessio/vitess#5314:Allow vtbackup to run as a daemon
vitessio/vitess#5315:migrater: handle tables based on the vschema info
vitessio/vitess#5316: InitTablet should not update master alias on shard record
vitessio/vitess#5321: Add read-only security_policy to block admin HTTP endpoints
vitessio/vitess#5323: Cat error log when mysqld fails to start
vitessio/vitess#5324: Added foreign_key_checks to ignored query set
vitessio/vitess#5325: migrater: reverse_replication and other solidification
vitessio/vitess#5336: Add MYSQL8 new keywords
vitessio/vitess#5338: Add division operator for sql parser
vitessio/vitess#5347: migrater: option to cancel a migration
vitessio/vitess#5348: Clean up temp dir after xtrabackup restore
vitessio/vitess#5349: examples/local/401_teardown start from any point vitessio#5349
vitessio/vitess#5351: compute total size of files to be backed up and use that for xtrabackup
vitessio/vitess#5360: vttablet-up and vtgate-up should block until ready
vitessio/vitess#5361: Examples: search for mysqld instead of mysqld_safe
vitessio/vitess#5363: EmergencyReparentShard does not need to update shard master
vitessio/vitess#5366: Implement a small subset of config file refactor
vitessio/vitess#5367: vreplication: vdiff
vitessio/vitess#5376: Fix more known-recoverable problems
vitessio/vitess#5379: Don't set RestorePosition in local_metadata
vitessio/vitess#5380: Change local_metadata.value to MEDIUMBLOB
vitessio/vitess#5383: Don't recheck mysqld port if it was provided explicitly
vitessio/vitess#5384: Fix usage of arch to work on OSX
vitessio/vitess#5391: Make reparents more robust
vitessio/vitess#5398: mysql: handle db name correctly
vitessio/vitess#5398: [JAVA] Vitess JDBC release 4.0
vitessio/vitess#5404: VStreams should respect FieldEventMode
vitessio/vitess#5407: Stop nagging about where go is installed

demmer and others added 30 commits January 27, 2018 08:31
Modeling after the vtgate mysql server implementation, add a simple
module that implements the mysql server protocol handlers and
proxies all requests to the appropriate methods in a queryservice
backend.

This includes optional support for query normalization.
Add a binary to wrap a standalone queryservice with a grpc service
interface and a mysql server implementation using the mysqlproxy
module to direct to the queryservice.
Following the example of vtgate, add support to set autocommit on
or off in the session, update the execution path to use ExecuteBatch
for single round-trip autocommit semantics, and add tests to ensure
the behavior matches mysql.
This allows EXPLAIN and other such statements to go through without
query normalization.
…8-02-07"

This reverts commit 713273a, reversing
changes made to edc17cd.
…8-02-07"

This reverts commit 0ce5f56, reversing
changes made to 713273a.
…ray-comment"

This reverts commit 80d72ac, reversing
changes made to 732edb1.
…-29"

This reverts commit d48e84a, reversing
changes made to 83866b3.
rafael and others added 24 commits December 17, 2018 13:33
Patch to handle this case while we move towards a permanent fix upstream.
cf. vitessio#4661 vitessio#4669
Signed-off-by: Rafael Chacon <[email protected]>
* Deprecate the concept of regions.
* Favor aliases instead

Signed-off-by: Rafael Chacon <[email protected]>
@rafael
Copy link

rafael commented Jan 14, 2020

@spark4 should we close this one?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants