HDFS-13677: Swap old replicas when reconfiguration Disk #780

ZanderXu · 2019-04-28T04:11:55Z

BugFix for 13677HDFS-13677

Update

merge trunk

hadoop-yetus · 2019-04-28T07:00:12Z

💔 -1 overall

Vote	Subsystem	Runtime	Comment
0	reexec	877	Docker mode activated.
		_ Prechecks _
+1	@author	0	The patch does not contain any @author tags.
+1	test4tests	0	The patch appears to include 1 new or modified test files.
		_ trunk Compile Tests _
+1	mvninstall	1463	trunk passed
+1	compile	66	trunk passed
+1	checkstyle	46	trunk passed
+1	mvnsite	69	trunk passed
+1	shadedclient	851	branch has no errors when building and testing our client artifacts.
+1	findbugs	127	trunk passed
+1	javadoc	51	trunk passed
		_ Patch Compile Tests _
+1	mvninstall	58	the patch passed
+1	compile	53	the patch passed
+1	javac	53	the patch passed
-0	checkstyle	38	hadoop-hdfs-project/hadoop-hdfs: The patch generated 1 new + 90 unchanged - 0 fixed = 91 total (was 90)
+1	mvnsite	60	the patch passed
+1	whitespace	0	The patch has no whitespace issues.
+1	shadedclient	794	patch has no errors when building and testing our client artifacts.
+1	findbugs	133	the patch passed
+1	javadoc	48	the patch passed
		_ Other Tests _
-1	unit	4807	hadoop-hdfs in the patch failed.
+1	asflicense	53	The patch does not generate ASF License warnings.
		9638

Reason	Tests
Failed junit tests	hadoop.hdfs.server.datanode.TestBPOfferService
	hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks
	hadoop.hdfs.server.datanode.TestDirectoryScanner
	hadoop.hdfs.web.TestWebHdfsTimeouts

Subsystem	Report/Notes
Docker	Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-780/2/artifact/out/Dockerfile
GITHUB PR	#780
JIRA Issue	HDFS-13677
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle
uname	Linux 6172042187a3 4.4.0-143-generic #169~14.04.2-Ubuntu SMP Wed Feb 13 15:00:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	personality/hadoop.sh
git revision	trunk / `43b2a4b`
maven	version: Apache Maven 3.3.9
Default Java	1.8.0_191
findbugs	v3.1.0-RC1
checkstyle	https://builds.apache.org/job/hadoop-multibranch/job/PR-780/2/artifact/out/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt
unit	https://builds.apache.org/job/hadoop-multibranch/job/PR-780/2/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
Test Results	https://builds.apache.org/job/hadoop-multibranch/job/PR-780/2/testReport/
Max. process+thread count	3912 (vs. ulimit of 5500)
modules	C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output	https://builds.apache.org/job/hadoop-multibranch/job/PR-780/2/console
Powered by	Apache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2019-04-28T07:01:57Z

💔 -1 overall

Vote	Subsystem	Runtime	Comment
0	reexec	814	Docker mode activated.
		_ Prechecks _
+1	@author	0	The patch does not contain any @author tags.
+1	test4tests	0	The patch appears to include 1 new or modified test files.
		_ trunk Compile Tests _
+1	mvninstall	1140	trunk passed
+1	compile	61	trunk passed
+1	checkstyle	44	trunk passed
+1	mvnsite	65	trunk passed
+1	shadedclient	836	branch has no errors when building and testing our client artifacts.
+1	findbugs	125	trunk passed
+1	javadoc	51	trunk passed
		_ Patch Compile Tests _
+1	mvninstall	58	the patch passed
+1	compile	55	the patch passed
+1	javac	55	the patch passed
-0	checkstyle	41	hadoop-hdfs-project/hadoop-hdfs: The patch generated 1 new + 90 unchanged - 0 fixed = 91 total (was 90)
+1	mvnsite	62	the patch passed
+1	whitespace	0	The patch has no whitespace issues.
+1	shadedclient	804	patch has no errors when building and testing our client artifacts.
+1	findbugs	131	the patch passed
+1	javadoc	48	the patch passed
		_ Other Tests _
-1	unit	5714	hadoop-hdfs in the patch failed.
+1	asflicense	33	The patch does not generate ASF License warnings.
		10121

Reason	Tests
Failed junit tests	hadoop.hdfs.TestReconstructStripedFile
	hadoop.hdfs.server.namenode.ha.TestHASafeMode
	hadoop.hdfs.web.TestWebHdfsTimeouts
	hadoop.hdfs.tools.TestDFSZKFailoverController

Subsystem	Report/Notes
Docker	Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-780/1/artifact/out/Dockerfile
GITHUB PR	#780
JIRA Issue	HDFS-13677
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle
uname	Linux b0370166451e 4.4.0-141-generic #167~14.04.1-Ubuntu SMP Mon Dec 10 13:20:24 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	personality/hadoop.sh
git revision	trunk / `43b2a4b`
maven	version: Apache Maven 3.3.9
Default Java	1.8.0_191
findbugs	v3.1.0-RC1
checkstyle	https://builds.apache.org/job/hadoop-multibranch/job/PR-780/1/artifact/out/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt
unit	https://builds.apache.org/job/hadoop-multibranch/job/PR-780/1/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
Test Results	https://builds.apache.org/job/hadoop-multibranch/job/PR-780/1/testReport/
Max. process+thread count	2810 (vs. ulimit of 5500)
modules	C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output	https://builds.apache.org/job/hadoop-multibranch/job/PR-780/1/console
Powered by	Apache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2019-04-28T18:01:11Z

💔 -1 overall

Vote	Subsystem	Runtime	Comment
0	reexec	23	Docker mode activated.
		_ Prechecks _
+1	@author	0	The patch does not contain any @author tags.
+1	test4tests	0	The patch appears to include 2 new or modified test files.
		_ trunk Compile Tests _
+1	mvninstall	1048	trunk passed
+1	compile	56	trunk passed
+1	checkstyle	41	trunk passed
+1	mvnsite	64	trunk passed
+1	shadedclient	723	branch has no errors when building and testing our client artifacts.
+1	findbugs	120	trunk passed
+1	javadoc	55	trunk passed
		_ Patch Compile Tests _
+1	mvninstall	61	the patch passed
+1	compile	51	the patch passed
+1	javac	51	the patch passed
+1	checkstyle	38	the patch passed
+1	mvnsite	58	the patch passed
+1	whitespace	0	The patch has no whitespace issues.
+1	shadedclient	709	patch has no errors when building and testing our client artifacts.
+1	findbugs	127	the patch passed
+1	javadoc	48	the patch passed
		_ Other Tests _
-1	unit	4598	hadoop-hdfs in the patch failed.
+1	asflicense	37	The patch does not generate ASF License warnings.
		7914

Reason	Tests
Failed junit tests	hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks
	hadoop.hdfs.web.TestWebHdfsTimeouts
	hadoop.hdfs.TestRollingUpgrade

Subsystem	Report/Notes
Docker	Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-780/3/artifact/out/Dockerfile
GITHUB PR	#780
JIRA Issue	HDFS-13677
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle
uname	Linux 3140035b8a9a 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	personality/hadoop.sh
git revision	trunk / `43b2a4b`
maven	version: Apache Maven 3.3.9
Default Java	1.8.0_191
findbugs	v3.1.0-RC1
unit	https://builds.apache.org/job/hadoop-multibranch/job/PR-780/3/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
Test Results	https://builds.apache.org/job/hadoop-multibranch/job/PR-780/3/testReport/
Max. process+thread count	3989 (vs. ulimit of 5500)
modules	C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output	https://builds.apache.org/job/hadoop-multibranch/job/PR-780/3/console
Powered by	Apache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

arp7

+1 the patch lgtm.

hadoop-yetus · 2019-07-19T13:08:55Z

💔 -1 overall

Vote	Subsystem	Runtime	Comment
0	reexec	0	Docker mode activated.
-1	patch	12	#780 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help.

Subsystem	Report/Notes
GITHUB PR	#780
JIRA Issue	HDFS-13677
Console output	https://builds.apache.org/job/hadoop-multibranch/job/PR-780/4/console
versions	git=2.7.4
Powered by	Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2019-07-26T14:24:13Z

💔 -1 overall

Vote	Subsystem	Runtime	Comment
0	reexec	0	Docker mode activated.
-1	patch	11	#780 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help.

Subsystem	Report/Notes
GITHUB PR	#780
JIRA Issue	HDFS-13677
Console output	https://builds.apache.org/job/hadoop-multibranch/job/PR-780/5/console
versions	git=2.17.1
Powered by	Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2019-08-02T01:11:02Z

💔 -1 overall

Vote	Subsystem	Runtime	Comment
0	reexec	0	Docker mode activated.
-1	patch	12	#780 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help.

Subsystem	Report/Notes
GITHUB PR	#780
JIRA Issue	HDFS-13677
Console output	https://builds.apache.org/job/hadoop-multibranch/job/PR-780/6/console
versions	git=2.7.4
Powered by	Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2019-08-08T03:22:52Z

💔 -1 overall

Vote	Subsystem	Runtime	Comment
0	reexec	0	Docker mode activated.
-1	patch	11	#780 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help.

Subsystem	Report/Notes
GITHUB PR	#780
JIRA Issue	HDFS-13677
Console output	https://builds.apache.org/job/hadoop-multibranch/job/PR-780/7/console
versions	git=2.7.4
Powered by	Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

jojochuang · 2019-08-08T04:11:07Z

Close the PR because it was committed via the patch attached to the jira.

hadoop-yetus · 2019-08-08T11:20:13Z

💔 -1 overall

Vote	Subsystem	Runtime	Comment
0	reexec	0	Docker mode activated.
-1	patch	17	#780 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help.

Subsystem	Report/Notes
GITHUB PR	#780
JIRA Issue	HDFS-13677
Console output	https://builds.apache.org/job/hadoop-multibranch/job/PR-780/8/console
versions	git=2.7.4
Powered by	Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

Author: Jagadish <[email protected]> Reviewers: Jagadish<[email protected]> Closes apache#780 from vjagadish1989/website-reorg27

ZanderXu and others added 3 commits April 17, 2019 14:59

Merge pull request #1 from apache/trunk

df6395a

Update

Merge pull request #2 from apache/trunk

27e4626

merge trunk

BugFix HDFS-13677

17005e4

ZanderXu closed this Apr 28, 2019

ZanderXu reopened this Apr 28, 2019

ZanderXu changed the title ~~Hdfs 13677~~ HDFS-13677: Swap old replicas when reconfiguration Disk Apr 28, 2019

drop the lock and add testReAddVolumeWithBlocks

a929c12

arp7 self-requested a review April 29, 2019 19:24

arp7 approved these changes Apr 29, 2019

View reviewed changes

jojochuang closed this Aug 8, 2019

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

HDFS-13677: Swap old replicas when reconfiguration Disk #780

HDFS-13677: Swap old replicas when reconfiguration Disk #780

ZanderXu commented Apr 28, 2019 •

edited

Loading

hadoop-yetus commented Apr 28, 2019

hadoop-yetus commented Apr 28, 2019

hadoop-yetus commented Apr 28, 2019

arp7 left a comment

hadoop-yetus commented Jul 19, 2019

hadoop-yetus commented Jul 26, 2019

hadoop-yetus commented Aug 2, 2019

hadoop-yetus commented Aug 8, 2019

jojochuang commented Aug 8, 2019

hadoop-yetus commented Aug 8, 2019

HDFS-13677: Swap old replicas when reconfiguration Disk #780

HDFS-13677: Swap old replicas when reconfiguration Disk #780

Conversation

ZanderXu commented Apr 28, 2019 • edited Loading

hadoop-yetus commented Apr 28, 2019

hadoop-yetus commented Apr 28, 2019

hadoop-yetus commented Apr 28, 2019

arp7 left a comment

Choose a reason for hiding this comment

hadoop-yetus commented Jul 19, 2019

hadoop-yetus commented Jul 26, 2019

hadoop-yetus commented Aug 2, 2019

hadoop-yetus commented Aug 8, 2019

jojochuang commented Aug 8, 2019

hadoop-yetus commented Aug 8, 2019

ZanderXu commented Apr 28, 2019 •

edited

Loading