Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HBASE-22877 WebHDFS based export snapshot will fail if hfile is in archive directory #509

Closed
wants to merge 2 commits into from

Conversation

VicoWu
Copy link
Contributor

@VicoWu VicoWu commented Aug 19, 2019

The corresponding issue: HBASE-22877
The problem happened in the method tryOpen :

    /**
     * Try to open the file from one of the available locations.
     *
     * @return FSDataInputStream stream of the opened file link
     * @throws IOException on unexpected error, or file not found.
     */
    private FSDataInputStream tryOpen() throws IOException {
      IOException exception = null;
      for (Path path: fileLink.getLocations()) {
        if (path.equals(currentPath)) continue;
        try {
          if(fs instanceof WebHdfsFileSystem && !fs.exists(path))
            throw new FileNotFoundException("File not exists for path " + path.toString());
          in = fs.open(path, bufferSize);
          if (pos != 0) in.seek(pos);
          assert(in.getPos() == pos) : "Link unable to seek to the right position=" + pos;
          if (LOG.isTraceEnabled()) {
            if (currentPath == null) {
              LOG.debug("link open path=" + path);
            } else {
              LOG.trace("link switch from path=" + currentPath + " to path=" + path);
            }
          }
          currentPath = path;
          return(in);
        } catch (FileNotFoundException | AccessControlException | RemoteException e) {
          exception = FileLink.handleAccessLocationException(fileLink, e, exception);
        }
      }
      throw exception;
    }

FileLink.tryOpen() depends on fs.open(path, bufferSize) to throw FileNotFoundException
to try the next file location; When we are using traditional HDFS, the fs is implements of DistributedFileSystem OR ViewFileSystem, but when we are use webhdfs, the fs is implement of WebHdfsFileSystem, in this case, no exception will be thrown even when
the file didn't exist when we are calling fs.open(path, bufferSize); so, ExportMapper will think that hfile exists in the tmp directory, the FileLink will use this directory as the hfile directory by fault; Then finally, when mapper task trying to read this hfile, it found that this file doesn't exist in fact and mapper will fail:

Error: java.io.FileNotFoundException: File does not exist: /hbase/light-hbase/.tmp/data/subill/babylon_event_history/e24ce0b56feb626b4dfe4a0e1d4f3229/info/8bef474844ec42338e7481a1933cecbd
	at sun.reflect.GeneratedConstructorAccessor14.newInstance(Unknown Source)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
	at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
	at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.toIOException(WebHdfsFileSystem.java:451)
	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.access$600(WebHdfsFileSystem.java:108)
	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.shouldRetry(WebHdfsFileSystem.java:738)
	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.runWithRetry(WebHdfsFileSystem.java:704)
	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.access$100(WebHdfsFileSystem.java:524)
	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner$1.run(WebHdfsFileSystem.java:554)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.run(WebHdfsFileSystem.java:550)
	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$ReadRunner.read(WebHdfsFileSystem.java:1824)
	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$WebHdfsInputStream.read(WebHdfsFileSystem.java:1682)
	at java.io.DataInputStream.read(DataInputStream.java:149)
	at org.apache.hadoop.hbase.io.FileLink$FileLinkInputStream.read(FileLink.java:152)
	at java.io.DataInputStream.read(DataInputStream.java:149)
	at java.io.BufferedInputStream.read1(BufferedInputStream.java:284)
	at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
	at java.io.FilterInputStream.read(FilterInputStream.java:107)
	at org.apache.hadoop.hbase.io.hadoopbackport.ThrottledInputStream.read(ThrottledInputStream.java:79)
	at org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.copyData(ExportSnapshot.java:387)
	at org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.copyFile(ExportSnapshot.java:284)
	at org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.map(ExportSnapshot.java:212)
	at org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.map(ExportSnapshot.java:130)
	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.FileNotFoundException): File does not exist: /hbase/light-hbase/.tmp/data/subill/babylon_event_history/e24ce0b56feb626b4dfe4a0e1d4f3229/info/8bef474844ec42338e7481a1933cecbd
	at org.apache.hadoop.hdfs.web.JsonUtil.toRemoteException(JsonUtil.java:124)
	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.validateResponse(WebHdfsFileSystem.java:420)
	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.access$200(WebHdfsFileSystem.java:108)
	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.connect(WebHdfsFileSystem.java:596)
	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$ReadRunner.connect(WebHdfsFileSystem.java:1875)
	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.runWithRetry(WebHdfsFileSystem.java:674)
	... 27 more

We should add an addition code to handle the WebHDFS case;

…chive directory

FileLink.tryOpen() depends on fs.open(path, bufferSize) to throw FileNotFoundException
to try the next file location; But when we use WebHDFS, no exception was thrown even when
the file didn't exist; We should add an addition code to handle the WebHDFS case;
@jojochuang
Copy link
Contributor

Does the patch try to fail early? Or does it try to support webhdfs based snapshot export?
it is entirely possible that webhdfs fails to encode certain file names properly.

@VicoWu
Copy link
Contributor Author

VicoWu commented Aug 19, 2019

@jojochuang
Thanks for you focus;
I have update the problem description and make it more detailed; Very appreciated if you could read it in detail;

  1. Does the patch try to fail early?
    What do you mean by fail early? Your question is , does HBase export snapshot fail early without this patch?

  2. Or does it try to support webhdfs based snapshot export?
    According to my test, WebHDFS based snapshot export is actually supported; The error happened when some data is in the archive directory; After the patch applied, the WebHDFS Based snapshot export works fine;

  3. it is entirely possible that webhdfs fails to encode certain file names properly.
    At least in this case I didn't find its relationship with file name encoding;

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 69 Docker mode activated.
_ Prechecks _
+1 dupname 1 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 355 master passed
+1 compile 58 master passed
+1 checkstyle 90 master passed
+1 shadedjars 301 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 38 master passed
0 spotbugs 265 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 263 master passed
_ Patch Compile Tests _
+1 mvninstall 349 the patch passed
+1 compile 79 the patch passed
+1 javac 79 the patch passed
-1 checkstyle 99 hbase-server: The patch generated 1 new + 12 unchanged - 0 fixed = 13 total (was 12)
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 408 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 1696 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 100 the patch passed
+1 findbugs 569 the patch passed
_ Other Tests _
-1 unit 15512 hbase-server in the patch failed.
+1 asflicense 39 The patch does not generate ASF License warnings.
20652
Subsystem Report/Notes
Docker Client=19.03.0 Server=19.03.0 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/2/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 5d915ecfcae8 4.15.0-52-generic #56-Ubuntu SMP Tue Jun 4 22:49:08 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 46abaef
Default Java 1.8.0_181
checkstyle https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/2/artifact/out/diff-checkstyle-hbase-server.txt
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/2/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/2/testReport/
Max. process+thread count 4723 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/2/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 33 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 364 master passed
+1 compile 62 master passed
+1 checkstyle 93 master passed
+1 shadedjars 277 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 40 master passed
0 spotbugs 282 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 280 master passed
_ Patch Compile Tests _
+1 mvninstall 343 the patch passed
+1 compile 66 the patch passed
+1 javac 66 the patch passed
-1 checkstyle 95 hbase-server: The patch generated 1 new + 12 unchanged - 0 fixed = 13 total (was 12)
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 323 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 1085 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 36 the patch passed
+1 findbugs 324 the patch passed
_ Other Tests _
-1 unit 9610 hbase-server in the patch failed.
+1 asflicense 28 The patch does not generate ASF License warnings.
13493
Reason Tests
Failed junit tests hadoop.hbase.regionserver.TestHRegion
hadoop.hbase.regionserver.TestHRegionWithInMemoryFlush
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/3/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 0126ab4d2185 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 8e488ce
Default Java 1.8.0_181
checkstyle https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/3/artifact/out/diff-checkstyle-hbase-server.txt
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/3/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/3/testReport/
Max. process+thread count 4375 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/3/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 116 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 360 master passed
+1 compile 59 master passed
+1 checkstyle 81 master passed
+1 shadedjars 288 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 36 master passed
0 spotbugs 246 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 245 master passed
_ Patch Compile Tests _
+1 mvninstall 326 the patch passed
+1 compile 55 the patch passed
+1 javac 55 the patch passed
-1 checkstyle 75 hbase-server: The patch generated 1 new + 12 unchanged - 0 fixed = 13 total (was 12)
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 286 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 997 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 33 the patch passed
+1 findbugs 258 the patch passed
_ Other Tests _
-1 unit 16166 hbase-server in the patch failed.
+1 asflicense 28 The patch does not generate ASF License warnings.
19814
Reason Tests
Failed junit tests hadoop.hbase.client.TestFromClientSide3
hadoop.hbase.regionserver.TestHRegion
hadoop.hbase.regionserver.TestHRegionWithInMemoryFlush
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/4/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 2179151ab6e8 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 6738280
Default Java 1.8.0_181
checkstyle https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/4/artifact/out/diff-checkstyle-hbase-server.txt
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/4/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/4/testReport/
Max. process+thread count 5110 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/4/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 71 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 413 master passed
+1 compile 68 master passed
+1 checkstyle 95 master passed
+1 shadedjars 346 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 40 master passed
0 spotbugs 284 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 281 master passed
_ Patch Compile Tests _
+1 mvninstall 333 the patch passed
+1 compile 59 the patch passed
+1 javac 59 the patch passed
-1 checkstyle 81 hbase-server: The patch generated 1 new + 12 unchanged - 0 fixed = 13 total (was 12)
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 301 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 1215 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 39 the patch passed
+1 findbugs 326 the patch passed
_ Other Tests _
-1 unit 20941 hbase-server in the patch failed.
+1 asflicense 88 The patch does not generate ASF License warnings.
25224
Reason Tests
Failed junit tests hadoop.hbase.tool.TestBulkLoadHFiles
hadoop.hbase.master.procedure.TestTruncateTableProcedure
hadoop.hbase.replication.multiwal.TestReplicationSyncUpToolWithMultipleWAL
hadoop.hbase.replication.TestReplicationKillSlaveRS
hadoop.hbase.replication.TestReplicationSmallTests
hadoop.hbase.master.procedure.TestProcedurePriority
hadoop.hbase.regionserver.TestHRegion
hadoop.hbase.client.TestFromClientSide3
hadoop.hbase.replication.TestReplicationKillSlaveRSWithSeparateOldWALs
hadoop.hbase.master.procedure.TestSCPWithReplicasWithoutZKCoordinated
hadoop.hbase.replication.TestReplicationSmallTestsSync
hadoop.hbase.regionserver.TestHRegionWithInMemoryFlush
hadoop.hbase.client.TestSnapshotTemporaryDirectoryWithRegionReplicas
hadoop.hbase.client.TestSnapshotDFSTemporaryDirectory
hadoop.hbase.tool.TestSecureBulkLoadHFiles
hadoop.hbase.security.access.TestSnapshotScannerHDFSAclController
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/5/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux d5ac272a1ad6 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / a59f7d4
Default Java 1.8.0_181
checkstyle https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/5/artifact/out/diff-checkstyle-hbase-server.txt
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/5/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/5/testReport/
Max. process+thread count 4940 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/5/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@shahrs87
Copy link
Contributor

shahrs87 commented Aug 20, 2019

in this case, no exception will be thrown even when the file didn't exist when we are calling

@VicoWu Could you elaborate why you think it doesn't throw FileNotfound exception. In the stack trace you pasted, it did throw FileNotFound Exception but it is wrapped in RemoteException. You just need to unwrap RemoteException to see underlying exception. Maybe I am missing something. Please correct me if I am wrong.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 98 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 361 master passed
+1 compile 66 master passed
+1 checkstyle 80 master passed
+1 shadedjars 317 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 35 master passed
0 spotbugs 277 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 273 master passed
_ Patch Compile Tests _
+1 mvninstall 320 the patch passed
+1 compile 59 the patch passed
+1 javac 59 the patch passed
-1 checkstyle 76 hbase-server: The patch generated 1 new + 12 unchanged - 0 fixed = 13 total (was 12)
+1 whitespace 1 The patch has no whitespace issues.
+1 shadedjars 313 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 999 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 33 the patch passed
+1 findbugs 268 the patch passed
_ Other Tests _
-1 unit 19512 hbase-server in the patch failed.
+1 asflicense 79 The patch does not generate ASF License warnings.
23331
Reason Tests
Failed junit tests hadoop.hbase.util.TestFromClientSide3WoUnsafe
hadoop.hbase.client.TestFromClientSideWithCoprocessor
hadoop.hbase.client.TestAsyncTableAdminApi
hadoop.hbase.replication.TestReplicationSmallTests
hadoop.hbase.tool.TestBulkLoadHFiles
hadoop.hbase.client.TestFromClientSide3
hadoop.hbase.replication.TestReplicationSmallTestsSync
hadoop.hbase.client.TestSnapshotTemporaryDirectory
hadoop.hbase.master.procedure.TestSCPWithReplicas
hadoop.hbase.client.TestCloneSnapshotFromClientNormal
hadoop.hbase.client.TestSnapshotDFSTemporaryDirectory
hadoop.hbase.tool.TestSecureBulkLoadHFiles
hadoop.hbase.master.procedure.TestSCPWithReplicasWithoutZKCoordinated
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/6/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux afd35db0fd7b 4.4.0-137-generic #163-Ubuntu SMP Mon Sep 24 13:14:43 UTC 2018 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / ab28f9d
Default Java 1.8.0_181
checkstyle https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/6/artifact/out/diff-checkstyle-hbase-server.txt
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/6/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/6/testReport/
Max. process+thread count 5380 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/6/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@jojochuang
Copy link
Contributor

Interesting to know this webhdfs behavior.
I wonder if the behavior had changed recently, because on Hadoop 3, it does throw FileNotFoundException upon opening an non-existent file:


curl http://nn1:20101/webhdfs/v1/abc?op=OPEN
{"RemoteException":{"exception":"FileNotFoundException","javaClassName":"java.io.FileNotFoundException","message":"File /abc not found."}}

@VicoWu
Copy link
Contributor Author

VicoWu commented Aug 21, 2019

@jojochuang
Thanks for your experiments;
From my understanding, when you use curl with op=OPEN, this rest request definitely will send to the httpfs server and get a FileNotFound exception;This is just as expect;
But when it comes to the httpfs java client WebHdfsFileSystem, things is different; I have debug and dive into to implements of WebHdfsFileSystem and I found: when we call WebHdfsFileSystem.open(), in fact, it does nothing except for preparing an InputStream to the remote httpfs server, but it didn't establish any connection to the httpfs. That's why we cannot get an FileNotFound exception when calling WebHdfsFileSystem.open() on a non-exist files;
So I think it has nothing to do with hadoop version; But you could still check the code of hadoop 3.0;

@Apache-HBase
Copy link

🎊 +1 overall

Vote Subsystem Runtime Comment
0 reexec 38 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 316 master passed
+1 compile 50 master passed
+1 checkstyle 72 master passed
+1 shadedjars 268 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 38 master passed
0 spotbugs 253 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 252 master passed
_ Patch Compile Tests _
+1 mvninstall 286 the patch passed
+1 compile 52 the patch passed
+1 javac 52 the patch passed
+1 checkstyle 70 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 259 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 905 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 33 the patch passed
+1 findbugs 265 the patch passed
_ Other Tests _
+1 unit 8923 hbase-server in the patch passed.
+1 asflicense 25 The patch does not generate ASF License warnings.
12210
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/7/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 91edf9cc5787 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 66ad42c
Default Java 1.8.0_181
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/7/testReport/
Max. process+thread count 4897 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/7/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 72 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 414 master passed
+1 compile 70 master passed
+1 checkstyle 94 master passed
+1 shadedjars 407 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 43 master passed
0 spotbugs 298 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 295 master passed
_ Patch Compile Tests _
+1 mvninstall 362 the patch passed
+1 compile 69 the patch passed
+1 javac 69 the patch passed
+1 checkstyle 87 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 348 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 1341 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 39 the patch passed
+1 findbugs 312 the patch passed
_ Other Tests _
-1 unit 18222 hbase-server in the patch failed.
+1 asflicense 56 The patch does not generate ASF License warnings.
22809
Reason Tests
Failed junit tests hadoop.hbase.client.TestSnapshotTemporaryDirectory
hadoop.hbase.client.TestFromClientSideWithCoprocessor
hadoop.hbase.client.TestFromClientSide3
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/8/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux d6cc95b1fc0e 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 7af5b30
Default Java 1.8.0_181
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/8/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/8/testReport/
Max. process+thread count 4908 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/8/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@shahrs87
Copy link
Contributor

shahrs87 commented Aug 21, 2019

But when it comes to the httpfs java client WebHdfsFileSystem

I am confused whether you are talking about WebHdfsFileSystem or HttpFSFileSystem. These two are different. Refer to class org.apache.hadoop.fs.http.client.HttpFSFileSystem for latter. The further comment is assuming that you are talking about WebHdfsFileSystem since you mentioned that multiple times.

I have debug and dive into to implements of WebHdfsFileSystem and I found: when we call WebHdfsFileSystem.open(), in fact, it does nothing except for preparing an InputStream to the remote httpfs server, but it didn't establish any connection to the httpfs.

This is not correct. When you call WebHdfsFileSystem#open(), it does create an http connection to namenode and gets the list of datanodes where the blocks for that file resides. When you call read on the input stream, it directly goes to datanode.
Follow the code path below.
WebHdfsFileSystem#open --> WebHdfsInputStream(f, bufferSize) --> ReadRunner(path, buffersize) --> ReadRunner#getRedirectedUrl --> AbstractRunner#run() --> WebHdfsFileSystem#runWithRetry --> ReadRunner#connect --> AbstractRunner#connect(URL url) --> AbstractRunner#connect(final HttpOpParam.Op op, final URL url) which makes actual connection to namenode and if the file doesn't exist, WebHdfsFileSystem (client) will receive FileNotFoundException wrapped in RemoteException.
My checked out branch in hadoop is branch-2.8.
Hope this helps.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 98 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 348 master passed
+1 compile 66 master passed
+1 checkstyle 82 master passed
+1 shadedjars 354 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 60 master passed
0 spotbugs 296 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 294 master passed
_ Patch Compile Tests _
+1 mvninstall 601 the patch passed
+1 compile 89 the patch passed
+1 javac 89 the patch passed
+1 checkstyle 93 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 327 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 1207 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 45 the patch passed
+1 findbugs 299 the patch passed
_ Other Tests _
-1 unit 20280 hbase-server in the patch failed.
+1 asflicense 40 The patch does not generate ASF License warnings.
24785
Reason Tests
Failed junit tests hadoop.hbase.util.TestFromClientSide3WoUnsafe
hadoop.hbase.client.TestFromClientSideWithCoprocessor
hadoop.hbase.security.access.TestSnapshotScannerHDFSAclController
hadoop.hbase.client.TestAsyncTableAdminApi
hadoop.hbase.tool.TestBulkLoadHFiles
hadoop.hbase.client.TestFromClientSide3
hadoop.hbase.client.TestSnapshotTemporaryDirectory
hadoop.hbase.client.TestCloneSnapshotFromClientNormal
hadoop.hbase.client.TestSnapshotDFSTemporaryDirectory
hadoop.hbase.tool.TestSecureBulkLoadHFiles
hadoop.hbase.master.procedure.TestSCPWithReplicasWithoutZKCoordinated
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/9/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 2cfebf1799f4 4.4.0-137-generic #163-Ubuntu SMP Mon Sep 24 13:14:43 UTC 2018 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 1b50404
Default Java 1.8.0_181
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/9/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/9/testReport/
Max. process+thread count 5162 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/9/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

🎊 +1 overall

Vote Subsystem Runtime Comment
0 reexec 38 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 327 master passed
+1 compile 54 master passed
+1 checkstyle 74 master passed
+1 shadedjars 281 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 35 master passed
0 spotbugs 239 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 237 master passed
_ Patch Compile Tests _
+1 mvninstall 299 the patch passed
+1 compile 51 the patch passed
+1 javac 51 the patch passed
+1 checkstyle 73 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 278 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 915 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 33 the patch passed
+1 findbugs 254 the patch passed
_ Other Tests _
+1 unit 8620 hbase-server in the patch passed.
+1 asflicense 24 The patch does not generate ASF License warnings.
11963
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/10/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux abfabbf92f20 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / b8857ec
Default Java 1.8.0_181
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/10/testReport/
Max. process+thread count 4756 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/10/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 75 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 366 master passed
+1 compile 64 master passed
+1 checkstyle 90 master passed
+1 shadedjars 309 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 41 master passed
0 spotbugs 276 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 273 master passed
_ Patch Compile Tests _
+1 mvninstall 336 the patch passed
+1 compile 63 the patch passed
+1 javac 63 the patch passed
+1 checkstyle 87 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 323 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 1110 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 38 the patch passed
+1 findbugs 291 the patch passed
_ Other Tests _
-1 unit 16913 hbase-server in the patch failed.
+1 asflicense 39 The patch does not generate ASF License warnings.
20834
Reason Tests
Failed junit tests hadoop.hbase.client.TestFromClientSideWithCoprocessor
hadoop.hbase.security.access.TestSnapshotScannerHDFSAclController
hadoop.hbase.client.TestAsyncSnapshotAdminApi
hadoop.hbase.client.TestSnapshotDFSTemporaryDirectory
Subsystem Report/Notes
Docker Client=18.09.7 Server=18.09.7 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/11/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux d6e5ce7c9106 4.15.0-52-generic #56-Ubuntu SMP Tue Jun 4 22:49:08 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / b8857ec
Default Java 1.8.0_181
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/11/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/11/testReport/
Max. process+thread count 4938 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/11/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

🎊 +1 overall

Vote Subsystem Runtime Comment
0 reexec 35 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 436 master passed
+1 compile 60 master passed
+1 checkstyle 90 master passed
+1 shadedjars 312 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 42 master passed
0 spotbugs 265 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 261 master passed
_ Patch Compile Tests _
+1 mvninstall 339 the patch passed
+1 compile 61 the patch passed
+1 javac 61 the patch passed
+1 checkstyle 95 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 342 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 1107 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 39 the patch passed
+1 findbugs 325 the patch passed
_ Other Tests _
+1 unit 9359 hbase-server in the patch passed.
+1 asflicense 26 The patch does not generate ASF License warnings.
13368
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/12/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 33d6cddae471 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 84ee378
Default Java 1.8.0_181
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/12/testReport/
Max. process+thread count 4430 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/12/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 66 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 352 master passed
+1 compile 56 master passed
+1 checkstyle 80 master passed
+1 shadedjars 307 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 35 master passed
0 spotbugs 245 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 243 master passed
_ Patch Compile Tests _
+1 mvninstall 300 the patch passed
+1 compile 56 the patch passed
+1 javac 56 the patch passed
+1 checkstyle 75 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 306 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 1074 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 34 the patch passed
+1 findbugs 266 the patch passed
_ Other Tests _
-1 unit 17667 hbase-server in the patch failed.
+1 asflicense 30 The patch does not generate ASF License warnings.
21354
Reason Tests
Failed junit tests hadoop.hbase.client.TestFromClientSideWithCoprocessor
hadoop.hbase.master.procedure.TestSCPWithReplicasWithoutZKCoordinated
hadoop.hbase.client.TestCloneSnapshotFromClientNormal
hadoop.hbase.client.TestFromClientSide3
hadoop.hbase.util.TestFromClientSide3WoUnsafe
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/13/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 115c45a64ca5 4.4.0-139-generic #165-Ubuntu SMP Wed Oct 24 10:58:50 UTC 2018 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / b329bf0
Default Java 1.8.0_181
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/13/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/13/testReport/
Max. process+thread count 5042 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/13/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 94 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 341 master passed
+1 compile 51 master passed
+1 checkstyle 74 master passed
+1 shadedjars 267 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 38 master passed
0 spotbugs 257 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 254 master passed
_ Patch Compile Tests _
+1 mvninstall 318 the patch passed
+1 compile 59 the patch passed
+1 javac 59 the patch passed
+1 checkstyle 73 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 281 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 974 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 46 the patch passed
+1 findbugs 264 the patch passed
_ Other Tests _
-1 unit 18334 hbase-server in the patch failed.
+1 asflicense 73 The patch does not generate ASF License warnings.
22091
Reason Tests
Failed junit tests hadoop.hbase.client.TestFromClientSide
hadoop.hbase.client.TestIncrementsFromClientSide
hadoop.hbase.client.TestCloneSnapshotFromClientNormal
hadoop.hbase.client.TestFromClientSide3
hadoop.hbase.security.access.TestSnapshotScannerHDFSAclController
hadoop.hbase.client.TestSnapshotDFSTemporaryDirectory
hadoop.hbase.client.TestAsyncTableAdminApi
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/14/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 3785e7e1858d 4.4.0-137-generic #163-Ubuntu SMP Mon Sep 24 13:14:43 UTC 2018 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 4268774
Default Java 1.8.0_181
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/14/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/14/testReport/
Max. process+thread count 5413 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/14/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 63 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 337 master passed
+1 compile 56 master passed
+1 checkstyle 77 master passed
+1 shadedjars 273 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 45 master passed
0 spotbugs 273 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 271 master passed
_ Patch Compile Tests _
+1 mvninstall 310 the patch passed
+1 compile 52 the patch passed
+1 javac 52 the patch passed
+1 checkstyle 72 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 270 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 972 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 34 the patch passed
+1 findbugs 248 the patch passed
_ Other Tests _
-1 unit 20321 hbase-server in the patch failed.
+1 asflicense 85 The patch does not generate ASF License warnings.
23882
Reason Tests
Failed junit tests hadoop.hbase.tool.TestSecureBulkLoadHFiles
hadoop.hbase.master.procedure.TestRestoreSnapshotProcedure
hadoop.hbase.master.procedure.TestSCPWithReplicas
hadoop.hbase.master.procedure.TestProcedurePriority
hadoop.hbase.client.TestFromClientSide
hadoop.hbase.tool.TestBulkLoadHFiles
hadoop.hbase.client.TestAdmin2
hadoop.hbase.namespace.TestNamespaceAuditor
hadoop.hbase.client.TestSnapshotDFSTemporaryDirectory
hadoop.hbase.client.TestSnapshotTemporaryDirectory
hadoop.hbase.master.procedure.TestTruncateTableProcedure
hadoop.hbase.util.TestFromClientSide3WoUnsafe
hadoop.hbase.client.TestFromClientSide3
hadoop.hbase.client.TestAsyncTableAdminApi
hadoop.hbase.client.TestCloneSnapshotFromClientNormal
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/15/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 26258c33d8dd 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 288d1f2
Default Java 1.8.0_181
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/15/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/15/testReport/
Max. process+thread count 4958 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/15/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

🎊 +1 overall

Vote Subsystem Runtime Comment
0 reexec 38 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 323 master passed
+1 compile 53 master passed
+1 checkstyle 73 master passed
+1 shadedjars 268 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 33 master passed
0 spotbugs 242 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 239 master passed
_ Patch Compile Tests _
+1 mvninstall 294 the patch passed
+1 compile 54 the patch passed
+1 javac 54 the patch passed
+1 checkstyle 70 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 266 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 984 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 34 the patch passed
+1 findbugs 270 the patch passed
_ Other Tests _
+1 unit 8627 hbase-server in the patch passed.
+1 asflicense 21 The patch does not generate ASF License warnings.
12024
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/16/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux ac7a3357d2d3 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 767bb15
Default Java 1.8.0_181
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/16/testReport/
Max. process+thread count 4738 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/16/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

🎊 +1 overall

Vote Subsystem Runtime Comment
0 reexec 39 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 414 master passed
+1 compile 60 master passed
+1 checkstyle 96 master passed
+1 shadedjars 311 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 41 master passed
0 spotbugs 288 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 286 master passed
_ Patch Compile Tests _
+1 mvninstall 333 the patch passed
+1 compile 65 the patch passed
+1 javac 65 the patch passed
+1 checkstyle 88 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 318 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 1065 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 44 the patch passed
+1 findbugs 336 the patch passed
_ Other Tests _
+1 unit 9889 hbase-server in the patch passed.
+1 asflicense 23 The patch does not generate ASF License warnings.
13828
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/17/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 4211565af9ca 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 74fb204
Default Java 1.8.0_181
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/17/testReport/
Max. process+thread count 4839 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/17/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 101 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 371 master passed
+1 compile 58 master passed
+1 checkstyle 83 master passed
+1 shadedjars 289 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 37 master passed
0 spotbugs 268 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 264 master passed
_ Patch Compile Tests _
+1 mvninstall 330 the patch passed
+1 compile 54 the patch passed
+1 javac 54 the patch passed
+1 checkstyle 84 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 291 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 1007 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 39 the patch passed
+1 findbugs 318 the patch passed
_ Other Tests _
-1 unit 17536 hbase-server in the patch failed.
+1 asflicense 36 The patch does not generate ASF License warnings.
21300
Reason Tests
Failed junit tests hadoop.hbase.master.procedure.TestSCPWithReplicasWithoutZKCoordinated
hadoop.hbase.client.TestSnapshotTemporaryDirectoryWithRegionReplicas
hadoop.hbase.client.TestSnapshotDFSTemporaryDirectory
hadoop.hbase.master.TestAssignmentManagerMetrics
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/18/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux b5d0bb956ab9 4.15.0-48-generic #51-Ubuntu SMP Wed Apr 3 08:28:49 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 2d45801
Default Java 1.8.0_181
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/18/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/18/testReport/
Max. process+thread count 4549 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/18/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

🎊 +1 overall

Vote Subsystem Runtime Comment
0 reexec 55 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 434 master passed
+1 compile 72 master passed
+1 checkstyle 100 master passed
+1 shadedjars 380 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 48 master passed
0 spotbugs 324 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 320 master passed
_ Patch Compile Tests _
+1 mvninstall 431 the patch passed
+1 compile 76 the patch passed
+1 javac 76 the patch passed
+1 checkstyle 104 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 370 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 1291 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 46 the patch passed
+1 findbugs 332 the patch passed
_ Other Tests _
+1 unit 16175 hbase-server in the patch passed.
+1 asflicense 32 The patch does not generate ASF License warnings.
20737
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/19/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 46b9dfa4924c 4.4.0-154-generic #181-Ubuntu SMP Tue Jun 25 05:29:03 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 43f53c1
Default Java 1.8.0_181
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/19/testReport/
Max. process+thread count 4496 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/19/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 40 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 331 master passed
+1 compile 53 master passed
+1 checkstyle 76 master passed
+1 shadedjars 278 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 34 master passed
0 spotbugs 242 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 240 master passed
_ Patch Compile Tests _
+1 mvninstall 305 the patch passed
+1 compile 53 the patch passed
+1 javac 53 the patch passed
+1 checkstyle 70 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 263 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 915 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 33 the patch passed
+1 findbugs 248 the patch passed
_ Other Tests _
-1 unit 8657 hbase-server in the patch failed.
+1 asflicense 24 The patch does not generate ASF License warnings.
11980
Reason Tests
Failed junit tests hadoop.hbase.security.token.TestZKSecretWatcher
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/20/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 4ab83ca2d982 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 504fc52
Default Java 1.8.0_181
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/20/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/20/testReport/
Max. process+thread count 4710 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/20/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

🎊 +1 overall

Vote Subsystem Runtime Comment
0 reexec 42 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 327 master passed
+1 compile 54 master passed
+1 checkstyle 76 master passed
+1 shadedjars 280 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 34 master passed
0 spotbugs 243 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 242 master passed
_ Patch Compile Tests _
+1 mvninstall 298 the patch passed
+1 compile 54 the patch passed
+1 javac 54 the patch passed
+1 checkstyle 77 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 277 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 946 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 33 the patch passed
+1 findbugs 259 the patch passed
_ Other Tests _
+1 unit 8436 hbase-server in the patch passed.
+1 asflicense 32 The patch does not generate ASF License warnings.
11842
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/21/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 5e16e514e967 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / ee9d986
Default Java 1.8.0_181
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/21/testReport/
Max. process+thread count 4615 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/21/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

🎊 +1 overall

Vote Subsystem Runtime Comment
0 reexec 36 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 470 master passed
+1 compile 76 master passed
+1 checkstyle 112 master passed
+1 shadedjars 377 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 54 master passed
0 spotbugs 281 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 280 master passed
_ Patch Compile Tests _
+1 mvninstall 353 the patch passed
+1 compile 58 the patch passed
+1 javac 58 the patch passed
+1 checkstyle 89 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 302 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 1049 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 38 the patch passed
+1 findbugs 320 the patch passed
_ Other Tests _
+1 unit 9495 hbase-server in the patch passed.
+1 asflicense 24 The patch does not generate ASF License warnings.
13547
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/22/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 33723f727fc6 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / ee9d986
Default Java 1.8.0_181
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/22/testReport/
Max. process+thread count 4518 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/22/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

🎊 +1 overall

Vote Subsystem Runtime Comment
0 reexec 131 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 388 master passed
+1 compile 59 master passed
+1 checkstyle 88 master passed
+1 shadedjars 305 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 40 master passed
0 spotbugs 277 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 275 master passed
_ Patch Compile Tests _
+1 mvninstall 357 the patch passed
+1 compile 61 the patch passed
+1 javac 61 the patch passed
+1 checkstyle 88 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 310 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 1056 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 37 the patch passed
+1 findbugs 296 the patch passed
_ Other Tests _
+1 unit 13752 hbase-server in the patch passed.
+1 asflicense 29 The patch does not generate ASF License warnings.
17690
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/26/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 92e9db80f663 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 94155fe
Default Java 1.8.0_181
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/26/testReport/
Max. process+thread count 4650 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/26/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 109 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 432 master passed
+1 compile 71 master passed
+1 checkstyle 100 master passed
+1 shadedjars 362 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 47 master passed
0 spotbugs 333 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 331 master passed
_ Patch Compile Tests _
+1 mvninstall 407 the patch passed
+1 compile 71 the patch passed
+1 javac 71 the patch passed
+1 checkstyle 103 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 365 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 1098 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 40 the patch passed
+1 findbugs 292 the patch passed
_ Other Tests _
-1 unit 15458 hbase-server in the patch failed.
+1 asflicense 36 The patch does not generate ASF License warnings.
19765
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/27/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux ba1ed521584d 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 554b253
Default Java 1.8.0_181
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/27/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/27/testReport/
Max. process+thread count 4824 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/27/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@VicoWu
Copy link
Contributor Author

VicoWu commented Aug 25, 2019

@shahrs87
Great thanks for you code insight for my problem;

  • For the mistake I made between the difference between WebHDFSFileSystem and HttpFSFileSystem:

Yes, I previous make mistakes for the differences between WebHDFSFileSystem and HttpFSFileSystem because the schema for both them are webhdfs; I find that when I am using WebHDFSFileSystem, the target could be both the HttpFS server (default port is 14000) or the NameNode webserver(default port is 57000), both connections could work fine except that they didn't throw FileNotFoundException timely when I am calling fs.open();

  • Why the error happened in my side and I find that no connection is established in fs.open?

To be simple, in my code base hadoop2.6.0-cdh5.16.1, the client indeed didn't connect to the remote server. Your code base seems like hadoop3.x, and I find the commit which make the fs.open() try to connect to remote server and thus throws a FileNotFoundException timely is this commit
in which is adds the getRedirectedUrl() call in the ReadRunner construction method:

    ReadRunner(Path p, int bs) throws IOException {
      super(GetOpParam.Op.OPEN, p, new BufferSizeParam(bs));	      super(GetOpParam.Op.OPEN, p, new BufferSizeParam(bs));
      this.path = p;	      this.path = p;
      this.bufferSize = bs;	      this.bufferSize = bs;
      getRedirectedUrl();
    }

And this patch has been applied to only 3.x hadoop:

release-3.2.0-RC1 release-3.2.0-RC0 release-3.1.2-RC1 release-3.1.2-RC0 release-3.1.1-RC0 release-3.1.0-RC1 release-3.1.0-RC0 rel/submarine-0.2.0 rel/release-3.2.0 rel/release-3.1.2 rel/release-3.1.1 rel/release-3.1.0 ozone-0.4.0-alpha-RC2 ozone-0.4.0-alpha-RC1 ozone-0.4.0-alpha-RC0 ozone-0.3.0-alpha ozone-0.3.0-alpha-RC1 ozone-0.3.0-alpha-RC0 ozone-0.2.1-alpha-RC0

So that's why your experiment cannot reproduce this problem and that you think the fs.open() do make a connection to the remote server; But in hadoop 2.x, this problem do exists;

So that's my investigation for this problem; I think everything is much more clear now;
Do you think it is necessary to add this patch?

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 86 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 345 master passed
+1 compile 59 master passed
+1 checkstyle 87 master passed
+1 shadedjars 289 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 42 master passed
0 spotbugs 306 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 304 master passed
_ Patch Compile Tests _
+1 mvninstall 312 the patch passed
+1 compile 60 the patch passed
+1 javac 60 the patch passed
+1 checkstyle 83 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 287 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 981 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 37 the patch passed
+1 findbugs 323 the patch passed
_ Other Tests _
-1 unit 17684 hbase-server in the patch failed.
+1 asflicense 42 The patch does not generate ASF License warnings.
21411
Reason Tests
Failed junit tests hadoop.hbase.master.procedure.TestSCPWithReplicasWithoutZKCoordinated
hadoop.hbase.client.TestFromClientSideWithCoprocessor
hadoop.hbase.client.TestSnapshotDFSTemporaryDirectory
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/28/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux ef9c55875787 4.15.0-48-generic #51-Ubuntu SMP Wed Apr 3 08:28:49 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 1ea5d8b
Default Java 1.8.0_181
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/28/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/28/testReport/
Max. process+thread count 4502 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/28/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

🎊 +1 overall

Vote Subsystem Runtime Comment
0 reexec 110 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 344 master passed
+1 compile 60 master passed
+1 checkstyle 77 master passed
+1 shadedjars 265 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 38 master passed
0 spotbugs 258 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 257 master passed
_ Patch Compile Tests _
+1 mvninstall 301 the patch passed
+1 compile 56 the patch passed
+1 javac 56 the patch passed
+1 checkstyle 77 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 271 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 954 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 41 the patch passed
+1 findbugs 289 the patch passed
_ Other Tests _
+1 unit 9692 hbase-server in the patch passed.
+1 asflicense 29 The patch does not generate ASF License warnings.
13247
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/29/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux c03b9d51a2d4 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 1ea5d8b
Default Java 1.8.0_181
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/29/testReport/
Max. process+thread count 4653 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/29/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@shahrs87
Copy link
Contributor

shahrs87 commented Aug 26, 2019

But in hadoop 2.x, this problem do exists;

This bug does not exist in branch-2.6.0 also.
Here is the git repo for branch-2.6.0 https://github.com/apache/hadoop/tree/branch-2.6.0
Refer to WebHdfsFileSystem#open --> OffsetUrlInputStream(UnresolvedUrlOpener o, OffsetUrlOpener r) --> ByteRangeInputStream(URLOpener o, URLOpener r) --> ByteRangeInputStream#getInputStream() --> ByteRangeInputStream#openInputStream() --> UnresolvedUrlOpener#connect() --> AbstractRunner#run() --> AbstractRunner#runWithRetry() method which in turn calls NameNodeWebHdfsMethods on server side and it will throw FileNotFoundException wrapped in RemoteException.
One suggestion: Please enable trace logging on client side if possible. It will show you many debug and trace level logs about communication between client and server to understand WebHdfsFileSystem better.
@VicoWu Hope this helps.

@Apache-HBase
Copy link

🎊 +1 overall

Vote Subsystem Runtime Comment
0 reexec 32 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 415 master passed
+1 compile 65 master passed
+1 checkstyle 95 master passed
+1 shadedjars 305 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 38 master passed
0 spotbugs 302 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 299 master passed
_ Patch Compile Tests _
+1 mvninstall 352 the patch passed
+1 compile 60 the patch passed
+1 javac 60 the patch passed
+1 checkstyle 87 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 314 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 1037 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 36 the patch passed
+1 findbugs 294 the patch passed
_ Other Tests _
+1 unit 10164 hbase-server in the patch passed.
+1 asflicense 38 The patch does not generate ASF License warnings.
14036
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/30/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 17404b9d9846 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 0438fdc
Default Java 1.8.0_181
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/30/testReport/
Max. process+thread count 4841 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/30/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 89 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 444 master passed
+1 compile 67 master passed
+1 checkstyle 100 master passed
+1 shadedjars 315 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 41 master passed
0 spotbugs 297 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 294 master passed
_ Patch Compile Tests _
+1 mvninstall 345 the patch passed
+1 compile 61 the patch passed
+1 javac 61 the patch passed
+1 checkstyle 88 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 303 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 1117 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 42 the patch passed
+1 findbugs 316 the patch passed
_ Other Tests _
-1 unit 14667 hbase-server in the patch failed.
+1 asflicense 34 The patch does not generate ASF License warnings.
18750
Reason Tests
Failed junit tests hadoop.hbase.client.TestFromClientSideWithCoprocessor
hadoop.hbase.client.TestSnapshotTemporaryDirectory
Subsystem Report/Notes
Docker Client=19.03.0 Server=19.03.0 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/31/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux ddc00cc86af7 4.15.0-52-generic #56-Ubuntu SMP Tue Jun 4 22:49:08 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / ec68bf3
Default Java 1.8.0_181
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/31/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/31/testReport/
Max. process+thread count 4608 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/31/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 34 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 361 master passed
+1 compile 59 master passed
+1 checkstyle 92 master passed
+1 shadedjars 351 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 43 master passed
0 spotbugs 341 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 338 master passed
_ Patch Compile Tests _
+1 mvninstall 385 the patch passed
+1 compile 70 the patch passed
+1 javac 70 the patch passed
+1 checkstyle 100 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 351 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 1200 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 41 the patch passed
+1 findbugs 342 the patch passed
_ Other Tests _
-1 unit 10062 hbase-server in the patch failed.
+1 asflicense 26 The patch does not generate ASF License warnings.
14298
Reason Tests
Failed junit tests hadoop.hbase.client.TestAsyncTableGetMultiThreaded
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/32/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux a52ba673406e 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / f2425c7
Default Java 1.8.0_181
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/32/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/32/testReport/
Max. process+thread count 4369 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/32/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 73 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 352 master passed
+1 compile 59 master passed
+1 checkstyle 89 master passed
+1 shadedjars 298 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 37 master passed
0 spotbugs 258 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 256 master passed
_ Patch Compile Tests _
+1 mvninstall 329 the patch passed
+1 compile 56 the patch passed
+1 javac 56 the patch passed
+1 checkstyle 87 the patch passed
+1 whitespace 1 The patch has no whitespace issues.
+1 shadedjars 300 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 1036 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 36 the patch passed
+1 findbugs 270 the patch passed
_ Other Tests _
-1 unit 12288 hbase-server in the patch failed.
+1 asflicense 25 The patch does not generate ASF License warnings.
15992
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/33/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 4ad01f9819f6 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 56980fb
Default Java 1.8.0_181
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/33/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/33/testReport/
Max. process+thread count 5017 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/33/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@VicoWu
Copy link
Contributor Author

VicoWu commented Aug 29, 2019

@shahrs87
Thanks for you comments;
My current branch is a CDH version hadoop2.6.0-CDH5.16.1;
I previously thought that the hadoop2.6.0-CDH5.16.1; is totallly based on the apache hadoop 2..6.0, but from this case it seems not;
This is my code of the HDFSFileSystem.open() for hadoop2.6.0-CDH5.16.1`:

  @Override
  public FSDataInputStream open(final Path f, final int bufferSize
      ) throws IOException {
    statistics.incrementReadOps(1);
    return new FSDataInputStream(new WebHdfsInputStream(f, bufferSize));
  }

And I find the first occurrence for the WebHdfsInputSteam.open() method occurs in Apache hadoop apache/hadoop@eda4dbb
It seems that they are already different from scratch;
Maybe I should communicate with Cloudera ;
Thanks again;

@Apache-HBase
Copy link

🎊 +1 overall

Vote Subsystem Runtime Comment
0 reexec 56 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 1 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 413 master passed
+1 compile 72 master passed
+1 checkstyle 103 master passed
+1 shadedjars 349 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 46 master passed
0 spotbugs 279 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 276 master passed
_ Patch Compile Tests _
+1 mvninstall 305 the patch passed
+1 compile 58 the patch passed
+1 javac 58 the patch passed
+1 checkstyle 78 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 285 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 1005 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 38 the patch passed
+1 findbugs 256 the patch passed
_ Other Tests _
+1 unit 9539 hbase-server in the patch passed.
+1 asflicense 33 The patch does not generate ASF License warnings.
13302
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/34/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 3558ac521f02 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 83e7794
Default Java 1.8.0_181
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/34/testReport/
Max. process+thread count 4477 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/34/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

🎊 +1 overall

Vote Subsystem Runtime Comment
0 reexec 36 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 323 master passed
+1 compile 54 master passed
+1 checkstyle 77 master passed
+1 shadedjars 269 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 38 master passed
0 spotbugs 238 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 236 master passed
_ Patch Compile Tests _
+1 mvninstall 294 the patch passed
+1 compile 53 the patch passed
+1 javac 53 the patch passed
+1 checkstyle 77 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 270 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 931 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 35 the patch passed
+1 findbugs 247 the patch passed
_ Other Tests _
+1 unit 9350 hbase-server in the patch passed.
+1 asflicense 28 The patch does not generate ASF License warnings.
12688
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/35/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 6c03171ad208 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 090c55f
Default Java 1.8.0_181
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/35/testReport/
Max. process+thread count 5015 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/35/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 73 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 343 master passed
+1 compile 61 master passed
+1 checkstyle 81 master passed
+1 shadedjars 286 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 40 master passed
0 spotbugs 268 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 264 master passed
_ Patch Compile Tests _
+1 mvninstall 314 the patch passed
+1 compile 61 the patch passed
+1 javac 61 the patch passed
+1 checkstyle 82 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 289 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 976 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 39 the patch passed
+1 findbugs 275 the patch passed
_ Other Tests _
-1 unit 16008 hbase-server in the patch failed.
+1 asflicense 29 The patch does not generate ASF License warnings.
19608
Reason Tests
Failed junit tests hadoop.hbase.master.TestSplitWALManager
hadoop.hbase.client.TestAsyncRegionAdminApi
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/36/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 2cdee7bb8752 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 090c55f
Default Java 1.8.0_181
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/36/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/36/testReport/
Max. process+thread count 4842 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/36/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

🎊 +1 overall

Vote Subsystem Runtime Comment
0 reexec 39 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 331 master passed
+1 compile 59 master passed
+1 checkstyle 80 master passed
+1 shadedjars 282 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 39 master passed
0 spotbugs 243 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 241 master passed
_ Patch Compile Tests _
+1 mvninstall 325 the patch passed
+1 compile 59 the patch passed
+1 javac 59 the patch passed
+1 checkstyle 77 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 298 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 971 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 34 the patch passed
+1 findbugs 263 the patch passed
_ Other Tests _
+1 unit 9364 hbase-server in the patch passed.
+1 asflicense 35 The patch does not generate ASF License warnings.
12895
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/37/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux e617a5f18a53 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / ee5cf0d
Default Java 1.8.0_181
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/37/testReport/
Max. process+thread count 4822 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/37/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

🎊 +1 overall

Vote Subsystem Runtime Comment
0 reexec 41 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 399 master passed
+1 compile 58 master passed
+1 checkstyle 81 master passed
+1 shadedjars 288 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 40 master passed
0 spotbugs 256 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 254 master passed
_ Patch Compile Tests _
+1 mvninstall 382 the patch passed
+1 compile 65 the patch passed
+1 javac 65 the patch passed
+1 checkstyle 89 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 349 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 1188 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 41 the patch passed
+1 findbugs 300 the patch passed
_ Other Tests _
+1 unit 9800 hbase-server in the patch passed.
+1 asflicense 34 The patch does not generate ASF License warnings.
13878
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/38/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux e2118191fd6a 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / b642ee0
Default Java 1.8.0_181
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/38/testReport/
Max. process+thread count 4412 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/38/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

🎊 +1 overall

Vote Subsystem Runtime Comment
0 reexec 36 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 330 master passed
+1 compile 56 master passed
+1 checkstyle 79 master passed
+1 shadedjars 277 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 38 master passed
0 spotbugs 234 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 232 master passed
_ Patch Compile Tests _
+1 mvninstall 295 the patch passed
+1 compile 56 the patch passed
+1 javac 56 the patch passed
+1 checkstyle 75 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 273 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 970 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 36 the patch passed
+1 findbugs 261 the patch passed
_ Other Tests _
+1 unit 10158 hbase-server in the patch passed.
+1 asflicense 31 The patch does not generate ASF License warnings.
13584
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/39/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 26ea8def96e6 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 97fbaa6
Default Java 1.8.0_181
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/39/testReport/
Max. process+thread count 4489 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/39/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 94 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 371 master passed
+1 compile 64 master passed
+1 checkstyle 100 master passed
+1 shadedjars 307 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 39 master passed
0 spotbugs 285 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 282 master passed
_ Patch Compile Tests _
+1 mvninstall 349 the patch passed
+1 compile 67 the patch passed
+1 javac 67 the patch passed
+1 checkstyle 90 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 306 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 1053 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 39 the patch passed
+1 findbugs 283 the patch passed
_ Other Tests _
-1 unit 16467 hbase-server in the patch failed.
+1 asflicense 61 The patch does not generate ASF License warnings.
20396
Reason Tests
Failed junit tests hadoop.hbase.client.TestSnapshotTemporaryDirectory
hadoop.hbase.client.TestSnapshotTemporaryDirectoryWithRegionReplicas
hadoop.hbase.client.TestFromClientSideWithCoprocessor
hadoop.hbase.master.TestSplitWALManager
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/40/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux fa6143fc712a 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / a5ef6b2
Default Java 1.8.0_181
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/40/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/40/testReport/
Max. process+thread count 4937 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/40/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

🎊 +1 overall

Vote Subsystem Runtime Comment
0 reexec 115 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 327 master passed
+1 compile 55 master passed
+1 checkstyle 79 master passed
+1 shadedjars 273 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 37 master passed
0 spotbugs 208 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 205 master passed
_ Patch Compile Tests _
+1 mvninstall 299 the patch passed
+1 compile 55 the patch passed
+1 javac 55 the patch passed
+1 checkstyle 76 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 273 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 937 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 35 the patch passed
+1 findbugs 245 the patch passed
_ Other Tests _
+1 unit 9524 hbase-server in the patch passed.
+1 asflicense 36 The patch does not generate ASF License warnings.
12941
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/41/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux ec56fb5dcf38 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / a5ef6b2
Default Java 1.8.0_181
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/41/testReport/
Max. process+thread count 4961 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/41/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 40 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
-0 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 mvninstall 326 master passed
+1 compile 56 master passed
+1 checkstyle 75 master passed
+1 shadedjars 283 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 39 master passed
0 spotbugs 262 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 260 master passed
_ Patch Compile Tests _
+1 mvninstall 313 the patch passed
+1 compile 58 the patch passed
+1 javac 58 the patch passed
+1 checkstyle 82 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 294 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 970 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 42 the patch passed
+1 findbugs 306 the patch passed
_ Other Tests _
-1 unit 10459 hbase-server in the patch failed.
+1 asflicense 32 The patch does not generate ASF License warnings.
14071
Reason Tests
Failed junit tests hadoop.hbase.regionserver.TestHRegionWithInMemoryFlush
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/42/artifact/out/Dockerfile
GITHUB PR #509
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux d6b55f893f6d 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-509/out/precommit/personality/provided.sh
git revision master / 8e8bd8b
Default Java 1.8.0_181
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/42/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/42/testReport/
Max. process+thread count 4629 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-509/42/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@saintstack
Copy link
Contributor

Ok. Really good back and forth here. Good info in the above dialog. Seems like a CDH5 issue. Closing. Shout if I have it wrong.

@saintstack saintstack closed this Sep 14, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants