Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP][test-hadoop3.2] Test Hadoop 3.2 on jenkins #24044

Closed
wants to merge 56 commits into from
Closed

[WIP][test-hadoop3.2] Test Hadoop 3.2 on jenkins #24044

wants to merge 56 commits into from

Conversation

wangyum
Copy link
Member

@wangyum wangyum commented Mar 10, 2019 •
edited
Loading

What changes were proposed in this pull request?

  • Test upgrade built-in Hive to 2.3.4
  • Test new hive-thriftserver(named hive-thriftserver2). Adapted it from hive-thriftserver

How was this patch tested?

manual tests:

export HADOOP_PROFILE=hadoop3.2
./dev/run-tests

wangyum added 12 commits February 14, 2019 18:14
@SparkQA
Copy link

SparkQA commented Mar 10, 2019

Test build #103279 has finished for PR 24044 at commit 71421d6.

  • This patch fails to build.
  • This patch merges cleanly.
  • This patch adds no public classes.

@wangyum wangyum changed the title [WIP][TEST-HADOOP3.1] Test Hadoop 3.1 on jenkins [WIP][test-hadoop3.1] Test Hadoop 3.1 on jenkins Mar 10, 2019
@wangyum
Copy link
Member Author

wangyum commented Mar 10, 2019

retest this please

@HyukjinKwon
Copy link
Member

@wangyum, does this PR target to test it against hadoop 3 profile or add a new thrift server? Let's make it separate if possible.

@HyukjinKwon
Copy link
Member

Because hadoop3 profile test needs a separate work for Jenkins setup. We better need to do that first IIRC.

@wangyum
Copy link
Member Author

wangyum commented Mar 10, 2019

@HyukjinKwon Only test new built-in Hive and new thrift server.

@SparkQA
Copy link

SparkQA commented Mar 10, 2019

Test build #103280 has finished for PR 24044 at commit 71421d6.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@HyukjinKwon
Copy link
Member

retest this please

@SparkQA
Copy link

SparkQA commented Mar 11, 2019

Test build #103292 has finished for PR 24044 at commit 71421d6.

  • This patch fails Java style tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@wangyum
Copy link
Member Author

wangyum commented Mar 11, 2019

retest this please

@SparkQA
Copy link

SparkQA commented Mar 11, 2019

Test build #103295 has finished for PR 24044 at commit 71421d6.

  • This patch fails Java style tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Mar 11, 2019

Test build #103328 has finished for PR 24044 at commit 19d52e7.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

HyukjinKwon
HyukjinKwon reviewed Mar 12, 2019
View reviewed changes
dev/sbt-checkstyle Outdated Show resolved Hide resolved
@wangyum
Error testing can be passed on my machine.
3b2e454 
Exclusion commons-httpclient:commons-httpclient:
org.apache.spark.sql.hive.HiveExternalCatalogVersionsSuite.backward compatibility
org.apache.spark.sql.hive.HiveSparkSubmitSuite.SPARK-9757 Persist Parquet relation with decimal column
org.apache.spark.sql.hive.HiveSparkSubmitSuite.ConnectionURL

ignore these test and print locale and environment(maybe HADOOP-12258):
org.apache.spark.sql.hive.execution.HiveCatalogedDDLSuite.basic DDL using locale tr - caseSensitive true
org.apache.spark.sql.hive.execution.HiveDDLSuite.create Hive-serde table and view with unicode columns and comment
@SparkQA
Copy link

SparkQA commented Mar 12, 2019

Test build #103355 has finished for PR 24044 at commit 3b2e454.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Mar 13, 2019

Test build #103393 has finished for PR 24044 at commit 4c1ec25.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Apr 27, 2019

Test build #104955 has finished for PR 24044 at commit bdc1d2c.

  • This patch fails due to an unknown error code, -9.
  • This patch merges cleanly.
  • This patch adds no public classes.

@wangyum
Copy link
Member Author

wangyum commented Apr 27, 2019

retest this please

@SparkQA
Copy link

SparkQA commented Apr 27, 2019

Test build #104958 has finished for PR 24044 at commit bdc1d2c.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Apr 27, 2019

Test build #104962 has finished for PR 24044 at commit 26f7e89.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@wangyum
Copy link
Member Author

wangyum commented Apr 27, 2019

retest this please

@SparkQA
Copy link

SparkQA commented Apr 28, 2019

Test build #104968 has finished for PR 24044 at commit 26f7e89.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@wangyum wangyum changed the title [WIP][test-hadoop3.2][test-maven] Test Hadoop 3.2 on jenkins [WIP][test-hadoop2.7][test-maven] Test Hadoop 3.2 on jenkins Apr 29, 2019
@wangyum
Copy link
Member Author

wangyum commented Apr 29, 2019

retest this please

@SparkQA
Copy link

SparkQA commented Apr 29, 2019

Test build #104982 has finished for PR 24044 at commit 26f7e89.

  • This patch fails due to an unknown error code, -9.
  • This patch merges cleanly.
  • This patch adds no public classes.

@wangyum wangyum changed the title [WIP][test-hadoop2.7][test-maven] Test Hadoop 3.2 on jenkins [WIP][test-hadoop2.7] Test Hadoop 3.2 on jenkins Apr 29, 2019
@wangyum
Copy link
Member Author

wangyum commented Apr 29, 2019

retest this please

@SparkQA
Copy link

SparkQA commented Apr 29, 2019

Test build #104985 has finished for PR 24044 at commit 26f7e89.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@wangyum wangyum changed the title [WIP][test-hadoop2.7] Test Hadoop 3.2 on jenkins [WIP][test-hadoop3.2] Test Hadoop 3.2 on jenkins Apr 30, 2019
@SparkQA
Copy link

SparkQA commented Apr 30, 2019

Test build #105014 has finished for PR 24044 at commit 1158349.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented May 7, 2019

Test build #105190 has finished for PR 24044 at commit f1e550c.

  • This patch fails to build.
  • This patch merges cleanly.
  • This patch adds no public classes.

@wangyum wangyum changed the title [WIP][test-hadoop3.2] Test Hadoop 3.2 on jenkins [WIP][test-hadoop3.2][test-maven] Test Hadoop 3.2 on jenkins May 7, 2019
@wangyum
Copy link
Member Author

wangyum commented May 7, 2019

retest this please

@SparkQA
Copy link

SparkQA commented May 7, 2019

Test build #105191 has finished for PR 24044 at commit f1e550c.

  • This patch fails due to an unknown error code, -9.
  • This patch merges cleanly.
  • This patch adds no public classes.

@wangyum
Copy link
Member Author

wangyum commented May 7, 2019

retest this please

@SparkQA
Copy link

SparkQA commented May 7, 2019

Test build #105204 has finished for PR 24044 at commit f1e550c.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@wangyum wangyum changed the title [WIP][test-hadoop3.2][test-maven] Test Hadoop 3.2 on jenkins [WIP][test-hadoop3.2] Test Hadoop 3.2 on jenkins May 17, 2019
@SparkQA
Copy link

SparkQA commented May 17, 2019

Test build #105489 has finished for PR 24044 at commit c28fc2d.

  • This patch fails Spark unit tests.
  • This patch does not merge cleanly.
  • This patch adds no public classes.

@wangyum
Copy link
Member Author

wangyum commented May 17, 2019

retest this please

@SparkQA
Copy link

SparkQA commented May 17, 2019

Test build #105492 has finished for PR 24044 at commit c28fc2d.

  • This patch passes all tests.
  • This patch does not merge cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented May 17, 2019

Test build #105494 has finished for PR 24044 at commit c28fc2d.

  • This patch passes all tests.
  • This patch does not merge cleanly.
  • This patch adds no public classes.

@wangyum wangyum closed this May 23, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@srowen srowen srowen left review comments

@HyukjinKwon HyukjinKwon HyukjinKwon left review comments

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@wangyum @SparkQA @HyukjinKwon @dilipbiswal @srowen