[SPARK-6841] [SPARKR] add support for mean, median, stdev etc.

[hqzizania]

Moving here from amplab-extras/SparkR-pkg#241
sum() has been implemented. (amplab-extras/SparkR-pkg#242)

Now Phase 1: mean, sd, var have been implemented, but some things still need to be improved with the suggestions in https://issues.apache.org/jira/browse/SPARK-6841

[shivaram]

Jenkins, ok to test

[SparkQA]

Test build #30007 has finished for PR 5446 at commit f1a1455.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.
• This patch does not change any dependencies.

[hqzizania]

This update implements the describe() as DataFrame API as comments suggested (https://issues.apache.org/jira/browse/SPARK-6841?jql=text%20~%20%22sparkr%22). We could add this to the RDD API in the future if we find a need. Thus, some functions also don't need to be implemented like "histogram", "sampleStdev", "sampleVariance" now, since these still don't exist in DataFrame API of spark.

[shivaram]

Thanks @hqzizania -- Could you add a unit test for this ?

cc @rxin

[shivaram]

Jenkins, ok to test

[SparkQA]

Test build #31906 has finished for PR 5446 at commit 7e73d89.

• This patch fails to build.
• This patch merges cleanly.
• This patch adds no public classes.

[shivaram]

@shaneknapp this seems to have hit the same error from maven

[shivaram]

@hqzizania we'll also need to bring this up to date with the latest master

[shaneknapp]

yep. i'll take worker 03 offline until i can get a chance to investigate
(i'm OOO this afternoon).

Thanks for the catch!

@shaneknapp https://github.com/shaneknapp this seems to have hit the same
error from maven

—
Reply to this email directly or view it on GitHub
#5446 (comment).

[shivaram]

Jenkins, ok to test

[shivaram]

Jenkins, add to whitelist

[SparkQA]

Test build #31933 has finished for PR 5446 at commit f283572.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[rxin]

Thanks. merging in master.