Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pig Error: Pig 0.11.2/Hadoop 0.21.0 #40

Open
dbl001 opened this issue Aug 14, 2014 · 6 comments
Open

Pig Error: Pig 0.11.2/Hadoop 0.21.0 #40

dbl001 opened this issue Aug 14, 2014 · 6 comments

Comments

@dbl001
Copy link

dbl001 commented Aug 14, 2014

pig -l /tmp -x local -v -w sent_counts.pig
2014-08-13 22:26:16,744 [main] INFO org.apache.pig.Main - Apache Pig version 0.11.2-SNAPSHOT (rUnversioned directory) compiled Aug 13 2014, 21:53:01
2014-08-13 22:26:16,745 [main] INFO org.apache.pig.Main - Logging error messages to: /private/tmp/pig_1407990376721.log
2014-08-13 22:26:17,005 [main] INFO org.apache.hadoop.security.Groups - Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=300000
2014-08-13 22:26:17,222 [main] INFO org.apache.pig.impl.util.Utils - Default bootup file /Users/davidlaxer/.pigbootup not found
2014-08-13 22:26:17,271 [main] INFO org.apache.pig.tools.parameters.PreprocessorContext - Executing command : echo $HOME
2014-08-13 22:26:17,443 [main] WARN org.apache.hadoop.conf.Configuration - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-08-13 22:26:17,445 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: file:///
2014-08-13 22:26:17,449 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:17,450 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:17,451 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:17,452 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:17,538 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:17,539 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:17,608 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:17,608 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:17,687 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:17,696 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:17,783 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:17,788 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:18,926 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:18,930 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:18,996 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with processName=JobTracker, sessionId=
2014-08-13 22:26:19,670 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:19,671 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:19,672 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:19,767 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:19,767 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:19,768 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:19,874 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:19,874 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:19,886 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:19,980 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:19,981 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:19,987 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:20,018 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:20,018 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:20,039 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:20,145 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:20,158 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:20,159 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:20,210 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:20,210 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:20,211 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:20,322 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:20,322 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:20,323 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:20,412 [main] INFO org.apache.pig.tools.pigstats.ScriptState - Pig features used in the script: GROUP_BY,ORDER_BY,FILTER
2014-08-13 22:26:20,497 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:20,521 [main] INFO org.apache.pig.newplan.logical.rules.ColumnPruneVisitor - Columns pruned for messages: $0, $1, $2, $3, $4, $5, $8, $9, $10
2014-08-13 22:26:20,561 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:20,562 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:20,583 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:20,583 [main] WARN org.apache.hadoop.conf.Configuration - mapred.textoutputformat.separator is deprecated. Instead, use mapreduce.output.textoutputformat.separator
2014-08-13 22:26:20,803 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MRCompiler - File concatenation threshold: 100 optimistic? false
2014-08-13 22:26:20,874 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:20,875 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:20,905 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.CombinerOptimizer - Choosing to move algebraic foreach to combiner
2014-08-13 22:26:20,952 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size before optimization: 3
2014-08-13 22:26:20,952 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size after optimization: 3
2014-08-13 22:26:20,959 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-08-13 22:26:20,961 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-08-13 22:26:20,973 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:21,014 [main] WARN org.apache.pig.backend.hadoop20.PigJobControl - falling back to default JobControl (not using hadoop 0.20 ?)
java.lang.NoSuchFieldException: runnerState
at java.lang.Class.getDeclaredField(Class.java:2057)
at org.apache.pig.backend.hadoop20.PigJobControl.(PigJobControl.java:51)
at org.apache.pig.backend.hadoop.executionengine.shims.HadoopShims.newJobControl(HadoopShims.java:97)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:285)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:177)
at org.apache.pig.PigServer.launchPlan(PigServer.java:1264)
at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1249)
at org.apache.pig.PigServer.execute(PigServer.java:1239)
at org.apache.pig.PigServer.executeBatch(PigServer.java:333)
at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:137)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:198)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
at org.apache.pig.Main.run(Main.java:604)
at org.apache.pig.Main.main(Main.java:157)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.apache.hadoop.util.RunJar.main(RunJar.java:192)
2014-08-13 22:26:21,052 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:21,055 [main] INFO org.apache.pig.tools.pigstats.ScriptState - Pig script settings are added to the job
2014-08-13 22:26:21,106 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2014-08-13 22:26:21,107 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - mapred.job.reduce.markreset.buffer.percent is not set, set to default 0.3
2014-08-13 22:26:21,107 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2014-08-13 22:26:21,107 [main] WARN org.apache.hadoop.conf.Configuration - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-13 22:26:21,114 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Using reducer estimator: org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.InputSizeReducerEstimator
2014-08-13 22:26:21,116 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.InputSizeReducerEstimator - BytesPerReducer=1000000000 maxReducers=999 totalInputFileSize=23891952
2014-08-13 22:26:21,117 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Setting Parallelism to 1
2014-08-13 22:26:21,118 [main] WARN org.apache.hadoop.conf.Configuration - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2014-08-13 22:26:21,260 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Setting up single store job
2014-08-13 22:26:21,274 [main] INFO org.apache.pig.data.SchemaTupleFrontend - Key [pig.schematuple] is false, will not generate code.
2014-08-13 22:26:21,275 [main] INFO org.apache.pig.data.SchemaTupleFrontend - Starting process to move generated code to distributed cacche
2014-08-13 22:26:21,275 [main] INFO org.apache.pig.data.SchemaTupleFrontend - Distributed cache not supported or needed in local mode. Setting key [pig.schematuple.local.dir] with code temp directory: /var/folders/nj/nphdkhyj6s1dttb0pd9zb2wc0000gn/T/1407990381274-0
2014-08-13 22:26:21,488 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:21,491 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2998: Unhandled internal error. org.apache.hadoop.mapred.jobcontrol.JobControl.addJob(Lorg/apache/hadoop/mapred/jobcontrol/Job;)Ljava/lang/String;
2014-08-13 22:26:21,492 [main] ERROR org.apache.pig.tools.grunt.Grunt - java.lang.NoSuchMethodError: org.apache.hadoop.mapred.jobcontrol.JobControl.addJob(Lorg/apache/hadoop/mapred/jobcontrol/Job;)Ljava/lang/String;
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:296)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:177)
at org.apache.pig.PigServer.launchPlan(PigServer.java:1264)
at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1249)
at org.apache.pig.PigServer.execute(PigServer.java:1239)
at org.apache.pig.PigServer.executeBatch(PigServer.java:333)
at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:137)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:198)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
at org.apache.pig.Main.run(Main.java:604)
at org.apache.pig.Main.main(Main.java:157)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.apache.hadoop.util.RunJar.main(RunJar.java:192)

Details also at logfile: /private/tmp/pig_1407990376721.log
David-Laxers-MacBook-Pro:pig davidlaxer$

sudo ant clean jar-withouthadoop
Buildfile: /Users/davidlaxer/pig-0.11.1-src/build.xml

clean:
[delete] Deleting directory /Users/davidlaxer/pig-0.11.1-src/build

clean:

clean:

ivy-download:
[get] Getting: http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.2.0/ivy-2.2.0.jar
[get] To: /Users/davidlaxer/pig-0.11.1-src/ivy/ivy-2.2.0.jar
[get] Not modified - so not downloaded

ivy-init-dirs:
[mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/build/ivy
[mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/build/ivy/lib
[mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/build/ivy/report
[mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/build/ivy/maven

ivy-probe-antlib:

ivy-init-antlib:

ivy-init:
[ivy:configure] :: Ivy 2.2.0 - 20100923230623 :: http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = /Users/davidlaxer/pig-0.11.1-src/ivy/ivysettings.xml

ivy-resolve:
[ivy:resolve] :: resolving dependencies :: org.apache.pig#pig;0.11.2-SNAPSHOT
[ivy:resolve] confs: [master, default, runtime, compile, test, javadoc, releaseaudit, jdiff, checkstyle, buildJar, hadoop20, hadoop23]
[ivy:resolve] found com.sun.jersey#jersey-core;1.8 in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-core;1.0.0 in maven2
[ivy:resolve] found commons-cli#commons-cli;1.2 in maven2
[ivy:resolve] found xmlenc#xmlenc;0.52 in maven2
[ivy:resolve] found commons-httpclient#commons-httpclient;3.0.1 in maven2
[ivy:resolve] found commons-codec#commons-codec;1.4 in maven2
[ivy:resolve] found org.apache.commons#commons-math;2.1 in maven2
[ivy:resolve] found commons-configuration#commons-configuration;1.6 in maven2
[ivy:resolve] found commons-collections#commons-collections;3.2.1 in maven2
[ivy:resolve] found commons-lang#commons-lang;2.4 in maven2
[ivy:resolve] found commons-logging#commons-logging;1.1.1 in maven2
[ivy:resolve] found commons-digester#commons-digester;1.8 in maven2
[ivy:resolve] found commons-beanutils#commons-beanutils;1.7.0 in maven2
[ivy:resolve] found commons-beanutils#commons-beanutils-core;1.8.0 in maven2
[ivy:resolve] found commons-net#commons-net;1.4.1 in maven2
[ivy:resolve] found oro#oro;2.0.8 in maven2
[ivy:resolve] found org.mortbay.jetty#jetty;6.1.26 in maven2
[ivy:resolve] found org.mortbay.jetty#jetty-util;6.1.26 in maven2
[ivy:resolve] found org.mortbay.jetty#servlet-api;2.5-20081211 in maven2
[ivy:resolve] found tomcat#jasper-runtime;5.5.12 in maven2
[ivy:resolve] found tomcat#jasper-compiler;5.5.12 in maven2
[ivy:resolve] found org.mortbay.jetty#jsp-api-2.1;6.1.14 in maven2
[ivy:resolve] found org.mortbay.jetty#servlet-api-2.5;6.1.14 in maven2
[ivy:resolve] found org.mortbay.jetty#jsp-2.1;6.1.14 in maven2
[ivy:resolve] found org.eclipse.jdt#core;3.1.1 in maven2
[ivy:resolve] found ant#ant;1.6.5 in maven2
[ivy:resolve] found commons-el#commons-el;1.0 in maven2
[ivy:resolve] found net.java.dev.jets3t#jets3t;0.7.1 in maven2
[ivy:resolve] found net.sf.kosmosfs#kfs;0.3 in maven2
[ivy:resolve] found hsqldb#hsqldb;1.8.0.10 in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-test;1.0.0 in maven2
[ivy:resolve] found org.apache.ftpserver#ftplet-api;1.0.0 in maven2
[ivy:resolve] found org.apache.mina#mina-core;2.0.0-M5 in maven2
[ivy:resolve] found org.slf4j#slf4j-api;1.5.2 in maven2
[ivy:resolve] found org.apache.ftpserver#ftpserver-core;1.0.0 in maven2
[ivy:resolve] found org.apache.ftpserver#ftpserver-deprecated;1.0.0-M2 in maven2
[ivy:resolve] found commons-io#commons-io;2.3 in maven2
[ivy:resolve] found org.apache.httpcomponents#httpclient;4.1 in maven2
[ivy:resolve] found org.apache.httpcomponents#httpcore;4.1 in maven2
[ivy:resolve] found log4j#log4j;1.2.16 in maven2
[ivy:resolve] found org.slf4j#slf4j-log4j12;1.6.1 in maven2
[ivy:resolve] found org.apache.avro#avro;1.5.3 in maven2
[ivy:resolve] found com.thoughtworks.paranamer#paranamer;2.3 in maven2
[ivy:resolve] found org.xerial.snappy#snappy-java;1.0.3.2 in maven2
[ivy:resolve] found org.slf4j#slf4j-api;1.6.1 in maven2
[ivy:resolve] found com.googlecode.json-simple#json-simple;1.1 in maven2
[ivy:resolve] found com.jcraft#jsch;0.1.38 in maven2
[ivy:resolve] found jline#jline;0.9.94 in maven2
[ivy:resolve] found net.java.dev.javacc#javacc;4.2 in maven2
[ivy:resolve] found org.codehaus.groovy#groovy-all;1.8.6 in maven2
[ivy:resolve] found org.codehaus.jackson#jackson-mapper-asl;1.8.8 in maven2
[ivy:resolve] found org.codehaus.jackson#jackson-core-asl;1.8.8 in maven2
[ivy:resolve] found org.fusesource.jansi#jansi;1.9 in maven2
[ivy:resolve] found joda-time#joda-time;1.6 in maven2
[ivy:resolve] found com.google.guava#guava;11.0 in maven2
[ivy:resolve] found org.python#jython-standalone;2.5.3 in maven2
[ivy:resolve] found rhino#js;1.7R2 in maven2
[ivy:resolve] found org.antlr#antlr;3.4 in maven2
[ivy:resolve] found org.antlr#antlr-runtime;3.4 in maven2
[ivy:resolve] found org.antlr#stringtemplate;3.2.1 in maven2
[ivy:resolve] found antlr#antlr;2.7.7 in maven2
[ivy:resolve] found org.antlr#ST4;4.0.4 in maven2
[ivy:resolve] found org.apache.zookeeper#zookeeper;3.3.3 in maven2
[ivy:resolve] found dk.brics.automaton#automaton;1.11-8 in maven2
[ivy:resolve] found org.jruby#jruby-complete;1.6.7 in maven2
[ivy:resolve] found org.apache.hbase#hbase;0.90.0 in maven2
[ivy:resolve] found org.vafer#jdeb;0.8 in maven2
[ivy:resolve] found org.mockito#mockito-all;1.8.4 in maven2
[ivy:resolve] found xalan#xalan;2.7.1 in maven2
[ivy:resolve] found xalan#serializer;2.7.1 in maven2
[ivy:resolve] found xml-apis#xml-apis;1.3.04 in maven2
[ivy:resolve] found xerces#xercesImpl;2.10.0 in maven2
[ivy:resolve] found xml-apis#xml-apis;1.4.01 in maven2
[ivy:resolve] found junit#junit;4.11 in maven2
[ivy:resolve] found org.hamcrest#hamcrest-core;1.3 in maven2
[ivy:resolve] found org.jboss.netty#netty;3.2.2.Final in maven2
[ivy:resolve] found org.apache.hive#hive-exec;0.8.0 in maven2
[ivy:resolve] found junit#junit;3.8.1 in maven2
[ivy:resolve] found com.google.code.p.arat#rat-lib;0.5.1 in maven2
[ivy:resolve] found commons-collections#commons-collections;3.2 in maven2
[ivy:resolve] found commons-lang#commons-lang;2.1 in maven2
[ivy:resolve] found jdiff#jdiff;1.0.9 in maven2
[ivy:resolve] found checkstyle#checkstyle;4.2 in maven2
[ivy:resolve] found commons-beanutils#commons-beanutils-core;1.7.0 in maven2
[ivy:resolve] found commons-cli#commons-cli;1.0 in maven2
[ivy:resolve] found commons-logging#commons-logging;1.0.3 in maven2
[ivy:resolve] found org.codehaus.jackson#jackson-mapper-asl;1.0.1 in maven2
[ivy:resolve] found org.codehaus.jackson#jackson-core-asl;1.0.1 in maven2
[ivy:resolve] found com.sun.jersey#jersey-bundle;1.8 in maven2
[ivy:resolve] found com.sun.jersey#jersey-server;1.8 in maven2
[ivy:resolve] found com.sun.jersey.contribs#jersey-guice;1.8 in maven2
[ivy:resolve] found commons-httpclient#commons-httpclient;3.1 in maven2
[ivy:resolve] found javax.servlet#servlet-api;2.5 in maven2
[ivy:resolve] found javax.ws.rs#jsr311-api;1.1.1 in maven2
[ivy:resolve] found com.google.protobuf#protobuf-java;2.4.0a in maven2
[ivy:resolve] found javax.inject#javax.inject;1 in maven2
[ivy:resolve] found javax.xml.bind#jaxb-api;2.2.2 in maven2
[ivy:resolve] found com.sun.xml.bind#jaxb-impl;2.2.3-1 in maven2
[ivy:resolve] found com.google.inject#guice;3.0 in maven2
[ivy:resolve] found com.google.inject.extensions#guice-servlet;3.0 in maven2
[ivy:resolve] found aopalliance#aopalliance;1.0 in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-annotations;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-auth;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-common;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-hdfs;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-core;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-jobclient;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-tests;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-app;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-shuffle;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-common;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-api;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-common;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-server;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-web-proxy;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-common;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-nodemanager;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-resourcemanager;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-hs;2.0.0-alpha in maven2
[ivy:resolve] :: resolution report :: resolve 6281ms :: artifacts dl 178ms
[ivy:resolve] :: evicted modules:
[ivy:resolve] junit#junit;3.8.1 by [junit#junit;4.11] in [javadoc, default, test, buildJar, runtime]
[ivy:resolve] commons-logging#commons-logging;1.0.3 by [commons-logging#commons-logging;1.1.1] in [javadoc, default, compile, test, buildJar, hadoop20, runtime]
[ivy:resolve] commons-codec#commons-codec;1.2 by [commons-codec#commons-codec;1.4] in [javadoc, default, compile, test, buildJar, hadoop20, runtime]
[ivy:resolve] commons-logging#commons-logging;1.1 by [commons-logging#commons-logging;1.1.1] in [javadoc, default, compile, test, buildJar, hadoop20, runtime]
[ivy:resolve] commons-codec#commons-codec;1.3 by [commons-codec#commons-codec;1.4] in [javadoc, default, compile, test, buildJar, hadoop20, runtime]
[ivy:resolve] commons-httpclient#commons-httpclient;3.1 by [commons-httpclient#commons-httpclient;3.0.1] in [javadoc, default, compile, test, buildJar, hadoop20, runtime]
[ivy:resolve] org.codehaus.jackson#jackson-mapper-asl;1.0.1 by [org.codehaus.jackson#jackson-mapper-asl;1.8.8] in [javadoc, default, compile, test, buildJar, runtime]
[ivy:resolve] org.slf4j#slf4j-api;1.5.2 by [org.slf4j#slf4j-api;1.6.1] in [javadoc, default, compile, test, buildJar, runtime]
[ivy:resolve] org.apache.mina#mina-core;2.0.0-M4 by [org.apache.mina#mina-core;2.0.0-M5] in [javadoc, default, compile, test, buildJar, hadoop20, runtime]
[ivy:resolve] org.apache.ftpserver#ftplet-api;1.0.0-M2 by [org.apache.ftpserver#ftplet-api;1.0.0] in [javadoc, default, compile, test, buildJar, hadoop20, runtime]
[ivy:resolve] org.apache.ftpserver#ftpserver-core;1.0.0-M2 by [org.apache.ftpserver#ftpserver-core;1.0.0] in [javadoc, default, compile, test, buildJar, hadoop20, runtime]
[ivy:resolve] org.apache.mina#mina-core;2.0.0-M2 by [org.apache.mina#mina-core;2.0.0-M5] in [javadoc, default, compile, test, buildJar, hadoop20, runtime]
[ivy:resolve] commons-cli#commons-cli;1.0 by [commons-cli#commons-cli;1.2] in [javadoc, default, compile, test, buildJar, runtime]
[ivy:resolve] org.codehaus.jackson#jackson-mapper-asl;1.7.3 by [org.codehaus.jackson#jackson-mapper-asl;1.8.8] in [javadoc, default, compile, test, buildJar, runtime]
[ivy:resolve] org.antlr#antlr-runtime;3.3 by [org.antlr#antlr-runtime;3.4] in [javadoc, default, compile, test, buildJar, runtime]
[ivy:resolve] xml-apis#xml-apis;1.3.04 by [xml-apis#xml-apis;1.4.01] in [javadoc, default, test, buildJar, runtime]
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| master | 0 | 0 | 0 | 0 || 0 | 0 |
| default | 91 | 0 | 0 | 16 || 76 | 0 |
| runtime | 91 | 0 | 0 | 16 || 76 | 0 |
| compile | 82 | 0 | 0 | 14 || 69 | 0 |
| test | 91 | 0 | 0 | 16 || 76 | 0 |
| javadoc | 91 | 0 | 0 | 16 || 76 | 0 |
| releaseaudit | 3 | 0 | 0 | 0 || 3 | 0 |
| jdiff | 3 | 0 | 0 | 0 || 3 | 0 |
| checkstyle | 6 | 0 | 0 | 0 || 6 | 0 |
| buildJar | 91 | 0 | 0 | 16 || 76 | 0 |
| hadoop20 | 48 | 0 | 0 | 9 || 39 | 0 |
| hadoop23 | 39 | 0 | 0 | 0 || 41 | 0 |
---------------------------------------------------------------------

ivy-compile:
[ivy:retrieve] :: retrieving :: org.apache.pig#pig
[ivy:retrieve] confs: [compile]
[ivy:retrieve] 69 artifacts copied, 0 already retrieved (66821kB/2244ms)
[ivy:cachepath] DEPRECATED: 'ivy.conf.file' is deprecated, use 'ivy.settings.file' instead
[ivy:cachepath] :: loading settings :: file = /Users/davidlaxer/pig-0.11.1-src/ivy/ivysettings.xml

init:
[mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/src-gen/org/apache/pig/impl/logicalLayer/parser
[mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/src-gen/org/apache/pig/tools/pigscript/parser
[mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/src-gen/org/apache/pig/tools/parameters
[mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/build/classes
[mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/build/test/classes
[mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/test/org/apache/pig/test/utils/dotGraph/parser
[mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/src-gen/org/apache/pig/data/parser
[move] Moving 1 file to /Users/davidlaxer/pig-0.11.1-src/build/ivy/lib/Pig

cc-compile:
[javacc] Java Compiler Compiler Version 4.2 (Parser Generator)
[javacc](type "javacc" with no arguments for help)
[javacc] Reading from file /Users/davidlaxer/pig-0.11.1-src/src/org/apache/pig/tools/pigscript/parser/PigScriptParser.jj . . .
[javacc] File "TokenMgrError.java" does not exist. Will create one.
[javacc] File "ParseException.java" does not exist. Will create one.
[javacc] File "Token.java" does not exist. Will create one.
[javacc] File "JavaCharStream.java" does not exist. Will create one.
[javacc] Parser generated successfully.
[javacc] Java Compiler Compiler Version 4.2 (Parser Generator)
[javacc](type "javacc" with no arguments for help)
[javacc] Reading from file /Users/davidlaxer/pig-0.11.1-src/src/org/apache/pig/tools/parameters/PigFileParser.jj . . .
[javacc] Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking.
[javacc] File "TokenMgrError.java" does not exist. Will create one.
[javacc] File "ParseException.java" does not exist. Will create one.
[javacc] File "Token.java" does not exist. Will create one.
[javacc] File "JavaCharStream.java" does not exist. Will create one.
[javacc] Parser generated with 0 errors and 1 warnings.
[javacc] Java Compiler Compiler Version 4.2 (Parser Generator)
[javacc](type "javacc" with no arguments for help)
[javacc] Reading from file /Users/davidlaxer/pig-0.11.1-src/src/org/apache/pig/tools/parameters/ParamLoader.jj . . .
[javacc] File "TokenMgrError.java" is being rebuilt.
[javacc] File "ParseException.java" is being rebuilt.
[javacc] File "Token.java" is being rebuilt.
[javacc] File "JavaCharStream.java" is being rebuilt.
[javacc] Parser generated successfully.
[jjtree] Java Compiler Compiler Version 4.2 (Tree Builder)
[jjtree](type "jjtree" with no arguments for help)
[jjtree] Reading from file /Users/davidlaxer/pig-0.11.1-src/test/org/apache/pig/test/utils/dotGraph/DOTParser.jjt . . .
[jjtree] File "Node.java" does not exist. Will create one.
[jjtree] File "SimpleNode.java" does not exist. Will create one.
[jjtree] File "DOTParserTreeConstants.java" does not exist. Will create one.
[jjtree] File "JJTDOTParserState.java" does not exist. Will create one.
[jjtree] Annotated grammar generated successfully in /Users/davidlaxer/pig-0.11.1-src/test/org/apache/pig/test/utils/dotGraph/parser/DOTParser.jj
[javacc] Java Compiler Compiler Version 4.2 (Parser Generator)
[javacc](type "javacc" with no arguments for help)
[javacc] Reading from file /Users/davidlaxer/pig-0.11.1-src/test/org/apache/pig/test/utils/dotGraph/parser/DOTParser.jj . . .
[javacc] File "TokenMgrError.java" does not exist. Will create one.
[javacc] File "ParseException.java" does not exist. Will create one.
[javacc] File "Token.java" does not exist. Will create one.
[javacc] File "SimpleCharStream.java" does not exist. Will create one.
[javacc] Parser generated successfully.

prepare:
[mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/src-gen/org/apache/pig/parser

genLexer:

genParser:

genTreeParser:

gen:

compile:
[echo] *** Building Main Sources ***
[echo] *** To compile with all warnings enabled, supply -Dall.warnings=1 on command line ***
[echo] *** If all.warnings property is supplied, compile-sources-all-warnings target will be executed ***
[echo] *** Else, compile-sources (which only warns about deprecations) target will be executed ***

compile-sources:
[javac] /Users/davidlaxer/pig-0.11.1-src/build.xml:531: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds
[javac] Compiling 787 source files to /Users/davidlaxer/pig-0.11.1-src/build/classes
[javac] warning: [options] bootstrap class path not set in conjunction with -source 1.5
[javac] warning: [options] source value 1.5 is obsolete and will be removed in a future release
[javac] warning: [options] target value 1.5 is obsolete and will be removed in a future release
[javac] warning: [options] To suppress warnings about obsolete options, use -Xlint:-options.
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.
[javac] 4 warnings
[copy] Copying 1 file to /Users/davidlaxer/pig-0.11.1-src/build/classes/org/apache/pig/tools/grunt
[copy] Copying 1 file to /Users/davidlaxer/pig-0.11.1-src/build/classes/org/apache/pig/tools/grunt

compile-sources-all-warnings:

jar-withouthadoop:

jar-withouthadoopWithSvn:

ivy-download:
[get] Getting: http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.2.0/ivy-2.2.0.jar
[get] To: /Users/davidlaxer/pig-0.11.1-src/ivy/ivy-2.2.0.jar
[get] Not modified - so not downloaded

ivy-init-dirs:

ivy-probe-antlib:

ivy-init-antlib:

ivy-init:

ivy-resolve:

ivy-buildJar:
[ivy:retrieve] :: retrieving :: org.apache.pig#pig
[ivy:retrieve] confs: [buildJar]
[ivy:retrieve] 9 artifacts copied, 67 already retrieved (9631kB/208ms)

buildJar-withouthadoop:
[echo] svnString Unversioned directory
[jar] Building jar: /Users/davidlaxer/pig-0.11.1-src/build/pig-0.11.2-SNAPSHOT.jar
[jar] Building jar: /Users/davidlaxer/pig-0.11.1-src/build/pig-0.11.2-SNAPSHOT-withouthadoop.jar
[copy] Copying 1 file to /Users/davidlaxer/pig-0.11.1-src

jar-withouthadoopWithOutSvn:

BUILD SUCCESSFUL
Total time: 1 minute 55 seconds
David-Laxers-MacBook-Pro:pig-0.11.1-src davidlaxer$ ant test
Buildfile: /Users/davidlaxer/pig-0.11.1-src/build.xml

test:

ivy-download:
[get] Getting: http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.2.0/ivy-2.2.0.jar
[get] To: /Users/davidlaxer/pig-0.11.1-src/ivy/ivy-2.2.0.jar
[get] Not modified - so not downloaded

ivy-init-dirs:

ivy-probe-antlib:

ivy-init-antlib:

ivy-init:
[ivy:configure] :: Ivy 2.2.0 - 20100923230623 :: http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = /Users/davidlaxer/pig-0.11.1-src/ivy/ivysettings.xml

ivy-resolve:
[ivy:resolve] :: resolving dependencies :: org.apache.pig#pig;0.11.2-SNAPSHOT
[ivy:resolve] confs: [master, default, runtime, compile, test, javadoc, releaseaudit, jdiff, checkstyle, buildJar, hadoop20, hadoop23]
[ivy:resolve] found com.sun.jersey#jersey-core;1.8 in default
[ivy:resolve] found org.apache.hadoop#hadoop-core;1.0.0 in maven2
[ivy:resolve] found commons-cli#commons-cli;1.2 in fs
[ivy:resolve] found xmlenc#xmlenc;0.52 in default
[ivy:resolve] found commons-httpclient#commons-httpclient;3.0.1 in maven2
[ivy:resolve] found commons-codec#commons-codec;1.4 in fs
[ivy:resolve] found org.apache.commons#commons-math;2.1 in default
[ivy:resolve] found commons-configuration#commons-configuration;1.6 in default
[ivy:resolve] found commons-collections#commons-collections;3.2.1 in fs
[ivy:resolve] found commons-lang#commons-lang;2.4 in fs
[ivy:resolve] found commons-logging#commons-logging;1.1.1 in fs
[ivy:resolve] found commons-digester#commons-digester;1.8 in fs
[ivy:resolve] found commons-beanutils#commons-beanutils;1.7.0 in fs
[ivy:resolve] found commons-beanutils#commons-beanutils-core;1.8.0 in default
[ivy:resolve] found commons-net#commons-net;1.4.1 in maven2
[ivy:resolve] found oro#oro;2.0.8 in fs
[ivy:resolve] found org.mortbay.jetty#jetty;6.1.26 in fs
[ivy:resolve] found org.mortbay.jetty#jetty-util;6.1.26 in fs
[ivy:resolve] found tomcat#jasper-runtime;5.5.12 in maven2
[ivy:resolve] found tomcat#jasper-compiler;5.5.12 in maven2
[ivy:resolve] found org.mortbay.jetty#jsp-api-2.1;6.1.14 in default
[ivy:resolve] found org.mortbay.jetty#servlet-api-2.5;6.1.14 in default
[ivy:resolve] found org.mortbay.jetty#jsp-2.1;6.1.14 in default
[ivy:resolve] found org.eclipse.jdt#core;3.1.1 in default
[ivy:resolve] found ant#ant;1.6.5 in maven2
[ivy:resolve] found commons-el#commons-el;1.0 in default
[ivy:resolve] found net.java.dev.jets3t#jets3t;0.7.1 in default
[ivy:resolve] found net.sf.kosmosfs#kfs;0.3 in maven2
[ivy:resolve] found hsqldb#hsqldb;1.8.0.10 in default
[ivy:resolve] found org.apache.hadoop#hadoop-test;1.0.0 in maven2
[ivy:resolve] found org.apache.ftpserver#ftplet-api;1.0.0 in maven2
[ivy:resolve] found org.apache.mina#mina-core;2.0.0-M5 in fs
[ivy:resolve] found org.slf4j#slf4j-api;1.5.2 in maven2
[ivy:resolve] found org.apache.ftpserver#ftpserver-core;1.0.0 in maven2
[ivy:resolve] found org.apache.ftpserver#ftpserver-deprecated;1.0.0-M2 in maven2
[ivy:resolve] found commons-io#commons-io;2.3 in maven2
[ivy:resolve] found org.apache.httpcomponents#httpclient;4.1 in maven2
[ivy:resolve] found org.apache.httpcomponents#httpcore;4.1 in maven2
[ivy:resolve] found log4j#log4j;1.2.16 in maven2
[ivy:resolve] found org.slf4j#slf4j-log4j12;1.6.1 in maven2
[ivy:resolve] found org.apache.avro#avro;1.5.3 in maven2
[ivy:resolve] found com.thoughtworks.paranamer#paranamer;2.3 in maven2
[ivy:resolve] found org.xerial.snappy#snappy-java;1.0.3.2 in maven2
[ivy:resolve] found org.slf4j#slf4j-api;1.6.1 in maven2
[ivy:resolve] found com.googlecode.json-simple#json-simple;1.1 in default
[ivy:resolve] found com.jcraft#jsch;0.1.38 in fs
[ivy:resolve] found jline#jline;0.9.94 in fs
[ivy:resolve] found net.java.dev.javacc#javacc;4.2 in maven2
[ivy:resolve] found org.codehaus.groovy#groovy-all;1.8.6 in maven2
[ivy:resolve] found org.codehaus.jackson#jackson-mapper-asl;1.8.8 in maven2
[ivy:resolve] found org.codehaus.jackson#jackson-core-asl;1.8.8 in maven2
[ivy:resolve] found org.fusesource.jansi#jansi;1.9 in maven2
[ivy:resolve] found joda-time#joda-time;1.6 in maven2
[ivy:resolve] found com.google.guava#guava;11.0 in maven2
[ivy:resolve] found org.python#jython-standalone;2.5.3 in maven2
[ivy:resolve] found rhino#js;1.7R2 in maven2
[ivy:resolve] found org.antlr#antlr;3.4 in default
[ivy:resolve] found org.antlr#antlr-runtime;3.4 in default
[ivy:resolve] found org.antlr#stringtemplate;3.2.1 in default
[ivy:resolve] found antlr#antlr;2.7.7 in fs
[ivy:resolve] found org.antlr#ST4;4.0.4 in default
[ivy:resolve] found org.apache.zookeeper#zookeeper;3.3.3 in maven2
[ivy:resolve] found dk.brics.automaton#automaton;1.11-8 in maven2
[ivy:resolve] found org.jruby#jruby-complete;1.6.7 in maven2
[ivy:resolve] found org.apache.hbase#hbase;0.90.0 in maven2
[ivy:resolve] found org.vafer#jdeb;0.8 in maven2
[ivy:resolve] found org.mockito#mockito-all;1.8.4 in maven2
[ivy:resolve] found xalan#xalan;2.7.1 in maven2
[ivy:resolve] found xalan#serializer;2.7.1 in maven2
[ivy:resolve] found xml-apis#xml-apis;1.3.04 in fs
[ivy:resolve] found xerces#xercesImpl;2.10.0 in maven2
[ivy:resolve] found xml-apis#xml-apis;1.4.01 in maven2
[ivy:resolve] found junit#junit;4.11 in fs
[ivy:resolve] found org.hamcrest#hamcrest-core;1.3 in fs
[ivy:resolve] found org.jboss.netty#netty;3.2.2.Final in maven2
[ivy:resolve] found org.apache.hive#hive-exec;0.8.0 in maven2
[ivy:resolve] found junit#junit;3.8.1 in fs
[ivy:resolve] found com.google.code.p.arat#rat-lib;0.5.1 in maven2
[ivy:resolve] found commons-collections#commons-collections;3.2 in fs
[ivy:resolve] found commons-lang#commons-lang;2.1 in fs
[ivy:resolve] found jdiff#jdiff;1.0.9 in fs
[ivy:resolve] found checkstyle#checkstyle;4.2 in maven2
[ivy:resolve] found commons-beanutils#commons-beanutils-core;1.7.0 in maven2
[ivy:resolve] found commons-cli#commons-cli;1.0 in fs
[ivy:resolve] found commons-logging#commons-logging;1.0.3 in fs
[ivy:resolve] found org.codehaus.jackson#jackson-mapper-asl;1.0.1 in default
[ivy:resolve] found org.codehaus.jackson#jackson-core-asl;1.0.1 in default
[ivy:resolve] found com.sun.jersey#jersey-bundle;1.8 in maven2
[ivy:resolve] found com.sun.jersey#jersey-server;1.8 in default
[ivy:resolve] found com.sun.jersey.contribs#jersey-guice;1.8 in maven2
[ivy:resolve] found commons-httpclient#commons-httpclient;3.1 in fs
[ivy:resolve] found javax.servlet#servlet-api;2.5 in fs
[ivy:resolve] found javax.ws.rs#jsr311-api;1.1.1 in maven2
[ivy:resolve] found com.google.protobuf#protobuf-java;2.4.0a in default
[ivy:resolve] found javax.inject#javax.inject;1 in maven2
[ivy:resolve] found javax.xml.bind#jaxb-api;2.2.2 in maven2
[ivy:resolve] found com.sun.xml.bind#jaxb-impl;2.2.3-1 in default
[ivy:resolve] found com.google.inject#guice;3.0 in maven2
[ivy:resolve] found com.google.inject.extensions#guice-servlet;3.0 in maven2
[ivy:resolve] found aopalliance#aopalliance;1.0 in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-annotations;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-auth;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-common;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-hdfs;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-core;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-jobclient;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-tests;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-app;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-shuffle;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-common;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-api;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-common;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-server;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-web-proxy;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-common;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-nodemanager;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-resourcemanager;2.0.0-alpha in maven2
[ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-hs;2.0.0-alpha in maven2
[ivy:resolve] :: resolution report :: resolve 13603ms :: artifacts dl 5473ms
[ivy:resolve] :: evicted modules:
[ivy:resolve] junit#junit;3.8.1 by [junit#junit;4.11] in [default, test, runtime, javadoc, buildJar]
[ivy:resolve] commons-logging#commons-logging;1.0.3 by [commons-logging#commons-logging;1.1.1] in [default, hadoop20, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] commons-codec#commons-codec;1.2 by [commons-codec#commons-codec;1.4] in [default, hadoop20, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] commons-logging#commons-logging;1.1 by [commons-logging#commons-logging;1.1.1] in [default, hadoop20, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] commons-codec#commons-codec;1.3 by [commons-codec#commons-codec;1.4] in [default, hadoop20, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] commons-httpclient#commons-httpclient;3.1 by [commons-httpclient#commons-httpclient;3.0.1] in [default, hadoop20, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] org.codehaus.jackson#jackson-mapper-asl;1.0.1 by [org.codehaus.jackson#jackson-mapper-asl;1.8.8] in [default, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] org.slf4j#slf4j-api;1.5.2 by [org.slf4j#slf4j-api;1.6.1] in [default, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] org.apache.mina#mina-core;2.0.0-M4 by [org.apache.mina#mina-core;2.0.0-M5] in [default, hadoop20, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] org.apache.ftpserver#ftplet-api;1.0.0-M2 by [org.apache.ftpserver#ftplet-api;1.0.0] in [default, hadoop20, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] org.apache.ftpserver#ftpserver-core;1.0.0-M2 by [org.apache.ftpserver#ftpserver-core;1.0.0] in [default, hadoop20, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] org.apache.mina#mina-core;2.0.0-M2 by [org.apache.mina#mina-core;2.0.0-M5] in [default, hadoop20, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] commons-cli#commons-cli;1.0 by [commons-cli#commons-cli;1.2] in [default, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] org.codehaus.jackson#jackson-mapper-asl;1.7.3 by [org.codehaus.jackson#jackson-mapper-asl;1.8.8] in [default, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] org.antlr#antlr-runtime;3.3 by [org.antlr#antlr-runtime;3.4] in [default, test, compile, runtime, javadoc, buildJar]
[ivy:resolve] xml-apis#xml-apis;1.3.04 by [xml-apis#xml-apis;1.4.01] in [default, test, runtime, javadoc, buildJar]
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| master | 0 | 0 | 0 | 0 || 0 | 0 |
| default | 90 | 0 | 0 | 16 || 75 | 0 |
| runtime | 90 | 0 | 0 | 16 || 75 | 0 |
| compile | 81 | 0 | 0 | 14 || 68 | 0 |
| test | 90 | 0 | 0 | 16 || 75 | 0 |
| javadoc | 90 | 0 | 0 | 16 || 75 | 0 |
| releaseaudit | 3 | 0 | 0 | 0 || 3 | 0 |
| jdiff | 3 | 0 | 0 | 0 || 3 | 0 |
| checkstyle | 6 | 0 | 0 | 0 || 6 | 0 |
| buildJar | 90 | 0 | 0 | 16 || 75 | 0 |
| hadoop20 | 47 | 0 | 0 | 9 || 38 | 0 |
| hadoop23 | 39 | 0 | 0 | 0 || 41 | 0 |
---------------------------------------------------------------------
[ivy:resolve]
[ivy:resolve] :: problems summary ::
[ivy:resolve] :::: WARNINGS
[ivy:resolve] [FAILED ] org.mortbay.jetty#jetty;6.1.26!jetty.zip: (0ms)
[ivy:resolve] ==== local: tried
[ivy:resolve] /Users/davidlaxer/.ivy2/local/org.mortbay.jetty/jetty/6.1.26/zips/jetty.zip
[ivy:resolve] ==== maven2: tried
[ivy:resolve] http://repo2.maven.org/maven2/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.zip
[ivy:resolve] ==== jboss-maven2: tried
[ivy:resolve] http://repository.jboss.com/nexus/content/groups/public/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.zip
[ivy:resolve] ==== apache-snapshots: tried
[ivy:resolve] http://repository.apache.org/content/groups/snapshots-group/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.zip
[ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve] :: FAILED DOWNLOADS ::
[ivy:resolve] :: ^ see resolution messages for details ^ ::
[ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve] :: org.mortbay.jetty#jetty;6.1.26!jetty.zip
[ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve]
[ivy:resolve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS

BUILD FAILED
/Users/davidlaxer/pig-0.11.1-src/build.xml:941: The following error occurred while executing this line:
/Users/davidlaxer/pig-0.11.1-src/build.xml:1723: impossible to resolve dependencies:
resolve failed - see output for details

Total time: 23 seconds

find ~ -name '6.1.26' -ls
42361118 1056 -rw-r--r-- 1 davidlaxer staff 540234 Dec 22 2012 /Users/davidlaxer/.bundler/ruby/1.8/sunspot-78717a338942/sunspot_solr/solr/lib/jetty-6.1.26-patched-JETTY-1340.jar
42361119 352 -rw-r--r-- 1 davidlaxer staff 177393 Dec 22 2012 /Users/davidlaxer/.bundler/ruby/1.8/sunspot-78717a338942/sunspot_solr/solr/lib/jetty-util-6.1.26-patched-JETTY-1340.jar
80795382 8 -rw-r--r-- 1 davidlaxer staff 2189 May 22 18:03 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/jetty/ivy-6.1.26.xml
82151461 8 -rw-r--r-- 1 davidlaxer staff 425 May 22 18:03 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/jetty/ivy-6.1.26.xml.original
80795336 8 -rw-r--r-- 1 davidlaxer staff 838 Aug 13 20:52 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/jetty/ivydata-6.1.26.properties
80796510 1056 -rw-r--r-- 1 davidlaxer staff 539912 Nov 10 2010 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/jetty/jars/jetty-6.1.26.jar
80795393 16 -rw-r--r-- 1 davidlaxer staff 7327 May 22 18:02 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/jetty-util/ivy-6.1.26.xml
82151464 8 -rw-r--r-- 1 davidlaxer staff 3876 May 22 18:02 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/jetty-util/ivy-6.1.26.xml.original
80795391 8 -rw-r--r-- 1 davidlaxer staff 900 Aug 13 20:52 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/jetty-util/ivydata-6.1.26.properties
80796764 352 -rw-r--r-- 1 davidlaxer staff 177131 Nov 10 2010 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/jetty-util/jars/jetty-util-6.1.26.jar
80795380 16 -rw-r--r-- 1 davidlaxer staff 5000 May 22 18:02 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/project/ivy-6.1.26.xml
82151467 24 -rw-r--r-- 1 davidlaxer staff 9205 May 22 18:02 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/project/ivy-6.1.26.xml.original
80795345 8 -rw-r--r-- 1 davidlaxer staff 620 Aug 9 18:00 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/project/ivydata-6.1.26.properties
75248719 0 drwxr-xr-x 9 davidlaxer staff 306 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty/6.1.26
75248840 1056 -rw-r--r-- 1 davidlaxer staff 539912 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar
75248805 8 -rw-r--r-- 1 davidlaxer staff 505 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar.lastUpdated
75248848 8 -rw-r--r-- 1 davidlaxer staff 40 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar.sha1
75248723 8 -rw-r--r-- 1 davidlaxer staff 425 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.pom
75248720 8 -rw-r--r-- 1 davidlaxer staff 376 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.pom.lastUpdated
75248725 8 -rw-r--r-- 1 davidlaxer staff 40 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.pom.sha1
75248696 0 drwxr-xr-x 9 davidlaxer staff 306 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26
75248830 352 -rw-r--r-- 1 davidlaxer staff 177131 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar
75248804 8 -rw-r--r-- 1 davidlaxer staff 505 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar.lastUpdated
75248835 8 -rw-r--r-- 1 davidlaxer staff 40 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar.sha1
75248705 8 -rw-r--r-- 1 davidlaxer staff 3876 May 22 18:02 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.pom
75248698 8 -rw-r--r-- 1 davidlaxer staff 505 May 22 18:02 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.pom.lastUpdated
75248707 8 -rw-r--r-- 1 davidlaxer staff 40 May 22 18:02 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.pom.sha1
75248709 0 drwxr-xr-x 6 davidlaxer staff 204 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/project/6.1.26
75248715 24 -rw-r--r-- 1 davidlaxer staff 9205 May 22 18:02 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/project/6.1.26/project-6.1.26.pom
75248711 8 -rw-r--r-- 1 davidlaxer staff 505 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/project/6.1.26/project-6.1.26.pom.lastUpdated
75248717 8 -rw-r--r-- 1 davidlaxer staff 40 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/project/6.1.26/project-6.1.26.pom.sha1
42356239 1056 -rw-r--r-- 1 davidlaxer staff 540234 Dec 22 2012 /Users/davidlaxer/chorus/vendor/solr/lib/jetty-6.1.26-patched-JETTY-1340.jar
42356240 352 -rw-r--r-- 1 davidlaxer staff 177393 Dec 22 2012 /Users/davidlaxer/chorus/vendor/solr/lib/jetty-util-6.1.26-patched-JETTY-1340.jar
75177741 1056 -rw-r--r-- 1 davidlaxer staff 539912 Mar 31 02:49 /Users/davidlaxer/Downloads/hadoop-2.4.0/share/hadoop/common/lib/jetty-6.1.26.jar
75177736 352 -rw-r--r-- 1 davidlaxer staff 177131 Mar 31 02:49 /Users/davidlaxer/Downloads/hadoop-2.4.0/share/hadoop/common/lib/jetty-util-6.1.26.jar
75184493 1056 -rw-r--r-- 1 davidlaxer staff 539912 Mar 31 02:49 /Users/davidlaxer/Downloads/hadoop-2.4.0/share/hadoop/hdfs/lib/jetty-6.1.26.jar
75184491 352 -rw-r--r-- 1 davidlaxer staff 177131 Mar 31 02:49 /Users/davidlaxer/Downloads/hadoop-2.4.0/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar
75184734 1056 -rw-r--r-- 1 davidlaxer staff 539912 Mar 31 02:49 /Users/davidlaxer/Downloads/hadoop-2.4.0/share/hadoop/tools/lib/jetty-6.1.26.jar
75184730 352 -rw-r--r-- 1 davidlaxer staff 177131 Mar 31 02:49 /Users/davidlaxer/Downloads/hadoop-2.4.0/share/hadoop/tools/lib/jetty-util-6.1.26.jar
75184619 1056 -rw-r--r-- 1 davidlaxer staff 539912 Mar 31 02:49 /Users/davidlaxer/Downloads/hadoop-2.4.0/share/hadoop/yarn/lib/jetty-6.1.26.jar
75184615 352 -rw-r--r-- 1 davidlaxer staff 177131 Mar 31 02:49 /Users/davidlaxer/Downloads/hadoop-2.4.0/share/hadoop/yarn/lib/jetty-util-6.1.26.jar
82312261 3400 -rw-r--r-- 1 davidlaxer staff 1740076 Aug 13 21:01 /Users/davidlaxer/Downloads/jetty-hadoop-fix-6.1.26.cloudera.zip
82312276 0 drwxr-xr-x 16 davidlaxer staff 544 Aug 13 21:04 /Users/davidlaxer/jetty-hadoop-fix-6.1.26.cloudera

@rjurney
Copy link
Owner

rjurney commented Oct 8, 2014

Try downloading Pig 12 or 13 and report back.

@dbl001
Copy link
Author

dbl001 commented Oct 9, 2014

I downloaded pig 14 source and built it:

$ svn co http://svn.apache.org/repos/asf/pig/trunk
$ ant
$ cd contrib/piggybank/java
$ ant
$ ./pig -help

Apache Pig version 0.14.0-SNAPSHOT (r1630244)
compiled Oct 08 2014, 21:36:18

USAGE: Pig [options] [-] : Run interactively in grunt shell.
Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s).
Pig [options] [-f[ile]] file : Run cmds found in file.
options include:
-4, -log4jconf - Log4j configuration file, overrides log conf
-b, -brief - Brief logging (no timestamps)
-c, -check - Syntax check
-d, -debug - Debug level, INFO is default
-e, -execute - Commands to execute (within quotes)
-f, -file - Path to the script to execute
-g, -embedded - ScriptEngine classname or keyword for the ScriptEngine
-h, -help - Display this message. You can specify topic to get help for that topic.
properties is the only topic currently supported: -h properties.
-i, -version - Display version information
-l, -logfile - Path to client side log file; default is current working directory.
-m, -param_file - Path to the parameter file
-p, -param - Key value pair of the form param=val
-r, -dryrun - Produces script with substituted parameters. Script is not executed.
-t, -optimizer_off - Turn optimizations off. The following values are supported:
ConstantCalculator - Calculate constants at compile time
SplitFilter - Split filter conditions
PushUpFilter - Filter as early as possible
MergeFilter - Merge filter conditions
PushDownForeachFlatten - Join or explode as late as possible
LimitOptimizer - Limit as early as possible
ColumnMapKeyPrune - Remove unused data
AddForEach - Add ForEach to remove unneeded columns
MergeForEach - Merge adjacent ForEach
GroupByConstParallelSetter - Force parallel 1 for "group all" statement
PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData
PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown
All - Disable all optimizations
All optimizations listed here are enabled by default. Optimization values are case insensitive.
-v, -verbose - Print all error messages to screen
-w, -warning - Turn warning logging on; also turns warning aggregation off
-x, -exectype - Set execution mode: local|mapreduce, default is mapreduce.
-F, -stop_on_failure - Aborts execution on the first failed job; default is off
-M, -no_multiquery - Turn multiquery optimization off; default is on
-N, -no_fetch - Turn fetch optimization off; default is on
-P, -propertyFile - Path to property file
-printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including
any environment variables that are set by the pig command.
14/10/08 21:58:08 INFO pig.Main: Pig script completed in 148 milliseconds (148 ms)

(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -l /tmp -x local -v -w sent_counts.pig
14/10/08 21:48:53 INFO security.Groups: Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=300000
14/10/08 21:48:53 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
14/10/08 21:48:53 INFO pig.ExecTypeProvider: Picked LOCAL as the ExecType
2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08 2014, 21:36:18
2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Logging error messages to: /private/tmp/pig_1412822933095.log
2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - ERROR 2998: Unhandled internal error. org/apache/commons/io/input/ClassLoaderObjectInputStream
2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - java.lang.NoClassDefFoundError: org/apache/commons/io/input/ClassLoaderObjectInputStream
at org.apache.pig.Main.run(Main.java:414)
at org.apache.pig.Main.main(Main.java:170)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:192)
Caused by: java.lang.ClassNotFoundException: org.apache.commons.io.input.ClassLoaderObjectInputStream
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
... 7 more

Details also at logfile: /private/tmp/pig_1412822933095.log
2014-10-08 21:48:53,328 [main] INFO org.apache.pig.Main - Pig script completed in 297 milliseconds (297 ms)
(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ vi /private/tmp/pig_1412822933095.log

On Oct 8, 2014, at 3:56 PM, Russell Jurney [email protected] wrote:

Try downloading Pig 12 or 13 and report back.


Reply to this email directly or view it on GitHub.

@dbl001
Copy link
Author

dbl001 commented Oct 9, 2014

David-Laxers-MacBook-Pro:~ davidlaxer$ !e
echo $PATH
/opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/opt/X11/bin:/usr/local/CrossPack-AVR/bin:/usr/local/git/bin:/usr/texbin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin::/bin:/sbin:/Users/davidlaxer/.rvm/bin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin:/Users/davidlaxer/Downloads/apache-maven-3.2.1/bin::/bin:/sbin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/usr/local/mysql/bin:/Users/davidlaxer/pig/trunk/bin:
David-Laxers-MacBook-Pro:~ davidlaxer$ pig
Cannot locate pig-core-h2.jar. do 'ant -Dhadoopversion=23 jar', and try again
David-Laxers-MacBook-Pro:~ davidlaxer$ which pig
/usr/local/bin/pig
David-Laxers-MacBook-Pro:~ davidlaxer$ ls -l /usr/local/bin/pig
lrwxr-xr-x 1 root wheel 35 Oct 8 21:29 /usr/local/bin/pig -> /Users/davidlaxer/pig/trunk/bin/pig
David-Laxers-MacBook-Pro:~ davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -help

Apache Pig version 0.14.0-SNAPSHOT (r1630244)
compiled Oct 08 2014, 21:36:18

USAGE: Pig [options] [-] : Run interactively in grunt shell.
Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s).
Pig [options] [-f[ile]] file : Run cmds found in file.
options include:
-4, -log4jconf - Log4j configuration file, overrides log conf
-b, -brief - Brief logging (no timestamps)
-c, -check - Syntax check
-d, -debug - Debug level, INFO is default
-e, -execute - Commands to execute (within quotes)
-f, -file - Path to the script to execute
-g, -embedded - ScriptEngine classname or keyword for the ScriptEngine
-h, -help - Display this message. You can specify topic to get help for that topic.
properties is the only topic currently supported: -h properties.
-i, -version - Display version information
-l, -logfile - Path to client side log file; default is current working directory.
-m, -param_file - Path to the parameter file
-p, -param - Key value pair of the form param=val
-r, -dryrun - Produces script with substituted parameters. Script is not executed.
-t, -optimizer_off - Turn optimizations off. The following values are supported:
ConstantCalculator - Calculate constants at compile time
SplitFilter - Split filter conditions
PushUpFilter - Filter as early as possible
MergeFilter - Merge filter conditions
PushDownForeachFlatten - Join or explode as late as possible
LimitOptimizer - Limit as early as possible
ColumnMapKeyPrune - Remove unused data
AddForEach - Add ForEach to remove unneeded columns
MergeForEach - Merge adjacent ForEach
GroupByConstParallelSetter - Force parallel 1 for "group all" statement
PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData
PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown
All - Disable all optimizations
All optimizations listed here are enabled by default. Optimization values are case insensitive.
-v, -verbose - Print all error messages to screen
-w, -warning - Turn warning logging on; also turns warning aggregation off
-x, -exectype - Set execution mode: local|mapreduce, default is mapreduce.
-F, -stop_on_failure - Aborts execution on the first failed job; default is off
-M, -no_multiquery - Turn multiquery optimization off; default is on
-N, -no_fetch - Turn fetch optimization off; default is on
-P, -propertyFile - Path to property file
-printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including
any environment variables that are set by the pig command.
14/10/09 01:36:52 INFO pig.Main: Pig script completed in 327 milliseconds (327 ms)
David-Laxers-MacBook-Pro:~ davidlaxer$

On Oct 8, 2014, at 9:58 PM, David Laxer [email protected] wrote:

I downloaded pig 14 source and built it:

$ svn co http://svn.apache.org/repos/asf/pig/trunk
$ ant
$ cd contrib/piggybank/java
$ ant
$ ./pig -help

Apache Pig version 0.14.0-SNAPSHOT (r1630244)
compiled Oct 08 2014, 21:36:18

USAGE: Pig [options] [-] : Run interactively in grunt shell.
Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s).
Pig [options] [-f[ile]] file : Run cmds found in file.
options include:
-4, -log4jconf - Log4j configuration file, overrides log conf
-b, -brief - Brief logging (no timestamps)
-c, -check - Syntax check
-d, -debug - Debug level, INFO is default
-e, -execute - Commands to execute (within quotes)
-f, -file - Path to the script to execute
-g, -embedded - ScriptEngine classname or keyword for the ScriptEngine
-h, -help - Display this message. You can specify topic to get help for that topic.
properties is the only topic currently supported: -h properties.
-i, -version - Display version information
-l, -logfile - Path to client side log file; default is current working directory.
-m, -param_file - Path to the parameter file
-p, -param - Key value pair of the form param=val
-r, -dryrun - Produces script with substituted parameters. Script is not executed.
-t, -optimizer_off - Turn optimizations off. The following values are supported:
ConstantCalculator - Calculate constants at compile time
SplitFilter - Split filter conditions
PushUpFilter - Filter as early as possible
MergeFilter - Merge filter conditions
PushDownForeachFlatten - Join or explode as late as possible
LimitOptimizer - Limit as early as possible
ColumnMapKeyPrune - Remove unused data
AddForEach - Add ForEach to remove unneeded columns
MergeForEach - Merge adjacent ForEach
GroupByConstParallelSetter - Force parallel 1 for "group all" statement
PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData
PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown
All - Disable all optimizations
All optimizations listed here are enabled by default. Optimization values are case insensitive.
-v, -verbose - Print all error messages to screen
-w, -warning - Turn warning logging on; also turns warning aggregation off
-x, -exectype - Set execution mode: local|mapreduce, default is mapreduce.
-F, -stop_on_failure - Aborts execution on the first failed job; default is off
-M, -no_multiquery - Turn multiquery optimization off; default is on
-N, -no_fetch - Turn fetch optimization off; default is on
-P, -propertyFile - Path to property file
-printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including
any environment variables that are set by the pig command.
14/10/08 21:58:08 INFO pig.Main: Pig script completed in 148 milliseconds (148 ms)

(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -l /tmp -x local -v -w sent_counts.pig
14/10/08 21:48:53 INFO security.Groups: Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=300000
14/10/08 21:48:53 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
14/10/08 21:48:53 INFO pig.ExecTypeProvider: Picked LOCAL as the ExecType
2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08 2014, 21:36:18
2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Logging error messages to: /private/tmp/pig_1412822933095.log
2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - ERROR 2998: Unhandled internal error. org/apache/commons/io/input/ClassLoaderObjectInputStream
2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - java.lang.NoClassDefFoundError: org/apache/commons/io/input/ClassLoaderObjectInputStream
at org.apache.pig.Main.run(Main.java:414)
at org.apache.pig.Main.main(Main.java:170)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:192)
Caused by: java.lang.ClassNotFoundException: org.apache.commons.io.input.ClassLoaderObjectInputStream
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
... 7 more

Details also at logfile: /private/tmp/pig_1412822933095.log
2014-10-08 21:48:53,328 [main] INFO org.apache.pig.Main - Pig script completed in 297 milliseconds (297 ms)
(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ vi /private/tmp/pig_1412822933095.log

On Oct 8, 2014, at 3:56 PM, Russell Jurney [email protected] wrote:

Try downloading Pig 12 or 13 and report back.


Reply to this email directly or view it on GitHub.

@dbl001
Copy link
Author

dbl001 commented Oct 9, 2014

David-Laxers-MacBook-Pro:~ davidlaxer$ env | grep HADOOP
HADOOP_HOME=/users/davidlaxer/hadoop-2.3.0-src
HADOOP_CONF_DIR=/users/davidlaxer/hadoop-2.3.0-src/src/conf

On Oct 9, 2014, at 1:37 AM, David Laxer [email protected] wrote:

David-Laxers-MacBook-Pro:~ davidlaxer$ !e
echo $PATH
/opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/opt/X11/bin:/usr/local/CrossPack-AVR/bin:/usr/local/git/bin:/usr/texbin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin::/bin:/sbin:/Users/davidlaxer/.rvm/bin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin:/Users/davidlaxer/Downloads/apache-maven-3.2.1/bin::/bin:/sbin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/usr/local/mysql/bin:/Users/davidlaxer/pig/trunk/bin:
David-Laxers-MacBook-Pro:~ davidlaxer$ pig
Cannot locate pig-core-h2.jar. do 'ant -Dhadoopversion=23 jar', and try again
David-Laxers-MacBook-Pro:~ davidlaxer$ which pig
/usr/local/bin/pig
David-Laxers-MacBook-Pro:~ davidlaxer$ ls -l /usr/local/bin/pig
lrwxr-xr-x 1 root wheel 35 Oct 8 21:29 /usr/local/bin/pig -> /Users/davidlaxer/pig/trunk/bin/pig
David-Laxers-MacBook-Pro:~ davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -help

Apache Pig version 0.14.0-SNAPSHOT (r1630244)
compiled Oct 08 2014, 21:36:18

USAGE: Pig [options] [-] : Run interactively in grunt shell.
Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s).
Pig [options] [-f[ile]] file : Run cmds found in file.
options include:
-4, -log4jconf - Log4j configuration file, overrides log conf
-b, -brief - Brief logging (no timestamps)
-c, -check - Syntax check
-d, -debug - Debug level, INFO is default
-e, -execute - Commands to execute (within quotes)
-f, -file - Path to the script to execute
-g, -embedded - ScriptEngine classname or keyword for the ScriptEngine
-h, -help - Display this message. You can specify topic to get help for that topic.
properties is the only topic currently supported: -h properties.
-i, -version - Display version information
-l, -logfile - Path to client side log file; default is current working directory.
-m, -param_file - Path to the parameter file
-p, -param - Key value pair of the form param=val
-r, -dryrun - Produces script with substituted parameters. Script is not executed.
-t, -optimizer_off - Turn optimizations off. The following values are supported:
ConstantCalculator - Calculate constants at compile time
SplitFilter - Split filter conditions
PushUpFilter - Filter as early as possible
MergeFilter - Merge filter conditions
PushDownForeachFlatten - Join or explode as late as possible
LimitOptimizer - Limit as early as possible
ColumnMapKeyPrune - Remove unused data
AddForEach - Add ForEach to remove unneeded columns
MergeForEach - Merge adjacent ForEach
GroupByConstParallelSetter - Force parallel 1 for "group all" statement
PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData
PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown
All - Disable all optimizations
All optimizations listed here are enabled by default. Optimization values are case insensitive.
-v, -verbose - Print all error messages to screen
-w, -warning - Turn warning logging on; also turns warning aggregation off
-x, -exectype - Set execution mode: local|mapreduce, default is mapreduce.
-F, -stop_on_failure - Aborts execution on the first failed job; default is off
-M, -no_multiquery - Turn multiquery optimization off; default is on
-N, -no_fetch - Turn fetch optimization off; default is on
-P, -propertyFile - Path to property file
-printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including
any environment variables that are set by the pig command.
14/10/09 01:36:52 INFO pig.Main: Pig script completed in 327 milliseconds (327 ms)
David-Laxers-MacBook-Pro:~ davidlaxer$

On Oct 8, 2014, at 9:58 PM, David Laxer [email protected] wrote:

I downloaded pig 14 source and built it:

$ svn co http://svn.apache.org/repos/asf/pig/trunk
$ ant
$ cd contrib/piggybank/java
$ ant
$ ./pig -help

Apache Pig version 0.14.0-SNAPSHOT (r1630244)
compiled Oct 08 2014, 21:36:18

USAGE: Pig [options] [-] : Run interactively in grunt shell.
Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s).
Pig [options] [-f[ile]] file : Run cmds found in file.
options include:
-4, -log4jconf - Log4j configuration file, overrides log conf
-b, -brief - Brief logging (no timestamps)
-c, -check - Syntax check
-d, -debug - Debug level, INFO is default
-e, -execute - Commands to execute (within quotes)
-f, -file - Path to the script to execute
-g, -embedded - ScriptEngine classname or keyword for the ScriptEngine
-h, -help - Display this message. You can specify topic to get help for that topic.
properties is the only topic currently supported: -h properties.
-i, -version - Display version information
-l, -logfile - Path to client side log file; default is current working directory.
-m, -param_file - Path to the parameter file
-p, -param - Key value pair of the form param=val
-r, -dryrun - Produces script with substituted parameters. Script is not executed.
-t, -optimizer_off - Turn optimizations off. The following values are supported:
ConstantCalculator - Calculate constants at compile time
SplitFilter - Split filter conditions
PushUpFilter - Filter as early as possible
MergeFilter - Merge filter conditions
PushDownForeachFlatten - Join or explode as late as possible
LimitOptimizer - Limit as early as possible
ColumnMapKeyPrune - Remove unused data
AddForEach - Add ForEach to remove unneeded columns
MergeForEach - Merge adjacent ForEach
GroupByConstParallelSetter - Force parallel 1 for "group all" statement
PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData
PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown
All - Disable all optimizations
All optimizations listed here are enabled by default. Optimization values are case insensitive.
-v, -verbose - Print all error messages to screen
-w, -warning - Turn warning logging on; also turns warning aggregation off
-x, -exectype - Set execution mode: local|mapreduce, default is mapreduce.
-F, -stop_on_failure - Aborts execution on the first failed job; default is off
-M, -no_multiquery - Turn multiquery optimization off; default is on
-N, -no_fetch - Turn fetch optimization off; default is on
-P, -propertyFile - Path to property file
-printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including
any environment variables that are set by the pig command.
14/10/08 21:58:08 INFO pig.Main: Pig script completed in 148 milliseconds (148 ms)

(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -l /tmp -x local -v -w sent_counts.pig
14/10/08 21:48:53 INFO security.Groups: Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=300000
14/10/08 21:48:53 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
14/10/08 21:48:53 INFO pig.ExecTypeProvider: Picked LOCAL as the ExecType
2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08 2014, 21:36:18
2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Logging error messages to: /private/tmp/pig_1412822933095.log
2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - ERROR 2998: Unhandled internal error. org/apache/commons/io/input/ClassLoaderObjectInputStream
2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - java.lang.NoClassDefFoundError: org/apache/commons/io/input/ClassLoaderObjectInputStream
at org.apache.pig.Main.run(Main.java:414)
at org.apache.pig.Main.main(Main.java:170)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:192)
Caused by: java.lang.ClassNotFoundException: org.apache.commons.io.input.ClassLoaderObjectInputStream
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
... 7 more

Details also at logfile: /private/tmp/pig_1412822933095.log
2014-10-08 21:48:53,328 [main] INFO org.apache.pig.Main - Pig script completed in 297 milliseconds (297 ms)
(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ vi /private/tmp/pig_1412822933095.log

On Oct 8, 2014, at 3:56 PM, Russell Jurney [email protected] wrote:

Try downloading Pig 12 or 13 and report back.


Reply to this email directly or view it on GitHub.

@dbl001
Copy link
Author

dbl001 commented Oct 9, 2014

The requirements for the virtual environment finally completed:

(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ sudo port install snappy
Password:
---> Computing dependencies for snappy
---> Cleaning snappy
---> Scanning binaries for linking errors
---> No broken files found.
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ sudo port install python-snappy
Error: Port python-snappy not found
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ pip install python-snappy
Requirement already satisfied (use --upgrade to upgrade): python-snappy in /Users/davidlaxer/anaconda/lib/python2.7/site-packages
Cleaning up...
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ pwd
/users/davidlaxer/hadoop-2.3.0-src
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ dirs
/users/davidlaxer/hadoop-2.3.0-src ~/Agile_Data_Code/ch03/pig
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ pushd ~/Agile_Data_Code/
~/Agile_Data_Code /users/davidlaxer/hadoop-2.3.0-src ~/Agile_Data_Code/ch03/pig
(virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ history | grep pip
146 pip install -r python/requirements.txt
175 pip install --upgrade --no-deps git+git://github.com/Theano/Theano.git
441 pip freeze
442 sudo pip install virtualenv
448 sudo pip install virtualenv
451 pip install graphlab-create==0.9.1
502 pip install virtualenv
508 pip install -r requirements.txt
509 pip install snappy
510 pip install python-snappy
512 pip install python-snappy
513 pip install -r requirements.txt
514 pip install -r requirements.txt
529 pip install python-snappy
551 pip install python-snappy
555 history | grep pip
(virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ sudo !513
sudo pip install -r requirements.txt
Requirement already satisfied (use --upgrade to upgrade): BareNecessities==0.2.8 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 1))
Requirement already satisfied (use --upgrade to upgrade): ESClient==0.5.3 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 2))
Requirement already satisfied (use --upgrade to upgrade): Flask==0.9 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 3))
Requirement already satisfied (use --upgrade to upgrade): Jinja2==2.6 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 4))
Requirement already satisfied (use --upgrade to upgrade): LEPL==5.1.3 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 5))
Requirement already satisfied (use --upgrade to upgrade): Mail==2.1.0 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 6))
Requirement already satisfied (use --upgrade to upgrade): Werkzeug==0.8.3 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 7))
Requirement already satisfied (use --upgrade to upgrade): distribute==0.6.31 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 8))
Requirement already satisfied (use --upgrade to upgrade): python-snappy in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 9))
Requirement already satisfied (use --upgrade to upgrade): avro==1.7.3 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 10))
Obtaining pyelasticsearch from git+https://github.com/rhec/pyelasticsearch.git#egg=pyelasticsearch (from -r requirements.txt (line 11))
Updating ./src/pyelasticsearch clone
Running setup.py (path:/Users/davidlaxer/Agile_Data_Code/src/pyelasticsearch/setup.py) egg_info for package pyelasticsearch

Installing extra requirements: 'egg'
Requirement already satisfied (use --upgrade to upgrade): pymongo==2.4.1 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 12))
Downloading/unpacking requests==1.0.4 (from -r requirements.txt (line 13))
Downloading requests-1.0.4.tar.gz (336kB): 336kB downloaded
Running setup.py (path:/private/tmp/pip_build_root/requests/setup.py) egg_info for package requests

Requirement already satisfied (use --upgrade to upgrade): simplejson==2.6.2 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): wsgiref==0.1.2 in /Users/davidlaxer/anaconda/lib/python2.7 (from -r requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): numpy in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): honcho in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 17))
Requirement already satisfied (use --upgrade to upgrade): scipy in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): dotcloud in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): python-dateutil in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): nltk in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): six in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from pyelasticsearch->-r requirements.txt (line 11))
Requirement already satisfied (use --upgrade to upgrade): argparse in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from dotcloud->-r requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): colorama in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from dotcloud->-r requirements.txt (line 19))
Installing collected packages: pyelasticsearch, requests
Running setup.py develop for pyelasticsearch

Creating /Users/davidlaxer/anaconda/lib/python2.7/site-packages/pyelasticsearch.egg-link (link to .)
pyelasticsearch 0.6.1 is already the active version in easy-install.pth

Installed /Users/davidlaxer/Agile_Data_Code/src/pyelasticsearch

Found existing installation: requests 2.3.0
Uninstalling requests:
Successfully uninstalled requests
Running setup.py install for requests

Successfully installed pyelasticsearch requests
Cleaning up...
(virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ pig
Cannot locate pig-core-h2.jar. do 'ant -Dhadoopversion=23 jar', and try again
(virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ sudo pip install avro
Requirement already satisfied (use --upgrade to upgrade): avro in /Users/davidlaxer/anaconda/lib/python2.7/site-packages
Cleaning up...
(virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$

On Oct 9, 2014, at 7:29 AM, David Laxer [email protected] wrote:

David-Laxers-MacBook-Pro:~ davidlaxer$ env | grep HADOOP
HADOOP_HOME=/users/davidlaxer/hadoop-2.3.0-src
HADOOP_CONF_DIR=/users/davidlaxer/hadoop-2.3.0-src/src/conf

On Oct 9, 2014, at 1:37 AM, David Laxer [email protected] wrote:

David-Laxers-MacBook-Pro:~ davidlaxer$ !e
echo $PATH
/opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/opt/X11/bin:/usr/local/CrossPack-AVR/bin:/usr/local/git/bin:/usr/texbin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin::/bin:/sbin:/Users/davidlaxer/.rvm/bin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin:/Users/davidlaxer/Downloads/apache-maven-3.2.1/bin::/bin:/sbin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/usr/local/mysql/bin:/Users/davidlaxer/pig/trunk/bin:
David-Laxers-MacBook-Pro:~ davidlaxer$ pig
Cannot locate pig-core-h2.jar. do 'ant -Dhadoopversion=23 jar', and try again
David-Laxers-MacBook-Pro:~ davidlaxer$ which pig
/usr/local/bin/pig
David-Laxers-MacBook-Pro:~ davidlaxer$ ls -l /usr/local/bin/pig
lrwxr-xr-x 1 root wheel 35 Oct 8 21:29 /usr/local/bin/pig -> /Users/davidlaxer/pig/trunk/bin/pig
David-Laxers-MacBook-Pro:~ davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -help

Apache Pig version 0.14.0-SNAPSHOT (r1630244)
compiled Oct 08 2014, 21:36:18

USAGE: Pig [options] [-] : Run interactively in grunt shell.
Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s).
Pig [options] [-f[ile]] file : Run cmds found in file.
options include:
-4, -log4jconf - Log4j configuration file, overrides log conf
-b, -brief - Brief logging (no timestamps)
-c, -check - Syntax check
-d, -debug - Debug level, INFO is default
-e, -execute - Commands to execute (within quotes)
-f, -file - Path to the script to execute
-g, -embedded - ScriptEngine classname or keyword for the ScriptEngine
-h, -help - Display this message. You can specify topic to get help for that topic.
properties is the only topic currently supported: -h properties.
-i, -version - Display version information
-l, -logfile - Path to client side log file; default is current working directory.
-m, -param_file - Path to the parameter file
-p, -param - Key value pair of the form param=val
-r, -dryrun - Produces script with substituted parameters. Script is not executed.
-t, -optimizer_off - Turn optimizations off. The following values are supported:
ConstantCalculator - Calculate constants at compile time
SplitFilter - Split filter conditions
PushUpFilter - Filter as early as possible
MergeFilter - Merge filter conditions
PushDownForeachFlatten - Join or explode as late as possible
LimitOptimizer - Limit as early as possible
ColumnMapKeyPrune - Remove unused data
AddForEach - Add ForEach to remove unneeded columns
MergeForEach - Merge adjacent ForEach
GroupByConstParallelSetter - Force parallel 1 for "group all" statement
PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData
PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown
All - Disable all optimizations
All optimizations listed here are enabled by default. Optimization values are case insensitive.
-v, -verbose - Print all error messages to screen
-w, -warning - Turn warning logging on; also turns warning aggregation off
-x, -exectype - Set execution mode: local|mapreduce, default is mapreduce.
-F, -stop_on_failure - Aborts execution on the first failed job; default is off
-M, -no_multiquery - Turn multiquery optimization off; default is on
-N, -no_fetch - Turn fetch optimization off; default is on
-P, -propertyFile - Path to property file
-printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including
any environment variables that are set by the pig command.
14/10/09 01:36:52 INFO pig.Main: Pig script completed in 327 milliseconds (327 ms)
David-Laxers-MacBook-Pro:~ davidlaxer$

On Oct 8, 2014, at 9:58 PM, David Laxer [email protected] wrote:

I downloaded pig 14 source and built it:

$ svn co http://svn.apache.org/repos/asf/pig/trunk
$ ant
$ cd contrib/piggybank/java
$ ant
$ ./pig -help

Apache Pig version 0.14.0-SNAPSHOT (r1630244)
compiled Oct 08 2014, 21:36:18

USAGE: Pig [options] [-] : Run interactively in grunt shell.
Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s).
Pig [options] [-f[ile]] file : Run cmds found in file.
options include:
-4, -log4jconf - Log4j configuration file, overrides log conf
-b, -brief - Brief logging (no timestamps)
-c, -check - Syntax check
-d, -debug - Debug level, INFO is default
-e, -execute - Commands to execute (within quotes)
-f, -file - Path to the script to execute
-g, -embedded - ScriptEngine classname or keyword for the ScriptEngine
-h, -help - Display this message. You can specify topic to get help for that topic.
properties is the only topic currently supported: -h properties.
-i, -version - Display version information
-l, -logfile - Path to client side log file; default is current working directory.
-m, -param_file - Path to the parameter file
-p, -param - Key value pair of the form param=val
-r, -dryrun - Produces script with substituted parameters. Script is not executed.
-t, -optimizer_off - Turn optimizations off. The following values are supported:
ConstantCalculator - Calculate constants at compile time
SplitFilter - Split filter conditions
PushUpFilter - Filter as early as possible
MergeFilter - Merge filter conditions
PushDownForeachFlatten - Join or explode as late as possible
LimitOptimizer - Limit as early as possible
ColumnMapKeyPrune - Remove unused data
AddForEach - Add ForEach to remove unneeded columns
MergeForEach - Merge adjacent ForEach
GroupByConstParallelSetter - Force parallel 1 for "group all" statement
PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData
PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown
All - Disable all optimizations
All optimizations listed here are enabled by default. Optimization values are case insensitive.
-v, -verbose - Print all error messages to screen
-w, -warning - Turn warning logging on; also turns warning aggregation off
-x, -exectype - Set execution mode: local|mapreduce, default is mapreduce.
-F, -stop_on_failure - Aborts execution on the first failed job; default is off
-M, -no_multiquery - Turn multiquery optimization off; default is on
-N, -no_fetch - Turn fetch optimization off; default is on
-P, -propertyFile - Path to property file
-printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including
any environment variables that are set by the pig command.
14/10/08 21:58:08 INFO pig.Main: Pig script completed in 148 milliseconds (148 ms)

(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -l /tmp -x local -v -w sent_counts.pig
14/10/08 21:48:53 INFO security.Groups: Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=300000
14/10/08 21:48:53 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
14/10/08 21:48:53 INFO pig.ExecTypeProvider: Picked LOCAL as the ExecType
2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08 2014, 21:36:18
2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Logging error messages to: /private/tmp/pig_1412822933095.log
2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - ERROR 2998: Unhandled internal error. org/apache/commons/io/input/ClassLoaderObjectInputStream
2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - java.lang.NoClassDefFoundError: org/apache/commons/io/input/ClassLoaderObjectInputStream
at org.apache.pig.Main.run(Main.java:414)
at org.apache.pig.Main.main(Main.java:170)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:192)
Caused by: java.lang.ClassNotFoundException: org.apache.commons.io.input.ClassLoaderObjectInputStream
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
... 7 more

Details also at logfile: /private/tmp/pig_1412822933095.log
2014-10-08 21:48:53,328 [main] INFO org.apache.pig.Main - Pig script completed in 297 milliseconds (297 ms)
(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ vi /private/tmp/pig_1412822933095.log

On Oct 8, 2014, at 3:56 PM, Russell Jurney [email protected] wrote:

Try downloading Pig 12 or 13 and report back.


Reply to this email directly or view it on GitHub.

@dbl001
Copy link
Author

dbl001 commented Oct 9, 2014

Here’s what happened with Pig 0.13

(virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$ ./bin/pig -x

Apache Pig version 0.13.0 (r1606446)
compiled Jun 29 2014, 02:27:58

USAGE: Pig [options] [-] : Run interactively in grunt shell.
Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s).
Pig [options] [-f[ile]] file : Run cmds found in file.
options include:
-4, -log4jconf - Log4j configuration file, overrides log conf
-b, -brief - Brief logging (no timestamps)
-c, -check - Syntax check
-d, -debug - Debug level, INFO is default
-e, -execute - Commands to execute (within quotes)
-f, -file - Path to the script to execute
-g, -embedded - ScriptEngine classname or keyword for the ScriptEngine
-h, -help - Display this message. You can specify topic to get help for that topic.
properties is the only topic currently supported: -h properties.
-i, -version - Display version information
-l, -logfile - Path to client side log file; default is current working directory.
-m, -param_file - Path to the parameter file
-p, -param - Key value pair of the form param=val
-r, -dryrun - Produces script with substituted parameters. Script is not executed.
-t, -optimizer_off - Turn optimizations off. The following values are supported:
SplitFilter - Split filter conditions
PushUpFilter - Filter as early as possible
MergeFilter - Merge filter conditions
PushDownForeachFlatten - Join or explode as late as possible
LimitOptimizer - Limit as early as possible
ColumnMapKeyPrune - Remove unused data
AddForEach - Add ForEach to remove unneeded columns
MergeForEach - Merge adjacent ForEach
GroupByConstParallelSetter - Force parallel 1 for "group all" statement
All - Disable all optimizations
All optimizations listed here are enabled by default. Optimization values are case insensitive.
-v, -verbose - Print all error messages to screen
-w, -warning - Turn warning logging on; also turns warning aggregation off
-x, -exectype - Set execution mode: local|mapreduce, default is mapreduce.
-F, -stop_on_failure - Aborts execution on the first failed job; default is off
-M, -no_multiquery - Turn multiquery optimization off; default is on
-N, -no_fetch - Turn fetch optimization off; default is on
-P, -propertyFile - Path to property file
-printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including
any environment variables that are set by the pig command.
(virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$ ./bin/pig
14/10/09 11:36:34 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
14/10/09 11:36:34 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE
14/10/09 11:36:34 INFO pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType
2014-10-09 11:36:34,366 [main] INFO org.apache.pig.Main - Apache Pig version 0.13.0 (r1606446) compiled Jun 29 2014, 02:27:58
2014-10-09 11:36:34,366 [main] INFO org.apache.pig.Main - Logging error messages to: /Users/davidlaxer/pig-0.13.0/pig_1412872594365.log
2014-10-09 11:36:34,421 [main] ERROR org.apache.pig.Main - ERROR 2998: Unhandled internal error. org/apache/commons/io/input/ClassLoaderObjectInputStream
Details at logfile: /Users/davidlaxer/pig-0.13.0/pig_1412872594365.log
(virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$ !v
vi RELEASE_NOTES.txt
(virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$ ant
Buildfile: /Users/davidlaxer/pig-0.13.0/build.xml

ivy-download:
[get] Getting: http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.2.0/ivy-2.2.0.jar
[get] To: /Users/davidlaxer/pig-0.13.0/ivy/ivy-2.2.0.jar
[get] Not modified - so not downloaded

ivy-init-dirs:

ivy-probe-antlib:

ivy-init-antlib:

ivy-init:
[ivy:configure] :: Apache Ivy ${target.ivy.version}-local-20140820125617 - 20140820125617 :: http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = /Users/davidlaxer/pig-0.13.0/ivy/ivysettings.xml

ivy-resolve:
[ivy:resolve] :: resolving dependencies :: org.apache.pig#pig;0.13.1-SNAPSHOT
[ivy:resolve] confs: [compile]
[ivy:resolve] found com.sun.jersey#jersey-core;1.8 in fs
[ivy:resolve] found org.apache.hadoop#hadoop-core;1.0.4 in default
[ivy:resolve] found commons-cli#commons-cli;1.2 in default
[ivy:resolve] found xmlenc#xmlenc;0.52 in fs
[ivy:resolve] found commons-httpclient#commons-httpclient;3.0.1 in fs
[ivy:resolve] found junit#junit;3.8.1 in default
[ivy:resolve] found commons-codec#commons-codec;1.4 in default
[ivy:resolve] found org.apache.commons#commons-math;2.1 in fs
[ivy:resolve] found commons-configuration#commons-configuration;1.6 in fs
[ivy:resolve] found commons-collections#commons-collections;3.2.1 in default
[ivy:resolve] found commons-lang#commons-lang;2.4 in default
[ivy:resolve] found commons-logging#commons-logging;1.1.1 in default
[ivy:resolve] found commons-digester#commons-digester;1.8 in default
[ivy:resolve] found commons-beanutils#commons-beanutils;1.7.0 in default
[ivy:resolve] found commons-beanutils#commons-beanutils-core;1.8.0 in fs
[ivy:resolve] found commons-net#commons-net;1.4.1 in fs
[ivy:resolve] found oro#oro;2.0.8 in default
[ivy:resolve] found org.mortbay.jetty#jetty;6.1.26 in default
[ivy:resolve] found org.mortbay.jetty#jetty-util;6.1.26 in default
[ivy:resolve] found tomcat#jasper-runtime;5.5.12 in fs
[ivy:resolve] found tomcat#jasper-compiler;5.5.12 in fs
[ivy:resolve] found org.mortbay.jetty#jsp-api-2.1;6.1.14 in fs
[ivy:resolve] found org.mortbay.jetty#servlet-api-2.5;6.1.14 in fs
[ivy:resolve] found org.mortbay.jetty#jsp-2.1;6.1.14 in fs
[ivy:resolve] found org.eclipse.jdt#core;3.1.1 in fs
[ivy:resolve] found ant#ant;1.6.5 in fs
[ivy:resolve] found commons-el#commons-el;1.0 in fs
[ivy:resolve] found net.java.dev.jets3t#jets3t;0.7.1 in fs
[ivy:resolve] found net.sf.kosmosfs#kfs;0.3 in fs
[ivy:resolve] found hsqldb#hsqldb;1.8.0.10 in fs
[ivy:resolve] found org.apache.hadoop#hadoop-test;1.0.4 in maven2
[ivy:resolve] found org.apache.ftpserver#ftplet-api;1.0.0 in fs
[ivy:resolve] found org.apache.mina#mina-core;2.0.0-M5 in fs
[ivy:resolve] found org.slf4j#slf4j-api;1.5.2 in fs
[ivy:resolve] found org.apache.ftpserver#ftpserver-core;1.0.0 in fs
[ivy:resolve] found org.apache.ftpserver#ftpserver-deprecated;1.0.0-M2 in fs
[ivy:resolve] found org.apache.hbase#hbase;0.94.1 in maven2
[ivy:resolve] found commons-io#commons-io;2.3 in default
[ivy:resolve] found org.apache.httpcomponents#httpclient;4.1 in maven2
[ivy:resolve] found org.apache.httpcomponents#httpcore;4.1 in maven2
[ivy:resolve] found log4j#log4j;1.2.16 in fs
[ivy:resolve] found org.slf4j#slf4j-log4j12;1.6.1 in maven2
[ivy:resolve] found org.apache.avro#avro;1.7.5 in default
[ivy:resolve] found com.thoughtworks.paranamer#paranamer;2.3 in fs
[ivy:resolve] found org.xerial.snappy#snappy-java;1.0.5 in fs
[ivy:resolve] found org.apache.commons#commons-compress;1.4.1 in fs
[ivy:resolve] found org.tukaani#xz;1.0 in fs
[ivy:resolve] found org.slf4j#slf4j-api;1.6.4 in fs
[ivy:resolve] found org.apache.avro#avro-mapred;1.7.5 in maven2
[ivy:resolve] found org.apache.avro#avro-ipc;1.7.5 in maven2
[ivy:resolve] found io.netty#netty;3.4.0.Final in fs
[ivy:resolve] found org.apache.velocity#velocity;1.7 in default
[ivy:resolve] found org.mortbay.jetty#servlet-api;2.5-20081211 in fs
[ivy:resolve] found org.apache.avro#trevni-core;1.7.5 in maven2
[ivy:resolve] found org.apache.avro#trevni-avro;1.7.5 in maven2
[ivy:resolve] found org.xerial.snappy#snappy-java;1.1.0.1 in maven2
[ivy:resolve] found com.googlecode.json-simple#json-simple;1.1 in fs
[ivy:resolve] found jline#jline;1.0 in default
[ivy:resolve] found net.java.dev.javacc#javacc;4.2 in maven2
[ivy:resolve] found org.codehaus.groovy#groovy-all;1.8.6 in maven2
[ivy:resolve] found org.codehaus.jackson#jackson-mapper-asl;1.8.8 in fs
[ivy:resolve] found org.codehaus.jackson#jackson-core-asl;1.8.8 in fs
[ivy:resolve] found org.fusesource.jansi#jansi;1.9 in maven2
[ivy:resolve] found joda-time#joda-time;2.1 in maven2
[ivy:resolve] found com.google.guava#guava;11.0 in maven2
[ivy:resolve] found org.python#jython-standalone;2.5.3 in maven2
[ivy:resolve] found rhino#js;1.7R2 in maven2
[ivy:resolve] found org.antlr#antlr;3.4 in default
[ivy:resolve] found org.antlr#antlr-runtime;3.4 in default
[ivy:resolve] found org.antlr#stringtemplate;3.2.1 in default
[ivy:resolve] found antlr#antlr;2.7.7 in default
[ivy:resolve] found org.antlr#ST4;4.0.4 in default
[ivy:resolve] found org.apache.zookeeper#zookeeper;3.4.5 in fs
[ivy:resolve] found dk.brics.automaton#automaton;1.11-8 in maven2
[ivy:resolve] found org.jruby#jruby-complete;1.6.7 in maven2
[ivy:resolve] found asm#asm;3.3.1 in fs
[ivy:resolve] found org.apache.accumulo#accumulo-core;1.5.0 in maven2
[ivy:resolve] found com.beust#jcommander;1.30 in maven2
[ivy:resolve] found org.apache.accumulo#accumulo-fate;1.5.0 in maven2
[ivy:resolve] found org.apache.accumulo#accumulo-start;1.5.0 in maven2
[ivy:resolve] found org.apache.commons#commons-vfs2;2.0 in maven2
[ivy:resolve] found org.apache.maven.scm#maven-scm-api;1.4 in fs
[ivy:resolve] found org.codehaus.plexus#plexus-utils;1.5.6 in fs
[ivy:resolve] found org.apache.maven.scm#maven-scm-provider-svnexe;1.4 in fs
[ivy:resolve] found org.apache.maven.scm#maven-scm-provider-svn-commons;1.4 in fs
[ivy:resolve] found regexp#regexp;1.3 in fs
[ivy:resolve] found org.apache.accumulo#accumulo-trace;1.5.0 in maven2
[ivy:resolve] found org.apache.thrift#libthrift;0.9.0 in default
[ivy:resolve] found org.apache.httpcomponents#httpclient;4.1.3 in default
[ivy:resolve] found org.apache.httpcomponents#httpcore;4.1.3 in fs
[ivy:resolve] found org.apache.accumulo#accumulo-minicluster;1.5.0 in maven2
[ivy:resolve] found org.apache.accumulo#accumulo-server;1.5.0 in maven2
[ivy:resolve] found com.google.code.gson#gson;2.2.2 in maven2
[ivy:resolve] found org.vafer#jdeb;0.8 in maven2
[ivy:resolve] found org.mockito#mockito-all;1.8.4 in maven2
[ivy:resolve] found com.twitter#parquet-pig-bundle;1.2.3 in maven2
[ivy:resolve] :: resolution report :: resolve 10876ms :: artifacts dl 111ms
[ivy:resolve] :: evicted modules:
[ivy:resolve] commons-logging#commons-logging;1.0.3 by [commons-logging#commons-logging;1.1.1] in [compile]
[ivy:resolve] commons-codec#commons-codec;1.2 by [commons-codec#commons-codec;1.4] in [compile]
[ivy:resolve] commons-logging#commons-logging;1.1 by [commons-logging#commons-logging;1.1.1] in [compile]
[ivy:resolve] commons-codec#commons-codec;1.3 by [commons-codec#commons-codec;1.4] in [compile]
[ivy:resolve] commons-httpclient#commons-httpclient;3.1 by [commons-httpclient#commons-httpclient;3.0.1] in [compile]
[ivy:resolve] org.codehaus.jackson#jackson-mapper-asl;1.0.1 by [org.codehaus.jackson#jackson-mapper-asl;1.8.8] in [compile]
[ivy:resolve] org.slf4j#slf4j-api;1.5.2 by [org.slf4j#slf4j-api;1.6.4] in [compile]
[ivy:resolve] org.apache.mina#mina-core;2.0.0-M4 by [org.apache.mina#mina-core;2.0.0-M5] in [compile]
[ivy:resolve] org.apache.ftpserver#ftplet-api;1.0.0-M2 by [org.apache.ftpserver#ftplet-api;1.0.0] in [compile]
[ivy:resolve] org.apache.ftpserver#ftpserver-core;1.0.0-M2 by [org.apache.ftpserver#ftpserver-core;1.0.0] in [compile]
[ivy:resolve] org.apache.mina#mina-core;2.0.0-M2 by [org.apache.mina#mina-core;2.0.0-M5] in [compile]
[ivy:resolve] org.apache.httpcomponents#httpclient;4.1 by [org.apache.httpcomponents#httpclient;4.1.3] in [compile]
[ivy:resolve] org.apache.httpcomponents#httpcore;4.1 by [org.apache.httpcomponents#httpcore;4.1.3] in [compile]
[ivy:resolve] commons-cli#commons-cli;1.0 by [commons-cli#commons-cli;1.2] in [compile]
[ivy:resolve] org.xerial.snappy#snappy-java;1.0.5 by [org.xerial.snappy#snappy-java;1.1.0.1] in [compile]
[ivy:resolve] org.antlr#antlr-runtime;3.3 by [org.antlr#antlr-runtime;3.4] in [compile]
[ivy:resolve] org.apache.httpcomponents#httpcore;4.1.4 by [org.apache.httpcomponents#httpcore;4.1.3] in [compile]
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| compile | 109 | 55 | 0 | 17 || 95 | 0 |
---------------------------------------------------------------------

ivy-compile:
[ivy:retrieve] :: retrieving :: org.apache.pig#pig
[ivy:retrieve] confs: [compile]
[ivy:retrieve] 95 artifacts copied, 0 already retrieved (81667kB/3564ms)
[ivy:cachepath] DEPRECATED: 'ivy.conf.file' is deprecated, use 'ivy.settings.file' instead
[ivy:cachepath] :: loading settings :: file = /Users/davidlaxer/pig-0.13.0/ivy/ivysettings.xml

init:
[mkdir] Created dir: /Users/davidlaxer/pig-0.13.0/src-gen/org/apache/pig/impl/logicalLayer/parser
[mkdir] Created dir: /Users/davidlaxer/pig-0.13.0/src-gen/org/apache/pig/tools/pigscript/parser
[mkdir] Created dir: /Users/davidlaxer/pig-0.13.0/src-gen/org/apache/pig/tools/parameters
[mkdir] Created dir: /Users/davidlaxer/pig-0.13.0/build/classes
[mkdir] Created dir: /Users/davidlaxer/pig-0.13.0/build/test/classes
[mkdir] Created dir: /Users/davidlaxer/pig-0.13.0/src-gen/org/apache/pig/data/parser
[move] Moving 1 file to /Users/davidlaxer/pig-0.13.0/build/ivy/lib/Pig

cc-compile:
[javacc] Java Compiler Compiler Version 4.2 (Parser Generator)
[javacc](type "javacc" with no arguments for help)
[javacc] Reading from file /Users/davidlaxer/pig-0.13.0/src/org/apache/pig/tools/pigscript/parser/PigScriptParser.jj . . .
[javacc] File "TokenMgrError.java" does not exist. Will create one.
[javacc] File "ParseException.java" does not exist. Will create one.
[javacc] File "Token.java" does not exist. Will create one.
[javacc] File "JavaCharStream.java" does not exist. Will create one.
[javacc] Parser generated successfully.
[javacc] Java Compiler Compiler Version 4.2 (Parser Generator)
[javacc](type "javacc" with no arguments for help)
[javacc] Reading from file /Users/davidlaxer/pig-0.13.0/src/org/apache/pig/tools/parameters/PigFileParser.jj . . .
[javacc] Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking.
[javacc] File "TokenMgrError.java" does not exist. Will create one.
[javacc] File "ParseException.java" does not exist. Will create one.
[javacc] File "Token.java" does not exist. Will create one.
[javacc] File "JavaCharStream.java" does not exist. Will create one.
[javacc] Parser generated with 0 errors and 1 warnings.
[javacc] Java Compiler Compiler Version 4.2 (Parser Generator)
[javacc](type "javacc" with no arguments for help)
[javacc] Reading from file /Users/davidlaxer/pig-0.13.0/src/org/apache/pig/tools/parameters/ParamLoader.jj . . .
[javacc] File "TokenMgrError.java" is being rebuilt.
[javacc] File "ParseException.java" is being rebuilt.
[javacc] File "Token.java" is being rebuilt.
[javacc] File "JavaCharStream.java" is being rebuilt.
[javacc] Parser generated successfully.
[jjtree] Java Compiler Compiler Version 4.2 (Tree Builder)
[jjtree](type "jjtree" with no arguments for help)
[jjtree] Reading from file /Users/davidlaxer/pig-0.13.0/test/org/apache/pig/test/utils/dotGraph/DOTParser.jjt . . .
[jjtree] File "Node.java" is being rebuilt.
[jjtree] File "SimpleNode.java" is being rebuilt.
[jjtree] File "DOTParserTreeConstants.java" is being rebuilt.
[jjtree] File "JJTDOTParserState.java" is being rebuilt.
[jjtree] Annotated grammar generated successfully in /Users/davidlaxer/pig-0.13.0/test/org/apache/pig/test/utils/dotGraph/parser/DOTParser.jj
[javacc] Java Compiler Compiler Version 4.2 (Parser Generator)
[javacc](type "javacc" with no arguments for help)
[javacc] Reading from file /Users/davidlaxer/pig-0.13.0/test/org/apache/pig/test/utils/dotGraph/parser/DOTParser.jj . . .
[javacc] File "TokenMgrError.java" is being rebuilt.
[javacc] File "ParseException.java" is being rebuilt.
[javacc] File "Token.java" is being rebuilt.
[javacc] File "SimpleCharStream.java" is being rebuilt.
[javacc] Parser generated successfully.

prepare:
[mkdir] Created dir: /Users/davidlaxer/pig-0.13.0/src-gen/org/apache/pig/parser

genLexer:

genParser:

genTreeParser:

gen:

compile:
[echo] *** Building Main Sources ***
[echo] *** To compile with all warnings enabled, supply -Dall.warnings=1 on command line ***
[echo] *** Else, you will only be warned about deprecations ***
[javac] Compiling 887 source files to /Users/davidlaxer/pig-0.13.0/build/classes
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.
[copy] Copying 1 file to /Users/davidlaxer/pig-0.13.0/build/classes/org/apache/pig/tools/grunt
[copy] Copying 1 file to /Users/davidlaxer/pig-0.13.0/build/classes/org/apache/pig/tools/grunt
[copy] Copying 2 files to /Users/davidlaxer/pig-0.13.0/build/classes/python
[copy] Copying 2 files to /Users/davidlaxer/pig-0.13.0/build/classes/META-INF

ivy-buildJar:
[ivy:retrieve] :: resolving dependencies :: org.apache.pig#pig;0.13.1-SNAPSHOT
[ivy:retrieve] confs: [buildJar]
[ivy:retrieve] found com.sun.jersey#jersey-core;1.8 in fs
[ivy:retrieve] found org.apache.hadoop#hadoop-core;1.0.4 in default
[ivy:retrieve] found commons-cli#commons-cli;1.2 in default
[ivy:retrieve] found xmlenc#xmlenc;0.52 in fs
[ivy:retrieve] found commons-httpclient#commons-httpclient;3.0.1 in fs
[ivy:retrieve] found commons-codec#commons-codec;1.4 in default
[ivy:retrieve] found org.apache.commons#commons-math;2.1 in fs
[ivy:retrieve] found commons-configuration#commons-configuration;1.6 in fs
[ivy:retrieve] found commons-collections#commons-collections;3.2.1 in default
[ivy:retrieve] found commons-lang#commons-lang;2.4 in default
[ivy:retrieve] found commons-logging#commons-logging;1.1.1 in default
[ivy:retrieve] found commons-digester#commons-digester;1.8 in default
[ivy:retrieve] found commons-beanutils#commons-beanutils;1.7.0 in default
[ivy:retrieve] found commons-beanutils#commons-beanutils-core;1.8.0 in fs
[ivy:retrieve] found commons-net#commons-net;1.4.1 in fs
[ivy:retrieve] found oro#oro;2.0.8 in default
[ivy:retrieve] found org.mortbay.jetty#jetty;6.1.26 in default
[ivy:retrieve] found org.mortbay.jetty#jetty-util;6.1.26 in default
[ivy:retrieve] found tomcat#jasper-runtime;5.5.12 in fs
[ivy:retrieve] found tomcat#jasper-compiler;5.5.12 in fs
[ivy:retrieve] found org.mortbay.jetty#jsp-api-2.1;6.1.14 in fs
[ivy:retrieve] found org.mortbay.jetty#servlet-api-2.5;6.1.14 in fs
[ivy:retrieve] found org.mortbay.jetty#jsp-2.1;6.1.14 in fs
[ivy:retrieve] found org.eclipse.jdt#core;3.1.1 in fs
[ivy:retrieve] found ant#ant;1.6.5 in fs
[ivy:retrieve] found commons-el#commons-el;1.0 in fs
[ivy:retrieve] found net.java.dev.jets3t#jets3t;0.7.1 in fs
[ivy:retrieve] found net.sf.kosmosfs#kfs;0.3 in fs
[ivy:retrieve] found hsqldb#hsqldb;1.8.0.10 in fs
[ivy:retrieve] found org.apache.hadoop#hadoop-test;1.0.4 in maven2
[ivy:retrieve] found org.apache.ftpserver#ftplet-api;1.0.0 in fs
[ivy:retrieve] found org.apache.mina#mina-core;2.0.0-M5 in fs
[ivy:retrieve] found org.slf4j#slf4j-api;1.5.2 in fs
[ivy:retrieve] found org.apache.ftpserver#ftpserver-core;1.0.0 in fs
[ivy:retrieve] found org.apache.ftpserver#ftpserver-deprecated;1.0.0-M2 in fs
[ivy:retrieve] found org.apache.hbase#hbase;0.94.1 in maven2
[ivy:retrieve] found commons-io#commons-io;2.3 in default
[ivy:retrieve] found org.apache.httpcomponents#httpclient;4.1 in maven2
[ivy:retrieve] found org.apache.httpcomponents#httpcore;4.1 in maven2
[ivy:retrieve] found log4j#log4j;1.2.16 in fs
[ivy:retrieve] found org.slf4j#slf4j-log4j12;1.6.1 in maven2
[ivy:retrieve] found org.apache.avro#avro;1.7.5 in default
[ivy:retrieve] found com.thoughtworks.paranamer#paranamer;2.3 in fs
[ivy:retrieve] found org.xerial.snappy#snappy-java;1.0.5 in fs
[ivy:retrieve] found org.apache.commons#commons-compress;1.4.1 in fs
[ivy:retrieve] found org.tukaani#xz;1.0 in fs
[ivy:retrieve] found org.slf4j#slf4j-api;1.6.4 in fs
[ivy:retrieve] found org.apache.avro#avro-mapred;1.7.5 in maven2
[ivy:retrieve] found org.apache.avro#avro-ipc;1.7.5 in maven2
[ivy:retrieve] found io.netty#netty;3.4.0.Final in fs
[ivy:retrieve] found org.apache.velocity#velocity;1.7 in default
[ivy:retrieve] found org.mortbay.jetty#servlet-api;2.5-20081211 in fs
[ivy:retrieve] found org.apache.avro#trevni-core;1.7.5 in maven2
[ivy:retrieve] found org.apache.avro#trevni-avro;1.7.5 in maven2
[ivy:retrieve] found org.xerial.snappy#snappy-java;1.1.0.1 in maven2
[ivy:retrieve] found com.googlecode.json-simple#json-simple;1.1 in fs
[ivy:retrieve] found jline#jline;1.0 in default
[ivy:retrieve] found net.java.dev.javacc#javacc;4.2 in maven2
[ivy:retrieve] found org.codehaus.groovy#groovy-all;1.8.6 in maven2
[ivy:retrieve] found org.codehaus.jackson#jackson-mapper-asl;1.8.8 in fs
[ivy:retrieve] found org.codehaus.jackson#jackson-core-asl;1.8.8 in fs
[ivy:retrieve] found org.fusesource.jansi#jansi;1.9 in maven2
[ivy:retrieve] found joda-time#joda-time;2.1 in maven2
[ivy:retrieve] found com.google.guava#guava;11.0 in maven2
[ivy:retrieve] found org.python#jython-standalone;2.5.3 in maven2
[ivy:retrieve] found rhino#js;1.7R2 in maven2
[ivy:retrieve] found org.antlr#antlr;3.4 in default
[ivy:retrieve] found org.antlr#antlr-runtime;3.4 in default
[ivy:retrieve] found org.antlr#stringtemplate;3.2.1 in default
[ivy:retrieve] found antlr#antlr;2.7.7 in default
[ivy:retrieve] found org.antlr#ST4;4.0.4 in default
[ivy:retrieve] found org.apache.zookeeper#zookeeper;3.4.5 in fs
[ivy:retrieve] found dk.brics.automaton#automaton;1.11-8 in maven2
[ivy:retrieve] found org.jruby#jruby-complete;1.6.7 in maven2
[ivy:retrieve] found asm#asm;3.3.1 in fs
[ivy:retrieve] found org.apache.accumulo#accumulo-core;1.5.0 in maven2
[ivy:retrieve] found com.beust#jcommander;1.30 in maven2
[ivy:retrieve] found org.apache.accumulo#accumulo-fate;1.5.0 in maven2
[ivy:retrieve] found org.apache.accumulo#accumulo-start;1.5.0 in maven2
[ivy:retrieve] found org.apache.commons#commons-vfs2;2.0 in maven2
[ivy:retrieve] found org.apache.maven.scm#maven-scm-api;1.4 in fs
[ivy:retrieve] found org.codehaus.plexus#plexus-utils;1.5.6 in fs
[ivy:retrieve] found org.apache.maven.scm#maven-scm-provider-svnexe;1.4 in fs
[ivy:retrieve] found org.apache.maven.scm#maven-scm-provider-svn-commons;1.4 in fs
[ivy:retrieve] found regexp#regexp;1.3 in fs
[ivy:retrieve] found org.apache.accumulo#accumulo-trace;1.5.0 in maven2
[ivy:retrieve] found org.apache.thrift#libthrift;0.9.0 in default
[ivy:retrieve] found org.apache.httpcomponents#httpclient;4.1.3 in default
[ivy:retrieve] found org.apache.httpcomponents#httpcore;4.1.3 in fs
[ivy:retrieve] found org.apache.accumulo#accumulo-minicluster;1.5.0 in maven2
[ivy:retrieve] found org.apache.accumulo#accumulo-server;1.5.0 in maven2
[ivy:retrieve] found com.google.code.gson#gson;2.2.2 in maven2
[ivy:retrieve] found org.vafer#jdeb;0.8 in maven2
[ivy:retrieve] found org.mockito#mockito-all;1.8.4 in maven2
[ivy:retrieve] found com.twitter#parquet-pig-bundle;1.2.3 in maven2
[ivy:retrieve] found org.apache.avro#avro-tools;1.7.5 in maven2
[ivy:retrieve] found net.sf.jopt-simple#jopt-simple;4.1 in fs
[ivy:retrieve] found xalan#xalan;2.7.1 in maven2
[ivy:retrieve] found xalan#serializer;2.7.1 in maven2
[ivy:retrieve] found xml-apis#xml-apis;1.3.04 in fs
[ivy:retrieve] found xerces#xercesImpl;2.10.0 in maven2
[ivy:retrieve] found xml-apis#xml-apis;1.4.01 in maven2
[ivy:retrieve] found junit#junit;4.11 in fs
[ivy:retrieve] found org.hamcrest#hamcrest-core;1.3 in fs
[ivy:retrieve] found org.jboss.netty#netty;3.2.2.Final in fs
[ivy:retrieve] found com.github.stephenc.high-scale-lib#high-scale-lib;1.1.1 in fs
[ivy:retrieve] found com.google.protobuf#protobuf-java;2.4.0a in fs
[ivy:retrieve] found com.yammer.metrics#metrics-core;2.1.2 in fs
[ivy:retrieve] found org.apache.hive#hive-exec;0.8.0 in fs
[ivy:retrieve] :: resolution report :: resolve 13898ms :: artifacts dl 232ms
[ivy:retrieve] :: evicted modules:
[ivy:retrieve] junit#junit;3.8.1 by [junit#junit;4.11] in [buildJar]
[ivy:retrieve] commons-logging#commons-logging;1.0.3 by [commons-logging#commons-logging;1.1.1] in [buildJar]
[ivy:retrieve] commons-codec#commons-codec;1.2 by [commons-codec#commons-codec;1.4] in [buildJar]
[ivy:retrieve] commons-logging#commons-logging;1.1 by [commons-logging#commons-logging;1.1.1] in [buildJar]
[ivy:retrieve] commons-codec#commons-codec;1.3 by [commons-codec#commons-codec;1.4] in [buildJar]
[ivy:retrieve] commons-httpclient#commons-httpclient;3.1 by [commons-httpclient#commons-httpclient;3.0.1] in [buildJar]
[ivy:retrieve] org.codehaus.jackson#jackson-mapper-asl;1.0.1 by [org.codehaus.jackson#jackson-mapper-asl;1.8.8] in [buildJar]
[ivy:retrieve] org.slf4j#slf4j-api;1.5.2 by [org.slf4j#slf4j-api;1.6.4] in [buildJar]
[ivy:retrieve] org.apache.mina#mina-core;2.0.0-M4 by [org.apache.mina#mina-core;2.0.0-M5] in [buildJar]
[ivy:retrieve] org.apache.ftpserver#ftplet-api;1.0.0-M2 by [org.apache.ftpserver#ftplet-api;1.0.0] in [buildJar]
[ivy:retrieve] org.apache.ftpserver#ftpserver-core;1.0.0-M2 by [org.apache.ftpserver#ftpserver-core;1.0.0] in [buildJar]
[ivy:retrieve] org.apache.mina#mina-core;2.0.0-M2 by [org.apache.mina#mina-core;2.0.0-M5] in [buildJar]
[ivy:retrieve] org.apache.httpcomponents#httpclient;4.1 by [org.apache.httpcomponents#httpclient;4.1.3] in [buildJar]
[ivy:retrieve] org.apache.httpcomponents#httpcore;4.1 by [org.apache.httpcomponents#httpcore;4.1.3] in [buildJar]
[ivy:retrieve] commons-cli#commons-cli;1.0 by [commons-cli#commons-cli;1.2] in [buildJar]
[ivy:retrieve] org.xerial.snappy#snappy-java;1.0.5 by [org.xerial.snappy#snappy-java;1.1.0.1] in [buildJar]
[ivy:retrieve] org.antlr#antlr-runtime;3.3 by [org.antlr#antlr-runtime;3.4] in [buildJar]
[ivy:retrieve] org.apache.httpcomponents#httpcore;4.1.4 by [org.apache.httpcomponents#httpcore;4.1.3] in [buildJar]
[ivy:retrieve] xml-apis#xml-apis;1.3.04 by [xml-apis#xml-apis;1.4.01] in [buildJar]
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| buildJar | 123 | 63 | 2 | 19 || 107 | 0 |
---------------------------------------------------------------------
[ivy:retrieve] :: retrieving :: org.apache.pig#pig
[ivy:retrieve] confs: [buildJar]
[ivy:retrieve] 14 artifacts copied, 93 already retrieved (10371kB/493ms)

jar:
[echo] svnString Unversioned directory
[jar] Building jar: /Users/davidlaxer/pig-0.13.0/build/pig-0.13.1-SNAPSHOT.jar
[echo] svnString Unversioned directory
[jar] Building jar: /Users/davidlaxer/pig-0.13.0/build/pig-0.13.1-SNAPSHOT-withdependencies.jar
[jar] META-INF/DEPENDENCIES already added, skipping
[jar] META-INF/LICENSE already added, skipping
[jar] META-INF/NOTICE already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] org/apache/commons/beanutils/BasicDynaBean.class already added, skipping
[jar] org/apache/commons/beanutils/BasicDynaClass.class already added, skipping
[jar] org/apache/commons/beanutils/BeanAccessLanguageException.class already added, skipping
[jar] org/apache/commons/beanutils/BeanUtils.class already added, skipping
[jar] org/apache/commons/beanutils/BeanUtilsBean$1.class already added, skipping
[jar] org/apache/commons/beanutils/BeanUtilsBean.class already added, skipping
[jar] org/apache/commons/beanutils/ConstructorUtils.class already added, skipping
[jar] org/apache/commons/beanutils/ContextClassLoaderLocal.class already added, skipping
[jar] org/apache/commons/beanutils/ConversionException.class already added, skipping
[jar] org/apache/commons/beanutils/ConvertUtils.class already added, skipping
[jar] org/apache/commons/beanutils/ConvertUtilsBean.class already added, skipping
[jar] org/apache/commons/beanutils/Converter.class already added, skipping
[jar] org/apache/commons/beanutils/ConvertingWrapDynaBean.class already added, skipping
[jar] org/apache/commons/beanutils/DynaBean.class already added, skipping
[jar] org/apache/commons/beanutils/DynaClass.class already added, skipping
[jar] org/apache/commons/beanutils/DynaProperty.class already added, skipping
[jar] org/apache/commons/beanutils/JDBCDynaClass.class already added, skipping
[jar] org/apache/commons/beanutils/LazyDynaBean.class already added, skipping
[jar] org/apache/commons/beanutils/LazyDynaClass.class already added, skipping
[jar] org/apache/commons/beanutils/LazyDynaMap.class already added, skipping
[jar] org/apache/commons/beanutils/MappedPropertyDescriptor.class already added, skipping
[jar] org/apache/commons/beanutils/MethodUtils$MethodDescriptor.class already added, skipping
[jar] org/apache/commons/beanutils/MethodUtils.class already added, skipping
[jar] org/apache/commons/beanutils/MutableDynaClass.class already added, skipping
[jar] org/apache/commons/beanutils/NestedNullException.class already added, skipping
[jar] org/apache/commons/beanutils/PropertyUtils.class already added, skipping
[jar] org/apache/commons/beanutils/PropertyUtilsBean.class already added, skipping
[jar] org/apache/commons/beanutils/ResultSetDynaClass.class already added, skipping
[jar] org/apache/commons/beanutils/ResultSetIterator.class already added, skipping
[jar] org/apache/commons/beanutils/RowSetDynaClass.class already added, skipping
[jar] org/apache/commons/beanutils/WrapDynaBean.class already added, skipping
[jar] org/apache/commons/beanutils/WrapDynaClass.class already added, skipping
[jar] org/apache/commons/beanutils/converters/AbstractArrayConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/BigDecimalConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/BigIntegerConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/BooleanArrayConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/BooleanConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/ByteArrayConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/ByteConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/CharacterArrayConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/CharacterConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/ClassConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/DoubleArrayConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/DoubleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/FileConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/FloatArrayConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/FloatConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/IntegerArrayConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/IntegerConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/LongArrayConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/LongConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/ShortArrayConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/ShortConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/SqlDateConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/SqlTimeConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/SqlTimestampConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/StringArrayConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/StringConverter.class already added, skipping
[jar] org/apache/commons/beanutils/converters/URLConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/BaseLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/LocaleBeanUtils$Descriptor.class already added, skipping
[jar] org/apache/commons/beanutils/locale/LocaleBeanUtils.class already added, skipping
[jar] org/apache/commons/beanutils/locale/LocaleBeanUtilsBean$1.class already added, skipping
[jar] org/apache/commons/beanutils/locale/LocaleBeanUtilsBean$Descriptor.class already added, skipping
[jar] org/apache/commons/beanutils/locale/LocaleBeanUtilsBean.class already added, skipping
[jar] org/apache/commons/beanutils/locale/LocaleConvertUtils.class already added, skipping
[jar] org/apache/commons/beanutils/locale/LocaleConvertUtilsBean.class already added, skipping
[jar] org/apache/commons/beanutils/locale/LocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/BigDecimalLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/BigIntegerLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/ByteLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/DateLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/DecimalLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/DoubleLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/FloatLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/IntegerLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/LongLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/ShortLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/SqlDateLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/SqlTimeLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/SqlTimestampLocaleConverter.class already added, skipping
[jar] org/apache/commons/beanutils/locale/converters/StringLocaleConverter.class already added, skipping
[jar] org/apache/commons/collections/ArrayStack.class already added, skipping
[jar] org/apache/commons/collections/Buffer.class already added, skipping
[jar] org/apache/commons/collections/BufferUnderflowException.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap$1.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap$CollectionView$CollectionViewIterator.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap$CollectionView.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap$EntrySet.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap$KeySet.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap$Values.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap.class already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] org/apache/commons/collections/ArrayStack.class already added, skipping
[jar] org/apache/commons/collections/Buffer.class already added, skipping
[jar] org/apache/commons/collections/BufferUnderflowException.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap$1.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap$CollectionView$CollectionViewIterator.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap$CollectionView.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap$EntrySet.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap$KeySet.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap$Values.class already added, skipping
[jar] org/apache/commons/collections/FastHashMap.class already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] META-INF/LICENSE already added, skipping
[jar] META-INF/NOTICE already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] META-INF/LICENSE already added, skipping
[jar] META-INF/NOTICE already added, skipping
[jar] META-INF/ASL2.0 already added, skipping
[jar] META-INF/LICENSE already added, skipping
[jar] META-INF/NOTICE already added, skipping
[jar] META-INF/LICENSE.txt already added, skipping
[jar] META-INF/NOTICE.txt already added, skipping
[jar] META-INF/LICENSE already added, skipping
[jar] META-INF/NOTICE already added, skipping
[jar] META-INF/DEPENDENCIES already added, skipping
[jar] META-INF/LICENSE already added, skipping
[jar] META-INF/NOTICE already added, skipping
[jar] META-INF/DEPENDENCIES already added, skipping
[jar] META-INF/LICENSE already added, skipping
[jar] META-INF/NOTICE already added, skipping

copyHadoop1:
[copy] Copying 1 file to /Users/davidlaxer/pig-0.13.0

copyHadoop2:

jar-withouthadoop:
[echo] svnString Unversioned directory
[echo] svnString Unversioned directory
[jar] Building jar: /Users/davidlaxer/pig-0.13.0/build/pig-0.13.1-SNAPSHOT-withouthadoop.jar
[jar] META-INF/DEPENDENCIES already added, skipping
[jar] META-INF/LICENSE already added, skipping
[jar] META-INF/NOTICE already added, skipping
[jar] META-INF/LICENSE already added, skipping
[jar] META-INF/NOTICE already added, skipping
[jar] META-INF/ASL2.0 already added, skipping
[jar] META-INF/LICENSE already added, skipping
[jar] META-INF/NOTICE already added, skipping
[jar] META-INF/DEPENDENCIES already added, skipping
[jar] META-INF/LICENSE already added, skipping
[jar] META-INF/NOTICE already added, skipping
[jar] META-INF/DEPENDENCIES already added, skipping
[jar] META-INF/LICENSE already added, skipping
[jar] META-INF/NOTICE already added, skipping

copyHadoop1:
[copy] Copying 1 file to /Users/davidlaxer/pig-0.13.0

copyHadoop2:

jar-all:

BUILD SUCCESSFUL
Total time: 3 minutes 6 seconds
(virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$ env | grep HADOOP
HADOOP_HOME=/users/davidlaxer/hadoop-2.3.0-src
HADOOP_CONF_DIR=/users/davidlaxer/hadoop-2.3.0-src/src/conf
(virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$ export PIG_CLASSPATH=/users/davidlaxer/hadoop-2.3.0-src/src/conf
(virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$ bin/pig
14/10/09 11:43:26 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
14/10/09 11:43:26 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE
14/10/09 11:43:26 INFO pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType
2014-10-09 11:43:27,477 [main] INFO org.apache.pig.Main - Apache Pig version 0.13.0 (r1606446) compiled Jun 29 2014, 02:27:58
2014-10-09 11:43:27,478 [main] INFO org.apache.pig.Main - Logging error messages to: /Users/davidlaxer/pig-0.13.0/pig_1412873007475.log
2014-10-09 11:43:27,737 [main] ERROR org.apache.pig.Main - ERROR 2998: Unhandled internal error. org/apache/commons/io/input/ClassLoaderObjectInputStream
Details at logfile: /Users/davidlaxer/pig-0.13.0/pig_1412873007475.log
(virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$

On Oct 9, 2014, at 11:07 AM, David Laxer [email protected] wrote:

The requirements for the virtual environment finally completed:

(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ sudo port install snappy
Password:
---> Computing dependencies for snappy
---> Cleaning snappy
---> Scanning binaries for linking errors
---> No broken files found.
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ sudo port install python-snappy
Error: Port python-snappy not found
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ pip install python-snappy
Requirement already satisfied (use --upgrade to upgrade): python-snappy in /Users/davidlaxer/anaconda/lib/python2.7/site-packages
Cleaning up...
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ pwd
/users/davidlaxer/hadoop-2.3.0-src
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ dirs
/users/davidlaxer/hadoop-2.3.0-src ~/Agile_Data_Code/ch03/pig
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ pushd ~/Agile_Data_Code/
~/Agile_Data_Code /users/davidlaxer/hadoop-2.3.0-src ~/Agile_Data_Code/ch03/pig
(virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ history | grep pip
146 pip install -r python/requirements.txt
175 pip install --upgrade --no-deps git+git://github.com/Theano/Theano.git
441 pip freeze
442 sudo pip install virtualenv
448 sudo pip install virtualenv
451 pip install graphlab-create==0.9.1
502 pip install virtualenv
508 pip install -r requirements.txt
509 pip install snappy
510 pip install python-snappy
512 pip install python-snappy
513 pip install -r requirements.txt
514 pip install -r requirements.txt
529 pip install python-snappy
551 pip install python-snappy
555 history | grep pip
(virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ sudo !513
sudo pip install -r requirements.txt
Requirement already satisfied (use --upgrade to upgrade): BareNecessities==0.2.8 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 1))
Requirement already satisfied (use --upgrade to upgrade): ESClient==0.5.3 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 2))
Requirement already satisfied (use --upgrade to upgrade): Flask==0.9 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 3))
Requirement already satisfied (use --upgrade to upgrade): Jinja2==2.6 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 4))
Requirement already satisfied (use --upgrade to upgrade): LEPL==5.1.3 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 5))
Requirement already satisfied (use --upgrade to upgrade): Mail==2.1.0 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 6))
Requirement already satisfied (use --upgrade to upgrade): Werkzeug==0.8.3 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 7))
Requirement already satisfied (use --upgrade to upgrade): distribute==0.6.31 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 8))
Requirement already satisfied (use --upgrade to upgrade): python-snappy in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 9))
Requirement already satisfied (use --upgrade to upgrade): avro==1.7.3 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 10))
Obtaining pyelasticsearch from git+https://github.com/rhec/pyelasticsearch.git#egg=pyelasticsearch (from -r requirements.txt (line 11))
Updating ./src/pyelasticsearch clone
Running setup.py (path:/Users/davidlaxer/Agile_Data_Code/src/pyelasticsearch/setup.py) egg_info for package pyelasticsearch

Installing extra requirements: 'egg'
Requirement already satisfied (use --upgrade to upgrade): pymongo==2.4.1 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 12))
Downloading/unpacking requests==1.0.4 (from -r requirements.txt (line 13))
Downloading requests-1.0.4.tar.gz (336kB): 336kB downloaded
Running setup.py (path:/private/tmp/pip_build_root/requests/setup.py) egg_info for package requests

Requirement already satisfied (use --upgrade to upgrade): simplejson==2.6.2 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): wsgiref==0.1.2 in /Users/davidlaxer/anaconda/lib/python2.7 (from -r requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): numpy in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): honcho in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 17))
Requirement already satisfied (use --upgrade to upgrade): scipy in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): dotcloud in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): python-dateutil in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): nltk in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): six in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from pyelasticsearch->-r requirements.txt (line 11))
Requirement already satisfied (use --upgrade to upgrade): argparse in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from dotcloud->-r requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): colorama in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from dotcloud->-r requirements.txt (line 19))
Installing collected packages: pyelasticsearch, requests
Running setup.py develop for pyelasticsearch

Creating /Users/davidlaxer/anaconda/lib/python2.7/site-packages/pyelasticsearch.egg-link (link to .)
pyelasticsearch 0.6.1 is already the active version in easy-install.pth

Installed /Users/davidlaxer/Agile_Data_Code/src/pyelasticsearch

Found existing installation: requests 2.3.0
Uninstalling requests:
Successfully uninstalled requests
Running setup.py install for requests

Successfully installed pyelasticsearch requests
Cleaning up...
(virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ pig
Cannot locate pig-core-h2.jar. do 'ant -Dhadoopversion=23 jar', and try again
(virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ sudo pip install avro
Requirement already satisfied (use --upgrade to upgrade): avro in /Users/davidlaxer/anaconda/lib/python2.7/site-packages
Cleaning up...
(virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$

On Oct 9, 2014, at 7:29 AM, David Laxer [email protected] wrote:

David-Laxers-MacBook-Pro:~ davidlaxer$ env | grep HADOOP
HADOOP_HOME=/users/davidlaxer/hadoop-2.3.0-src
HADOOP_CONF_DIR=/users/davidlaxer/hadoop-2.3.0-src/src/conf

On Oct 9, 2014, at 1:37 AM, David Laxer [email protected] wrote:

David-Laxers-MacBook-Pro:~ davidlaxer$ !e
echo $PATH
/opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/opt/X11/bin:/usr/local/CrossPack-AVR/bin:/usr/local/git/bin:/usr/texbin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin::/bin:/sbin:/Users/davidlaxer/.rvm/bin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin:/Users/davidlaxer/Downloads/apache-maven-3.2.1/bin::/bin:/sbin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/usr/local/mysql/bin:/Users/davidlaxer/pig/trunk/bin:
David-Laxers-MacBook-Pro:~ davidlaxer$ pig
Cannot locate pig-core-h2.jar. do 'ant -Dhadoopversion=23 jar', and try again
David-Laxers-MacBook-Pro:~ davidlaxer$ which pig
/usr/local/bin/pig
David-Laxers-MacBook-Pro:~ davidlaxer$ ls -l /usr/local/bin/pig
lrwxr-xr-x 1 root wheel 35 Oct 8 21:29 /usr/local/bin/pig -> /Users/davidlaxer/pig/trunk/bin/pig
David-Laxers-MacBook-Pro:~ davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -help

Apache Pig version 0.14.0-SNAPSHOT (r1630244)
compiled Oct 08 2014, 21:36:18

USAGE: Pig [options] [-] : Run interactively in grunt shell.
Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s).
Pig [options] [-f[ile]] file : Run cmds found in file.
options include:
-4, -log4jconf - Log4j configuration file, overrides log conf
-b, -brief - Brief logging (no timestamps)
-c, -check - Syntax check
-d, -debug - Debug level, INFO is default
-e, -execute - Commands to execute (within quotes)
-f, -file - Path to the script to execute
-g, -embedded - ScriptEngine classname or keyword for the ScriptEngine
-h, -help - Display this message. You can specify topic to get help for that topic.
properties is the only topic currently supported: -h properties.
-i, -version - Display version information
-l, -logfile - Path to client side log file; default is current working directory.
-m, -param_file - Path to the parameter file
-p, -param - Key value pair of the form param=val
-r, -dryrun - Produces script with substituted parameters. Script is not executed.
-t, -optimizer_off - Turn optimizations off. The following values are supported:
ConstantCalculator - Calculate constants at compile time
SplitFilter - Split filter conditions
PushUpFilter - Filter as early as possible
MergeFilter - Merge filter conditions
PushDownForeachFlatten - Join or explode as late as possible
LimitOptimizer - Limit as early as possible
ColumnMapKeyPrune - Remove unused data
AddForEach - Add ForEach to remove unneeded columns
MergeForEach - Merge adjacent ForEach
GroupByConstParallelSetter - Force parallel 1 for "group all" statement
PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData
PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown
All - Disable all optimizations
All optimizations listed here are enabled by default. Optimization values are case insensitive.
-v, -verbose - Print all error messages to screen
-w, -warning - Turn warning logging on; also turns warning aggregation off
-x, -exectype - Set execution mode: local|mapreduce, default is mapreduce.
-F, -stop_on_failure - Aborts execution on the first failed job; default is off
-M, -no_multiquery - Turn multiquery optimization off; default is on
-N, -no_fetch - Turn fetch optimization off; default is on
-P, -propertyFile - Path to property file
-printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including
any environment variables that are set by the pig command.
14/10/09 01:36:52 INFO pig.Main: Pig script completed in 327 milliseconds (327 ms)
David-Laxers-MacBook-Pro:~ davidlaxer$

On Oct 8, 2014, at 9:58 PM, David Laxer [email protected] wrote:

I downloaded pig 14 source and built it:

$ svn co http://svn.apache.org/repos/asf/pig/trunk
$ ant
$ cd contrib/piggybank/java
$ ant
$ ./pig -help

Apache Pig version 0.14.0-SNAPSHOT (r1630244)
compiled Oct 08 2014, 21:36:18

USAGE: Pig [options] [-] : Run interactively in grunt shell.
Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s).
Pig [options] [-f[ile]] file : Run cmds found in file.
options include:
-4, -log4jconf - Log4j configuration file, overrides log conf
-b, -brief - Brief logging (no timestamps)
-c, -check - Syntax check
-d, -debug - Debug level, INFO is default
-e, -execute - Commands to execute (within quotes)
-f, -file - Path to the script to execute
-g, -embedded - ScriptEngine classname or keyword for the ScriptEngine
-h, -help - Display this message. You can specify topic to get help for that topic.
properties is the only topic currently supported: -h properties.
-i, -version - Display version information
-l, -logfile - Path to client side log file; default is current working directory.
-m, -param_file - Path to the parameter file
-p, -param - Key value pair of the form param=val
-r, -dryrun - Produces script with substituted parameters. Script is not executed.
-t, -optimizer_off - Turn optimizations off. The following values are supported:
ConstantCalculator - Calculate constants at compile time
SplitFilter - Split filter conditions
PushUpFilter - Filter as early as possible
MergeFilter - Merge filter conditions
PushDownForeachFlatten - Join or explode as late as possible
LimitOptimizer - Limit as early as possible
ColumnMapKeyPrune - Remove unused data
AddForEach - Add ForEach to remove unneeded columns
MergeForEach - Merge adjacent ForEach
GroupByConstParallelSetter - Force parallel 1 for "group all" statement
PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData
PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown
All - Disable all optimizations
All optimizations listed here are enabled by default. Optimization values are case insensitive.
-v, -verbose - Print all error messages to screen
-w, -warning - Turn warning logging on; also turns warning aggregation off
-x, -exectype - Set execution mode: local|mapreduce, default is mapreduce.
-F, -stop_on_failure - Aborts execution on the first failed job; default is off
-M, -no_multiquery - Turn multiquery optimization off; default is on
-N, -no_fetch - Turn fetch optimization off; default is on
-P, -propertyFile - Path to property file
-printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including
any environment variables that are set by the pig command.
14/10/08 21:58:08 INFO pig.Main: Pig script completed in 148 milliseconds (148 ms)

(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -l /tmp -x local -v -w sent_counts.pig
14/10/08 21:48:53 INFO security.Groups: Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=300000
14/10/08 21:48:53 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
14/10/08 21:48:53 INFO pig.ExecTypeProvider: Picked LOCAL as the ExecType
2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08 2014, 21:36:18
2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Logging error messages to: /private/tmp/pig_1412822933095.log
2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - ERROR 2998: Unhandled internal error. org/apache/commons/io/input/ClassLoaderObjectInputStream
2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - java.lang.NoClassDefFoundError: org/apache/commons/io/input/ClassLoaderObjectInputStream
at org.apache.pig.Main.run(Main.java:414)
at org.apache.pig.Main.main(Main.java:170)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:192)
Caused by: java.lang.ClassNotFoundException: org.apache.commons.io.input.ClassLoaderObjectInputStream
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
... 7 more

Details also at logfile: /private/tmp/pig_1412822933095.log
2014-10-08 21:48:53,328 [main] INFO org.apache.pig.Main - Pig script completed in 297 milliseconds (297 ms)
(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ vi /private/tmp/pig_1412822933095.log

On Oct 8, 2014, at 3:56 PM, Russell Jurney [email protected] wrote:

Try downloading Pig 12 or 13 and report back.


Reply to this email directly or view it on GitHub.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants