Skip to content

Commit

Permalink
Removing Spark
Browse files Browse the repository at this point in the history
  • Loading branch information
setrar committed Jan 13, 2015
1 parent 6b7f620 commit aea5143
Show file tree
Hide file tree
Showing 2 changed files with 0 additions and 137 deletions.
60 changes: 0 additions & 60 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,66 +19,6 @@ At the REPL Prompt:
> (let [a (:akka/actor #(println "Received " %))]
(:akka! a "hello")) [Ctrl+Enter]

# this project also uses Apache Spark to match R and Incanter samples

To run the install:

> bootstrap/install.sh
Set the Hadoop Home
> HDFS_HOME=~/bin/local/bigdata/hadoop
### NameNode Daemons
Starting the services

> $HDFS_HOME/sbin/start-dfs.sh
Note: On MacOS, make sure SSH is started. Control Panel/Sharing/Remote Login [ON]

Checking Services are running

> jps
13049 NameNode (HDFS Name Node) -- Make sure this is running<br>
13241 DataNode (HDFS Data Node)<br>
22752 ResourceManager (Yarn Resource)<br>
22894 NodeManager (Yarn Node)<br>

---

Monitoring DFS Health

Browsing the File System's health

http://localhost:50070


Yarn Daemons
Start ResourceManager daemon and NodeManager daemon:

> $HDFS_HOME/sbin/start-yarn.sh
When you're done, stop the daemons with:

> $HDFS_HOME/sbin/stop-yarn.sh
Monitoring Resource Manager

If you want to look at the running jobs or already executed (Jobwatch Equivalent)

http://localhost:8088
Hadoop Distributed File System (Hadoop DFS) handling
Create and Mount a new Hadoop DFS

> hdfs namenode -format

Create a directory in Hadoop DFS

Create the user directory along with the owner directory

> hdfs dfs -mkdir -p /user/${USER}
## License

Copyleft © 2014 EgoOyiri [AfricaCoin]
Expand Down
77 changes: 0 additions & 77 deletions bootstrap/install.sh

This file was deleted.

0 comments on commit aea5143

Please sign in to comment.