Skip to content

Commit

Permalink
adding single Node Hadoop doc
Browse files Browse the repository at this point in the history
  • Loading branch information
setrar committed Jan 12, 2015
1 parent a2a4533 commit 2b208a5
Showing 1 changed file with 14 additions and 13 deletions.
27 changes: 14 additions & 13 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,58 +25,59 @@ To run the install:

> bootstrap/install.sh
HDFS_HOME=~/bin/local/bigdata/hadoop
Set the Hadoop Home
> HDFS_HOME=~/bin/local/bigdata/hadoop
### NameNode Daemons
Starting the services

$ $HDFS_HOME/sbin/start-dfs.sh
> $HDFS_HOME/sbin/start-dfs.sh
Note: On MacOS, make sure SSH is started. Control Panel/Sharing/Remote Login [ON]

Checking Services are running

$ jps
> jps
13049 NameNode (HDFS Name Node) -- Make sure this is running
13241 DataNode (HDFS Data Node)
22752 ResourceManager (Yarn Resource)
22894 NodeManager (Yarn Node)
13049 NameNode (HDFS Name Node) -- Make sure this is running<br>
13241 DataNode (HDFS Data Node)<br>
22752 ResourceManager (Yarn Resource)<br>
22894 NodeManager (Yarn Node)<br>

---

Monitoring DFS Health

Browsing the File System's health

http://fvisqa-lnx:50070
http://localhost:50070


Yarn Daemons
Start ResourceManager daemon and NodeManager daemon:

$ $HDFS_HOME/sbin/start-yarn.sh
> $HDFS_HOME/sbin/start-yarn.sh
When you're done, stop the daemons with:

$ $HDFS_HOME/sbin/stop-yarn.sh
> $HDFS_HOME/sbin/stop-yarn.sh
Monitoring Resource Manager

If you want to look at the running jobs or already executed (Jobwatch Equivalent)

http://fvisqa-lnx:8088
http://localhost:8088
Hadoop Distributed File System (Hadoop DFS) handling
Create and Mount a new Hadoop DFS

$ hdfs namenode -format
> hdfs namenode -format

Create a directory in Hadoop DFS

Create the user directory along with the owner directory

$ hdfs dfs -mkdir -p /user/${USER}
> hdfs dfs -mkdir -p /user/${USER}
## License

Expand Down

0 comments on commit 2b208a5

Please sign in to comment.