Skip to content

This project creates a small local Hadoop cluster using Cloudera CDH and CentOS.

License

Notifications You must be signed in to change notification settings

JohnnyFoulds/local-hadoop

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

44 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Local Hadoop Cluster

This project creates a small local Hadoop cluster using Cloudera Manager 6.3.0 on a CentOS 7.6 base.

Server Architecture Diagram

Installation Steps

  1. Create the Base CentOS virtual machine.
  2. Create the Base Manager virtual machine.
  3. Create the Worked Nodes.
  4. Download and Run the Cloudera Manager Server Installer.
  5. Navigate to http://192.168.3.200:7180 and login in with admin, admin.
  6. Follow the installation wizard and use the hadoop-manager.lan, hadoop-worker[01-03].lan pattern when adding hosts.

Pages of Interest

  • vSphere - This shows how the server configuration was done on the physical hardware.
  • vCenter - The vCenter Installation which was a bit finicky at times.
  • PowerCLI - Some helpful reference examples on the essentials of using VMWare PowerCLI.
  • vnc - Well not really, the better alternative to VNC when you are using VMWare.

Web References

About

This project creates a small local Hadoop cluster using Cloudera CDH and CentOS.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published