Hadoop Training Content

Technowings Pune | Hadoop Command | Hadoop Big Data | Latest Hadoop Project | BE Hadoop Tutorial | Hadoop Tutorials | Hadoop Commands Tutorial | Hadoop Architecture



Hadoop Architecture

Hadoop Framework includes Four Modules

  1. Hadoop Common :
  2. Hadoop Common it contains the Java libraries and Utilities that require by the other Hadoop module.
    These libraries have the necessary file and scripts require for starting Hadoop.
    It provide the OS level abstraction and file system.

  3. Hadoop Yarn :
  4. Yarn framework provides the facility for job scheduling and cluster resource management.

  5. Hadoop Distributed File System (HDFS) :
  6. This is the java based file system provides reliable, fault-tolerant and scalable distributed data storage system.
    It also provides high throughput access to application data.

  7. Hadoop MapReduce :
  8. It is a Yarn based software framework for writing the applications which process Big Data on large number of cluster.



MapReduce Working







Hadoop Commands


Command
1 Create Folder in Hadoop File System
hdfs dfs -mkdir /input
2 List all files of HDFS
hdfs dfs -ls /
3 Delete Folders from HDFS
hdfs dfs -rmdir /input
4 Delete Files from HDFS
hdfs dfs -rm /input
5 Lists all HDFS files & folder
hdfs dfs -ls -R /
Option -R is for Recursion
6 Inserting Files_DATA in HDFS
hdfs dfs -put HadoopWorkshop/Data/demo.txt /input/
7 Inserting Folder_DATA in HDFS
hdfs dfs -put HadoopWorkshop/Data/shakespeare/ /input/
Source_Folder = shakespeare
Destination_Folder = input
8 Delete Folder with content
hdfs dfs -rm -R /input
9 View the File content
hdfs dfs -cat /Data/salaries.txt
10 Run Project on Hadoop
hadoop jar /home/mmcoe/WordCount.jar WordDriver /shakespeare/poems /Result
Output_Folder = Result
InputData_Folder= /shakespeare/poems




Technowings Pune | Hadoop Command | Hadoop Big Data | Latest Hadoop Project | BE Hadoop Tutorial | Hadoop Tutorials | Hadoop Commands Tutorial

Call us : 09766750000 / 09860923474
Mail ID : TeamTechnoWings@gmail.com