27/08/2017
Courses we offer,
Hadoop Administration – I
1. Introduction to Hadoop
a. Overview of BigData & Hadoop
b. Basic concepts of Hadoop Cluster & Hadoop Ecosystems
c. Popular Hadoop Distributions
d. Introduction to Hortonworks
2. Hadoop Architecture
a. Hadoop Architecture Overview
b. The Hadoop Distributed File System (HDFS)
c. YARN and MapReduce
3. Hadoop Cluster Setup and Installation
a. Cluster Sizing and Planning
b. Rack Awareness and Topology
c. Installation Prerequisites
d. Hadoop Installation
e. Command-line and Browser-based Administration
4. Hadoop Configuration
a. Services Configuration
b. HDFS Configuration
c. YARN and MapReduce Architecture
d. Yarn and MapReduce configuration
i. Fair vs FIFO
5. Hive, Sqoop & Oozie Administration
6. Kafka/Flume administration
7. Spark Administration
a. Spark Applications
b. Spark local and YARN mode
8. NameNode High-Availability (HA) Architecture
9. Decommissioning & Re-commissioning cluster nodes
10. Adding/Removing Cluster Nodes
11. Hadoop Cluster Monitoring
a. Configure email alerts
b. Checking Hadoop logs
Advanced Hadoop Administration - II
1. HDFS Advanced commands
a. ACL’s, FSCK, quotas
b. HDFS balancer & NFS gateway
c. Hdfs dfsadmin command
d. Rack awareness
2. Yarn Capacity scheduler
a. Configuring additional Queues
b. Configure Queue ACL’s
3. Migrating Hadoop components from one node to another node
4. High Availability for Hadoop components
a. Hive, Hbase & Ranger
5. Zookeeper Administration
6. Security
c. Enable Kerberos
d. Run sample jobs using Kerberos
e. Ranger setup
i. Enable Ranger for HDFS, YARN, Hive, Hbase…….
ii. Create security policy from HDFS, YARN, Hive, Hbase…..
f. Knox gateway setup
i. Configure know with SSL certificate
ii. Run sample jobs to access data using Knox gateway
7. Backup & Recovery
a. HDFS Snapshot
b. Using Distcp
c. Hive, Ranger, Ambari DB backup
