Big Data and Hadoop Research lab is designed to provide knowledge and skills to become a successful Hadoop Developer. The following are the details of configuration of the peripherals and licensed software.
| S.NO | System Configuration | Quantity |
|---|---|---|
| 1 | Big data appliance with multicore SDMOS,DB SERVER,WEB SERVER | 01 |
| 2 | Data scientist and web analyst cloud stations | 30 |
| 3 | Network switches-Rack mount | 03 |
| 4 | 12 U rack 19”/1000D , With power panel and side panels | 01 |
| 5 | Data analyst license | 60 |
| 6 | Management station license | 02 |
| 7 | Data synchronization licenses | 60 |
| 8 | Big Data ICCP Licenses | 60 |
| 9 | RDP Licenses | 60 |
Objectives
1. Master the concepts of Hadoop Distributed File System and MapReduce framework
2. Setup a Hadoop Cluster
3. Understand Data Loading Techniques using Sqoop and Flume
4. Program in MapReduce (Both MRv1 and MRv2)
5. Learn to write Complex MapReduce programs
6. Program in YARN (MRv2)
7. Perform Data Analytics using Pig and Hive
8. Implement HBase, MapReduce Integration, Advanced Usage and Advanced Indexing
9. Have a good understanding of ZooKeeper service
10. New features in Hadoop 2.0 -- YARN, HDFS Federation, NameNode High Availability
11. Implement best Practices for Hadoop Development and Debugging
12. Implement a Hadoop Project
13. Work on a Real Life Project on Big Data Analytics and gain Hands on Project Experience