Big Data (B.Tech)

Departmental Elective-III: Hadoop ecosystem, MapReduce, HDFS, Spark and NoSQL databases.

6 महीनेअवधि 5Chapters28टॉपिक

अभी पूछताछ करें

सिलेबस · पाठ्यक्रम

Download PDF

01Unit 1: Introduction to Big Data 6 टॉपिक

Types of digital data: structured, semi-structured, unstructured
History and drivers of big data
Big data architecture and the 5 V's
Big data technology components and applications
Security, privacy and ethics
Analysis vs reporting and modern analytic tools

02Unit 2: Hadoop, MapReduce and YARN 6 टॉपिक

History of Hadoop and Apache Hadoop
Analysing data with Unix tools and with Hadoop
Hadoop streaming
MapReduce job run, failures and scheduling
Shuffle and sort, MapReduce types and formats
YARN: ResourceManager, NodeManager, ApplicationMaster

03Unit 3: HDFS and Hadoop Environment 6 टॉपिक

HDFS design and concepts: blocks, NameNode, DataNode
Data replication and rack awareness
Reading and writing files in HDFS
HDFS command line and Java interface
Data ingest with Flume and Sqoop; Hadoop I-O: compression, serialization, Avro
Setting up and administering a Hadoop cluster; Hadoop in the cloud

04Unit 4: Hadoop Ecosystem: Pig, Hive and HBase 5 टॉपिक

Pig: execution modes and Pig Latin
Hive: architecture, HiveQL, tables and partitions
HBase: data model, regions and client API
ZooKeeper basics
Applications on big data using Pig, Hive and HBase

05Unit 5: Spark, Scala and NoSQL 5 टॉपिक

Spark architecture and installation
RDDs, transformations and actions
Jobs, stages and tasks; Spark on YARN
Introduction to Scala
NoSQL databases: MongoDB and Cassandra

परिचय

आप यह कर पाएँगे

Explain the characteristics (V's), types and applications of big data and the challenges of conventional systems
Explain the Hadoop architecture, MapReduce job execution and YARN
Explain HDFS design, blocks, replication and read / write data flow and use HDFS commands
Write simple Pig Latin scripts and HiveQL queries and explain HBase
Explain Spark RDDs, transformations and actions and basic Scala
Compare NoSQL databases such as MongoDB and Cassandra

यह किसके लिए है

B.Tech Computer Science & Engineering students of Semester 6 (AKTU)
Students of other universities studying the same subject who want unit-wise coaching

आपको क्या चाहिए

Database Management System and Java / Python basics
Basic Linux commands

सवाल

Which syllabus does the Big Data course follow?

It follows the AKTU (Dr. A.P.J. Abdul Kalam Technical University, Lucknow) B.Tech syllabus for Big Data. If your own university's syllabus differs, the centre follows your university syllabus.

Will this help in the university examination?

Yes. Teaching is unit-wise as per the AKTU scheme, with previous-year question practice, MCQ tests and doubt sessions before the semester exam.

Will I get hands-on practice with Hadoop?

Yes. A single-node Hadoop / Spark set-up (or a cloud notebook) is used to run HDFS commands, word count and Hive queries.