Course Objectives: This course enables the students to:
Course Outcomes:
Course outcome (at course level) |
Learning and teaching strategies |
Assessment Strategies |
---|---|---|
CO 136.Describe concepts of Big Data and applications and tools in business domain. CLO 137.Explain Big data tools with their platform and their utility in business analytics. CLO 138.Examine and apply tool/s on big data of business domain. CLO 139.Analyze Big Data using tool/s. CLO 140.Interpret and communicate results of tool/s. |
Approach in teaching: Interactive Lectures, Group Discussion, Tutorials, Case Study
Learning activities for the students: Self-learning assignments, presentations |
Class test, Semester end examinations, Quiz, Assignments, Presentation |
Understanding Big Data
Digital data and its classification, characteristics of data, evolution and definition of big data. Challenges with big data, why big data, Traditional Business intelligence versus Big Data
Big Data Analytics
What is Big data analytics, why sudden hype around big data analytics, classification of analytics, top challenges facing big data, terminologies used in big data environment, Top analytics tools
Big Data Technology Landscape
Apache Hadoop,Why Hadoop, Comparison with other systems: RDBMS, Grid computing, Hadoop overview, HDFS and its ecosystems, Hadoop architecture and 2.x core components. Managing Resources and applications with Hadoop YARN (Yet Another Resource Negotiator), Understanding MapReduce Programming, Running sample MapReduce program, Executing MapReduce Applications -Word count, Tera Sort, Radix Sort.
Introduction to Hadoop Ecosystem, Pig, Hive, Sqoop, HBase.
Pig: Introduction to PIG, Execution Modes of Pig, Comparison of Pig with Databases, Pig on Hadoop
Hive: Hive Shell, Architecture, data types, Comparison with Traditional Databases, HiveQL, Tables, User Defined Functions.
NoSQL: Use of NoSQL, Types of NoSQL, Advantages of NoSQL. Use of No SQL in Industry, NoSQL Vendors, SQL versus NoSQL, NewSQL
Hbase: Hbase basics, Concepts, Clients, Example, Hbase Versus RDBMS.
Machine Learning using python ,Python installation (Window and Ubuntu), Execution modes of Python ,Executing Python programs on hadoop, Python Libraries and Tools - Pandas for data analysis, Matplotlib for data visualization, Numpy for matrix processing, SciPy for image manipulation. Applications of Machine Learning, Implementation of machine learning in Hadoop environment
*Case studies related to entire topics are to be taught
Suggested Readings: