Packt Publishing – Learning Hadoop 2

Packt Publishing – Learning Hadoop 2

An introduction to storing, structuring, and analyzing data at scale with Hadoop

An introduction to storing, structuring, and analyzing data at scale with Hadoop

About This Video

• Explore Hadoop and its ecosystem of core components, and set up an instance
• Import, organize, and query data with HDFS, Flume, Sqoop, and Hive
• Learn Pig, a simplified scripting language for Hadoop, to manipulate your data

In Detail

Hadoop emerged in response to the proliferation of masses and masses of data collected by organizations, offering a strong solution to store, process, and analyze what has commonly become known as Big Data. It comprises a comprehensive stack of components designed to enable these tasks on a distributed scale, across multiple servers and thousands of machines.

Learning Hadoop 2 introduces you to the powerful system synonymous with Big Data, demonstrating how to create an instance and leverage Hadoop ecosystem’s many components to store, process, manage, and query massive data sets with confidence.

We open this course by providing an overview of the Hadoop component ecosystem, including HDFS, Sqoop, Flume, YARN, MapReduce, Pig, and Hive, before installing and configuring our Hadoop environment. We take a look at Hue, the graphical user interface of Hadoop.

We will then discover HDFS, Hadoop’s file-system used to store data. We will learn how to import and export data, both manually and automatically. Afterward, we turn our attention toward running computations using MapReduce, and get to grips working with Hadoop’s scripting language, Pig. Lastly, we will siphon data from HDFS into Hive, and demonstrate how it can be used to structure and query data sets.

Get Packt Publishing – Learning Hadoop 2 At tenco.pro

Course Curriculum

The Hadoop Ecosystem

• The Course Overview (1:51)
• Overview of HDFS and YARN (7:24)
• Overview of Sqoop and Flume (3:17)
• Overview of MapReduce (3:38)
• Overview of Pig (3:04)
• Overview of Hive (6:33)

Installing and Configuring Hadoop

• Downloading and Installing Hadoop (2:53)w
• Exploring Hue (5:24)

Data Import and Export

• Manual Import (4:33)
• Importing from Databases Using Sqoop (6:27)
• Using Flume to Import Streaming Data (5:07)

Using MapReduce and Pig

• Coding “Word Count” in MapReduce (5:55)
• Coding “Word Count” in Pig (2:30)
• Performing Common ETL Functions in Pig (8:48)
• Using User-defined Functions in Pig (5:58)

Using Hive

• Importing Data from HDFS into Hive (4:57)
• Importing Data Directly from a Database (2:23)
• Performing Basic Queries in Hive (6:58)
• Putting It All Together (2:15)

Get Packt Publishing – Learning Hadoop 2 At tenco.pro