Blog Archive

About

A detail blog about big data technologies

Reading Hive table from Spark

We will read from a hive table with the help of Spark dataframe. Here we will be using Spark version 2.1.1 and hive version 1.2. In Hive we...
Reading Hbase table from Spark

For reading Hbase table from Spark, here we will show with the help of Hortonworks Spark-Hbase connector. We need to define a Catalog for ...
Analyzing video dataset in Spark

In this tutorial we will analyze the video dataset and process it through spark dataframe. We will see how we can use SQL queries to perfor...