September 2020 ~ Data Engineering

Archive for September 2020

Analyzing video dataset in Spark

In this tutorial we will analyze the video dataset and process it through spark dataframe. We will see how we can use SQL queries to perfor...

A detail blog about big data technologies

Reading Hive table from Spark

We will read from a hive table with the help of Spark dataframe. Here we will be using Spark version 2.1.1 and hive version 1.2. In Hive we...
Analyzing video dataset in Spark

In this tutorial we will analyze the video dataset and process it through spark dataframe. We will see how we can use SQL queries to perfor...
Reading Hbase table from Spark

For reading Hbase table from Spark, here we will show with the help of Hortonworks Spark-Hbase connector. We need to define a Catalog for ...