Working With Timestamps in Spark
Working with timestamps while processing data can be a headache sometimes. Luckily Spark has some…
Date & Timestamp Functions in Spark
Spark provides multiple Date and Timestamp functions to make processing dates easier. In this blog,…
Select Expr in Spark Dataframe
In this blog, we will learn how to use select and expr in the Spark…
Add, Rename, Drop Columns in Spark Dataframe
We will go through common column operations like add, rename, list, select, and dropping a…
MSCK Repair – Fixing Partitions in Hive Table
We will learn how to add multiple partitions to hive table using msck repair table…
Inserting Data In Hive Partitioned tables
In this blog, we will learn how to insert data in partitions in hive table….
Bucketing in Hive
With Bucketing in Hive, we can group similar kinds of data and write it to…
Alter Table Partitions in Hive
We have created partitioned tables, inserted data into them. Now, we will learn how to…
Static vs Dynamic Partitioning in Hive
Hive supports Static and Dynamic Partitions. Let us understand what is difference between them and…