Working with timestamps while processing data can be a headache sometimes. Luckily Spark has some in-built functions to make our life easier when working with …
Spark provides multiple Date and Timestamp functions to make processing dates easier. In this blog, we will see the date and timestamp functions with examples.
In this blog, we will learn how to use select and expr in the Spark data frame. We will learn multiple use cases along with …
We will go through common column operations like add, rename, list, select, and dropping a column from spark dataframe.
We will learn how to add multiple partitions to hive table using msck repair table command in hive.
In this blog, we will learn how to insert data in partitions in hive table. We will write queries to insert data in static as …
With Bucketing in Hive, we can group similar kinds of data and write it to one single file. This allows better performance while reading data …
We have created partitioned tables, inserted data into them. Now, we will learn how to drop some partition or add a new partition to the …
Hive supports Static and Dynamic Partitions. Let us understand what is difference between them and their use cases.