In this blog, we will learn how to filter rows from spark dataframe using Where and Filter functions.

Getting distinct values from columns or rows is one of most used operations. We will learn how to get distinct values as well as count…

In this blog, we will learn how to sort rows in spark dataframe based on some column values.

White spaces can be a headache if not removed before processing data. We will learn how to remove spaces from data in spark using inbuilt…

In this blog, we will learn how to use rpad and lpad functions to add padding to data in spark dataframe.

Working with strings is one of the most used tasks in Spark. That is why spark has provided multiple functions that can be used to…

In this blog, we are going to learn how to format dates in spark along with, changing date format and converting strings to dates with…

we need to find a difference between dates or find a date after or before “n” days from a given date. We are going to…

Working with timestamps while processing data can be a headache sometimes. Luckily Spark has some in-built functions to make our life easier when working with…