In this blog, we will learn how to filter rows from spark dataframe using Where and Filter functions.
Getting distinct values from columns or rows is one of most used operations. We will learn how to get distinct values as well as count of distinct values.
In this blog, we will learn how to sort rows in spark dataframe based on some column values.
White spaces can be a headache if not removed before processing data. We will learn how to remove spaces from data in spark using inbuilt functions.
In this blog, we will learn how to use rpad and lpad functions to add padding to data in spark dataframe.
We will go through common column operations like add, rename, list, select, and dropping a column from spark dataframe.