Where and Filter in Spark Dataframes
In this blog, we will learn how to filter rows from spark dataframe using Where and Filter functions.
Distinct Rows and Distinct Count from Spark Dataframe
Getting distinct values from columns or rows is one of most used operations. We will learn how to get distinct values as well as count of distinct values.
Sorting in Spark Dataframe
In this blog, we will learn how to sort rows in spark dataframe based on some column values.
Removing White Spaces From Data in Spark
White spaces can be a headache if not removed before processing data. We will learn how to remove spaces from data in spark using inbuilt functions.
Adding White Spaces to Data in Spark Dataframe
In this blog, we will learn how to use rpad and lpad functions to add padding to data in spark dataframe.
Add, Rename, Drop Columns in Spark Dataframe
We will go through common column operations like add, rename, list, select, and dropping a column from spark dataframe.