Requirement : Before making data available to wider audience its always better to add a check for the key columns to ensure that the spelling is correct. In case if any word is wrongly spelled, then there should be one option to get the correct spelling for the same.
Sample Data This table contains sales done by each customer by country along with the selling price(cost) & date. Spark Dataframe Using below pyspark code to read the above csv file from DBFS in Azure Databricks notebook in spark dataframe. Code : #import library import pyspark from pyspark.sql import Window,