Wednesday 31 July 2019

Perform addition/Mulitplication/division in Apache Spark on a column


# TODO
peopleWithFixedSalaries20KDF = peopleWithFixedSalariesDF.filter(col("salary") >100000).limit(10).withColumn("salary10k",round(col("salary")/10000))
peopleWithFixedSalaries20KDF.show()


use

withColumn("NameOfNewColumn",col("nameOfExistingColumn")/col("nameOfExistingColumn"))

No comments:

Post a Comment