Skip to main content
Data Science

Return to Question

fix the title
Link
edit approved Dec 9, 2017 at 10:27
Maxim
edit approved Dec 9, 2017 at 10:27
Maxim
  • 910
  • 1
  • 9
  • 20

when When does cache get expired for a RDD in pyspark?

edited tags
Link
Dawny33
Dawny33
  • 8.4k
  • 12
  • 49
  • 106
Source Link
krishna Prasad
krishna Prasad
  • 1.1k
  • 1
  • 14
  • 23

when does cache get expired for a RDD in pyspark?

We use .cache() on RDD for persistent caching of an dataset, My concern is when this cached will be expired?.

dt = sc.parallelize([2, 3, 4, 5, 6])
dt.cache()