• Member for 3 years, 7 months
  • Last seen more than a month ago
Best platform to work with when having millions of rows in dataframe
1 votes

Parallelize your analyses on a single (multi-cpu) machine with e.g. pandarallel or the like or go for broke with scala/spark/hadoop if the problem wont fit on a single machine.

View answer