I have data set of cicids2017 which in total has 2830743 rows and 79 columns. Since my local jupyter was crashing a lot, SO I am using Google Colab.

But Google Colab is also crashing if some big operation occurs, or even when I try to plot. For Example,

df['Destination Port'].plot.hist(figsize=(12,6))

This will crash my Colab server.

I am looking for some library that can perform EDA automatically, and handle such big data. Thanks.

  • $\begingroup$ if you want to do EDA on a temporary basis then try amazon quicksight. $\endgroup$ – Madhur Yadav Sep 15 '20 at 16:19

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.