I have a table in Postgres with ~5million records. When I load the dataset using pandas to perform EDA, I run out of memory.
dataframe_chunk = pd.read_sql("SELECT * from table", con = credentials)
How do I load and store the table in a format such that I can run all pandas/numpy functions for data analysis? What is the general approach taken?