1
$\begingroup$

I have a csv file with around 130 columns and 6000 rows

what is the best way to import them into python, so that I can later use them in a classification algorithm(columns are the labels and rows are individual samples)

$\endgroup$
2

3 Answers 3

4
$\begingroup$

Use pandas library:

import pandas as pd 
pd.read_csv('foo.csv')

Pandas identify the headers automatically and is a great tool for data wrangling.
10 Minutes intro to pandas

$\endgroup$
13
$\begingroup$

For small data, I think pandas.read_csv is the way to go.

For "medium" data, I recommend dask.read_csv

And for big data, I recommend spark.read.csv

$\endgroup$
2
  • $\begingroup$ Agreed. On my laptop (8G ram, i5 processor), reading in CSV's up to around 1GB isn't much of a problem using pandas.read_csv. Keep in mind also that read_csv has the handy feature of being able to read gzipped CSV's. $\endgroup$ Commented Sep 15, 2016 at 17:43
  • $\begingroup$ So do the other two! $\endgroup$
    – Emre
    Commented Sep 15, 2016 at 17:55
0
$\begingroup$

You can also SFrame. First install graph lab. Then:

import graphlab as gl
data = gl.SFrame.read_csv('data.csv')

If you're 'hardcore' you can use python's basic csv reader, but then you will have to write loops to manage the data yourself, so why bother reinvent the wheel, just use pandas or Frame.

$\endgroup$
2
  • $\begingroup$ what's better? pandas or SFrame? $\endgroup$
    – krishna
    Commented Sep 20, 2016 at 1:59
  • $\begingroup$ SFrame is technically better, but it's use is restricted and limited documentation. Pandas is free and has more community support. $\endgroup$ Commented Sep 20, 2016 at 2:02

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.