Questions tagged [csv]

Comma-Separated Values are a list of plain text values delimited by commas, or a file containing one or more lists in that format.

Filter by
Sorted by
Tagged with
11
votes
2answers
46k views

How to store strings in CSV with new line characters?

My question is: what are ways I can store strings in a CSV that contain newline characters (i.e. \n), where each data point is in one line? Sample data This is a ...
0
votes
2answers
28k views

Search and Replace in specific column of csv with python

I created a program that search and replaces over an entire csv file but I need to make so it is column specific. Is there a way to only search via a column. Here is my code, I am pretty new to python ...
1
vote
1answer
372 views

Data scraping & NLP?

I'm scraping data from Bing search results for (non-commercial purposes, of course) on Python using BeautifulSoup. I've entered an Indian dessert name, called 'rasmalai' as the word that I am focusing ...
0
votes
1answer
489 views

How can I transpose a high dimensional dataset?

I have a (.csv) file with more than 35,000 rows and 100 columns, where the rows represent the attributes and columns represent the instances. In Excel the maximum number of columns is 16,384. ...
1
vote
1answer
10k views

Orange: Data has no target variable error

I am trying to apply Random Forest algorithm on a data set using Orange. The target variable is not set in the data set. However, I know which column is the target variable. How can I specify the ...
1
vote
3answers
2k views

Creating data model out of .csv file using Python

I want to create a data model out of a .csv file using Python. I mean to create dependencies, for example the primary key and stuff such that I can check if the new ...
0
votes
1answer
3k views
3
votes
2answers
2k views

How to deal with large data sets

So i'm very new to this, forgive my silly questions. I've got some data I need to analyse, I would usually just use excel it doesnt seem to be able to do the job. I have .csv files containing data ...
0
votes
2answers
12k views

Python inserts newline by writing to csv

I am trying to scrape http://www.the-numbers.com/movie/budgets/all but when I write the table into a csv file, there is an additional line with the counter index written in between each movie row... ...
0
votes
1answer
16k views

Converting Json file to Dataframe Python

I have a json file which has multiple events, each event starts with EventVersion Key. The data looks similar to the following synthesized data. ...
1
vote
1answer
519 views

R: reading big data files in R

In R, there are libraries which help speed up the process of reading huge data files. Examples of these libraries include sqldf and ff. What would be the disadvantage of using these packages to read ...
2
votes
2answers
603 views

Breaking down a column in Pandas into a separate CSV for display in Tableau

My data is coming from a CSV, which should be visualized in Tableau. However, the data contains the column category_list, which consists of values separated by a ...
0
votes
1answer
2k views

How to shift rows values as columns in pandas?

Input: I have csv file like below as input.... ...
3
votes
1answer
1k views

ML algorithm for determining CSV file header names based on content

I have a large amount of CSV files, an example of which (for job titles) is listed below. The data is noisy (there are misspellings, difference in capitalisation, missing values, and they are not well-...
1
vote
1answer
3k views

Output data from scikit learn logistic regression

I have run a logistic regression using scikit learn in python. I know want to output the results to put into a csv and then load into Tableau. To do that I need to combine the y_test, y_actual, and ...
1
vote
2answers
11k views

Python - AttributeError: type object 'DataFrame' has no attribute 'read_csv'

I'm trying to create some charts using Python. I've this dataset in a CSV file: Banana Water Rice Rice Water Bread Banana Juice And I've this code: <...
1
vote
3answers
6k views

importing csv data in python

I have a csv file with around 130 columns and 6000 rows what is the best way to import them into python, so that I can later use them in a classification algorithm(columns are the labels and rows are ...
6
votes
2answers
18k views

Merging large CSV files in pandas

I have two CSV files (each of the file size is in GBs) which I am trying to merge, but every time I do that, my computer hangs. Is there no way to merge them in chunks in pandas itself?
6
votes
3answers
16k views

Reading CSVs with new lines in fields with Spark

I was trying to load the below weblogic domain log (application error log) into Spark dataframe. I created a RDD and converted the RDD into dataframe. I was able to load the data successfully for the ...
1
vote
2answers
132 views

Reading a wide dataset in R

I originally had a wide CSV dataset of about 18000 columns(and about 80 rows) that I am trying to read in R. It was stored in an Excel sheet,which unfortunately has a limit of only 16384 columns. ...
1
vote
3answers
75 views

Creating queries on the fly and general manipulation for dataset of half a million data records

What would one use for manipulating data of the kind below ? a) Data is bio-markers of different globs GlobA 3 4 5 .... GlobB 2 1 1 .... GlobC 3 2 1 .... b) Manipulations are queries like: - show ...
5
votes
2answers
351 views

What kind of statistical analyses can I do with my data?

I'm trying to analyze human intentions in clicking google ad word keywords. In this dataset I have the usual adword details, for example ...
0
votes
2answers
90 views

Reading a CSV using R [closed]

I have a CSV file that, by all appearances, is totally normal except that each line ends with ,^M. Not sure if that has anything to do with my issue or not, but I ...
3
votes
5answers
2k views

Quick way to visually explore data?

I have a very large csv file which Apple Numbers won't open. I can open it with TextEdit, but each row is so long it forms multiple lines in the document and makes the document difficult to understand....
0
votes
1answer
677 views

Batch convert json links to csv [closed]

I have a batch of links with the following naming convention: https://api.cilabs.net/v1/conferences/ws15/info/attendees?page=1; and the page number incrementing. I would like to extract the data ...
4
votes
2answers
1k views

Recommendations for storing time series data

As part of my thesis I've done some experiments that have resulted in a reasonable amount of time-series data (motion-capture + eye movements). I have a way of storing and organizing all of this data, ...
3
votes
3answers
4k views

Merging repeating data cells in csv

I have a CSV file with around 1 Million rows. Let say its have details like ...
3
votes
3answers
16k views

How to read file from user in Shiny and assign it to a variable in global.r?

I want to read a csv file as input from user in Shiny and assign it to a variable in global.r file.The code I have in ui.R is ...
1
vote
0answers
555 views

How to create separate nodes for each column in a spreadsheet using Neo4J?

I have an excel file containing lot of columns. I want to create a graph database in Neo4J with all these columns as a separate node so that I can establish relationship between them and play around ...
6
votes
3answers
1k views

Summarize and visualize a CSV in Java/Scala?

I would like to summarize (as in R) the contents of a CSV (possibly after loading it, or storing it somewhere, that's not a problem). The summary should contain the quartiles, mean, median, min and ...

1
2