Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [data-formats]

The tag has no usage guidance.

0
votes
0answers
12 views

Is it possible to import multiple (>100K) spectra of the .msa format to Orange

How do I import multiple (>100K) spectra of the .msa format to Orange? I do not see this most common free EDS spectral format (ISO 22029:2012) in the options in spectral add-on. Is it possible to add ...
1
vote
1answer
27 views

Prepare data : many products per row

I would like to find how to change my data structure to make it compatible with a ML model, with the following constraints : A Product is defined by {id, price, continuousVariable1, ..., ...
0
votes
0answers
11 views

What defines tidy data formatting in the tidyverse?

I'm working through a training video on beginner use of R. One of the features it points to is the "tidyverse". Here it defines tidyverse data as "Each variable must have its own column. Each ...
0
votes
1answer
32 views

Orange imports numeric features as categorical (“file” widget)

Why are some of my numeric features not being recognized as 'numeric' types AND why can't I reclassify them? I can't share my CSV here but I can assure you those features are indeed numeric (I use ...
0
votes
1answer
59 views

converting column from a factor to date format YYYY-MM-DDThh:mm:ss.SSSZ

i want to convert the whole column from a factor to date. The str of the dataset I am using is given below: ...
0
votes
0answers
9 views

Derive Column by Example Transformation - HOW?

Microsoft Azure has a feature called "derive column by example transformation". Basically, it transforms data in a column from one format to the other, and concludes it's value and format with/...
1
vote
1answer
28 views

parquet format: advise on log content

I'm using a python script to log IO of a grid job. the log is formatted like this: ...
0
votes
1answer
78 views

Formatting Data for use in SKmultilearn

I have a dataframe of X values and one with the y values in what I think is the proper format. I took the single feature y and converted it to dummies so it's binary and is m rows by n features. <...
1
vote
1answer
31 views

Format for time series data with non-trivial sampled data

I have a data stream that I would like to share with some data scientists. It is a regularly captured time series with some fields that are simple scalars, booleans. Each sample has a UTC time and ...
2
votes
3answers
281 views

Building a Citation Network to Analyze in R

I am working on network analysis project at one of our Nation's Service Academies, and I need a little help. As a starting point, we are looking at a citation network that we build by using the ...
1
vote
1answer
467 views

Format for X_train in keras using theano

I want to try out Keras (Theano backend) for regressions after already using sklearn. For this I uses this nice tutorial http://machinelearningmastery.com/regression-tutorial-keras-deep-learning-...
0
votes
2answers
408 views

Connecting Infusionsoft data to Google data studio

I want to create a Google Data studio dashboard from Infusion soft data. The main problem are the connectors - there are multiple tools that provide direct connectors but they are paid solutions like ...
1
vote
1answer
221 views

R data frame create a new variable which corresponds to one of the existing one

Currently this is what I get. "community_area_clean" is the new variable that I added by extracting a variable that lists all the communities from a data frame. "CommArea_Name" is the original "...
4
votes
2answers
346 views

What is the most used format to save data with type information

I am exporting data from an SQL database and importing it into R. This is a two step process since I first (automatically) download the data to a hard drive and then import the file with R. ...
1
vote
2answers
45 views

Are ICD codes forward compatible?

The ICD code scheme has gone through many revisions: https://en.wikipedia.org/wiki/International_Statistical_Classification_of_Diseases_and_Related_Health_Problems Is there any compatibility between ...
2
votes
3answers
620 views

What is the best file format to store an uncompressed 2D matrix?

For what it's worth my particular case is a symmetrical matrix, but this question should be answered more generally.
1
vote
1answer
31 views

Given the files and their parsed content how can I reverse engineer the file format?

I have access to a few thousand files binary files and I don't have the program that generated them. The files have been parsed and I also have access to the database where the parsed fields are ...
1
vote
0answers
55 views

Advantage of a treebank in XML format

Which treebanks are based on an XML format? What is the advantage of XML format for a treebank? I think it may have effects on annotation and querying the treebank. for example LASSY and Alpino or ...
2
votes
2answers
329 views

Why ConLL is not in XML format

I am new to NLP, I found a format named ConLL which seems a tab-separated file, like ID FORM LEMMA PLEMMA POS PPOS FEAT PFEAT HEAD PHEAD DEPREL PDEPREL I found ...
1
vote
3answers
514 views

Transposing Every nth row to column in a large dataset

I am attempting to work with a very large data-set (~1.5mil lines) for the first time in SAS and I am having some difficulty. The data-set I have is formatted as a "long" .txt file as follows: ...
1
vote
2answers
524 views

Appropriate way to store data in R

I have data, which looks like this: These data are only for one subject. I will have a lot more. These data will be analyzed in R. Now I'm storing them like this: ...
-1
votes
1answer
120 views

Best format for recording time stamp and GPS

In most data acquisition settings it is useful to tag your data with time and location. If I write the data to csv file, what are the best formats that I can use for this two variables if I want to ...
23
votes
3answers
5k views

Hierarchical Data Format. What are the advantages compared to alternative formats?

What are the main benefits from storing data in HDF? And what are the main data science tasks where HDF is really suitable and useful?