Skip to main content

Questions tagged [metadata]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
58 views

How can GPT4 be used to create structured meta-data for unstructured data?

I often ingest unstructured datasets in Excel format, create meta-data, and transform the data in R to create a structured dataset. This includes normalization, so that there is little redundancy in ...
ahorn's user avatar
  • 101
0 votes
0 answers
50 views

How to combine multiple similar columns in a dataset derived of multiple sources?

I am trying to combine data from multiple sources. One issue I face is that the same columns are named differently. For example, the following refer to the same columns: SampleID, sample id, sampleID,...
risingStar's user avatar
0 votes
1 answer
25 views

How to carry metadata with data examples and labels in python?

Is there a pythonic way to carry around metadata that describes the training examples, such that it preserves (i.e., order) after shuffling and splitting (train/test)? ...
BigBrownBear00's user avatar
0 votes
1 answer
66 views

Missing Standard Deviation Values

Currently trying to conduct a meta-analysis. I have reviewed the references I would like to use and made sure each reference met my criteria for this meta-analysis. However, majority of the references ...
Grace's user avatar
  • 1
1 vote
0 answers
305 views

Reduce MNIST dataset

I am working on the MNIST dataset. How I can reduce 50% of this data? (x_train, y_train), (x_test, y_test) = keras.datasets.mnist.load_data()
Salman Al-haddad's user avatar
0 votes
1 answer
34 views

Regression on multiple datasets with a per-dataset variable

I have 10 datasets, each with the same variables (e.g., age and income) but different numbers of observations. Let us now consider a categorical variable $X$ that can only take values $0$ and $1$ per ...
Pippo's user avatar
  • 143
0 votes
1 answer
67 views

How to work with input which is a combination of metadata+ vectorized text data + image pixel data to build a Regression Model (predict views)?

There are 4 datasets (all in csv format), each has a uniqueID column by which each record can be identified. Image and text datasets are dense datasets.(need to be converted to ndarray). Can someone ...
Mathew's user avatar
  • 31
1 vote
0 answers
213 views

Questions about adding metadata to a CNN using keras

I have a convolutional neural network and would like to include some metadata. My metadata is in a multiple csv files that correspond to each class and it contains a bunch of geometric properties (...
cdr's user avatar
  • 33
1 vote
0 answers
2k views

Error "comparison (6) is possible only for atomic and list types" encountered in metafor

I'm very new to r and trying to run a multi-level meta analysis using pre-calculated effect sizes. The data file can be accessed via this link:testrunfile The script I used as a first step to fit the ...
Jess D's user avatar
  • 11
1 vote
1 answer
1k views

What is meta- data and meta features?

I want to know what is metadata and what is meant by meta features? When I google Meta Features what I get is feature selection tool called "Meta-Feature". What is the function of feature ...
asmgx's user avatar
  • 549
2 votes
1 answer
1k views

Automatically uses several cores on R

I am using a library called MFE to generate meta-features. However, I am working right now with several files and I notice that I am using only 1 core of my machine and taking too much time. I have ...
Guilherme Felipe Reis's user avatar
1 vote
0 answers
34 views

Labeling data as having an error?

I am curating a large quantity of data from different sensors. If I know that a particular sensor was broken or poorly calibrated for a particular time range, what would be a useful way of annotating ...
David LeBauer's user avatar
1 vote
1 answer
57 views

Understanding a dataset (prior to applying ML models) with no metadata given

How do you understand a dataset when there is no metadata given (no details about the attributes given in the dataset)? It is difficult to comprehend the attribute names as only the short forms are ...
Aditya Kadrekar's user avatar
0 votes
1 answer
38 views

Finding an appropriate price using thousands of data points

If i have a lot of data points describing the price of a used car. How would I find the market value of the car (assuming that the price points in the data set are the only determinant used, and the ...
Zee's user avatar
  • 3
0 votes
3 answers
1k views

Visualizing community composition using network of pie charts

Given a social network, I want to perform community detection and compare the result to known node metadata, such as gender, age, etc. to see if certain communities are largely composed of "similar" ...
Zach Boyd's user avatar
  • 111
1 vote
0 answers
24 views

Antisymmetry of graph of Information vs probability

The formula for Information given by a data of occurring with probability p is: I=-log2 p This formula gives the bits if information needed to know the outcome of the event. This formula captures ...
user1825567's user avatar
  • 1,396
6 votes
0 answers
101 views

Meta-analysis of public 16S data

I am trying to start a meta-analysis for which I want to extract some 16S-based information from public databases. Moreover, I want to relate this information with any metadata found in the associated ...
André Soares's user avatar
4 votes
2 answers
1k views

Recommendations for storing time series data

As part of my thesis I've done some experiments that have resulted in a reasonable amount of time-series data (motion-capture + eye movements). I have a way of storing and organizing all of this data, ...
lmjohns3's user avatar
  • 568
23 votes
5 answers
4k views

How to annotate text documents with meta-data?

Having a lot of text documents (in natural language, unstructured), what are the possible ways of annotating them with some semantic meta-data? For example, consider a short document: ...
Amir Ali Akbari's user avatar
3 votes
1 answer
63 views

Can metadata be used to adapt parsing for an unescaped in field use of the delimiter?

I have data coming from a source system that is pipe delimited. Pipe was selected over comma since it was believed no pipes appeared in field, while it was known that commas do occur. After ingesting ...
Chris Simokat's user avatar