New answers tagged data
1
vote
Converting voting district GeoID to approximate zip code?
The first 5 digits of the GEOID are the FIPS code, and you have the full list available here linked with the ZIP code, county name, etc.
https://www.kaggle.com/datasets/danofer/zipcodes-county-fips-...
- 2,168
1
vote
Converting voting district GeoID to approximate zip code?
Voting districts can be matched to ZIP codes by their coordinates.
To get an approximate result I suggest the following algorithm:
Calculate voting district coordinates by averaging its polygon ...
2
votes
Accepted
Creating a grid type 3D data array from data points
You can use itertools.product to get a possible combinations of x, y, and z and then convert to resulting list to a numpy array:
...
- 5,809
0
votes
Data Visualisation Techniques for Multi Labelled data
use this link
[blog]: https://github.com/cdpierse/transformers-interpret
Choose MultiLabel Classification Explainer for show the visualize the perforamnce of bert on multiclassification techniques
1
vote
Calculating Potential Usefulness of Acquiring Additional Data
In my experience the most valuable data that Anne could have in addition is identified by asking validation questions "do we model the right data?" (as opposed to verification as in ...
3
votes
Calculating Potential Usefulness of Acquiring Additional Data
You can use a Bayesian model to evaluate the confidence of your predictions. You can then use the confidence to specifically acquire more data where you model is less confident.
When training a normal ...
- 131
0
votes
How to reduce position changes after dimensionality reduction?
To reduce position change, it is crucial to know how t-SNE works.
t-SNE is a projection from a high-dimensional space to a lower one, generally 2D or 3D.
For simplification purposes, let's take a 2D ...
- 2,168
3
votes
Calculating Potential Usefulness of Acquiring Additional Data
You can make experiments using only a subset of the data you already have.
Suppose you machine learning should estimate some underlying unknown probability distribution from a given sample. If your ...
- 131
3
votes
Calculating Potential Usefulness of Acquiring Additional Data
How do I measure if new data would improve results?
In other words: How do I measure if new data will make more or fewer correlations in general?
A good metric is the entropy.
If you add new data and ...
- 2,168
1
vote
Data Mining of unresearched data for a master's degree final project
If it's business oriented, there are many "business Wikipedia" type websites that have lots of data presented in the same format on each page, which will make them a lot simpler to scrape. ...
- 21
0
votes
Generating synthetic data based off existing real data (in Python)
One option is the Python package imblearn which contains the SMOTE algorithm. SMOTE generates synthetic samples from a real dataset by interpolating plausible new datapoints based on observed data.
- 16.5k
1
vote
NLP logistic regression
This is a completely plausible model. You have five features (probably one-hot encoded) and then a categorical outcome. This is a reasonable place to use a (multinomial) logistic regression.
Depending ...
- 2,830
Top 50 recent answers are included