New answers tagged

1 vote

Converting voting district GeoID to approximate zip code?

The first 5 digits of the GEOID are the FIPS code, and you have the full list available here linked with the ZIP code, county name, etc. https://www.kaggle.com/datasets/danofer/zipcodes-county-fips-...
user avatar
1 vote

Converting voting district GeoID to approximate zip code?

Voting districts can be matched to ZIP codes by their coordinates. To get an approximate result I suggest the following algorithm: Calculate voting district coordinates by averaging its polygon ...
user avatar
2 votes
Accepted

Creating a grid type 3D data array from data points

You can use itertools.product to get a possible combinations of x, y, and z and then convert to resulting list to a numpy array: ...
user avatar
  • 5,809
0 votes

Data Visualisation Techniques for Multi Labelled data

use this link [blog]: https://github.com/cdpierse/transformers-interpret Choose MultiLabel Classification Explainer for show the visualize the perforamnce of bert on multiclassification techniques
user avatar
1 vote

Calculating Potential Usefulness of Acquiring Additional Data

In my experience the most valuable data that Anne could have in addition is identified by asking validation questions "do we model the right data?" (as opposed to verification as in ...
user avatar
3 votes

Calculating Potential Usefulness of Acquiring Additional Data

You can use a Bayesian model to evaluate the confidence of your predictions. You can then use the confidence to specifically acquire more data where you model is less confident. When training a normal ...
user avatar
  • 131
0 votes

How to reduce position changes after dimensionality reduction?

To reduce position change, it is crucial to know how t-SNE works. t-SNE is a projection from a high-dimensional space to a lower one, generally 2D or 3D. For simplification purposes, let's take a 2D ...
user avatar
3 votes

Calculating Potential Usefulness of Acquiring Additional Data

You can make experiments using only a subset of the data you already have. Suppose you machine learning should estimate some underlying unknown probability distribution from a given sample. If your ...
user avatar
  • 131
3 votes

Calculating Potential Usefulness of Acquiring Additional Data

How do I measure if new data would improve results? In other words: How do I measure if new data will make more or fewer correlations in general? A good metric is the entropy. If you add new data and ...
user avatar
1 vote

Data Mining of unresearched data for a master's degree final project

If it's business oriented, there are many "business Wikipedia" type websites that have lots of data presented in the same format on each page, which will make them a lot simpler to scrape. ...
user avatar
  • 21
0 votes

Generating synthetic data based off existing real data (in Python)

One option is the Python package imblearn which contains the SMOTE algorithm. SMOTE generates synthetic samples from a real dataset by interpolating plausible new datapoints based on observed data.
user avatar
1 vote

NLP logistic regression

This is a completely plausible model. You have five features (probably one-hot encoded) and then a categorical outcome. This is a reasonable place to use a (multinomial) logistic regression. Depending ...
user avatar
  • 2,830

Top 50 recent answers are included