Questions tagged [estimators]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
15 views

Use of variance of estimators in cross-validation [migrated]

Let's suppose we are using K-fold cross validation on a set of data of dimension $N_{data}$. We do not want to fix any parameter but just to get a confidence of the predictive power using the ...
1
vote
1answer
30 views

Pearson correlation coefficient - theory vs estimator

As far as I know when it comes to theory, we use Pearson correlation when we want to check linear correlation between two random variables, which are both continuous or discrete. For mixed case it's ...
0
votes
2answers
18 views

How can I do the correlation between two estimators?

I'm working with several estimators of all kind. Then, I want to stack these estimators, and the best is if they have low correlation between them. I suppose that the correlation method depends on ...
0
votes
0answers
10 views

Tensorflow “canned” estimators unable to “see” that signficant signal is the ratio of two columns

I have an appropriate dataset composed of X,Y and a LABEL to be used for binary classification. When fed to a Tensorflow canned estimator (tf.estimator.LinearClassifier, I tried both Linear and DNN) ...
1
vote
0answers
61 views

Math behind, MSE = bias^2 + variance

Based on the deeplearningbook: $$MSE = E[(\theta_m^{-} - \theta)^2]$$ $$equals$$ $$Bias(\theta_m^{-})^2 + Var(\theta_m^{-})$$ where m is the number of samples ...
-1
votes
1answer
35 views

Is it possible to estimate

For example, if I want to know a page views/relative prevalence of a Reddit post, and I have the upvote and downvote data. Is it valid that I use the upvote and downvote to predict that, even if I ...
0
votes
0answers
18 views

Data sharing between Custom Tranformer and estimator in pyspark

Using Titanic Dataset for classification. Created custom Estimator and transformer for pipeline. some of logical operation need to be done in fit() method and data ...
1
vote
0answers
19 views

Observation Operator - Data Assimilation

In data assimilation, one assumes the existence of a observation operator $\mathcal{H}$ that maps the model-state vector $\bf{x_b}$ to $ \bf{y_b}$ (the model-equivalent of the observations $\bf{y_o}$) ...
6
votes
1answer
1k views

What is the difference between a Categorical Column and a Dense Column?

In Tensorflow, there are 9 different feature columns, arranged into three groups: categorical, dense and hybrid. From reading the guide, I understand categorical columns are used to represent ...
0
votes
2answers
43 views

Latent variables with thresholds

There are many ML techniques to estimate latent variables such as the EM algorithm. Is there a technique that allows for thresholds for each of the latent variables? I have a feature space with 10 ...
3
votes
3answers
194 views

Using recurrent neural networks for modeling errors in IMUs

Inertial measurement units (IMU), usually composed of accelerometers and gyroscopes; are well known to have inherent errors in their data, originating from bias, random walk noise, temperature ...
1
vote
0answers
3k views

How to Save TensorFlow model using estimator.export_savemodel() [closed]

How can i Save the TensorFlow model using estimator.export_savedmode() ? Especially, what should i put inside the ...
2
votes
1answer
16k views

'DecisionTreeClassifier' object has no attribute 'importances_'

I've this code in order to visualize the most important feature of each model: ...
1
vote
0answers
66 views

Plotting estimates of Tail Dependence Coefficient in R

I want to plot the following estimate of the tail dependence coefficient: $\hat{\lambda}_n=\frac{1}{k}\sum_{j=1}^nI_{\{X_j>X_{(n-k)},Y_j>X_{(n-k)}\}}$ where $I_{(.)}$ is an indicator function ...
1
vote
0answers
30 views

Transformation of independent variables in regression (Measurement Error)

Consider the model $𝑌_𝑖=𝛽_0+𝛽_1𝑋_𝑖^\star+𝑢_𝑖$ In practice we measure $𝑋_𝑖^\star$ by $𝑋_𝑖$ such that a) $𝑋_𝑖=𝑋_𝑖^\star+3$ b) $𝑋_𝑖=5𝑋_𝑖^\star$ What will be the effect of these ...
0
votes
1answer
60 views

Estimating forward velocity for a swimmer

With a modern IMU with 9 angles of freedom collecting accelerometer, magnetometer and gyroscope data on 3 axis, what would be the best approach on filtering the data and handling it to accurately ...
3
votes
1answer
1k views

How to estimate the mutual information numerically?

Suppose I have a sample {$z_i$}$_{i\in[0,N]}$ = {($x_i,y_i$)}$_{i\in[0,N]}$ which commes from a probability distribution $p_z(z)$. How can I use it to estimate the mutual information between X and Y ? ...