Questions tagged [estimators]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
8 views

TF Estimator stop when overfitting?

With TF 1.x is there a way to stop training, when evaluation loss starts increasing? Or is there another way to detect overlearning? I know about the stop_if_no_decrease_hook, but it doesn't consider ...
2
votes
0answers
41 views

Offline/Batch Reinforcement Learning: Doubly Robust Off-policy Estimator takes huge values

Context: My team and I are working on a RL problem for a specific application. We have data collected from user interactions (states, actions, etc.). It is too costly for us to emulate agents. We ...
0
votes
2answers
31 views

What is the value of AIC criterion if RSS is 0? [closed]

The AIC formula is : $AIC = 2k + n Log(RSS/n)$ So if RSS is equal to 0, it is undefined. How do I deal with this? What value should it take?
0
votes
0answers
32 views

Off-Policy Estimation - Importance Sampling with Negative Rewards

Importance sampling is a common method for calculating off-policy estimates in RL. I have been reading through some of the original documentation (D.G. Horvitz and D.J. Thompson, Powell, M.J. and ...
0
votes
0answers
25 views

Explaining biased standard deviation estimate to non-technical audience

The usual estimate for variance, $s^2 = \frac{1}{n-1}\sum(x_i-\bar{x})^2$, is an unbiased estimator for population variance. So $s = \sqrt{\frac{1}{n-1}\sum(x_i-\bar{x})^2}$ is an unbiased estimator ...
1
vote
1answer
68 views

Pearson correlation coefficient - is correlation estimator acceptable?

As far as I know when it comes to theory, we use Pearson correlation when we want to check the correlation between two variables, which are both continuous or discrete. For a mixed case it's not so ...
1
vote
2answers
26 views

How can I do the correlation between two estimators?

I'm working with several estimators of all kind. Then, I want to stack these estimators, and the best is if they have low correlation between them. I suppose that the correlation method depends on ...
1
vote
0answers
118 views

Math behind, MSE = bias^2 + variance

Based on the deeplearningbook: $$MSE = E[(\theta_m^{-} - \theta)^2]$$ $$equals$$ $$Bias(\theta_m^{-})^2 + Var(\theta_m^{-})$$ where m is the number of samples ...
-1
votes
1answer
36 views

Is it possible to estimate

For example, if I want to know a page views/relative prevalence of a Reddit post, and I have the upvote and downvote data. Is it valid that I use the upvote and downvote to predict that, even if I ...
1
vote
0answers
21 views

Observation Operator - Data Assimilation

In data assimilation, one assumes the existence of a observation operator $\mathcal{H}$ that maps the model-state vector $\bf{x_b}$ to $ \bf{y_b}$ (the model-equivalent of the observations $\bf{y_o}$) ...
6
votes
1answer
2k views

What is the difference between a Categorical Column and a Dense Column?

In Tensorflow, there are 9 different feature columns, arranged into three groups: categorical, dense and hybrid. From reading the guide, I understand categorical columns are used to represent ...
0
votes
2answers
58 views

Latent variables with thresholds

There are many ML techniques to estimate latent variables such as the EM algorithm. Is there a technique that allows for thresholds for each of the latent variables? I have a feature space with 10 ...
3
votes
3answers
213 views

Using recurrent neural networks for modeling errors in IMUs

Inertial measurement units (IMU), usually composed of accelerometers and gyroscopes; are well known to have inherent errors in their data, originating from bias, random walk noise, temperature ...
1
vote
0answers
3k views

How to Save TensorFlow model using estimator.export_savemodel() [closed]

How can i Save the TensorFlow model using estimator.export_savedmode() ? Especially, what should i put inside the ...
3
votes
1answer
23k views

'DecisionTreeClassifier' object has no attribute 'importances_'

I've this code in order to visualize the most important feature of each model: ...
1
vote
0answers
67 views

Plotting estimates of Tail Dependence Coefficient in R

I want to plot the following estimate of the tail dependence coefficient: $\hat{\lambda}_n=\frac{1}{k}\sum_{j=1}^nI_{\{X_j>X_{(n-k)},Y_j>X_{(n-k)}\}}$ where $I_{(.)}$ is an indicator function ...
0
votes
1answer
62 views

Estimating forward velocity for a swimmer

With a modern IMU with 9 angles of freedom collecting accelerometer, magnetometer and gyroscope data on 3 axis, what would be the best approach on filtering the data and handling it to accurately ...
5
votes
1answer
2k views

How to estimate the mutual information numerically?

Suppose I have a sample {$z_i$}$_{i\in[0,N]}$ = {($x_i,y_i$)}$_{i\in[0,N]}$ which commes from a probability distribution $p_z(z)$. How can I use it to estimate the mutual information between X and Y ? ...