Questions tagged [convergence]
The convergence tag has no usage guidance.
38
questions
0
votes
0
answers
13
views
What are desirable properties of layers in Deep Learning?
I have been thinking about the following the problem:
Given some task we assume there is a magical function that perfectly solve this task. For example, if we want to distinguish cats and dogs, then ...
- 148
0
votes
0
answers
18
views
Is learning_rate linear with the time to converge using AdamOpt?
Say that both learning rates 1e-3,1e-4 leading to the same solution (not too high or too small).
In terms of convergence by the amount of epochs, does ...
- 13
0
votes
0
answers
29
views
Convergence of Sarsa($\lambda$)
Is there any theorem on the convergence of the Sarsa($\lambda$) Algorithm?
I am currently working through the theory of Reinforcement Learning with the lecture by David Silver and the book of Sutton &...
- 3
0
votes
0
answers
13
views
RL agent behave differently for different data
I am training an RL model using PPO for AAPL stock. There are 3 actions to take, Buy, Sell or Hold. If there is a Buy(/Sell) signal, the environment will buy(/sell) all. To trade for each year, the ...
- 85
0
votes
0
answers
9
views
what does it mean when my accuracy converges asymptotically?
I am training a CNN using keras. My accuracy hits 70% quickly enough, then starts converging asymptotically to about 80%. What is this a symptom of? With a normal stack-o-Dense layers, I have ...
- 101
0
votes
1
answer
455
views
What exactly is convergence rate referring to in machine learning?
My understanding of the term "Convergence Rate" is as follows:
Rate at which maximum/Minimum of a function is reached, so in logistic
regression rate at which gradient decent reaches global ...
- 343
0
votes
0
answers
28
views
What is going on with this kind of validation loss graph?
I am using stock prices and a whole bunch of indicators values to try to get a tensorflow model to predict to buy,sell, or hold. I think im going about this right but when i train the model, first i ...
- 101
2
votes
1
answer
65
views
Rate of convergence - comparison of supervised ML methods
I am working on a project with sparse labelled datasets, and am looking for references regarding the rate of convergence of different supervised ML techniques with respect to dataset size.
I know that ...
- 121
2
votes
1
answer
157
views
Does convergence equal learning in Deep Q-learning?
In my current research project I'm using the Deep Q-learning algorithm. The setup is as follows: I'm training the model (using Deep Q-learning) on a static dataset made up of experiences extracted ...
- 81
1
vote
2
answers
353
views
Do smaller neural nets always converge faster than larger ones?
In your experience, do smaller CNN models (fewer params) converge faster than larger models?
I would think yes, naturally, because there are fewer parameters to optimize. However, I am training a a ...
- 617
3
votes
0
answers
24
views
Force Matching in Coarse Grained Molecular Dynamics with Jax - Forces do not match when neglecting energy loss
I am currently exploring force matching approaches for molecular dynamic simulations.
As I am still in an exploration state, I'd tried investigated
Force Matching Neural Network Colab Notebook
...
3
votes
1
answer
77
views
ElasticNet Convergence odd behavior
I am optimizing a model using ElasticNet, but am getting some odd behavior. When I set the tolerance hyperparameter with a small value, I get
...
- 31
1
vote
0
answers
36
views
Uniform convergence garantee on sample complexity
I can't understand why the Uniform Convergence guarantees an upper bound and not a lower bound on sample complexity as stated on [1]
Corollary 4.4.
If a class $H$ has the uniform convergence property ...
- 11
3
votes
2
answers
11k
views
Logistic regression does cannot converge without poor model performance
I have a multi-class classification logistic regression model. Using a very basic sklearn pipeline I am taking in cleansed text descriptions of an object and classifying said object into a category.
<...
- 53
0
votes
1
answer
253
views
How do i iterate functions until convergence in R?
I am looking to iterate until convergence but I am not sure how i should code it.
A simple similar example is something like
$X_0=5 , Y_0=3$
for $n=1,2..$
$P_n=X_{n-1}-Y_{n-1}$
$Y_n=3P_n$
$X_n=P_n+...
0
votes
2
answers
115
views
How to assess that a cross entropy based model has converged
I have a question regarding cross entropy convergence using Stochastic Gradient Descent. I am a little bit confused about how the convergence should be assessed. Should we treat the model as converged ...
- 125
1
vote
1
answer
64
views
Why GA convergence curves continue as two parallel lines?
I'm working on a optimization problem and using GA algorithm (in MATLAB, ga function).
As you know MATLAB plots GA result with two curves, one for the best values and other to show the mean values ...
- 221
2
votes
0
answers
23
views
Is there a universal convergence rate when stacking models/experts?
It's fairly common to see people stacking different models when chasing marginal gains in contexts such as Kaggle competitions or the Netflix challenge. I would like to know about the mathematics ...
2
votes
1
answer
53
views
How can we conclude that an optimization algorithm is better than another one
When we test a new optimization algorithm, what the process that we need to do?For example, do we need to run the algorithm several times, and pick a best performance,i.e., in terms of accuracy, f1 ...
- 21
1
vote
0
answers
148
views
Help with MLP convergence
I posted this question on AI SE and got advised to ask here for guidance. I've been stuck for a couple of days trying to figure it out how the standard MLP works and why my code doesn't converge at ...
0
votes
2
answers
951
views
Python lifelines - ConvergenceWarning: Newton-Raphson failed to converge sufficiently in Cox prop hazard
When calling CoxPHFitter() on my full dataset I'm getting the following error:
...
- 194
1
vote
0
answers
52
views
Huge cost not converging well with TensorFlow logistic regression
I try to use Logistic Regression for a dataset which contains 15 numeric features and 4238 rows of examples. The calculated cost started at 415.91, and converged when the cost was reduced to 220.119 ...
user77241
2
votes
0
answers
302
views
How does permutation of training data improve convergence time when training a perceptron or neural network model? [duplicate]
I'm currently studying some basic concepts regarding Deep Learning and Neural Networks with this material.
When discussing the training algorithm for a perceptron, the author states that looping ...
0
votes
1
answer
116
views
Can one use non converged results from Logistic Regression?
I'm running Logistic Regression on a dataset for a classification problem.
I used the model on the dataset when it was normalized and I had no problem with it converging.
Now, I wanted to see the ...
- 165
1
vote
0
answers
597
views
sequence convergence - python
Let $\{p_i : i \in \mathbb{Z}\}$ be an i.i.d sequence with $p_i \in (0, 1)$.
Fix this random environment, then consider the random walk
$$P[ X_{n+1} = i + 1 | X_n = i] = 1 − P[ X_{n+1} = i − 1 | X_n =...
- 11
2
votes
0
answers
948
views
LSTM not converging
I am sorry if this questions is basic but I am quite new to NN in general. I am trying to build an LSTM to predict certain properties of a light curve (the output is 0 or 1). I build it in pytorch. ...
- 21
3
votes
1
answer
905
views
DQN fails to find optimal policy
Based on DeepMind publication, I've recreated the environment and I am trying to make the DQN find and converge to an optimal policy. The task of an agent is to learn how to sustainably collect apples ...
- 31
3
votes
4
answers
357
views
Weights not converging while cost function has converged in neural networks
My cost/loss function drops drastically and approaches 0, which looks a sign of convergence. But the weights are still changing in a visible way, a lot faster than the cost function. Should I ensure ...
- 227
1
vote
1
answer
2k
views
Recurrent Neural Network (LSTM) not converging during optimization
I am trying to train a RNN with text from wikipedia but I having having trouble getting the RNN to converge. I have tried increasing the batch size but it doesn't seem to be helping. All data is one ...
- 37
2
votes
1
answer
1k
views
Very slow convergence with CNN [closed]
I am new to deep learning. I am working on training an SSD model on a set of small objects. I am using Adam gradient descent for optimization and a large input (800x800), but I seem to only get an ...
- 23
2
votes
1
answer
4k
views
Why this model does not converge in keras?
This case has an underlying story but I have essentially boiled it down to the simplest possible re-producible example I could.
Essentially let us think that I have up to 1000 nodes and each node ...
- 135
1
vote
1
answer
682
views
Validation loss keeps fluctuating about training loss
I am training a Keras model for multi-target regression by using a custom loss function with the goal of getting predictions accurate to below 0.01 with respect to ...
- 111
3
votes
1
answer
2k
views
Convergence of vanilla or natural policy gradients (e.g. REINFORCE)
I am reading in a lot of places that policy gradients, especially vanilla and natural, are at least guaranteed to converge to a local optimum (see, e.g., pg. 2 of Policy Gradient Methods for Robotics ...
- 81
2
votes
2
answers
468
views
Normalizing the final weights vector in the upper bound on the Perceptron's convergence
The convergence of the "simple" perceptron says that:
$$k\leqslant \left ( \frac{R\left \| \bar{\theta} \right \|}{\gamma } \right )^{2}$$
where $k$ is the number of iterations (in which the weights ...
- 645
3
votes
1
answer
122
views
need explanation on how an equation is being converted to cvxopt logic in solver.lq
This is the equation that is given in the example:
and the code to replicate it in python is
...
- 141
3
votes
1
answer
10k
views
Is the percepetron algorithm's convergence dependent on the linearity of the data?
Does the fact that I have linearly separable data or not impact the convergence of the perceptron algorithm?
Is it always gonna converge if the data is linearly separable and not if it is not ? Is ...
- 273
24
votes
2
answers
9k
views
local minima vs saddle points in deep learning
I heard Andrew Ng (in a video I unfortunately can't find anymore) talk about how the understanding of local minima in deep learning problems has changed in the sense that they are now regarded as less ...
oW_♦
- 5,959
15
votes
5
answers
22k
views
Number of epochs in Gensim Word2Vec implementation
There's an iter parameter in the gensim Word2Vec implementation
...
- 2,372