Timeline for Can Neural Networks be trained to smooth values / output the average?
Current License: CC BY-SA 3.0
3 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Nov 14, 2017 at 18:48 | comment | added | tom | @MartinThoma linear models are simple but lack representational power provided by the deepness of networks or boosted tree models. It's possible to make simpler or more complex NN or XGBoost models, and simplicity roughly corresponds to the number of parameters in the model. If it were me, I'd try a highly regularized NN or XGBoost (e.g. with tree depth = 2). In other words, with the category of NNs, you should consider making a simpler (more regularized) model. | |
| Nov 14, 2017 at 17:46 | comment | added | Martin Thoma | "In general simpler models are more robust to noise in the input" - which models are you thinking of (before you say it: linear models are likely too simple in most cases) | |
| Nov 14, 2017 at 17:41 | history | answered | tom | CC BY-SA 3.0 |