2
$\begingroup$

What are some machine learning methods that can be applied to non-compact input domain and output range?

Neural Networks is clearly not one of them as they well approximate in an interval.

I have a problem at hand where I need to identify a function with domain the entire real line. The good thing is I know the asymptotic behavior, which is a finite point.

Unfortunately common ML methods diverge immediately outside of training bounds and cannot be hoped to have any asymptotic stability. Polynomials were one idea that came to my mind, but they also diverge asymptotically.

$\endgroup$

1 Answer 1

1
$\begingroup$

Notice that the limitation of finite domains and ranges stems from the finite nature of hardware and thus finite representation of numbers. Therefore, a more promising approach is remodeling the domain, rather than using an "infinite" algorithm.

You can apply logarithmic scaling to your domain and range. This will get you off from the open bounds while still preserving order and continuity, which is important fur numerical ML algorithms.

The log function is the basic building block that you can use for your transformation. You can scale it to fit your ranges and this would solve your positive part of the range. You can do the same for the negative, even using different coefficients if this suits you.

$\endgroup$
3
  • $\begingroup$ Not really. Log transformation doesn’t solve anything. There are ways to make the real line compact but they don’t solve the learning problem either as unseen data samples always fall to the boundary. $\endgroup$ Nov 24, 2018 at 8:33
  • 1
    $\begingroup$ I'm sorry, I do not understand the "unseen data samples always fall to the boundary" part. Did you mean that huge data samples fall close to the boundary? Isn't this part of the intention, to identify disproportionally huge datapoints, simply as huge and move on? $\endgroup$
    – mapto
    Nov 24, 2018 at 9:20
  • $\begingroup$ Another approach to map real numbers onto a compact subset is trigonometric mapping, but while mathematically this is an isomorphic transformation, computationally it is more messy and sacrifices precision. $\endgroup$
    – mapto
    Nov 24, 2018 at 9:21

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.