• I think this' a good question but pls give more details, best by way of an example. Say the feature set available at training time for model $M_1$ is $x_1, x_2, x_3$. Are you asking what to do with model $M_1$ when feature $x_4$ appears? – horaceT Feb 14 '17 at 0:29