I am looking for techniques which utilise information in an incremental manner.

Example: A day with inclement climate is likely to be followed by another day with inclement climate. Or when an entire dataset sorted by date is available, an algorithm able to identify that a person is likely to call in sick when the previous day had bad weather.

Is there any effective analysis which utilises this prior information where not all events are completely independent?

  • $\begingroup$ Look up Markov models and sequential machine learning. $\endgroup$
    – Emre
    Jul 1 '15 at 14:18
  • $\begingroup$ I have a hunch that Bayesian Analysis might be able to address this problem. But couldn't find reliable literature for it. @Emre, can you provide references where Markov models are used for this type of Prediction/Modelling? $\endgroup$
    – Omley
    Jul 2 '15 at 7:18
  • $\begingroup$ Markov models are the simplest correlated sequence models, so they are widely used. A good example is in modeling language. You can predict the next word in a sequence given the past few words. Many spelling checkers work this way. $\endgroup$
    – Emre
    Jul 3 '15 at 14:17

It looks like you are looking for time series based Machine Learning (or Sequential Machine Learning as Emre pointed out).

This means that you have an entire dataset available to you beforehand. You train on this dataset and then use it to predict next day's weather given the weather of the last n days. Please note that you do not learn incrementally here, i.e. you do not learn from the new data that is rolling in every day. The learning is limited to the dataset that you had beforehand.

Widely used algorithms for this kind of learning are Conditional Random Fields(CRF), Hidden Markov Models etc. Statistical methods like Autoregressive Models can also be used sometimes. A good starting point would be CRFs.

If on the other hand you want to learn incrementally, read about online learning.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.