4
$\begingroup$

I am trying to learn and use reinforcement learning. Now I have only 6 numeric features in my dataset. Can I still use RL? in other words can be using RL for a such a number of features sensible?

$\endgroup$

2 Answers 2

5
$\begingroup$

It is relatively common when learning basics of RL (as opposed to Deep RL with neural networks etc), to consider a single discrete state variable. For instance many grid worlds, maze solvers etc just enumerate the positions. For practical learners, the variable is effectively one-hot encoded, but it is still a single variable.

The number of state features is not relevant to whether RL is applicable or not.

Assuming you have correctly formulated your problem as a Markov Decision Process (MDP), then the important things to consider are:

  • Do the state variables capture enough data about the current state so that the problem has the Markov property (that predictions of future rewards and state can be made using only the current state and action choices)?

  • Do the state variables need to be pre-processed before being used as features for your learning algorithm?

  • Is your state space, once turned into features, small and suitable for learning with a simple tabular method?

  • If the state space is not small, does a simple transformation (such as using a discrete tiling) make the problem simple, possibly linear, or is it complex? Simple problems can be adjusted to work with tabular approaches or linear approximators, complex ones will need approaches from Deep RL, such as DQN or A3C.

$\endgroup$
6
$\begingroup$

It really depends on how much data (samples) you have instead of how many features each samples has. And more importantly it depends on how you plan to structure the problem into an Environment with States and Actions.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.