I am looking into hyper-parameter tunning and was curious about whether the search space is considered continuous or discrete? My understanding of both those cases: 1. Continuous would make it 'easier' to look for hyperparameters combinations that are more fine-tuned to the problem. 2. Discrete would imply that a more brute-force (or random) approach would be helpful.
Subsidiary question: Am I mistaking on my understanding of either of those cases?