I want to calculate the prediction interval of individual predictions without knowing what it's target value is gonna be. For example, I am doing a blood glucose prediction of individual patients and I want to predict what his/her blood glucose value is going to be after 1 hour. I want to compute where that value is gonna lie. (Predicted value: 250, lies within : 220 - 270 or something) And I don't know what his/her actual value is going to be in next hour. So is it possible to achieve this?
What you are referring to is a problem of estimation regression model uncertainty. The uncertainty estimation method depends on the model that you are using. Take a look at this tutorial, it provides a detailed explanation of what to do when you are using Linear Regression. It also points to the more sophisticated paper, which describes what to do when your model is more complicated.
If you are working with Regression Trees (xgboost) this tutorial provides a code that you can use.