A couple of questions (any help appreciated) -- 1. Is there a way to change the threshold value that Studio uses to reject models? Ideally, I'd want to get forecasts from all models considered i.e., have zero rejected models. I understand that it's possible to get the runner-up (not rejected but not the champion model either) models from outstatselect and it's further possible then to generate forecasts by feeding that selection list + model list (after creating the logical concatentation for the model repository) to HPFEngine and getting the forecasts. But, to identify the rejected models, other than going into autolevmodrep to get all the models in the selection list and then matching that with the list in outstatselect to figure out which models were rejected, it doesn't look like there's any other way to resolve it? So, I was wondering if it's instead possible to simply change the threshold value (for whatever criterion one is using i.e., MASE, RMSE etc) that Studio uses to reject models? That way more (or all) of the models will be selected. 2. Is there a direct way to capture the forecasts for all the runner-up models in the Studio batch code? Currently, it looks like the only way to do it is to get the runner-up models (from outstatselect) for each series, create the logical modelrep and then run HPFEngine to get the forecasts for each of the runner-up models. Depending on the number of series that one has to go through this process, it can take many hours to complete. So, I was wondering if there's a way to modify the HPFEngine code (as part of the Studio batch code) to get the forecast datasets for all the runner-up models?
... View more
