BookmarkSubscribeRSS Feed
☑ This topic is solved. Need further help from the community? Please sign in and ask a new question.
whymath
Lapis Lazuli | Level 10

I am learning the lesson "Forecasting Using Model Studio in SAS® Viya®" from learn.sas.com and trying to repeat the demo "Pipeline Comparision".

 

I think the result of comparision is very confusing.

Before comparision, the distribution graph of MAPE of "Pipeline1" and "Honest Assessment Auto" are different:

whymath_1-1755761247274.png

whymath_2-1755761264946.png

But after I select both 2 pipelines and click Compare button, the distribution graph of MAPE become different and difficult to explain:

whymath_3-1755761411798.pngwhymath_4-1755761424275.png

 

Why will this happen? I think the distribution graph of MAPE should be same before and after click Compare button. 

1 ACCEPTED SOLUTION

Accepted Solutions
sbxkoenk
SAS Super FREQ

I suspect that — when comparing the pipelines — the horizontal axis is scaled identically for all pipelines (i.e. for all champion models within the pipelines). Check for yourself ... if you only look at pipeline 1, you have a horizontal axis with a much smaller range. The x-axis end point for pipeline 1 — when only looking at pipeline 1 — is below 100 (around 35), while for the comparison it is above 100 (around 125).
Because the number of bars (or the bar width) is calculated based on the range, you fall back from multiple bars to a single bar.
So there is definitely no error. But perhaps it could be improved visually?

 

Ciao,

Koen

View solution in original post

1 REPLY 1
sbxkoenk
SAS Super FREQ

I suspect that — when comparing the pipelines — the horizontal axis is scaled identically for all pipelines (i.e. for all champion models within the pipelines). Check for yourself ... if you only look at pipeline 1, you have a horizontal axis with a much smaller range. The x-axis end point for pipeline 1 — when only looking at pipeline 1 — is below 100 (around 35), while for the comparison it is above 100 (around 125).
Because the number of bars (or the bar width) is calculated based on the range, you fall back from multiple bars to a single bar.
So there is definitely no error. But perhaps it could be improved visually?

 

Ciao,

Koen