I want to set up some data drift monitoring. My first inclination was to write some code to get missing, mean, median, min, max etc for each column in my datasets (aobut 2000 variables). But the Run profile in Data explorer does most of what I want, so I was wondering if there is a way to use the Profiling to create a dataset that allows me to monitor how a dataset changes from day to day. The relevant dataset is uploaded each day as part of scoring data, so I would somehow need to call the Run Profile task e.g. via the VIYA API, and store the profile results for each day. I couldn't find anything about running data profiles on developer.sas.com. Is this a dead end? Am I better off just writing some proc meas and transposes? Or are the data profiles meant to be used as a means to monitor data drift?
... View more