Melissa, Another way to address "QA by Example" in the statistics world is 'regression testing'. Rather than following a single observation through the process, use the same set of inputs for both the development and the production systems and see if you get the same results. [The validation suite that SAS used to send with V8 would do just that. It would send known data through the procedures and run PROC COMPARE on the results.] One, more general, concern I have about doing this scoring with production systems is data completeness and having the tools and processes in place to know the degree of completeness to help interpert the results. Doc Muhlbaier Duke
... View more