topic Re: Claims data: clean data first, or query out patients first? in SAS Data Management

Claims data: clean data first, or query out patients first?

cdubs — Wed, 29 Nov 2017 01:38:18 GMT

Hi all,

I've been given an algorithm to select patients who have a certain type of illness. Given a set of ICD-9 codes + inclusion procedure codes, + other criteria (age, region, etc).

Generally with claims data (this is Truven) -- should I clean the entire set first, and then isolate my sample, or isolate my sample and then clean?

Thanks,

Re: Claims data: clean data first, or query out patients first?

Reeza — Wed, 29 Nov 2017 01:53:55 GMT

@cdubs wrote:

Hi all,

I've been given an algorithm to select patients who have a certain type of illness. Given a set of ICD-9 codes + inclusion procedure codes, + other criteria (age, region, etc).

Generally with claims data (this is Truven) -- should I clean the entire set first, and then isolate my sample, or isolate my sample and then clean?

Thanks,

Depends on your cleaning process. If the cleaning process can affect selection then it needs to go first.

Re: Claims data: clean data first, or query out patients first?

ballardw — Wed, 29 Nov 2017 16:26:53 GMT

I agree in general with @Reeza but experience has taught me if age is involved to always at least check it early in any process where it is important.

Finding data like date of birth after the date a service is performed or age (not to mention gender) inappropriate services might be a concern.

You may also have to consider age at time of service vs age at data extract depending on your data systems. Many systems will maintain demographics such as birth date separately from services and may calculate an age based on the date of the extract for each record even though the services were on different dates.