topic Re: Possible and Probable Cases in SAS Programming

Possible and Probable Cases

mar00390 — Tue, 14 Jan 2020 21:47:10 GMT

If I want to find possible and probable cases of a disease using full-text search from a cohort of people, what would some suggestions be?

For example, I have two variables: PatientNumber and Text. In some cases, the text tells me immediately - "Possible diagnosis" - but other times, the text never uses "possible" or "probable." I don't know if I can search for "might have diagnosis" because I don't think doctors write that, but I don't want to eliminate possible cases just because they don't have the word "possible" or "probable" in it.

Any ideas would be useful. Please help!

Re: Possible and Probable Cases

mkeintz — Tue, 14 Jan 2020 22:00:40 GMT

Take a sample of the unclassified text (i.e. that don't have "probable" or "possible"). BTW, you did screen for negatives right, like "not probable"?. See if there are expressions you conclude mean probable or possible. Add those expressions to your classification logic. Apply to your data, thereby reducing the number of unclassified.

Repeat the above with a sample of the remaining unclassified text.

Re: Possible and Probable Cases

Reeza — Tue, 14 Jan 2020 23:31:37 GMT

Find all of the words that are diagnosis in your file.

Find all words on either side, accounting for punctuation, using a two to five word window. Look at that data to determine your rules.