Thank you again @RW9
I really appreciate the time and effort you have put into your reply and answering this thread
I will explain things further - for your kind information- and i think you would afterwards say that I am definitely "not using the right tool for the right task"
The documents themselves have been created over many years, they were not intended for data collection, but to serve as reports for human readers, in such, there data was entered as free text. Even worse, as more than one person entered these data, there was no standardized system in writing the report, and different people described the results in different way (through there were some distinct patterns that I have been trying to exploit using Perl expressions)
The documents are stored as .DOC which is even worse. When I used SAS to extract data directly, I had to write a code that would re-save them as rtf files that would be easier to read with SAS. Even after doing this the result was a complete mess.
SO as you can see, the whole project is a bit of a mess that I am trying to salvage. One might think that a better alternative would be for a human reader to extract data manually from the results. Believe me i have been there and have done that many years ago with other projects, but the efficiency and reliability of humans significantly drops for such tasks after only doing a relatively small part of the project.
So my approach now is to combine both, to try to use SAS / other tools to extract as much as possible and then to use the human part to 1. verify output and tweak the code further 2. extract data that could not be extracted through step 1.
I guess another aspect of this is for my own learning. Through this process I learned a few things about using SAS Perl Regular expression, string manipulation, some new aspects in VBA etc....
So at the end of the day, is there a "right tool" to do what I am trying to do? The answer is definitely not, but sometimes the goal is the journey and the challenge and the learning process more than the final result (if I want to be philosophical here!)
As for using VBA in word, I havent thought about that, thanks for the suggesion, though iI would imagine that I would still need to export the data to an intermediary storage like excel or access...
Anyhow. I thank you again for your answer. Your and other people's answers clearly illustrate the important role that SAS Communities play to make life easier for people like me....
... View more