No, I wasn't meaning to denigrate your processing! 🙂
I simply meant that it sounds to me like your environment is taking a long time to process that volume of data. That's why I asked about the file size; if you had replied that it was gigabytes, I wouldn't have thought anything about it. Just to compare, I generated roughly the same data volume (1.6M records, 80 fields, 876MB). It only took five minutes to create the data, and less than 10 seconds to read it. This is on my PC. I'm wondering if you have a communications bottleneck somewhere that's slowing things down; it might be contributing to your "disconnect" issue as well (or maybe the "disconnect" issue is contributing to the slow processing). Anyhow, if you do decide to investigate, there are lots of experts on this board who would be happy to help you out!
Tom
... View more