"csv File is too large to open inside of Enterprise Guide and will open externally" Error

[rafidaljanahi]

Hi, 

I am trying to import a csv file to SAS enterprise guide and I keep getting this message "csv File is too large to open inside of Enterprise Guide and will open externally". 

I tried to import the data by using the following procedure: 

File → Import Data → Select the data directory → Performance → Bypass the data cleaning process → set the maximum length of the data (176,000)

but still not working. 

The file size is 19 mb and it has 178,000 observations and 17 variables. Please help1

Thank you 

[Kurt_Bremser]

Do you have a description of the file structure?

When I divide 19 million by 178000, I get an average line length of 106 to 107, so there can't be that many columns in the file.

In such a case as yours, I would use the Copy Files task of EG to upload the file to the SAS server, and then run a custom-written data step to read the file. Both parts can be automated in a project like the task created by the import wizard.

If you could post a few lines of the file (including the header line) by copy/pasting from an editor (open the file with Windows Editor) to a window opened with this button:

we can show you how to write that step.

[CarmineVerrell]

Can you try and turn off 'automatically open data or results when added to the project." 

Click on file menu TOOLs -> OPTIONS -> DATA -> PERFORMANCE and then uncheck the option above.

[rafidaljanahi]

Hi Carmine,

Thank you for your response. I did what you recommended and now when I try to work with the data I get the following errr message. 

[CarmineVerrell]

You most likely are dealing with data that is in UTF-8 format. Which means you would need to change your encoding to be able to read this file. 

I don't know anything about your current environment but let us see if this steps below work. BTW , if it doesn't work then please send me more information about how your EG and your environment is setup so i can provide alternative ( example is EG local/server).

Please take a look at steps below ..

1. Go to the link:  C:\Program Files\SASHome_foundation\SASFoundation\9.4\nls

     There should be a configuration file sasv9.cfg in both "en" and "u8" folders.

2. There is a file sasv9.cfg on the location: C:\Program Files\SASHome_foundation\SASFoundation\9.4

    Open it in notepad. Here you will find the config;

    -config "C:\Program Files\SASHome_foundation\SASFoundation\9.4\nls\en\sasv9.cfg"

3. Make a small change in it. Just replace "en" with "u8" and Save.

  -config "C:\Program Files\SASHome_foundation\SASFoundation\9.4\nls\u8\sasv9.cfg"

4. Open a new session of SAS Enterprise Guide and run this code.

    proc options option=encoding;
    run;

5. Now the Encoding of your system will change from WLATIN1 to UTF - 8.

[rafidaljanahi]

I am using SAS through something called Citrix receiver. It's a cloud-based delivery system.

[Tom]

---

@rafidaljanahi wrote:
I am using SAS through something called Citrix receiver. It's a cloud-based delivery system.

---

I thought you were using Enterprise Guide and not actually directly running SAS.  But in either case it doesn't really matter you you connect your keyboard and screen to the application.

You need to check what SAS server your current Enterprise Guide session is connecting to.  If your company wants you to work with Unicode data then they should have a SAS server you can connect to that starts SAS using utf-8 encoding.  That should make it easier to read the file using SAS code.

[rafidaljanahi]

Thank you very much, you have been very helpful.