Loading huge data into snowflake table

[samanvi]

Tried to use bulk load in libname but we got problem if I have 2 columns  with 1st is numeric  which has  nulls/nodata  and 2nd with data(char). the second column is moving it's position to left. In this case the character column is moving to numeric side and getting failed with error data type mismatch.

[Tom]

---

@samanvi wrote:

Tried to use bulk load in libname but we got problem if I have 2 columns  with 1st is numeric  which has  nulls/nodata  and 2nd with data(char). the second column is moving it's position to left. In this case the character column is moving to numeric side and getting failed with error data type mismatch.

---

Using bulkload options from SAS?  Raise a support ticket with SAS.

Writing your own code?  Sounds like somewhere you forgot to tell SNOWFLAKE to use the equivalent of the DSD option of the FILE or INFILE statement in SAS.

[samanvi]

We are just remediating the existing codes. Our source is SQL server and creating a physical key and loading them to the snowflake table. SAS ia acting as bridge to load data.

[Patrick]

---

@samanvi wrote:

...

But loading of this 59Mill is taking a lot of time. for every 1 Mill it's taking 20 min. We have 55 columns only.

---

Look into libname options readbuff, insertbuff, and dbcommit