topic Accessing Google BigQuery - Best Options to set? in SAS Data Management

Accessing Google BigQuery - Best Options to set?

ProcWes — Fri, 09 Apr 2021 15:49:33 GMT

My company is switching from Teradata to Google BigQuery. In testing, I'm seeing fairly large performance decreases, that is it takes longer to get data now than before. I have tried regular Proc SQL which is unusably slow with large data and Pass Through which is only a little slower, but requires the code to be reworked, and the data formats break.

Just wondering if anyone has experience converting to GBQ and if there are system options (SAS EG) that can be set to make things easier/faster/better.

Thanks!

Re: Accessing Google BigQuery - Best Options to set?

SASKiwi — Sat, 10 Apr 2021 06:24:53 GMT

I suggest you post the complete SAS logs of both your regular and pass-thru queries so we can get a better idea of what's happening.

Re: Accessing Google BigQuery - Best Options to set?

Cyril_R — Tue, 02 Nov 2021 21:30:07 GMT

Hi,
Did you find a way to improve SAS reading data from BigQuery.
I tried to change readbuff and used bulkunload set to yes but i'm getting this error : ERROR: CLI open cursor error.
So, to read a table wich have 40k lines it's take 5 minutes. I think there is a way to change this.
does anyone have an idea ?