topic Re: run time of job that use SCD type2 in SAS Data Management

run time of job that use SCD type2

deh_asma — Wed, 27 Jun 2012 11:04:05 GMT

Hi,

I executed SAS generated code by DIS in shell. This job uses SCD type2.

the job takes more then 17h in SCD step but the same job took 2h30 in previous run.

Thank you

Re: run time of job that use SCD type2

Patrick — Wed, 27 Jun 2012 13:32:04 GMT

Is this just an information or do you want to ask something?

If this is a question then you would need to give us MUCH more information (eg. SAS and DIS version and OS, what changed, the before and after logs as attachment if possible, the volumes, target table SAS or a DB, ...).

Just as general comments:

- If the previous run was an initial load but now it's a consecutive load then the difference in time can be substantial.

- Depending on the DIS version a lot of tweaking can be done (eg. maintaining a permanent XREF table - especially important when loading into a DBMS).

- DB settings like insert buffers.

Re: run time of job that use SCD type2

deh_asma — Wed, 27 Jun 2012 14:13:15 GMT

No i want to know the cause of this problem.

-SAS version: 9.2

-DIS version: 4.21

-target table: ORACLE

-the both previous run and this run are a consecutive load.

-all parameters aren't changed after the previous run.

thank you

Re: run time of job that use SCD type2

Patrick — Wed, 27 Jun 2012 16:37:59 GMT

Then start analyzing the 2 SAS Logs and determine where the main differences are (number of rows, timing).

Without analyzing the logs there will be no answer - and you haven't posted the logs here in this forum yet.