SAS Data Integration Studio, DataFlux Data Management Studio, SAS/ACCESS, SAS Data Loader for Hadoop and others

run time of job that use SCD type2

Reply
Occasional Contributor
Posts: 15

run time of job that use SCD type2

Hi,

I executed SAS generated code by DIS in shell. This job uses SCD type2.

the job takes more then 17h in SCD step but  the same job took 2h30 in previous run.



Thank you


Respected Advisor
Posts: 4,173

Re: run time of job that use SCD type2

Is this just an information or do you want to ask something?

If this is a question then you would need to give us MUCH more information (eg. SAS and DIS version and OS, what changed, the before and after logs as attachment if possible, the volumes, target table SAS or a DB, ...).

Just as general comments:

- If the previous run was an initial load but now it's a consecutive load then the difference in time can be substantial.

- Depending on the DIS version a lot of tweaking can be done (eg. maintaining a permanent XREF table - especially important when loading into a DBMS).

- DB settings like insert buffers.

Occasional Contributor
Posts: 15

Re: run time of job that use SCD type2

No i want to know the cause of this problem.

-SAS version: 9.2

-DIS version: 4.21

-target table: ORACLE

-the both previous run and this run are a consecutive load.

-all parameters aren't changed after the previous run.

thank you

Respected Advisor
Posts: 4,173

Re: run time of job that use SCD type2

Then start analyzing the 2 SAS Logs and determine where the main differences are (number of rows, timing).

Without analyzing the logs there will be no answer - and you haven't posted the logs here in this forum yet.

Ask a Question
Discussion stats
  • 3 replies
  • 221 views
  • 0 likes
  • 2 in conversation