SAS Data Integration Studio, DataFlux Data Management Studio, SAS/ACCESS, SAS Data Loader for Hadoop and others

Data Loader Performance Tuning

Reply
Occasional Contributor
Posts: 17

Data Loader Performance Tuning

Hello,

 

I have a SAS DI job which takes a bunch of tables from Oracle, pushes down the join criteria before it hits a table loader which directs the dataset into SAS.

 

The join operation completes very quickly, according to the Stats tab in 1 second and returns 7,931 records but the table loader has been processing for nearly two hours.

 

Options on the table loader are as follows:

Load Style: Replace

Replace: Entire Table

New Rows: Append (Proc Append) 

 

Is there anyway I can work out why this transformation is taking so long? Is it possible to view the process in SAS management studio at all?

Super User
Posts: 5,849

Re: Data Loader Performance Tuning

Loading SAS tables is usually not a performance problem.
Looking sort at the transformation run statistics without be aware of the underlying syntax can be misleading. The default setting for SQL Join and many other transformation is create view. Hence your run time may be in Oracle...
Not sure what you refer to as SAS Management Studio. ASFAIK there is no product with that exact name.
Data never sleeps
Ask a Question
Discussion stats
  • 1 reply
  • 162 views
  • 0 likes
  • 2 in conversation