BookmarkSubscribeRSS Feed

How to Limit the Number of Input Rows in a DataFlux Data Management Studio Data Job

Started ‎03-13-2017 by
Modified ‎03-13-2017 by
Views 1,649

Sometimes you may want to limit the number of rows you are reading in your DataFlux Data Management Studio Data Job. This is especially useful when trying to design and test your data jobs for large input data sets.  



There is an advanced property called MAX_OUTPUT_ROWS that can be used to limit the number of rows read. This property is available on all the Data Input nodes in a Data Management Studio data job. To view the advanced properties for a node, select the node in the data flow and then select 0_Action_button.png > Advanced Properties from the toolbar. It is a best practice to set the value of MAX_OUTPUT_ROWS property using a macro variable as shown below. 1_MAX_OUTPUT_ROWS.png

Figure 1: MAX_OUTPUT_ROWS Advanced Property



Using a macro variable for this setting means you can easily change the number of rows you are reading to increase or decrease the number of records you are working with in your data job. In the example below, the macro variable has been set to 10; therefore, only 10 rows will be read in from the data source.


Figure 2:  NUM_ROWS_TO_READ Macro Variable Setting



As expected the preview of the node below shows only the first 10 records for the data source. 3_MAX_OUTPUT_ROWS_Preview.png Figure 3:  MAX_OUTPUT_ROWS Data Job Preview



Setting the macro variable value to 0 means that all rows will be read in from the input data source. Typically, in your macro variable settings on your DataFlux Data Management Server you will have the MAX_OUTPUT_ROWS macro variable name you used in your data jobs set to 0, so all rows will be read in from you input data sources when running data jobs on the server.    



For more information on Advanced properties for nodes in DataFlux Data Management Studio, refer to the topic “Advanced Properties” in the DataFlux Data Management Studio 2.7: User’s Guide.    


Version history
Last update:
‎03-13-2017 04:23 PM
Updated by:



Registration is open! SAS is returning to Vegas for an AI and analytics experience like no other! Whether you're an executive, manager, end user or SAS partner, SAS Innovate is designed for everyone on your team. Register for just $495 by 12/31/2023.

If you are interested in speaking, there is still time to submit a session idea. More details are posted on the website. 

Register now!

Free course: Data Literacy Essentials

Data Literacy is for all, even absolute beginners. Jump on board with this free e-learning  and boost your career prospects.

Get Started

Article Labels
Article Tags