SAS VI Indexer - Performance improvement and API return

[avinashjha1787]

SAS VI Indexer - Performance improvement and API return

Hi

I am triggering SVI Indexer via API call from batch mode.

1. The API indexer takes a lot of time for indexing all entities and the time increases each day with new data load. How can I fine tune the performance ? Any guide on implementing Incremental Indexing ?

2. Is there any way to capture when the indexing triggered via API call is complete, it would be helpful to trigger next job. Currently I am just using sleep function to hold the next job.

[Erik_Zencos]

Hi 

1. Use this example program: ".../sas/spre/home/SASFoundation/ucmacros/amlcoresrv/fcf_post_index_etl.sas" combined with this docuentation: https://documentation.sas.com/doc/en/compcdc/8.2/visgatorag/n1qumm1bvz5hi5n1c6qp962o725i.htm and you should be able to create a batch job that does an incremental update. See screenshot of a program (part of it) that I made. 

2. Might not be needed if you get above to work, very fast update. Otherwise you can probably make a query to the e.g. indext.dh_batch_job_execution table to query the status of the index job and trigger the next job based on the result. 

The Zencos team can help you if you need more guidance. 

[avinashjha1787]

Hi @Erik_Zencos

Thanks for the suggestion. I observe that not ALL entities are getting Indexed Incrementally. Few of them are still indexing full load.

[Erik_Zencos]

Glad I could be of help. If you have any concerns I would look at this log: root_folder/sas/viya/config/var/log/svi-indexer/default/sas-svi-indexer_xxxx.log

or take a closer look at the tables in the postgres schema "svi_indexer".