We pipe the results of a jhist command to a file then parse the results into a SAS table. Like Greg mentioned, there are commands to get just jobs or flow info. jhist will return historical information about Process Manager Server, calendars, flow definitions, flows, and jobs. We leverage -C to filter the results to just 'job,flow' then using a -t we can get results just for the time window from our last processing time. Then using SAS Visual Analytics we provide insight into the processes running through the scheduler.
Brandon Kirk | Sr Manager, IT Software Development
If you want to collect the historical data from LSF jobs and flows you can read the files that LSF keeps. There are a few in the LSF directory (jobs) and the process manager directory (flows). The structure of these files is documented by IBM.
These files contain the data that you get from the bjobs, bhist and jhist commands. Depending on how you configured LSF these commands (and the Flowmanager application) show only recent history. This approach allows you to keep the info for an indefinite amount of time.
Let me also point you to the EOM Job Monitor that builds a database of your job and flow execution and has a effective flow-centric web interface.