SAS ESP Event Generator
SAS Event Stream Processing is a powerful solution to analyze streaming data and take appropriate action instantly. When designing your ESP model, you might face some challenges regarding the test, simulation, performance analysis and workload management of your streaming application. That’s where the Event Generator comes in. An Event Generator is an ESP object that generates event streams and publishes them into an event stream processing model. The Event Generator, which is new in SAS ESP 4.1/4.2, is very useful:
- To generate random sample data
- To test your ESP model when you don’t have yet sample data in flat files or in dynamic sources
- To validate the performance, the throughput, the low-latency required and the architecture of your ESP application
Let's go into more details.
Design an Event Generator
An Event Generator is an XML string that cannot be designed in ESP Studio. Event Generators can be created, destroyed, started, and stopped through the SAS Event Stream Processing HTTP interface (REST admin API). Let’s have a look at an Event Generator complete example:
The "publish-target" tag identifies the ESP source window that we want to publish events to.
The "resources" tag defines the resources from which you can read maps, lists, and sets to be accessed from your event generation functions.
Resources can also point to external files.
The "init" section is aimed to initialize a set of values upon the start of the event generation. The resources (properties) defined above are referenced here using # symbols (e.g. #brokers, #venues).
And the "fields"tag defines the event values to be generated using a set of functions. They are based on the functions defined in Functional Window and Notification Window Support Functions in SAS Event Stream Processing: Programming Reference.
For example, the "listItem(#symbols,random(0,$numSymbols))" will return a random item from the defined list of symbols, the random function returning a number between 0 and $numSymbols.
Run an Event Generator
Once you have designed a valid Event Generator, next steps are to create it by pushing the XML into an ESP XML server and start it. Here is the command to create it. The URL means that you want to create an Event Generator called myFirstEG in the according ESP server.
Note: this example assumes you have an ESP XML Factory Server running with an admin port of 5556.
You should see the following:
If you look to the linux terminal where you started the ESP XML Factory Server (assuming you started it with the -loglevel "event.generator=trace"), you should see how the Event Generator is initialized:
Then, you are ready to start your Event Generator with the following command:
This command tells the Event Generator to load 3000 events, at a rate of 50 events per second with a blocksize of 5 events.
You should see the following:
If you look to the linux terminal where you started the ESP XML Factory Server (assuming you started it with the -loglevel "event.generator=trace"), you should see how the Event Generator publishes events:
Now it is running, you should see some events coming in your ESP model, so that you can check the consistency of your model and your rules.
You have additional REST API methods:
- To retrieve all Event Generators from a ESP XML server with http://<server>:5556/SASESP/eventGenerators (GET method, works in a browser)
- To retrieve the current state of a specific Event Generator with http://<server>:5556/SASESP/eventGenerators/myFirstEG (GET method, works in a browser)
- To stop the Event Generator with http://<server>:5556/SASESP/eventGenerators/myFirstEG/state?value=stopped (PUT method)
- To remove an Event Generator from an ESP XML server with http://<server>:5556/SASESP/eventGenerators/myFirstEG (DELETE method)
Finally, the real rate (number of events published per second) is defined by the maximum value of either blocksize or rate. Here are several examples to illustrate this:
- EVENTS=100 BLOCKSIZE=10 RATE=1
- 1 block of 10 events will be published per second, resulting in a 10 seconds run
- EVENTS=100 BLOCKSIZE=1 RATE=10
- 10 blocks of 1 event will be published per second, resulting in a 10 seconds run
- EVENTS=16384 BLOCKSIZE=256 RATE=1024
- 4 blocks of 256 events will be published per second, resulting in a 16 seconds run
Don't miss out on SAS Innovate - Register now for the FREE Livestream!
Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.
