BookmarkSubscribeRSS Feed

Create and deploy a SAS ESP high availability system using Kafka and Viya 4

Started ‎07-21-2021 by
Modified ‎07-21-2021 by
Views 4,159
kafka.JPG

When building critical applications which require continuous operation, these systems must eliminate single points of failure. This is achieved by creating redundancy at all levels. For example, hospitals and airports require high availability to perform daily activities. When a portion of the IT infrastructure is broken the end users must still have access to key systems to do their work. The idea is to ensure uninterrupted processing of data in the event of a failure within a business critical environment.

 

There are three message buses supported for ESP failover: Solace, RabbitMQ and Kafka. This video will show how to use SAS Event Stream Processing (ESP) in conjunction with a Kafka message bus to build a real time fault-tolerant application which provides analytic services on a Kubernetes system running Viya 4.

 

The presentation highlights the following topics:

  • Define high availability
  • Learn the basics of the Kafka message bus
  • Learn how to deploy an ESP project in failover mode
  • Show an end to end example

SAS ESP and Kafka work together to create a great high availability system with redundancy built into each part of the system.  When combining these two technologies, real-time data pipelines and advanced analytics come together into a fault-tolerant, fast and scalable system.

 

Be sure to view my video for more information!

Version history
Last update:
‎07-21-2021 11:30 AM
Updated by:
Contributors

sas-innovate-2024.png

Don't miss out on SAS Innovate - Register now for the FREE Livestream!

Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.

 

Register now!

Free course: Data Literacy Essentials

Data Literacy is for all, even absolute beginners. Jump on board with this free e-learning  and boost your career prospects.

Get Started

Article Tags