BookmarkSubscribeRSS Feed

Create and deploy a SAS ESP high availability system using Kafka and Viya 4

Started ‎07-21-2021 by
Modified ‎07-21-2021 by
Views 4,565
kafka.JPG

When building critical applications which require continuous operation, these systems must eliminate single points of failure. This is achieved by creating redundancy at all levels. For example, hospitals and airports require high availability to perform daily activities. When a portion of the IT infrastructure is broken the end users must still have access to key systems to do their work. The idea is to ensure uninterrupted processing of data in the event of a failure within a business critical environment.

 

There are three message buses supported for ESP failover: Solace, RabbitMQ and Kafka. This video will show how to use SAS Event Stream Processing (ESP) in conjunction with a Kafka message bus to build a real time fault-tolerant application which provides analytic services on a Kubernetes system running Viya 4.

 

The presentation highlights the following topics:

  • Define high availability
  • Learn the basics of the Kafka message bus
  • Learn how to deploy an ESP project in failover mode
  • Show an end to end example

SAS ESP and Kafka work together to create a great high availability system with redundancy built into each part of the system.  When combining these two technologies, real-time data pipelines and advanced analytics come together into a fault-tolerant, fast and scalable system.

 

Be sure to view my video for more information!

Version history
Last update:
‎07-21-2021 11:30 AM
Updated by:
Contributors

SAS Innovate 2025: Register Now

Registration is now open for SAS Innovate 2025 , our biggest and most exciting global event of the year! Join us in Orlando, FL, May 6-9.
Sign up by Dec. 31 to get the 2024 rate of just $495.
Register now!

Free course: Data Literacy Essentials

Data Literacy is for all, even absolute beginners. Jump on board with this free e-learning  and boost your career prospects.

Get Started

Article Tags