BookmarkSubscribeRSS Feed

Create and deploy a SAS ESP high availability system using Kafka and Viya 4

Started ‎07-21-2021 by
Modified ‎07-21-2021 by
Views 5,078
kafka.JPG

When building critical applications which require continuous operation, these systems must eliminate single points of failure. This is achieved by creating redundancy at all levels. For example, hospitals and airports require high availability to perform daily activities. When a portion of the IT infrastructure is broken the end users must still have access to key systems to do their work. The idea is to ensure uninterrupted processing of data in the event of a failure within a business critical environment.

 

There are three message buses supported for ESP failover: Solace, RabbitMQ and Kafka. This video will show how to use SAS Event Stream Processing (ESP) in conjunction with a Kafka message bus to build a real time fault-tolerant application which provides analytic services on a Kubernetes system running Viya 4.

 

The presentation highlights the following topics:

  • Define high availability
  • Learn the basics of the Kafka message bus
  • Learn how to deploy an ESP project in failover mode
  • Show an end to end example

SAS ESP and Kafka work together to create a great high availability system with redundancy built into each part of the system.  When combining these two technologies, real-time data pipelines and advanced analytics come together into a fault-tolerant, fast and scalable system.

 

Be sure to view my video for more information!

Contributors
Version history
Last update:
‎07-21-2021 11:30 AM
Updated by:

hackathon24-white-horiz.png

The 2025 SAS Hackathon has begun!

It's finally time to hack! Remember to visit the SAS Hacker's Hub regularly for news and updates.

Latest Updates

SAS AI and Machine Learning Courses

The rapid growth of AI technologies is driving an AI skills gap and demand for AI talent. Ready to grow your AI literacy? SAS offers free ways to get started for beginners, business leaders, and analytics professionals of all skill levels. Your future self will thank you.

Get started

Article Tags