In this super demo, we will take a look at how levaraging the SAS Viya platform can accelerate our time from deciding which large language models (LLMs) we should be using for our use case, running prompt engineering in a no-code and a yes-code fashion, tracking every experiment, deploying our prompt as part of a decision, and monitoring the usage and cost in the production system. We will work through a concrete use case, handling customer complaints, and also take a look at how guardrailing LLMs with classic natural language processing (NLP) techniques can improve the outcomes.
Presenting Company: SAS
Watch the recording
