topic Re: SAS ESP reading data from Apache NiFi in Streaming Analytics

SAS ESP reading data from Apache NiFi

jovic92 — Thu, 04 Oct 2018 13:44:41 GMT

Hi everyone,

I have a problem with sending data from Apache NiFi to the Source window in ESP.

Field "Record Schema" is required, but not sure what to input there.

That question mark gives me an explanation about the field that I'm not really getting:

Record Schema

The AVRO schema for input records. If the schema is not set, it generates an AVRO schema from the publish target Source window in the ESP model.

You can get the AVRO schema from a running event stream processing model through the REST interface.

What is AVRO schema and how to run ESP model through the REST interface?

https://documentation.sas.com/?docsetId=espcases&docsetTarget=p1pyldv5uiyl2wn15ofigbx6qbd1.htm&docsetVersion=5.1&locale=en

Any help is welcomed. Thanks in advance

Re: SAS ESP reading data from Apache NiFi

AndyT_SAS — Fri, 05 Oct 2018 14:28:22 GMT

You can get the AVRO format of an ESP window's schema using this REST request:

http://hostname:http_port/SASESP/window?name=xxxxx&schema=true&avro=true

Substitute the window name you are trying to publish to for xxxxx.

But if the Record Schema isn't specified, ESP should connect to the running project and obtain the schema for you. Is the ESP project up when you try to start the processor, it should connect ok. What error message do you get?

Re: SAS ESP reading data from Apache NiFi

jovic92 — Mon, 08 Oct 2018 10:16:59 GMT

Hi @AndyT_SAS

Sorry, I could not answer earlier, I was on a trip.

Here is the screenshot

And yes, ESP engine is started, the project is started, data is coming if I ingest it from files (after created files from Nifi, because PutESP wasn't working).

Thanks for your responses, It means a lot to me.

Best regards,

Sinisa

Re: SAS ESP reading data from Apache NiFi

AndyT_SAS — Tue, 09 Oct 2018 14:31:14 GMT

Hi Sinisa,

I'm not sure what is happening here. I'm going to create a track for you and we can investigate it from there. You will get an email from the track.

Thanks,

Andy

Re: SAS ESP reading data from Apache NiFi

jovic92 — Tue, 09 Oct 2018 15:37:34 GMT

@AndyT_SAS

Thanks Andy, I will answer the questions from the track as soon as I sit in front of my laptop.

Also, I have something else to ask, it is more logical about windows in ESP, which should I use in my particular situation. I have to open a new question, not to ask in this one?

Thank you very much, once again.

Cheers,

Re: SAS ESP reading data from Apache NiFi

AndyT_SAS — Tue, 09 Oct 2018 17:00:28 GMT

I would open a new question. That way the discussions don't get confusing for someone else who finds this thread in the future.