About Chuck_IV4

Chuck_IV4 · ‎10-19-2018

Ok, I am very close to getting this working. If I remove the single quotes around the URL Encoded script= code, it WORKS(See below)! proc http method="GET" url="https://mixpanel.com/api/2.0/jql?script=function%20main()%20%7Breturn%20Events(%7Bfrom_date%3A%20%222018-10-17%22,%20to_date%3A%20%222018-10-19%22%7D)%7D" ct="application/json" headerout=hresult out=json; headers "Authorization" = "Basic &api_secret."; run; The issue was the script = code does NOT need the single quotes(even though the cURL statement shows them). However, this now presents another problem. I need to put the script code into its own file and then call the file. The problem is, when I put the file name as the script= statement(something like script=jscript.js), JQL thinks the jscript.js the actual script code and not a file name. I guess I can set a macro variable to the entire file and then just drop the macro variable in place of the jscript.js filename but that seems a little odd to have to do. Any thoughts on this one? Thanks.

Chuck_IV4 · ‎10-19-2018

Hi Everyone, I am really struggling with converting what I am able to get to run in Postman, into a valid Proc HTTP statement... I usually am able translate the cURL code snippets from Postman into SAS using Proc HTTP quite easily, but this one is stumping me. Here is the cURL code that works(removed my secret code and Postman token)... curl -X GET \ 'https://mixpanel.com/api/2.0/jql?script={{encoded_script}}' \ -H 'Authorization: Basic <my Secret Code>' \ -H 'Postman-Token: My Token' \ -H 'cache-control: no-cache' The {{encoded_script}} is a prerequest script that URLEncodes the actual script... var encoded = encodeURIComponent(function main() {return Events({from_date: "2018-10-17", to_date: "2018-10-19"})}); postman.setEnvironmentVariable("encoded_script", encoded); In reading the 3rd party vendors API documentation(JQL is what they use), here is a cURL example they give... curl https://mixpanel.com/api/2.0/jql \ -u Secret_Code \ --data-urlencode params='{"from_date":"2016-01-01", "to_date": "2016-01-07"}' \ --data-urlencode script='function main(){ return Events(params).groupBy(["name"], mixpanel.reducer.count()) }' My Proc HTTP statement looks like this, where the script= part has been run through the URLEncode function(I tried it not running it through that as well)... proc http method="GET" url="https://mixpanel.com/api/2.0/jql?script='%27function%20main()%20%7Breturn%20Events(%7Bfrom_date%3A%20%222018-10-17%22,%20to_date%3A%20%222018-10-19%22%7D)%7D%27'" ct="application/json" headerout=hresult out=json; headers "Authorization" = "Basic &api_secret."; run; It authenticates fine but I always get a Bad Request with a message similar to ... {"request": "/api/2.0/jql?script=%27function%20main()%20%7Breturn%20Events(%7Bfrom_date%3A%20%222018-10-17%22%2C%20to_date%3A%20%222018-10-19%22%7D)%7D%27", "error": "[Validate failed]the query must define the main() function\n"} I have also tried putting the script= into the IN= statement but the API always tells me I am missing the Script= statment(which is required). It seems to have something to do with URL Encoding the script, but it still doesn't seem like it likes my URL Encoded text. Any help would be appreciated.

Chuck_IV4 · ‎10-05-2018

That's an interesting thought. Reading it in line by line, outputting each line to a temp file then using the JSON engine to read that file and append it to the current dataset. Only issue I can see is making sure I create a map file that has the max length of each field. I may give this a shot. It sounds a lot easier that parsing the lines myself.

Chuck_IV4 · ‎10-05-2018

Unfortunately yes, that is my answer. I just talked to SAS and the JSON engine specialist says it cannot read that type of file. Hopefully they have this on their to do list as it seems like only a small update would be needed to handle the shifting to a new line, As I mentioned, if I have a file with just one line, the JSON engine works perfectly, it just doesn't know what to do after it hit's the end of the first line.

Chuck_IV4 · ‎10-05-2018

Ahh, I was in some strangely formatted version of the site and wasn't seeing the gear icon. After closing my browser and reopening it, the site looks like it used to. Anyway, it seems like that the return is something called JSONL, which the JSON engine seems to have issues with. I'm wondering if there's some type of option in maybe a custom mapping file to let it know it's JSONL vs JSON.

Chuck_IV4 · ‎10-05-2018

Here is the note from the vendor about the return format... Return Format: One event per line, sorted by increasing timestamp. Each line is a valid JSON object although the return itself is valid JSON but instead JSONL. Timestamps are expressed in seconds since January 1, 1970 in your project's timezone, not UTC as a true epoch timestamp. For example, if your project is set to Pacific time, you would need to add 8 hours (or 7 hours if not in daylights savings time) (60 min * 60 secs * 8 hours) to the timestamp in order to convert this timestamp into UTC. This means that converting the raw exported timestamps using many epoch converters will result in representing times with the incorrect offset. On a side note, is there a way to edit a previous post?

Chuck_IV4 · ‎10-05-2018

As a note, those are the first two lines in the file.

Chuck_IV4 · ‎10-05-2018

Here are two lines. In looking at the file, it is missing some elements of a normal JSON file(at least one that I am used to seeing)... {"event":"ws_page_load","properties":{"time":1536988982,"distinct_id":"165dd2f00c2468-0bcb9b2618f4ee-a35346f-130980-165dd2f00c3c55","$browser":"Chrome","$browser_version":64,"$city":"Trumbull","$current_url":"https://rgs-web-prod.fingerprintplay.com/teachers/login","$initial_referrer":"$direct","$initial_referring_domain":"$direct","$lib_version":"2.18.0","$os":"Windows","$region":"Connecticut","$screen_height":912,"$screen_width":1368,"mp_country_code":"US","mp_lib":"web","mp_processing_time_ms":1537014182964,"page_path":"https://rgs-web-prod.fingerprintplay.com/teachers/login","user_agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/64.0.3282.167 Safari/537.36"}} {"event":"ws_page_load","properties":{"time":1536988982,"distinct_id":"165dd2f00c2468-0bcb9b2618f4ee-a35346f-130980-165dd2f00c3c55","$browser":"Chrome","$browser_version":64,"$city":"Trumbull","$current_url":"https://rgs-web-prod.fingerprintplay.com/teachers/login","$initial_referrer":"$direct","$initial_referring_domain":"$direct","$lib_version":"2.18.0","$os":"Windows","$region":"Connecticut","$screen_height":912,"$screen_width":1368,"mp_country_code":"US","mp_lib":"web","mp_processing_time_ms":1537014183057,"page_path":"https://rgs-web-prod.fingerprintplay.com/teachers/login","user_agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/64.0.3282.167 Safari/537.36"}}

Chuck_IV4 · ‎10-05-2018

So I have read in a supposed JSON file from a vendor and normally, when I get a JSON file, when viewing it, the data is all on one line. The JSON engine handles this just fine. However, the file I am receiving from this vendor, has it separated somehow, where each record shows on its own line. This is causing issues with the JSON engine. It tells me... ERROR: Invalid JSON in input near line 2 column 2: Unexpected characters found after valid JSON text. If I take just one line of data from the file, the JSON engine reads it perfectly, but it chokes on anything past the first line because I think it is possibly putting a CR/LF at the end of each line and this is causing the issue. Is there some type of option I can set with the JSON engine to tell it to ignore the characters at the end, or will I need to filter these out somehow via maybe an infile statement? Thank You.

Chuck_IV4 · ‎09-05-2018

I FINALLY got it. WOW. Here is the code I used to get it to generate the code... proc http method="POST" url="https://auth.listrak.com/OAuth2/Token" ct="application/x-www-form-urlencoded" in='grant_type=client_credentials&client_id=xxxxxxxxxxxxxxxx&client_secret=xxxxxxxxxxxxxxxxx' headerout=headers out=resptkn HEADEROUT_OVERWRITE; run; I guess the key was to not only send the grant type via the IN= option, but also the credentials. That seemed to be my hangup. I kept trying to send them as part of the initial URL.

Chuck_IV4 · ‎09-05-2018

Put a post up for help with proc HTTP and it was marked as spam. Please put it back. I really need some help on my topic. **EDIT** Thank You for returning it to the boards.

Chuck_IV4 · ‎09-05-2018

Hello Everyone, I am struggling to get Proc HTTP to return an Access Token from a company called Listrak, uing their REST API. I AM able to get it from Postman, using their instructions, but I cannot seem to translate that into something that works with Proc HTTP. This is the Postman HTTP code that works(client_id/secret x'd out for security)... POST /OAuth2/Token HTTP/1.1 Host: auth.listrak.com Cache-Control: no-cache Postman-Token: xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx Content-Type: application/x-www-form-urlencoded grant_type=client_credentials&client_id=xxxxxxxxxxxxxxxxxxxxxxxx&client_secret=xxxxxxxxxxxxxxxxxxxxx The SAS code I have tried is this but it always returns a "Bad Request" from the headerout and {"error":"Invalid Grant Type"} error from the resptkn file... filename resptkn TEMP; filename headers TEMP; %let client_credentials = xxxxxxxxxxxxxxxxxxxxxx; %let client secret = xxxxxxxxxxxxxxxxxxxxxxxxxx; %let oauth2_token = https://auth.listrak.com/OAuth2/Token proc http method="POST" url="&oauth2_token.?grant_type=client_credentials%str(&)client_id=&client_id%str(&)client_secret=&client_secret" ct="application/x-www-form-urlencoded" headerout=headers out=resptkn HEADEROUT_OVERWRITE; run; I "think" the issue is based on the fact that with Postman, I had to put the credentials and grant type in the BODY portion and not the header portion. While I know about the Headers option in Proc HTTP, I don't know how to put anything into a BODY portiong with proc HTTP. Once I have a token, I am able to connect to their REST Any help would be much appreciated. Thank You

Online Status	Offline
Date Last Visited	‎12-03-2018 12:02 PM

Re: Proc HTTP and sending URLEncoded Javascript file...

Proc HTTP and sending URLEncoded Javascript file...

Re: Using JSON libname engine to read JSON file that is NOT all on the...

Re: Using JSON libname engine to read JSON file that is NOT all on the...

Re: Using JSON libname engine to read JSON file that is NOT all on the...

Re: Using JSON libname engine to read JSON file that is NOT all on the...

Re: Using JSON libname engine to read JSON file that is NOT all on the...

Re: Using JSON libname engine to read JSON file that is NOT all on the...

Using JSON libname engine to read JSON file that is NOT all on the sam...

Re: Cannot get Proc HTTP to return Access Token via REST API...

Re: Using JSON libname engine to read JSON file that is NOT all on the...

Re: Cannot get Proc HTTP to return Access Token via REST API...

Re: Proc HTTP and sending URLEncoded Javascript file...

Proc HTTP and sending URLEncoded Javascript file...

Re: Using JSON libname engine to read JSON file that is NOT all on the...

Re: Using JSON libname engine to read JSON file that is NOT all on the...

Re: Using JSON libname engine to read JSON file that is NOT all on the...

Re: Using JSON libname engine to read JSON file that is NOT all on the...

Re: Using JSON libname engine to read JSON file that is NOT all on the...

Re: Using JSON libname engine to read JSON file that is NOT all on the...

Using JSON libname engine to read JSON file that is NOT all on the sam...

Re: Cannot get Proc HTTP to return Access Token via REST API...

Re: What to do when our spam filter traps your post

Cannot get Proc HTTP to return Access Token via REST API...