@FriedEgg, Thanks for the suggestions.  By web service do you mean use java via proc groovy to submit a request to the api?   Would this be faster than using cURL?  The reason I use cURL is that I can submit 3 requests simultaneously. -Bill ... View more

Kurt, Your idea works!  I use the x command to call cURL and save the output directly to a text file.  This circumvents any restrictions in SAS.  I can then use proc groovy to parse the data (json file).  Thanks for your help. -Bill Code: x "curl -d @C:\Users\Bill\Desktop\curl.txt -H ""Authorization: OAuth oauth_consumer_key=""""&oauth_consumer_key"""",oauth_token=""""&oauth_token"""",oauth_signature_method=""""&oauth_signature_method."""",   oauth_signature=""""&oauth_signature."""",oauth_timestamp=""""&oauth_timestamp."""",oauth_nonce=""""&oauth_nonce."""",oauth_version=""""&oauth_version.""""""   -k &url. -o C:\json.txt"; ... View more

Kurt, Thanks for your thoughts.  My input statement is below.  Currently, I'm putting the output to the log, so I can view it.  I could be wrong, but I don't believe the input statement is the issue.  It appears that the data gets truncated when I execute the filename statement.  Note I've examined the output from the filename statement and the total record length is just below 1098304, which is the limit SAS imposes even though I specify lrecl=100M.  data _null_;   infile data truncover;   input;   put _infile_; run; ... View more

FriedEgg, It was the classpath.  I added groovy-2.4.0.jar and groovy-json-2.4.0.jar separately, and the code runs!  Thanks so much for your assistance in this matter.  Note the json parser seems to execute quickly.  Now that you've given me a working  template, I'll try to compare json with xml to see which is faster. Thanks again. Bill ... View more

Friedegg, Thanks so much for your code and thoughts on this problem.  I made your suggested changes, but still cannot get the code to run. Note I tried using both the groovy-all jar that was installed with SAS and a newer version.  I got the same error in both cases. -Bill Log: 1661  dm 'clear log'; 1662 1663  options mprint; 1664 1665  filename cp temp; 1666 1667  proc 1667!      groovy classpath=cp; NOTE: The ADD CLASSPATH command completed. 1668 1669  add classpath="C:\Program Files (x86)\Groovy\Groovy-2.4.0\lib\groovy-all.2.4.0.jar"; NOTE: The ADD CLASSPATH command completed. 1670 1671  submit parseonly; 1672  import groovy.json.JsonSlurper 1673  class MyJsonParser { 1674      def parseFile(path) { 1675       def jsonFile = new File(path) 1676    def jsonText = jsonFile.getText() 1677          def InputJSON = new JsonSlurper().parseText(jsonText) 1678          def accounts = [] 1679 1680 1681          InputJSON.results.each{ 1682              accounts << [ 1683                      acct_nbr      : it.acct_nbr.toString(), 1684                      firstName     : it.firstName, 1685                      lastName      : it.lastName, 1686                      age           : it.age.toString(), 1687                      streetAddress : it.address.streetAddress, 1688                      city          : it.address.city, 1689                      state         : it.address.state, 1690                      postalCode    : it.address.postalCode 1691              ] 1692          } 1693 1694 1695          return accounts 1696      } 1697  } 1698  endsubmit; ERROR: The SUBMIT command failed. org.codehaus.groovy.control.MultipleCompilationErrorsException: startup failed: script14252651249521306453411.groovy: 1: unable to resolve class groovy.json.JsonSlurper @ line 1, column 1.    import groovy.json.JsonSlurper    ^ 1 error      at org.codehaus.groovy.control.ErrorCollector.failIfErrors(ErrorCollector.java:296)      at org.codehaus.groovy.control.CompilationUnit.applyToSourceUnits(CompilationUnit.java:860)      at org.codehaus.groovy.control.CompilationUnit.doPhaseOperation(CompilationUnit.java:521)      at org.codehaus.groovy.control.CompilationUnit.processPhaseOperations(CompilationUnit.java:497)      at org.codehaus.groovy.control.CompilationUnit.compile(CompilationUnit.java:474)      at groovy.lang.GroovyClassLoader.parseClass(GroovyClassLoader.java:292)      at groovy.lang.GroovyClassLoader.parseClass(GroovyClassLoader.java:263)      at groovy.lang.GroovyClassLoader.parseClass(GroovyClassLoader.java:207)      at groovy.lang.GroovyClassLoader.parseClass(GroovyClassLoader.java:217) 1699 1700 1701  submit parseonly; 1702  import java.util.ArrayList; 1703  import java.util.Iterator; 1704  import java.util.LinkedHashMap; 1705 1706 1707  public class MyJsonParser4Sas { 1708      public String filename = ""; 1709 1710 1711      public void init() { 1712          MyJsonParser myParser = new MyJsonParser(); 1713          accounts = myParser.parseFile(filename); 1714          iter = accounts.iterator(); 1715      } 1716 1717 1718      public boolean hasNext() { 1719          return iter.hasNext(); 1720      } 1721 1722 1723      public void getNext() { 1724          account = ((LinkedHashMap) (iter.next())); 1725      } 1726 1727 1728      public String getString(String k) { 1729          return account.get(k); 1730      } 1731 1732 1733      protected ArrayList accounts; 1734      protected Iterator iter; 1735      protected LinkedHashMap account; 1736  } 1737  endsubmit; ERROR: The SUBMIT command failed. org.codehaus.groovy.control.MultipleCompilationErrorsException: startup failed: script1425265124971621978172.groovy: 11: unable to resolve class MyJsonParser @ line 11, column 22.            MyJsonParser myParser = new MyJsonParser();                         ^ script1425265124971621978172.groovy: 11: unable to resolve class MyJsonParser @ line 11, column 33.            MyJsonParser myParser = new MyJsonParser();                                    ^ 2 errors      at org.codehaus.groovy.control.ErrorCollector.failIfErrors(ErrorCollector.java:296)      at org.codehaus.groovy.control.CompilationUnit.applyToSourceUnits(CompilationUnit.java:860)      at org.codehaus.groovy.control.CompilationUnit.doPhaseOperation(CompilationUnit.java:521)      at org.codehaus.groovy.control.CompilationUnit.processPhaseOperations(CompilationUnit.java:497)      at org.codehaus.groovy.control.CompilationUnit.compile(CompilationUnit.java:474)      at groovy.lang.GroovyClassLoader.parseClass(GroovyClassLoader.java:292)      at groovy.lang.GroovyClassLoader.parseClass(GroovyClassLoader.java:263)      at groovy.lang.GroovyClassLoader.parseClass(GroovyClassLoader.java:207)      at groovy.lang.GroovyClassLoader.parseClass(GroovyClassLoader.java:217) 1738 1739 1740  quit; NOTE: The SAS System stopped processing this step because of errors. NOTE: PROCEDURE GROOVY used (Total process time):       real time           0.04 seconds       cpu time            0.01 seconds 1741 1742 1743  options set=classpath "%sysfunc(pathname(cp,f))"; 1744  filename json "/C:/json.txt"; 1745 1746 1747  data accounts; 1748     attrib id            label="Account Index"  length=    8 1749            acct_nbr      label="Account Number" length=$  10 1750            firstName     label="First Name"     length=$  20 1751            lastName      label="Last Name"      length=$  30 1752            age           label="Age"            length=$   3 1753            streetAddress label="Street Address" length=$ 128 1754            city          label="City"           length=$  40 1755            state         label="State"          length=$   2 1756            postalCode    label="Postal Code"    length=$   5; 1757 1758 1759     dcl javaobj accounts("MyJsonParser4Sas"); 1760     accounts.exceptiondescribe(1); 1761 1762 1763     accounts.setStringField("filename", "%sysfunc(pathname(json,f))"); 1764 1765 1766     accounts.callVoidMethod("init"); 1767 1768 1769     accounts.callBooleanMethod("hasNext",rc); 1770     do id=1 by 1 while(rc); 1771        accounts.callVoidMethod("getNext"); 1772     accounts.callStringMethod("getString", "acct_nbr", acct_nbr); 1773     accounts.callStringMethod("getString", "firstName", firstName); 1774     accounts.callStringMethod("getString", "lastName", lastName); 1775     accounts.callStringMethod("getString", "age", age); 1776     accounts.callStringMethod("getString", "streetAddress", streetAddress); 1777     accounts.callStringMethod("getString", "city", city); 1778     accounts.callStringMethod("getString", "state", state); 1779     accounts.callStringMethod("getString", "postalCode", postalCode); 1780        output; 1781     accounts.callBooleanMethod("hasNext",rc); 1782     end; 1783 1784     drop rc; 1785  run; ERROR: Could not find class MyJsonParser4Sas at line 1759 column 24.  Please ensure that the        CLASSPATH is correct. ERROR: DATA STEP Component Object failure.  Aborted during the EXECUTION phase. java.lang.ClassNotFoundException: MyJsonParser4Sas      at java.net.URLClassLoader$1.run(Unknown Source)      at java.security.AccessController.doPrivileged(Native Method)      at java.net.URLClassLoader.findClass(Unknown Source)      at java.lang.ClassLoader.loadClass(Unknown Source)      at groovy.lang.GroovyClassLoader.loadClass(GroovyClassLoader.java:674)      at groovy.lang.GroovyClassLoader.loadClass(GroovyClassLoader.java:773)      at java.lang.ClassLoader.loadClass(Unknown Source) NOTE: The SAS System stopped processing this step because of errors. WARNING: The data set WORK.ACCOUNTS may be incomplete.  When this step was stopped there were 0          observations and 9 variables. WARNING: Data set WORK.ACCOUNTS was not replaced because this step was stopped. NOTE: DATA statement used (Total process time):       real time           0.01 seconds       cpu time            0.01 seconds ... View more

Thanks!  I just realized that I need the commons-codec and not the groovy-all.2.4.0.jar.  I used the explicit classpath syntax to get the code to run. add classpath="C:\Program Files (x86)\Groovy\Groovy-2.4.0\lib\commons-codec-1.10.jar"; Works perfectly now.  Truly appreciate your expertise and help. ... View more

Success!  Thanks so very much for your time and help with this.  I've tried numerous different ways to generate the oauth_signature.  Finally, I found a solution that works with sas. Regards, Bill ... View more

I added the classpath for the groovy-all.2.4.0.jar per your recommendation in another thread.   However, now I'm getting a different type of error: 334  dm 'clear log'; 335 336  %let key = %nrstr(kd94hf93k423kf44&pfkkdhi9sl3r4s00); 337  %let message = 337! %nrstr(GET&http%3A%2F%2Fphotos.example.net%2Fphotos&file%3Dvacation.jpg%26oauth_consumer_key%3Ddp 337! f43f3p2l4k3l03%26oauth_nonce%3Dkllo9940pd9333jh%26oauth_signature_method%3DHMAC-SHA1%26oauth_time 337! stamp%3D1191242096%26oauth_token%3Dnnch734d00sl2jdk%26oauth_version%3D1.0%26size%3Doriginal); 338 339 340  proc 340!      groovy; 341 342  add classpath="C:\Program Files (x86)\Groovy\Groovy-2.4.0\lib\groovy-all.2.4.0.jar"; NOTE: The ADD CLASSPATH command completed. 343 344  submit "&key." "&message."; WARNING: The quoted string currently being processed has become more than 262 characters long.  You          might have unbalanced quotation marks. 345 346  import javax.crypto.Mac 347  import javax.crypto.spec.SecretKeySpec 348  import org.apache.commons.codec.binary.Base64 349 350  def base64hmacsha1(key, message) { 351      mac = Mac.getInstance("HmacSHA1") 352      mac.init(new SecretKeySpec(key.getBytes(), "HmacSHA1")) 353 354      sha1_bytes = mac.doFinal(message.getBytes()) 355 356      base64 = new Base64() 357      return new String(base64.encode(sha1_bytes)) 358  } 359 360 361  exports.base64hmacsha1 = hmacsha1(args[0], args[1]) 362 363 364  endsubmit; groovy.lang.MissingMethodException: No signature of method: Script10.hmacsha1() is applicable for argument types: (java.lang.String, java.lang.String) values: [kd94hf93k423kf44&pfkkdhi9sl3r4s00, GET&http%3A%2F%2Fphotos.example.net%2Fphotos&file%3Dvacation.jpg%26oauth_consumer_key%3Ddpf43f3p2l4k3l 03%26oauth_nonce%3Dkllo9940pd9333jh%26oauth_signature_method%3DHMAC-SHA1%26oauth_timestamp%3D119124209 6%26oauth_token%3Dnnch734d00sl2jdk%26oauth_version%3D1.0%26size%3Doriginal]      at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.unwrap(ScriptBytecodeAdapter.java:54)      at org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.callCurrent(PogoMetaClassSite.java:78)      at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:44)      at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:143)      at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:155)      at Script10.run(Script10.groovy:17) ERROR: The SUBMIT command failed. 365 366 367  quit; NOTE: The SAS System stopped processing this step because of errors. NOTE: PROCEDURE GROOVY used (Total process time):       real time           0.03 seconds       cpu time            0.01 seconds WARNING: Apparent symbolic reference HMACSHA1 not resolved. 368  %put &hmacsha1.; &hmacsha1. 369  /*tR3+Ty81lMeYAr/Fid0kMTYa/WM=*/ ... View more

FriedEgg, Thanks so much for the code and your time.  I tried to recreate the oauth_signature for a GET example on nouncer.com (url is below).  I created macro variables that generate the key and message inputs correctly (comparisons are below).  However, when I compute the oauth_signature, I get a much different answer to what's on the website.  Noucner.com states that the oauth_signature must be base64-encoded.    I'm using put statement with format $base64x32767.  Is this correct?  Also, should I upgrade java?  Currently, I'm running version 6 update 24. Thanks again and sorry to keep hassling you with this. -Bill Compare oauth signature inputs Key sas kd94hf93k423kf44&pfkkdhi9sl3r4s00 website kd94hf93k423kf44&pfkkdhi9sl3r4s00 Message sas GET&http%3A%2F%2Fphotos.example.net%2Fphotos&file%3Dvacation.jpg%26oauth_consumer_key%3Ddpf43f3p2l4k3l03%26oauth_nonce%3Dkllo9940pd9333jh%26oauth_signature_method%3DHMAC-SHA1%26oauth_timestamp%3D1191242096%26oauth_token%3Dnnch734d00sl2jdk%26oauth_version%3D1.0%26size%3Doriginal website (called signature base string) GET&http%3A%2F%2Fphotos.example.net%2Fphotos&file%3Dvacation.jpg%26oauth_consumer_key%3Ddpf43f3p2l4k3l03%26oauth_nonce%3Dkllo9940pd9333jh%26oauth_signature_method%3DHMAC-SHA1%26oauth_timestamp%3D1191242096%26oauth_token%3Dnnch734d00sl2jdk%26oauth_version%3D1.0%26size%3Doriginal Compare oauth_signature output sas YjUxZGZlNGYyZjM1OTRjNzk4MDJiZmM1ODlkZDI0MzEzNjFhZmQ2Mw== website tR3+Ty81lMeYAr/Fid0kMTYa/WM= Link to GET example on http://nouncer.com/oauth/authentication.html (May have to first click on a radio button on the top of the page to something other than the example and then back on the example to see the details.  This is the only way that I can view all the information.) SAS log: 529  dm 'clear log'; 530 531  *Oauth vars; 532  %let oauth_consumer_key=dpf43f3p2l4k3l03; 533  %let oauth_consumer_secret=kd94hf93k423kf44; 534  %let oauth_token=nnch734d00sl2jdk; 535  %let oauth_token_secret=pfkkdhi9sl3r4s00; 536  %let oauth_signature_method=HMAC-SHA1; 537  %let oauth_version=1.0; 538  %let url=%sysfunc(urlencode(http://photos.example.net/photos)); 539  %let oauth_size=original; 540  %let oauth_file=vacation.jpg; 541  %let oauth_timestamp=1191242096; 542  %let oauth_nonce=kllo9940pd9333jh; 543 544  *Vars for oauth signature; 545  %let API_TIME_STAMP=%str(oauth_timestamp=&oauth_timestamp.); 546  %let API_NONCE=%str(oauth_nonce=&oauth_nonce.); 547  %let API_KEY=%str(oauth_consumer_key=&oauth_consumer_key.); 548  %let API_SECRET=%str(oauth_consumer_secret=&oauth_consumer_secret.); 549  %let API_METHOD=%str(oauth_signature_method=&oauth_signature_method.); 550  %let API_TOKEN=%str(oauth_token=&oauth_token.); 551  %let API_VERSION=%str(oauth_version=1.0); 552  %let API_SIZE=%str(size=&oauth_size.); 553  %LET API_FILE=%str(file=&oauth_file.); 554  %let API_CONSUMER_SECRET=%sysfunc(urlencode(&oauth_consumer_secret.)); 555  %let API_TOKEN_SECRET=%sysfunc(urlencode(&oauth_token_secret.)); 556 557  %let 557! string=&API_FILE.%str(&)&API_KEY.%str(&)&API_NONCE.%str(&)&API_METHOD.%str(&)&API_TIME_STAMP.%str 557! (&)&API_TOKEN.%str(&)&API_VERSION.%str(&)&API_SIZE.; 558  %let message=%str(GET)%str(&)&url.%str(&)%sysfunc(urlencode(&string.)); 559  %put &message.; GET&http%3A%2F%2Fphotos.example.net%2Fphotos&file%3Dvacation.jpg%26oauth_consumer_key%3Ddpf43f3p2l4k3l03%26oauth_nonce%3Dkllo9940pd9333jh%26oauth_signature_method%3DHMAC- SHA1%26oauth_timestamp%3D1191242096%26oauth_token%3Dnnch734d00sl2jdk%26oauth_version%3D1.0%26size%3Doriginal 560 561  %let key=&API_CONSUMER_SECRET.%str(&)&API_TOKEN_SECRET.; 562  %put &key; kd94hf93k423kf44&pfkkdhi9sl3r4s00 563 564 565  proc 565!      groovy; 566 567      submit "&key." "&message."; WARNING: The quoted string currently being processed has become more than 262 characters long.  You          might have unbalanced quotation marks. 568 569      import javax.crypto.Mac 570      import javax.crypto.spec.SecretKeySpec 571 572      def hmacsha1(key, message) { 573          mac = Mac.getInstance("HmacSHA1") 574          mac.init(new SecretKeySpec(key.getBytes(), "HmacSHA1")) 575 576          sha1_bytes = mac.doFinal(message.getBytes()) 577 578          return new BigInteger(1, sha1_bytes).toString(16) 579      } 580 581      exports.hmacsha1 = hmacsha1(args[0], args[1]) 582 583       endsubmit; NOTE: Exporting macro variable "hmacsha1". NOTE: The SUBMIT command completed. 584 585  quit; NOTE: PROCEDURE GROOVY used (Total process time):       real time           0.01 seconds       cpu time            0.00 seconds 586 587  %put &hmacsha1.; b51dfe4f2f3594c79802bfc589dd2431361afd63 588 589  data _null_; 590      oauth_signature = put("&hmacsha1.",$base64x32767.); 591      call symput('oauth_signature',oauth_signature); 592  run; NOTE: DATA statement used (Total process time):       real time           0.00 seconds       cpu time            0.00 seconds 593 594  %put &oauth_signature.; YjUxZGZlNGYyZjM1OTRjNzk4MDJiZmM1ODlkZDI0MzEzNjFhZmQ2Mw== ... View more

FriedEgg, Thanks so much for your help.  Code works and produces a sha1 signature.  Quick follow-up questions, if I have key and text components to go into the digest function (digest = HMAC-SHA1 (key, text)), can I simply use a macro variable like %let disgest_inputs=&key.,&text.;?  Or should I do something different? My apologies about the double post.  I deleted the other thread.  I was having trouble posting my question the other night and inadvertently created a duplicate post. Thanks again! Regards, Bill ... View more