About akpattnaik

akpattnaik · ‎02-19-2018

Thanks a Ton Ian. You are a genius! Cheers

akpattnaik · ‎02-19-2018

Hi Ian, Trust you well. Just wondering if you can help with the below: Now instead of 1 on the diagonal, i want 1- a matrix element. For example: y[do(1,n#n,n+1)] = 1- AR; (where AR is a matrix, of same shape) y[do(1,n#n,n+1)] = (1- AR); Both doesn't work. I get a error - "Matrix do not conform to the operation" Any idea?

akpattnaik · ‎02-16-2018

Excellent. Great stuff.

akpattnaik · ‎02-15-2018

Hi Ian, A quick question. I want to check a condition .i.e. if the value is not zero then set the diagonal to 1. I tried a lot but couldn't find what needs to be done to the below. Any help will really be appreciated. Cheers y[do(1,n#n,n+1)] = 1; /* set diagonal to 1 */

akpattnaik · ‎02-15-2018

Ah, Sorry Ian. My bad. You are right. I guess i'm not able to think straight now 🙂 Diag is the option. i was wandering how to put that in the shape of table 1. proc iml; N=nrow(table1); test= diag(table2); result=?? run;

akpattnaik · ‎02-15-2018

Thanks for your reply. But i believe its something more to that. Can you please have a look at the data which is attached? i want the values from a different table to be replaced with the diagonals. Appreciate your input and time.

akpattnaik · ‎02-15-2018

Hi Guys, I have two tables as shown in the attachment. I want to create the result table, which is shown at the bottom of the attachment: For the diagonal columns in table 1, i want to populate the values from table 2 Challenge is in table 2 i got a product name column which got a value "A" as i appended it to a table. Can someone give me a hand please? I really appreciate everyone who have been helping me so far.

akpattnaik · ‎02-14-2018

Hi Guys, I’m in process of converting an excel report into sas proc iml code. I have to achieve the below, can anyone give me a hand please? For all diagonal values I want to get 1. For non-diagonal values, divide the respective values by column total. If division ends in error populate value 0. Attached in the sample data set.

akpattnaik · ‎02-13-2018

Hi Ksharp, Thanks for your reply. Its all good and its all working fine. However, it only gives me the numeric values. I want all the variables together. Output i receive is as follows: A B C D E ROW1 Value Value Value Value Value ROW2 Value Value Value Value Value ROW3 Value Value Value Value Value ROW4 Value Value Value Value Value ROW5 Value Value Value Value Value P.S. the value represents the resultant value post division.( as per my expectation) But, i need below as output, i.e. the character value(Product name) columwise and calculated values in the rows. Product Name A B C D E A Value Value Value Value Value B Value Value Value Value Value C Value Value Value Value Value D Value Value Value Value Value E Value Value Value Value Value Massive thanks for your support Sir.

akpattnaik · ‎02-10-2018

Hi Guys, I'm new to IML and need some help to start with. hope someone will help. Below ,are the two matrix which i have. I want a new matrix, by dividing the Sum_row values of second matrix with each element of the first. So, the output matrix first row should be: A 11/185 22/185 33/185 44/185 55/185 B 89/346 45/346 55/346 59/346 63/346 ... so on and so forth. Any help, will really be appreciated.

akpattnaik · ‎12-31-2017

Hi, I have finished the "Big Data programming and Loading" online course along with the case study and looking forward for the certification exam sometime in January. Can any one suggest, where can i find sample questions of the exam please?

akpattnaik · ‎12-14-2017

When we use SASHDAT libname engine the files are place on HDFS using the path= <HDFS path> and the copies= for number of replication. The replication factor for SASHDAT tables is 2 by default. Whereas on HDFS the replication factor is 3 by default. Now if a sas table is loaded to HDFS, though SASHDAT it will have 2 copies or where as in HDFS it will have 3 Copies. How is that possible. I'm bit confused. Can anyone explain me the above please?

akpattnaik · ‎11-30-2017

While accessing the Hive tables through Libname statement, we can perform lot of computation intensive tasks on the table like proc freq and proc means etc. As I understand, traditionally Hive doesn’t have “out of box” functionality to do all of such task, hence Hive developers create custom UDF’s in python/Java and register them in hive to use them in there Hive query. Does that mean, as a SAS developer I don’t need to learn python as creation of UDF’s in not required? I'm new to hadoop world, apologies if my question doesn't make sense.

akpattnaik · ‎11-29-2017

ERROR: 11-29 10:47:10,452 [RunPigThread][ERROR PigStatsUtil] - 1 map reduce job(s) failed! ERROR: The pig script has encountered errors. ERROR: The pig job, job_1511967281334_0001, has encountered errors. ERROR: org.apache.pig.backend.executionengine.ExecException: ERROR 2118: Input path does not exist: hdfs://server2.demo.sas.com:8020/user/shared/DIACHD/data/custord at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:288) at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:597) at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:614) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:492) at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1306) at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1303) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671) at org.apache.hadoop.mapreduce.Job.submit(Job.java:1303) at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128) at org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:191) at java.lang.Thread.run(Thread.java:745) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:270) Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://server2.demo.sas.com:8020/user/shared/DIACHD/data/custord at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:321) at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:264) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigTextInputFormat.listStatus(PigTextInputFormat.java:36) at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:385) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:274) ... 18 more 3 Hi, Above is the error message on the SAS EG.

akpattnaik · ‎11-28-2017

Hi, I'm in Chapter 2: accessing HDFS and Invoking Hadoop application and trying the demo hp02d02.sas When i execute the code i got the error: Input path does not exist. (See attachment for more info.) I went into Hue and found out /user/shared/DIACHD/data/Custord is not available. Hence, i tried to create a folder under shared. However, i got a permission issue. Again i tried to create the folder using proc hadoop mkdir statement and got the same permission issue. Attached is the screen shot trail of all my approach. Can anyone advice, if i'm missing anything please?

Online Status	Offline
Date Last Visited	‎09-19-2018 05:00 AM

Re: Matrix diagonal operation

Re: Matrix diagonal operation

Re: Matrix diagonal operation

Re: Matrix diagonal operation

Re: Matrix diagonal manipulation

Re: Matrix diagonal manipulation

Matrix diagonal manipulation

Matrix diagonal operation

Re: Proc IML- Matrix element operation

Proc IML- Matrix element operation

Re: Proc IML- Matrix element operation

Re: Proc IML- Matrix element operation

Re: Proc IML- Matrix element operation

Proc IML- Matrix element operation

Re: Matrix diagonal operation

Re: Matrix diagonal operation

Re: Matrix diagonal operation

Re: Matrix diagonal operation

Re: Matrix diagonal manipulation

Re: Matrix diagonal manipulation

Matrix diagonal manipulation

Matrix diagonal operation

Re: Proc IML- Matrix element operation

Proc IML- Matrix element operation

Big Data Programming and Loading - certification

Replication Factor for SASHDAT and HDFS

Hive UDF not required ?

Re: error executing hp02d02.sas

error executing hp02d02.sas