Hi Sir, I have a very large dataset (>500k records) and will use it to run linear regression. The large sample size makes the power of statistical tests also very large. This means that any tiny little effect will cause the null hypothesis H0 to be rejected. It becomes very impractical to judge the significance of a variable simply based on p-value. Is there any reference or rule which provides a guideline for the sample size and significance level alpha? For example, rather than treat 5% as significance level for small sample, do I use 0.1% as significance level? So if the p-value for a variable is 2%, it is treated as not significant. Thanks for your clarification and suggestion. ... View more

I first created a format and applied it to the existing variables a, b. But this method using put statement is not very neat with DROP, RENAME etc. Is there any clever way to do this without assigning to new variables? Thanks for advice. PROC FORMAT; VALUE valuefmt 17-<20 ... 21-25 ... ... DATA work.test; a=18; b=19;output; a=15; b=24;output; run; DATA work.check; SET work.test; a2=PUT(a,valuefmt.); b2=PUT(b,valuefmt.); DROP a b; RENAME a2=a b2=b; RUN; Message was edited by: bncoxuk ... View more

Guys, can you tell me why there is no output for cases with age<=30? OUTPUT statement in the ELSE should not cause any effect. DATA work.a; SET work.b; IF (age>30) THEN status='mature'; ELSE THEN DO; status='young'; OUTPUT; END; RUN; ... View more

I used OUTPUT statement as below. For the IF statement, no OUTPUT used. For the ELSE statement, there is an OUTPUT statement. However, the results showed that cases with age<=30 are in fact not in the dataset work.a. Is this caused by the OUTPUT statement? But the OUTPUT statement is enclosed in the ELSE, and should not affect the IF condition. I must be wrong? DATA work.a; SET work.b; IF (age>30) THEN status='mature'; ELSE THEN DO; status='young'; OUTPUT; END; RUN; ... View more