BookmarkSubscribeRSS Feed
robertrao
Quartz | Level 8

Hi Team,

I am comparing two means and calculating Z score and then the p-value.

If i get the p-value less than 0.05 will I call it "YES THERE IS SIGNIFICANT DIFFERENCE"

OR

NO, THERE IS NO SIGNIFICANT DIFFERENCE???

Please give me some idea.

Regards

5 REPLIES 5
Ksharp
Super User

What is your SAS code ?

If i get the p-value less than 0.05 , I can call it "YES THERE IS SIGNIFICANT DIFFERENCE" .

But I will more trust confidence interval  .

ballardw
Super User

You should decide what would be a significant difference BEFORE the test and know why you chose that value.

rnmishra
Calcite | Level 5

The P-value =0.05, is not always useful. First go back to your problem and decide how accurate you want to be. Then decide on your p-value- not necessarily 0.05.

Then go ahead with what you are doing.

These are just my thoughts.

Thanks.

Doc_Duke
Rhodochrosite | Level 12

There is a lot more to interpreting statistical significance than just looking at the p-value.  See, for instance,

http://ceaccp.oxfordjournals.org/content/7/6/208.full

Your second claim, "NO, THERE IS NO SIGNIFICANT DIFFERENCE???" is a statement about the type II error and not about the type I (p-value) error.  The correct interpretation statement is

"We failed to determine statistical significance.", which is much weaker.

Doc Muhlbaier

Duke

SteveDenham
Jade | Level 19

Great reference, Doc.  I want to send it to all of the toxicology study directors Smiley Wink

Steve Denham

sas-innovate-2024.png

Join us for SAS Innovate April 16-19 at the Aria in Las Vegas. Bring the team and save big with our group pricing for a limited time only.

Pre-conference courses and tutorials are filling up fast and are always a sellout. Register today to reserve your seat.

 

Register now!

What is Bayesian Analysis?

Learn the difference between classical and Bayesian statistical approaches and see a few PROC examples to perform Bayesian analysis in this video.

Find more tutorials on the SAS Users YouTube channel.

Click image to register for webinarClick image to register for webinar

Classroom Training Available!

Select SAS Training centers are offering in-person courses. View upcoming courses for:

View all other training opportunities.

Discussion stats
  • 5 replies
  • 809 views
  • 0 likes
  • 6 in conversation