topic Re: How to estimate Confidence intervals in SAS Programming

How to estimate Confidence intervals

AndersS — Fri, 13 Oct 2023 13:33:50 GMT

Hi! I need to calculate estimates of the confidence intervals for extreme quantiles, say q1 and q99 (or q(0.1) and q(99.9)).

My knowledge of this type of mathematical statistics is not so great.
I know that there are options in Proc Means or Univariate, for something like this.

But I need to do these calculations in a Data-step.

If anyone has a tip of some good papers to read and implement, then I would appreciate thsi very much.

(I will use this info to try to automatically estimate the parameters LLM and ULIM in the method:
"Fast and Accurate Calculation of Descriptive Statistics of Very Large Sets of Data".

The work is paused at present. I need a break. But extended paper will appear during 2024).

Many thanks in advance!
/Br AndersS (Anders Sköllermo)

Re: How to estimate Confidence intervals

PaigeMiller — Fri, 13 Oct 2023 14:25:13 GMT

Why would you want to use a DATA step if SAS has already done the work and provided confidence intervals for percentiles in PROC UNIVARIATE (and probably elsewhere)?

Re: How to estimate Confidence intervals

Ksharp — Sat, 14 Oct 2023 10:22:31 GMT

How about Bootstrap method ?

@Rick_SAS wrote many blogs about it to get statistic confidence interval.

https://blogs.sas.com/content/iml/2018/07/23/boot-and-bootci-macros-sas.html

https://blogs.sas.com/content/iml/2016/08/10/bootstrap-confidence-interval-sas.html

Re: How to estimate Confidence intervals

Rick_SAS — Sat, 14 Oct 2023 10:38:40 GMT

The CIPCTLDF option on the PROC UNIVARIATE statement produces distribution-free confidence intervals. The formulas are in the doc.

Hahn and Meeker are a little vague about one portion of the formula. See this discussion from someone who was trying to reproduce the formula in R and was unable to match the PROC UNIVARIATE output.

Re: How to estimate Confidence intervals

AndersS — Sat, 14 Oct 2023 11:09:24 GMT

Hi! 1) se my text in ( ).
2) See the answer from Rick. I want to be able to use another language than SAS.

/Br AndersS

Re: How to estimate Confidence intervals

AndersS — Sat, 14 Oct 2023 13:46:31 GMT

Hi! The basic discussion was in 2019. Has SAS updated the software and/or the documentation?

VERY useful discussion for me! MANY thanks! /Br AndersS

Re: How to estimate Confidence intervals

Rick_SAS — Sun, 15 Oct 2023 10:12:24 GMT

> The basic discussion was in 2019. Has SAS updated the software and/or the documentation?

The software has not changed. I gave the link to the most recent documentation.

Re: How to estimate Confidence intervals

AndersS — Sun, 15 Oct 2023 11:57:20 GMT

Hi! Very good. My problem has been solved. /Br AndersS