topic Re: Plot of summary stats of Y against numeric variable X for big dataset in Graphics Programming

Plot of summary stats of Y against numeric variable X for big dataset

BingyiYang — Mon, 14 Jan 2019 01:42:58 GMT

I often need to plot out the mean/sum of a continuous variable (Y) against the buckets of another continuous variable (X), by a third grouping variable (Z).

Note that the big datasets are typically huge; it is impractical to scatter plot every point. That's why we need to group X into buckets and calculate bucket means first for the plots.

We can do it by using proc rank on X first then calculate buckets for X and Y. But I am wondering if any SAS plot procs can do this automatically. Thanks.

Re: Plot of summary stats of Y against numeric variable X for big dataset

PGStats — Mon, 14 Jan 2019 06:20:22 GMT

Look at proc hpbin as a faster and more flexible alternative to proc rank.

Re: Plot of summary stats of Y against numeric variable X for big dataset

ballardw — Mon, 14 Jan 2019 15:45:37 GMT

@BingyiYang wrote:

I often need to plot out the mean/sum of a continuous variable (Y) against the buckets of another continuous variable (X), by a third grouping variable (Z).

Note that the big datasets are typically huge; it is impractical to scatter plot every point. That's why we need to group X into buckets and calculate bucket means first for the plots.

We can do it by using proc rank on X first then calculate buckets for X and Y. But I am wondering if any SAS plot procs can do this automatically. Thanks.

Without knowing what type of plot or what your data currently looks like it is hard to provide any explicit example.

The SGPLOT HBAR and VBAR plots will do Freq, Mean, Median and Sum statistics for a given Response variable for levels of a group variable. "Bins" from a variable can often be created using a format.

Re: Plot of summary stats of Y against numeric variable X for big dataset

BingyiYang — Tue, 15 Jan 2019 04:43:41 GMT

Thanks all for your response. I was wondering if there is a way that SAS would convert numeric X to buckets and then plot out Freq/Mean/Sum of Y against bucket means of X automatically. This is a typical data visualization of Y ~ X when dataset is huge. Thanks.