topic Re: Question about Clustering in Data Management Studio 2.4 in SAS Data Management

Question about Clustering in Data Management Studio 2.4

cristinadumitru — Tue, 17 Mar 2015 08:03:58 GMT

Hi all,

I am fairly new to the advanced functionality of DMStudio and I am trying to set up a new data job that requires clustering of data and surviving record identification.

My input looks something like the below table.

e1	a
e1	a
e1	a
e2	b
e2	b
e3	c
e3	c
e3	c

I would like to have as output only the records that are repeated 3 times

e1	a
e3	c

Any ideas about what I could use to do so?

Thank you in advance,

Cristina

Re: Question about Clustering in Data Management Studio 2.4

skillman — Tue, 17 Mar 2015 11:07:25 GMT

Cristina,

If you are querying a database directly, SQL can do this for you. DM Studio you can create an expression to help with this. Once you cluster the records, add an expression node which will return only clusters containing 3 records:

Job:

Clustering:

Desired Output:

Expression configuration (Grouping):

Expression configuration (Expression Logic):

-shawn

Re: Question about Clustering in Data Management Studio 2.4

cristinadumitru — Tue, 17 Mar 2015 13:39:44 GMT

Hi Shawn,

Have you added any additional conditions?

My output is just:

Thanks again,

Cristina

Re: Question about Clustering in Data Management Studio 2.4

skillman — Tue, 17 Mar 2015 14:34:51 GMT

When you are clustering, are you sorting by the cluster id? Does your cluster output resemble my second screenshot? Also, make sure in the expression, that you have indicated that you are grouping by the sorted cluster id.

Re: Question about Clustering in Data Management Studio 2.4

cristinadumitru — Tue, 17 Mar 2015 15:21:45 GMT

My fault, I didn't see the grouping by cluster_id - never used the functionality before.

Thank you very much, it all works great now.

Best wishes,

Cristina