DATAFLUX CLUSTERING ERROR

[sasismylife]

HI experts,

i getting the below error while running the sas dataflux(2.6 version ) clustering job

2018-09-03T17:37:57,139 INFO  Initializing resident pooler 'NDC3CLNPSASD06:114262'
2018-09-03T17:37:57,350 INFO  DATAFLOW job type
2018-09-03T17:37:57,350 INFO  Running under PID: 114262
2018-09-03T17:37:57,350 INFO  Loaded job '/sasdq/sas/sasinst/SASHome/DataFluxDataManagementServer/2.7/dmserver/var/batch_jobs/testing_job/cluster_250.ddf'.
2018-09-03T17:37:57,351 INFO  [ROOT]Setting Execution State: RUNNING, Error message:()
2018-09-03T17:37:57,351 INFO  [ROOT]Process Flow - Node DF001 started.
2018-09-03T17:52:11,973 INFO  Node DF001(0) failed.
2018-09-03T17:52:11,973 ERROR [ROOT][DF001_0]Node DF001 error: [1:CLUSTER:Clustering 1] Condition matching error for row:
2018-09-03T17:52:11,973 INFO  [ROOT]Setting Execution State: STOPPING, Error message:(Process Flow - Job terminated due to error in one or more nodes. (DF001:0 - [1:CLUSTER:Clustering 1] Condition matching error for row:))
2018-09-03T17:52:11,973 INFO  [ROOT]Process Flow - Job terminated due to error in one or more nodes.
2018-09-03T17:52:11,973 INFO  [ROOT]Setting Execution State: ERROR, Error message:(Process Flow - Job terminated due to error in one or more nodes. (DF001:0 - [1:CLUSTER:Clustering 1] Condition matching error for row:))
2018-09-03T17:52:11,973 ERROR Job '/sasdq/sas/sasinst/SASHome/DataFluxDataManagementServer/2.7/dmserver/var/batch_jobs/testing_job/cluster_250.ddf' failed (Process Flow - Job terminated due to error in one or more nodes. (DF001:0 - [1:CLUSTER:Clustering 1] Condition matching error for row:)).
2018-09-03T17:52:11,974 INFO  ...Begin JobMon Block...
2018-09-03T17:52:11,974 INFO  JobMon: PROC | 0 | 2018-09-03 17:37:57,351 | 2018-09-03 17:52:11,973 | ERROR | DF001 | 0: | [1:CLUSTER:Clustering 1] Condition matching error for row:.
2018-09-03T17:52:11,974 INFO  JobMon: DATA | 1 | 50%, 3% Completing cluster index mappings | Clustering 1
2018-09-03T17:52:11,974 INFO  JobMon: DATA | 2 | 0%, Calculating | Expression 1
2018-09-03T17:52:11,974 INFO  JobMon: DATA | 3 | 0%, Inserted 0 rows | Data Target (Insert) 1
2018-09-03T17:52:11,974 INFO  JobMon: DATA | 4 | 100%, Complete | SQL Query 1

Can anyone please suggest me how to resolve the issue.

[RonAgresta]

Sometimes errors in the clustering steps are related to the process running out of memory. Does the job run to completion on a smaller test set of rows? If so, you can try to allocate more memory to the node in the node's advanced settings. This could also point to something in the data (like a control character) causing problems too.

If a smaller set of data doesn't remove the error, you might selectively remove clustering rules to see if one in particular is causing problems. This shouldn't be a problem so if you find this is the case, I suggest you initiate a technical support track.

Ron

[sasismylife]

Hi Ron,

Thanks for your revert.

Job is executing on the smaller set of data but when it comes to huge data its is getting failed at the cluster node for that i have increased the cluster memory too but it is not working.

Even i have added few options in the app.cfg file for the cluster memory that is also not working.

base/sort bytes= 32768000000

cluster /bytes =68719476736

is there any way to handle the large data in cluster node please let me know