topic SAS to Hadoop/Hive values of of range? in SAS Data Management

SAS to Hadoop/Hive values of of range?

Timmy2383 — Thu, 11 Oct 2018 14:04:02 GMT

I am trying to publish data from our SAS environment into a remote Hadoop/Hive database (as sequence files). I'm performing basic tests by taking some source data from our business users and using a data step to write out to the Hadoop library.

I'm getting errors indicating that a value at row X is out of range.

For example:

ERROR: Value out of range for column BUY_RT1, type DECIMAL(5, 5). Disallowed value is: 0.

The source data has a numeric format of 6.5, and the actual value is ".00000".

Why is .00000 out of range? Would the format for Hadoop need to be "DECIMAL(6, 5)"?

I get the same error when the value is "0.09"

ERROR: Value out of range for column INT_RT, type DECIMAL(5, 5). Disallowed value is: 0.09

Re: SAS to Hadoop/Hive values of of range?

LinusH — Thu, 11 Oct 2018 14:11:21 GMT

Just a thought, what is the SAS format or this column?

"When you specify a SAS format for a DECIMAL data type with specified precision and scale, specify w.d format. w is the width of the variable (including the decimal portion, if any), the decimal point, and a potential negative sign. For example, given a column of type DECIMAL(10,0), the format is 11. Given a column of type DECIMAL(18,2), the format is 20.2."

Re: SAS to Hadoop/Hive values of of range?

Timmy2383 — Thu, 11 Oct 2018 14:16:21 GMT

According to proc contents...
Type = Num
Len = 8
Format = 6.5