04-03-2017 09:43 AM
I cannot retrieve the entire values from a CASTable, as they get truncated after 10000 entries when trying to save them as apndas dataframe.
i am working with SAS Viya in Python and was trying to access values in the CASTable in order to save them in a pandas dataframe.
When i print infos concerning the table i get (correctly) 21401 rows in the table
CASTable(u'my_table', caslib=u'CASUSER(myusername)') Data columns (total 6 columns): N Miss Type id 21401 False double age 21297 True double sex_id 21297 True double sire_id 21297 True double dam_id 21297 True double prize_money 21297 True double
When i try to access the values and print the shape of the values array:
my_table.casTable.values.shape (10000L, 6L)
So the array gets truncated after 10000 entries .
How can i address that, and get the full numpy array?
04-03-2017 10:50 AM
04-04-2017 03:45 AM
Thanks, in the end i managed to solve this problem by exporting the CASTable to SASFrame and then converting the SASFrame to Pandas Dataframe
import pandas as pd
my_dataframe = pd.DataFrame(my_table.to_frame())