I cannot retrieve the entire values from a CASTable, as they get truncated after 10000 entries when trying to save them as apndas dataframe.
i am working with SAS Viya in Python and was trying to access values in the CASTable in order to save them in a pandas dataframe.
When i print infos concerning the table i get (correctly) 21401 rows in the table
CASTable(u'my_table', caslib=u'CASUSER(myusername)') Data columns (total 6 columns): N Miss Type id 21401 False double age 21297 True double sex_id 21297 True double sire_id 21297 True double dam_id 21297 True double prize_money 21297 True double
When i try to access the values and print the shape of the values array:
my_table.casTable.values.shape (10000L, 6L)
So the array gets truncated after 10000 entries .
How can i address that, and get the full numpy array?
To convert the Pandas object to DataFrame, use to_frame() method. The to_frame() method is used to convert a Series object into a DataFrame. Series is a one-dimensional array with axis labels, which is also defined under the Pandas library.
You can export the CASTable to SASFrame and then convert the SASFrame to Pandas Dataframe. Pandas Dataframe.to_numpy() is an inbuilt method that is used to convert a DataFrame to a numpy array.
Registration is open! SAS is returning to Vegas for an AI and analytics experience like no other! Whether you're an executive, manager, end user or SAS partner, SAS Innovate is designed for everyone on your team. Register for just $495 by 12/31/2023.
If you are interested in speaking, there is still time to submit a session idea. More details are posted on the website.
Learn how use the CAT functions in SAS to join values from multiple variables into a single value.
Find more tutorials on the SAS Users YouTube channel.