Hi everybody,
I cannot retrieve the entire values from a CASTable, as they get truncated after 10000 entries when trying to save them as apndas dataframe.
i am working with SAS Viya in Python and was trying to access values in the CASTable in order to save them in a pandas dataframe.
When i print infos concerning the table i get (correctly) 21401 rows in the table
CASTable(u'my_table', caslib=u'CASUSER(myusername)') Data columns (total 6 columns): N Miss Type id 21401 False double age 21297 True double sex_id 21297 True double sire_id 21297 True double dam_id 21297 True double prize_money 21297 True double
When i try to access the values and print the shape of the values array:
my_table.casTable.values.shape (10000L, 6L)
So the array gets truncated after 10000 entries .
How can i address that, and get the full numpy array?
Thanks
Luca
Thanks, in the end i managed to solve this problem by exporting the CASTable to SASFrame and then converting the SASFrame to Pandas Dataframe
import pandas as pd
my_dataframe = pd.DataFrame(my_table.to_frame())
To convert the Pandas object to DataFrame, use to_frame() method. The to_frame() method is used to convert a Series object into a DataFrame. Series is a one-dimensional array with axis labels, which is also defined under the Pandas library.
You can export the CASTable to SASFrame and then convert the SASFrame to Pandas Dataframe. Pandas Dataframe.to_numpy() is an inbuilt method that is used to convert a DataFrame to a numpy array.
Are you ready for the spotlight? We're accepting content ideas for SAS Innovate 2025 to be held May 6-9 in Orlando, FL. The call is open until September 16. Read more here about why you should contribute and what is in it for you!
Learn how use the CAT functions in SAS to join values from multiple variables into a single value.
Find more tutorials on the SAS Users YouTube channel.
Select SAS Training centers are offering in-person courses. View upcoming courses for: