I am currently struggling with a space optimisation problem. I can not compress data, because a star schema will be applied on them, so that I am trying to reduce the size "manually". I figured out that a lot of space is lost by storing small numbers on 8 bytes.
However I can not reduce the length of a numeric variable stored on LASR server. For example: even when I upload a table with numeric variables lengths set to 3. all lengths are automatically set to 8. on the server.
How can I determine this length? Is that a server configuration issue?
Any help will be appreciated.
Each column in the LASR server is padded to an 8-byte boundary. If the variable you are adding is not a multiple of 8 bytes, the variable will be padded to an 8-byte boundary.
One strategy I've successfully used to reduce space is to make use of codes in character variables which are expanded to full descriptions using SAS formats (eg store USA in a character variable and have a SAS format which applies United States of America).
Also if you want to compress numeric variables that are just codes that aren't used in calculations, convert them to character.
Please note that even when you are able to compress LASR tables, in my experience the performance degradation is significant.
Registration is open! SAS is returning to Vegas for an AI and analytics experience like no other! Whether you're an executive, manager, end user or SAS partner, SAS Innovate is designed for everyone on your team. Register for just $495 by 12/31/2023.
If you are interested in speaking, there is still time to submit a session idea. More details are posted on the website.
See how to use one filter for multiple data sources by mapping your data from SAS’ Alexandria McCall.
Find more tutorials on the SAS Users YouTube channel.