cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
dylanleong78
‎11-07-2022
  • 7 Posts
  • 2 Likes Given
  • 0 Solutions
  • 4 Likes Received

Re: SAS Viya 4 - Visual Analytics Expression Builder - Replace Operato...

by Fluorite | Level 6 in SAS Visual Analytics
‎09-22-2022 07:17 AM
‎09-22-2022 07:17 AM
Thanks HunterT, Your suggestion works and I was able to prevent partial matches and 0 but somehow fails to filter out missing values when the >200 character logic is applied. I will accept this solution. Thanks for your help!   You are also right that it isn't the prettiest piece of logic, whether you are looking at it from a coding perspective or in visual mode. But that applies to the expression builder in general whichever way you see it. Absolutely hate that it reformats my written logic into incomprehensible lines of jibberish. It is bad enough that logic has to be written in "business-friendly" language but to lose all my indentation and formatting is taking it to a whole new level. Having said that, I highly doubt that there is sufficient appetite to overhaul the expression builder. IF ( 'pid_list5'p IsSet ) RETURN ( IF ( GetLength('pid_list5'p) > 200 ) RETURN ( RemoveBlanks(Concatenate(Concatenate(Concatenate( Concatenate(Concatenate(Concatenate(',', RemoveBlanks(Replace( Substring('pid_list5'p, 1, 200), ' ', ',', _All_), _All_)), Concatenate(',', RemoveBlanks(Replace(Substring('pid_list5'p, 201 , 400), ' ', ',', _All_), _All_))), Concatenate(Concatenate(',', RemoveBlanks(Replace(Substring('pid_list5'p, 401, 600), ' ', ',', _All_), _All_)), Concatenate(',', RemoveBlanks(Replace(Substring( 'pid_list5'p, 601, 800), ' ', ',', _All_), _All_)))), Concatenate (Concatenate(',', RemoveBlanks(Replace(Substring('pid_list5'p, 801, 1000), ' ', ',', _All_), _All_)), Concatenate(',', RemoveBlanks(Replace(Substring('pid_list5'p, 1001, 1200), ' ', ',', _All_), _All_)))), Concatenate(Concatenate(',', RemoveBlanks (Replace(Substring('pid_list5'p, 1201, 1400), ' ', ',', _All_), _All_)), Concatenate(',', RemoveBlanks(Replace(Substring( 'pid_list5'p, 1401, 1600), ' ', ',', _All_), _All_)))), Concatenate(',', RemoveBlanks(Replace(Substring('pid_list5'p, 1601, GetLength('pid_list5'p)), ' ', ',', _All_), _All_))), _All_ ) Contains Concatenate(',', Concatenate(UpCase(RemoveBlanks( 'PRODUCT_ID'n, _All_)), ',')) ) ELSE ( Concatenate(',', Concatenate(RemoveBlanks(Replace( 'pid_list5'p, ' ', ',', _All_), _All_), '_All_')) Contains Concatenate(',', Concatenate(UpCase(RemoveBlanks('PRODUCT_ID'n, _All_)), ',')) ) ) ELSE ( 1 = 0 )     ... View more

SAS Viya 4 - Visual Analytics Expression Builder - Replace Operator li...

by Fluorite | Level 6 in SAS Visual Analytics
‎09-21-2022 06:18 AM
‎09-21-2022 06:18 AM
Hi,   I was attempting to use a text box to enable users to enter list of multiple values for filtering based on the excellent article below: https://communities.sas.com/t5/SAS-Communities-Library/Using-Text-Box-to-enter-list-of-values-for-filtering/ta-p/774255   There was a slight difference because users were copying values from an Excel spreadsheet and pasting into the text box to filter. And this could possibly contain hundreds of different values. When copying and pasting from Excel, the values pasted are usually separated by a blank space. Therefore, in order for me to mimic the solution in the article above, I attempted to use the Replace operator as per below to replace empty blank space with a comma.   https://documentation.sas.com/doc/en/vacdc/8.3/vareportdata/p0dovqqp325peyn1dpijpxxmwj83.htm   Original from Excel: 1234567 7654321 1987654   After applying: Replace('myparam'p, ' ', ',', _ALL_) 1234567,7654321,1987654   This worked pretty well and users were able to filter based on list of values copied and pasted from Excel. However, a user complained that the report was not showing all the expected results. He had 183 different values  but the report was only showing about 25 of those values. Upon further investigation, I discovered that when the expression builder applied the Replace() function against the parameter value, the result was limited to 200 characters. Therefore I think that there is either a bug or a limitation in the expression builder, specifically in the Replace() function. I had Upcase, RemoveBlanks and Concatenate applied against the parameter and they did not alter the length of the parameter.   I managed to produce a workaround that does not use Replace(). However, this workaround has its limitations. I needed the commas between the values to ensure the filter only return exact matches. However, without the commas, the filter was returning missing values, 0 and was returning partial matches.   1. Can SAS raise a bug and fix this 2. Does anyone else have a savvy workaround? ... View more

Re: SAS Viya 4 - SAS Visual Text Analytics - tpParse and tpSpell using...

by Fluorite | Level 6 in SAS Data Science
‎06-08-2022 06:49 AM
‎06-08-2022 06:49 AM
Thanks @RussAlbright    I've taken your 2nd suggestion and used a hash table lookup to lookup the parsed data set against the dictionary table and produced a data set of words that were not found in the dictionary. This doesn't provide a recommended word replacement but at least it helps identify words that are highly likely misspelt ... View more

SAS Viya 4 - SAS Visual Text Analytics - tpParse and tpSpell using dic...

by Fluorite | Level 6 in SAS Data Science
‎06-06-2022 10:21 AM
‎06-06-2022 10:21 AM
Hi,   I've been looking into performing spellcheck against a specific column and identify misspelt words that should be corrected.   Based on reading several articles and SAS documentation (see below), I've managed to come up with a basic solution that "sort of" works. https://towardsdatascience.com/handling-text-data-quality-issues-can-yuo-h-andle-thsi-7f77dac3ddff https://documentation.sas.com/doc/en/pgmsascdc/v_011/casvtapg/n1vl3yuyzcl7x4n0zc4vwynknl99.htm   As you can see from spellcheck.sas, this is my thought process: 1. download the en_GB.dic file from https://extensions.openoffice.org/en/project/english-dictionaries-apache-openoffice 2. import the file into a SAS data set 3. create a sample data set containing 6 rows of text with misspelled words in the text column 4. use tpParse to parse the sample data set and produce tpParse_out data set 5. use tpSpell to attempt to identify misspelt words and produce tpSpell_out data set 6. in tpSpell_out, the _OriginalStem_ should contain the original misspelled word whereas the _Parent_ should contain the correct word   See the TPSPELL_OUT.csv for the output generated.   However, the solution only works for misspelt words (e.g. compzter) that has the same word correctly spelled repeated within the sample data set multiple times (e.g. computer). If a word (e.g. tihs) is only in the sample data set once, tpSpell will not be able to determine that "tihs" is actually "this" even though the word exists in the dictionary data set. I have a number of words misspelled in the sample data set (e.g. sentnce, neeeds, storuy, etc...)    Other misspelt words can potentially be identified by the _ComplexTag_ value = "inc" but I have no idea what "inc" means.   I've been toying with the dictPenalty, maxSpellDist, etc... to improve matching but to no avail.   Am I barking up the wrong tree?    ... View more

Re: SAS EG 8.2 Horizontal Tab (Split screen) Output On All Results

by Fluorite | Level 6 in SAS Enterprise Guide
‎05-21-2021 05:07 AM
‎05-21-2021 05:07 AM
Did you get a solution for this? I absolutely hate how much effort it takes to organise your tabs in Enterprise Guide 8.2. It looks as if this version is about 20 years behind previous versions of EG  ... View more
Contact Me
Online Status
Offline
Date Last Visited
‎11-07-2022 12:18 PM
Likes given to
View All
Likes from
View All
Quick links