topic Re: text parsing for a mix of Japanese and English language in SAS Data Science

text parsing for a mix of Japanese and English language

sumitthakral — Wed, 21 Sep 2016 05:16:34 GMT

Hi,

I want to do text parsing in the SAS Text miner for a mix of Japanese and english words . E.g.

カーネリアンネックレスオレンジ45cm/天然石シルバー925銀/

I tried running text parsing on this observation, but it does parsing on only term '45cm' which is in english language, and not for Japanese characters. Can any body help ?

Re: text parsing for a mix of Japanese and English language

Ksharp — Wed, 21 Sep 2016 09:52:17 GMT

What kind of output would you like to see ?
Check the functions started with Kxxxx() which are used for Chinese,Korean,Japanese words:
KSCAN()
KSUBSTR()
.........

Re: text parsing for a mix of Japanese and English language

sumitthakral — Wed, 21 Sep 2016 10:15:09 GMT

Hi KSharp,

I am using Text Miner and not SAS coding. I think the functions you are referring to are used for text processing but I want to do text parsing.

Re: text parsing for a mix of Japanese and English language

Ksharp — Thu, 22 Sep 2016 01:23:28 GMT

That is very hard, since SAS is coming from America. But you could ask SAS Support if SAS offer Japanese text parsing.