SAS loading from Hive is truncated to 32,767 characters

[imdickson]

Hi. I have a script to read from a table from Hive DB. However, 1 of the columns contains data that is more than 32,767 character which is the SAS character word limit. For this, I have done some research online and noticed that i may be able to get over it by using pass thru. However, my script is to read from Hive table and do transformation in 1 data step.

The column that contains data more than 32,767 is "geometry"

Here is my code:

proc sort data=ncpdm.ncp_dim_ba 
               (keep=region zone state_code state business_area_code business_area gis_ba)
           out=business_area nodupkeys;
by gis_ba business_area_code;
run;

data business_area;
  set business_area;
  by gis_ba business_area_code;
  if first.business_area_code;
run;

data ncp_dim_ba_geo (drop=excp_code cgis_area)
     work.excp_ncp_dim_ba_geo;
  length excp_code $50;
  length gis_ba dotpos $50 zone $2 state_code $5 /*geometry $1500*/
         region state business_area_code $30 business_area $50 xval yval 8;
  if _n_=1 then do;
     declare hash h(dataset:"business_area");
     h.definekey('gis_ba');
     h.definedata('region','zone','state_code','state','business_area_code','business_area');
     h.definedone();
     call missing(region,zone,state_code,state,business_area_code,business_area);
  end;
  set hpsncp.DIST_OPERATION_BND_GIS (keep=cgis_area geometry cgis_label
      dbsastype=(cgis_area='CHAR(50)' geometry='CHAR(32767)' cgis_label='CHAR(50)'));
  if cgis_area='0290 - Sg. Petani' then cgis_area = '6290 - SUNGAI PETANI';
  if cgis_label='PERLIS' then cgis_area = '2610 - PERLIS';
  gis_ba=upcase(cgis_area);
  rc2=h.find();
  if (rc2 ne 0) then do;
     excp_code='Exception: Unable to map business area';
     output work.excp_ncp_dim_ba_geo;
  end;
  if (rc2=0);
  geometry=substr(geometry,15);
  seq=1;
  do until(dotpos eq '');
     dotpos=compress(scan(geometry, seq, '[]'),',','nk');
     if dotpos not in ('' '{' '}' '[' ']' ',') then do;
        xval=input(put(scan(dotpos,1,','),20.),20.)/1000;
        yval=input(put(scan(dotpos,2,','),20.),20.)/1000;
        if xval ne . and yval ne . then do;
           output ncp_dim_ba_geo;
        end;
     end;
     seq+1;
  end;
  keep excp_code cgis_area region zone state_code state business_area_code business_area seq xval yval /*geometry*/;
run;

Here is the raw data that is not in SAS Data Step as it exceeded 32,767.

"{""rings"":[[[794533591,649756392],[794460411,643714587],[797817321,640072798],[798129358,636695242],[798322922,633792355],[797756719,633041300],[797949498,630288094],[794695905,627040004],[794619914,623986269],[794328752,622069096],[794215316,620631699],[796922917,618788022],[797467683,617712824],[796756854,615733839],[796165119,613935034],[794734837,611833139],[794380257,610634154],[795585405,609442135],[797865882,609272758],[797988024,608794336],[799428391,608681095],[799785094,609401177],[801582426,609948210],[802306998,608933675],[804104633,609420908],[804413690,607446476],[803350140,603849174],[803898576,601995575],[803619136,597443896],[804748246,594062351],[798643797,590323168],[795646998,589471940],[789271491,592916964],[785205389,589547304],[781873184,582708977],[779591421,583058891],[777806084,579340230],[771898662,554894181],[768790041,551410842],[771089313,546510904],[769913010,539802456],[770523789,536931458],[766802071,536678710],[766213086,533444358],[765995948,526859374],[764076478,526254167],[764095364,520747510],[759891353,520852989],[758461302,517496409],[763528342,510809594],[762533435,509303361],[760735961,507980629],[761585277,505409684],[762640976,501150372],[760950773,492992594],[759702410,490269939],[762838465,486449208],[766318770,487777148],[769209157,485751369],[770894937,484679414],[769106746,480244192],[771660720,478258968],[770921845,467742317],[778783239,465074559],[777255074,459812310],[778942592,455457862],[784160745,454384464],[786684594,450353139],[783806087,444381118],[788878291,428431524],[787992855,423106994],[789362548,417404565],[782304626,408086945],[783863066,405277457],[781045644,405761433],[780475246,404966332],[780907363,403773680],[781465326,402602040],[781480428,400706692],[780294892,400155455],[780015498,399823203],[779517119,397648461],[779970191,396349656],[778432574,395516933],[778432480,395089730],[778534758,394542941],[780277879,383066156],[774678777,385351969],[761284176,398395586],[742640785,391877508],[740386168,390270359],[740068832,390597930],[740094422,390746363],[739981820,390843609],[739858980,390818019],[735957549,394830634],[732022074,402838176],[727912965,405321484],[730388926,408323289],[730795113,408986625],[731584402,409536605],[731895078,409973230],[732310711,409423250],[732906875,409335086],[735279976,410011015],[736771504,409038976],[737006551,408855527],[737564066,409889344],[737676133,410489024],[741094449,410318006],[741143691,411154976],[741164715,411512320],[740363074,412069359],[738238879,412856289],[737704773,412948012],[737643625,412875398],[736988172,413377973],[737979949,414574219],[736975273,415376812],[736468875,415697851],[735863586,414907680],[735979740,413832688],[736089040,413620681],[735894854,413336315],[735581722,413455367],[734661129,414313375],[734220688,414272261],[733920841,413813775],[734098022,413049154],[733778754,412822848],[733549918,412918394],[733507879,412979543],[733557562,413013941],[733490679,413147707],[733214754,414323847],[733386709,414874102],[732989316,415481530],[732446311,416107048],[731804727,416490474],[729740945,416327117],[729740945,415581281],[729740945,415395922],[729481058,415390187],[729347293,415277445],[729131836,415209605],[728898699,415328082],[728795512,415494336],[728751558,415834480],[728891058,416450758],[728921633,416811926],[728900613,417132965],[728816531,417406226],[728568109,417752105],[728434344,418099898],[728493582,418631137],[728600594,418866183],[728743914,419036254],[727528082,419034344],[727197488,418843250],[727019773,418835605],[726807660,418782101],[726503820,418812676],[726235332,418740058],[726097746,418627316],[725778621,418529859],[725769066,418661711],[725637211,418657890],[725453762,418799301],[725425097,418910133],[725481945,419042789],[725284625,419042789],[725708656,419559183],[725838804,419798488],[725838804,420008406],[725775828,420243512],[725561715,420684336],[725393781,420919441],[725242640,421066383],[724999137,421112566],[724018828,420831277],[723174965,420335875],[722721547,420331676],[722064508,420629758],[721871383,420608765],[721644676,420503808],[721313008,420218324],[721052711,419857265],[720930957,419403848],[720864836,418543191],[720780867,418102367],[720545762,417548187],[720323250,417367660],[719844640,417283691],[719286265,417329875],[718820250,417590168],[718496980,417909242],[717963793,418555785],[717858832,419021801],[717833644,419139351],[717871429,419496211],[717955394,419769101],[717716090,419848871],[718564152,420793492],[719647320,421255308],[719886625,421763308],[720012574,421805289],[720029367,421943836],[719928609,422317484],[719533965,422829683],[718740480,423341879],[718173707,423493015],[717748433,423544625],[717093496,423555543],[716258449,423773855],[715707207,424292348],[715510726,424990949],[715543472,425471238],[715850476,426841152],[715907381,427191376],[715893331,427472771],[715778392,427731073],[715638076,427883270],[715288274,427994500],[715005285,427992114],[714251074,427828938],[714251071,427828937],[713762727,427585488],[712817114,427265231],[712143848,426964630],[711380687,426692405],[709659552,426307269],[709023625,426258679],[708246436,426269046],[707306321,426346163],[706764047,426309370],[706474852,426252508],[705017843,425737106],[704673798,425740521],[703882940,425687376],[702704786,425727433],[702308710,425806593],[702201235,425810859],[701945057,425904686],[701888813,425897959],[699709655,424589768],[699639277,424581911],[699551438,424576002],[699532196,424567374],[699508594,424556997],[699446454,424514842],[699375624,424470982],[699232230,424386270],[699219412,424378762],[699147145,424336790],[699083430,424296798],[699040841,424270801],[699000673,424246964],[698923324,424173402],[698833779,424093224],[698817439,424079603],[698718458,423997982],[698654404,423947323],[698588335,423899320],[698520362,423854055],[698450597,423811602],[698362023,423760151],[698319804,423736322],[698236588,423690675],[698143052,423642523],[698047114,423599355],[697891537,423534217],[697807052,423501076],[697745264,423479581],[697682806,423460119],[697575435,423428578],[697469946,423400692],[697363094,423378600],[697284719,423366212],[697199734,423354502],[697156001,423348966],[697074032,423339507],[696960212,423329657],[696888218,423325494],[696776881,423322163],[696689632,423323886],[696602541,423329414],[696515774,423338735],[696429496,423351832],[696327773,423372284],[696227247,423397983],[696107845,423431831],[696040106,423452334],[695973136,423475222],[695883101,423510263],[695794863,423549610],[695686377,423601163],[695631273,423628677],[695617894,423630668],[695532270,423647516],[695447463,423668083],[695405260,423680290],[695363721,423677482],[695276480,423675399],[695189231,423677124],[695102141,423682653],[695015374,423691975],[694929097,423705073],[694843999,423721807],[694759706,423742214],[694711949,423754878],[694627594,423779241],[694544388,423807283],[694462992,423838744],[694383045,423873726],[694304699,423912162],[694293454,423918302],[694256416,423930972],[694201398,423951789],[694027832,424020396],[693926364,424063777],[693848954,424102052],[693844968,424103389],[693763572,424134851],[693683625,424169833],[693605281,424208269],[693528687,424250086],[693453991,424295204],[693381334,424343538],[693310854,424394994],[693242685,424449476],[693176959,424506879],[693113798,424567095],[693053324,424630008],[693044601,424639914],[692991751,424667884],[692889176,424725434],[692871321,424735573],[692796625,424780691],[692723968,424829024],[692653489,424880481],[692643482,424888479],[692637038,424891997],[692598634,424914638],[692516248,424964455],[692430362,425019425],[692347389,425078702],[692274789,425133416],[692254876,425148620],[692085140,425279904],[692026312,425327206],[691959777,425385382],[691900721,425415961],[691815360,425462293],[691748434,425502509],[691583300,425606179],[691526540,425643167],[691471066,425682056],[691416941,425722801],[691364226,425765356],[691298501,425822760],[691235341,425882976],[691174869,425945889],[691117198,426011381],[691113988,426015200],[691002700,426147953],[690948869,426215044],[690897973,426284388],[690865223,426333286],[690852630,426339704],[690793912,426372157],[690725449,426378649],[690621409,426393972],[690541260,426409629],[690461817,426428546],[690365178,426453653],[690275863,426479084],[690187826,426508633],[690106431,426540097],[690026487,426575081],[689948145,426613518],[689871554,426655337],[689796860,426700456],[689724206,426748790],[689653728,426800248],[689585563,426854730],[689519838,426912134],[689456681,426972351],[689396210,427035265],[689338540,427100756],[689283783,427168701],[689232041,427238970],[689183413,427311428],[689137993,427385939],[689086410,427480664],[689040008,427578032],[688984296,427703543],[688958268,427764917],[688934300,427827125],[688900611,427927212],[688889082,427968566],[688863810,428008387],[688822416,428076579],[688815861,428087967],[688729887,428238453],[688680955,428329486],[688625082,428440199],[688590004,428500412],[688540322,428555827],[688485565,428623771],[688433823,428694040],[688385196,428766498],[688339776,428841009],[688290090,428932023],[688277601,428956381],[688225008,429067203],[688205337,429116203],[688162217,429165172],[688107460,429233117],[688055719,429303385],[688009919,429371629],[688006842,429375625],[687984251,429400779],[687929494,429468724],[687877753,429538992],[687829126,429611451],[687783706,429685961],[687741579,429762382],[687702826,429840567],[687667520,429920368],[687635728,430001634],[687607512,430084209],[687582924,430167936],[687562011,430252655],[687544814,430338207],[687531365,430424427],[687521690,430511151],[687517761,430569286],[687511429,430600787],[687506619,430631620],[687468029,430684028],[687419402,430756487],[687373982,430830997],[687331855,430907417],[687293102,430985602],[687257796,431065404],[687226004,431146669],[687189152,431257145],[687158792,431369579],[687155712,431382467],[687132009,431496129],[687118560,431582349],[687108885,431669073],[687103001,431756137],[687100921,431843375],[687102648,431930620],[687108179,432017707],[687117503,432104470],[687130603,432190743],[687155931,432313301],[687188875,432434034],[687196720,432459606],[687227998,432553252],[687243775,432594067],[687230902,432891305],[687198798,433239016],[687198352,433245415],[687197491,433250301],[687183627,433341152],[687173951,433432544],[687158143,433623712],[687124676,433973267],[687121762,434006652],[687097451,434314933],[687059512,434622177],[687050421,434712670],[687039322,434855814],[687033970,434924848],[687008674,435251199],[686996501,435312861],[686993269,435329603],[686954657,435534358],[686951115,435553665],[686932938,435678005],[686910274,435876417],[686896399,435959888],[686891254,435990821],[686888101,436012137],[686880734,436061953],[686872777,436133417],[686867394,436205121],[686864592,436276972],[686860347,436479044],[686859910,436516959],[686862837,436629297],[686863704,436636647],[686862977,436645273],[686858718,436699466],[686857145,436716681],[686856063,436723614],[686846386,436810338],[686840500,436897401],[686839347,436945733],[686822686,437048509],[686811546,437127055],[686803530,437205981],[686798651,437285162],[686796915,437364475],[686799179,437463799],[686804567,437576837],[686809923,437689201],[686815839,437845675],[686822681,438027052],[686823328,438042600],[686836527,438332566],[686837573,438353205],[686851263,438729566],[686861850,439020666],[686866065,439059899],[686879163,439146172],[686892972,439217713],[686900966,439252302],[686902227,439270045],[686923207,439506847],[686932389,439590449],[686945078,439673591],[686957242,439737292],[686984822,439870005],[687000512,439939302],[687018654,440007999],[687028545,440040702],[687028189,440088296],[687028137,440099142],[687031399,440217524],[687041662,440335506],[687062844,440516697],[687076247,440611577],[687121742,440886003],[687152721,441100140],[687161785,441157002],[687180835,441252538],[687236384,441499587],[687253764,441570762],[687273738,441641254],[687396504,442046079],[687423592,442128867],[687821661,442998562],[687830836,443014704],[687887972,443108127],[687950135,443198282],[687981095,443240652],[688023184,443308507],[688061352,443367688],[688101580,443425489],[688143818,443481838],[688188013,443536665],[688227655,443582672],[688319149,443685651],[688367989,443738666],[688418707,443789886],[688471238,443839246],[688521470,443883147],[688525446,443886751],[688541376,443901863],[688595978,443949594],[688675555,444013256],[688713346,444041941],[688750745,444072899],[688800225,444112552],[688850938,444150617],[688902831,444187056],[688955854,444221831],[688978257,444236022],[689009798,444255150],[689034423,444271610],[689080480,444305506],[689150562,444352546],[689152895,444354192],[689164075,444361716],[689233451,444409478],[689305102,444453692],[689347805,444478818],[689358405,444485011],[689434823,444527144],[689513006,444565904],[689592805,444601216],[689674069,444633015],[689728134,444651083],[689745477,444658592],[689816837,444686295],[689922286,444721633],[690029536,444751056],[690115703,444772137],[690177431,444786208],[690239572,444798318],[690325792,444811774],[690412517,444821457],[690499582,444827347],[690586821,444829434],[690644268,444828730],[690784750,444824989],[690857579,444821720],[690930241,444815800],[691002639,444807235],[691028403,444803231],[691083261,444811777],[691137920,444819521],[691282197,444837934],[691309758,444847355],[691393484,444871951],[691478203,444892872],[691563754,444910078],[691627598,444920412],[691669298,444926472],[691739827,444935445],[691810631,444941905],[691881620,444945845],[691938594,444946979],[691940596,444948592],[692000967,444995389],[692063081,445039847],[692126848,445081901],[692192174,445121489],[692261788,445160048],[692332880,445195808],[692405339,445228711],[692479049,445258706],[693633099,445701775],[693643198,445705653],[693717979,446148582],[693719707,446158663],[693731716,446221651],[693745739,446284221],[693761759,446346310],[693779761,446407853],[693891830,446769362],[693921281,446857131],[693963651,446964530],[694012147,447069305],[694156637,447359220],[694213363,447478062],[694224870,447638049],[694222892,447745182],[694216270,447774723],[694198987,447860596],[694197710,447867823],[694151470,448132369],[694138733,448215507],[694129503,448299107],[694123795,448383021],[694121621,448467101],[694120566,448685517],[694115678,449062593],[694091805,449202253],[694090278,449211313],[694067781,449346664],[694044560,449425447],[694000744,449573835],[693976821,449662261],[693956868,449752212],[693943131,449792613],[693918528,449876338],[693897602,449961057],[693880390,450046608],[693865707,450142100],[693854140,450231684],[693846821,450296730],[693834232,450427898],[693817409,450491931],[693801000,450565598],[693795207,450594128],[693786366,450640469],[693772903,450726689],[693763212,450813414],[693757314,450900480],[693755864,450960884],[693752556,450974276],[693735344,451059827],[693730289,451092200],[693685354,451140103],[693638751,451193450],[693581294,451264881],[693551560,451303633],[693483629,451397694],[693421267,451495536],[693385234,451555860],[693372385,451577683],[693345554,451625415],[693326273,451660836],[693290554,451709323],[693241914,451781775],[693196480,451856280],[693150062,451941536],[693087782,452042328],[693072505,452069682],[693041602,452114108],[693019110,452150539],[692979049,452196020],[692901304,452294360],[692875385,452331739],[692816933,452370612],[692746446,452422059],[692678271,452476532],[692612537,452533927],[692549369,452594134],[692530475,452613784],[692527684,452616004],[692478273,452648309],[692412494,452676915],[692244497,452754226],[692163495,452793739],[692084355,452836860],[692077038,452841084],[691941242,452919859],[691877351,452958533],[691814949,452999566],[691783144,453021311],[691700377,453049204],[691618978,453080656],[691582746,453096505],[691518401,453106267],[691478832,453113566],[691432087,453122678],[691356605,453138908],[691281805,453158039],[691207800,453180043],[691134699,453204887],[691053300,453236339],[690973351,453271312],[690895003,453309739],[690844756,453337165],[690797873,453357996],[690704582,453402368],[690613706,453451498],[690539006,453496607],[690466344,453544932],[690395860,453596380],[690327686,453650853],[690261954,453708249],[690198788,453768457],[690138308,453831363],[690080630,453896847],[690036295,453951367],[689993904,454007411],[689953506,454064910],[689915154,454123792],[689885627,454170915],[689850515,454229127],[689808377,454305542],[689769613,454383723],[689734295,454463520],[689702492,454544782],[689674264,454627354],[689649664,454711078],[689628740,454795796],[689611530,454881346],[689598069,454967565],[689591291,455028244],[689569388,455084762],[689541159,455167333],[689516560,455251057],[689495635,455335775],[689478426,455421325],[689473375,455451923],[689457671,455482959],[689422353,455562756],[689390550,455644017],[689368884,455706306],[689355160,455750397],[689330144,455807666],[689317301,455840637],[689307586,455860230],[689272268,455940027],[689253103,455988999],[689245921,456000879],[689202046,456080622],[689181285,456120476],[689152407,456178163],[689144104,456196180],[689128361,456218242],[689084039,456260488],[689063751,456281590],[689005280,456332645],[688942114,456392853],[688881635,456455759],[688823957,456521242],[688774468,456582363],[688733181,456635454],[688692588,456689515],[688653845,456744917],[688616996,456801597],[688610806,456811862],[688577867,456847203],[688534106,456897408],[688486868,456955639],[688458869,456992928],[688455282,456996347],[688394803,457059252],[688337126,457124736],[688316184,457150606],[688295305,457172323],[688237627,457237806],[688203279,457280415],[688178106,457306599],[688137783,457352379],[688072335,457374440],[687990937,457405893],[687910990,457440866],[687832644,457479294],[687756048,457521102],[687713207,457546429],[687689159,457561052],[687625966,457601116],[687564316,457643516],[687504295,457688192],[687445987,457735082],[687380256,457792478],[687317092,457852686],[687256614,457915592],[687198937,457981076],[687144172,458049013],[687115041,458088564],[687105123,458092903],[687026778,458131331],[686950183,458173139],[686904666,458201174],[686861564,458222363],[686786048,458263613],[686711350,458308723],[686696084,458318877],[686672056,458321456],[686585781,458334548],[686500159,458351390],[686415354,458371951],[686331526,458396191],[686248836,458424065],[686167440,458455519],[686087493,458490494],[686009149,458528922],[685932555,458570731],[685858486,458615443],[685786420,458663317],[685734258,458701319],[685727469,458703282],[685725060,458697777],[685686629,458619434],[685644817,458542842],[685599704,458468146],[685551376,458395489],[685499925,458325010],[685445448,458256841],[685375474,458177461],[685301400,458101893],[685253387,458055436],[685203199,458008517],[685151430,457963349],[685083490,457908588],[685013226,457856843],[684940772,457808212],[684866266,457762787],[684789849,457720656],[684711668,457681898],[684631870,457646587],[684550607,457614790],[684451043,457581255],[684349855,457552994],[684266925,457532164],[684199272,457516415],[684131113,457503025],[684044896,457489571],[683958173,457479890],[683871111,457474002],[683783875,457471916],[683766523,457471955],[681737862,457485362],[681720561,457485590],[681650622,457487237],[681637661,457487825],[681563540,457492731],[681554924,457493490],[681476778,457502014],[681472490,457502577],[681390501,457515068],[681304883,457531915],[681220081,457552481],[681136257,457576726],[681053570,457604604],[680972178,457636063],[680892235,457671041],[680878895,457677586],[680873130,457676437],[680795900,457664209],[680718252,457655008],[680680154,457651248],[680584092,457644097],[680487797,457641580],[680400554,457643305],[680313470,457648834],[680226709,457658156],[680140438,457671253],[680054820,457688101],[679970019,457708668],[679886196,457732914],[679803510,457760793],[679722118,457792253],[679642177,457827232],[679563837,457865666],[679487249,457907480],[679482699,457910102],[679459789,457923347],[679386323,457967952],[679314841,458015672],[679245475,458066420],[679178354,458120100],[679112631,458177500],[679049475,458237711],[678989005,458300620],[678931336,458366107],[678876579,458434047],[678824837,458504311],[678778780,458572936],[678761603,458578777],[678680213,458610237],[678600272,458645217],[678521933,458683651],[678445345,458725465],[678389464,458758797],[678360394,458776784],[678300694,458815206],[678242395,458855721],[678185571,458898281],[678130293,458942830],[678060823,459003659],[677994234,459067630],[677971672,459090330],[677914948,459149794],[677860715,459211538],[677805959,459279478],[677754219,459349742],[677717677,459404188],[677653500,459469053],[677582723,459548651],[677527967,459616591],[677476226,459686855],[677427600,459759309],[677382180,459833815],[677340054,459910231],[677301300,459988412],[677265994,460068208],[677234202,460149469],[677211340,460215426],[677201173,460246500],[677180627,460313217],[677162421,460380611],[677146578,460448599],[677133117,460517098],[677120761,460595256],[677111506,460673842],[677105367,460752732],[677102354,460831804],[677101376,460859698],[677091541,460906208],[677078091,460992424],[677068413,461079144],[677062528,461166204],[677060446,461253438],[677061341,461317500],[677061885,461335627],[677035428,461383404],[677030471,461386111],[676955781,461431226],[676883130,461479556],[676812655,461531009],[676803050,461538686],[676784865,461524031],[676714600,461472293],[676642145,461423669],[676567638,461378252],[676491221,461336128],[676413039,461297378],[676333241,461262074],[676251980,461230285],[676153485,461197088],[676053399,461169053],[676031661,461163569],[675962934,461147515],[675893684,461133896],[675807469,461120449],[675720748,461110775],[675633689,461104894],[675546456,461102815],[675472652,461104029],[675398944,461107966],[675325431,461114619],[675294795,461118537],[675286321,461118704],[675199239,461124237],[675183147,461125966],[675112481,461133562],[675026212,461146663],[674940597,461163515],[674855799,461184084],[674771978,461208333],[674701486,461232105],[674685258,461228189],[674606451,461212491],[674522779,461199387],[674438626,461189837],[674354145,461183858],[674269486,461181462],[674247937,461181308],[674237675,461181262],[674150434,461182991],[674063353,461188525],[673976595,461197851],[673958067,461200628],[673870887,461209981],[673784619,461223083],[673662350,461248347],[673541896,461281192],[673523544,461286817],[673449145,461311657],[673428417,461313885],[673342150,461326988],[673256535,461343841],[673171738,461364412],[673087918,461388662],[673005237,461416546],[672960966,461433661],[672957339,461430738],[672887073,461379004],[672814617,461330384],[672740109,461284971],[672690503,461257136],[672667901,461244873],[672603077,461211219],[672537068,461179954],[672469962,461151121],[672401847,461124757],[672319276,461096547],[672235553,461071966],[672150838,461051060],[672065292,461033869],[672016215,461025744],[671969589,461018620],[671895426,461008704],[671820944,461001569],[671746248,460997226],[671671441,460995679],[671584202,460997412],[671497121,461002947],[671426493,461010542],[671399092,461008692],[671311860,461006618],[671247724,461007892],[671174168,460997122],[671050195,460986788],[671035864,460986041],[670935704,460983335],[670904561,460983517],[670889650,460983720],[670802132,460986830],[670714834,460993767],[670701587,460995113],[670630722,461003589],[670560205,461014588],[670474592,461031444],[670389796,461052018],[670305979,461076271],[670223299,461104156],[670141914,461135622],[670061979,461170608],[669983646,461209047],[669907065,461250867],[669832380,461295987],[669759735,461344322],[669689267,461395779],[669621111,461450261],[669589501,461477243],[669584186,461481876],[669527223,461533490],[669472286,461587254],[669418692,461643963],[669391997,461671282],[669325268,461746564],[669270519,461814507],[669218787,461884772],[669170168,461957228],[669124756,462031735],[669082638,462108152],[669043892,462186333],[669008594,462266130],[668976810,462347391],[668948601,462429960],[668924020,462513682],[668903115,462598396],[668885924,462683941],[668875601,462750933],[668854833,462818439],[668836344,462886623],[668820274,462955417],[668806643,463024735],[668793200,463110949],[668783531,463197667],[668777653,463284724],[668777300,463299562],[668772326,463316507],[668751420,463401221],[668734229,463486766],[668720786,463572979],[668711117,463659697],[668705239,463746755],[668703165,463833985],[668705041,463924615],[668705837,463942972],[668709680,464007453],[668715602,464071776],[668723599,464135875],[668733662,464199681],[668750516,464285293],[668771089,464370089],[668795341,464453906],[668816378,464516281],[668823308,464604314],[668827013,464639340],[668835199,464705994],[668845617,464772336],[668862471,464857948],[668883044,464942743],[668907295,465026561],[668935180,465109241],[668966644,465190626],[669001629,465270561],[669040066,465348894],[669081884,465425476],[669135855,465513991],[669149757,465535514],[669219437,465636465],[669224609,465643055],[669245993,465678453],[669294327,465751099],[669303711,465763950],[669296701,465807880],[669287823,465880519],[669284450,465913043],[669279463,465976870],[669273501,465984213],[669229779,466042255],[669215485,466061964],[669157815,466145906],[669104492,466232675],[669062373,466309091],[669023626,466387272],[668988326,466467068],[668956541,466548328],[668928330,466630897],[668903748,466714618],[668882841,466799332],[668865649,466884877],[668857229,466935889],[668852235,466968786],[668842446,467042471],[668835402,467116469],[668831113,467190677],[668829584,467264994],[668831315,467352232],[668836849,467439312],[668846177,467526067],[668859280,467612333],[668879143,467711430],[668903987,467809397],[668910061,467831038],[668931203,467901371],[668954912,467970880],[668969855,468009532],[668965976,468014800],[668917356,468087254],[668871943,468161760],[668867164,468170506],[668841875,468204105],[668800036,468264141],[668760422,468325668],[668748138,468345536],[668719196,468393857],[668677076,468470273],[668638329,468548453],[668603029,468628249],[668571243,468709509],[668548020,468776586],[668527192,468844445],[668520529,468867608],[668494498,468967808],[668473687,469069220],[668460243,469155434],[668450572,469242151],[668444692,469329208],[668442615,469416439],[668444346,469503677],[668449880,469590757],[668459207,469677512],[668472309,469763778],[668484579,469827964],[668498939,469891714],[668515375,469954962],[668533868,470017638],[668539792,470036569],[668567789,470119615],[668599252,470201000],[668634235,470280936],[668653891,470320995],[668650702,470327915],[668625593,470387392],[668602416,470447647],[668574204,470530216],[668549621,470613937],[668528713,470698650],[668511520,470784195],[668510501,470790725],[668493502,470859600],[668476309,470945145],[668462864,471031358],[668453192,471118076],[668447312,471205133],[668445235,471292363],[668446312,471362101],[668449820,471431759],[668451632,471458456],[668461460,471562756],[668476737,471666399],[668493589,471752012],[668514159,471836807],[668538409,471920625],[668566291,472003306],[668597753,472084692],[668632736,472164627],[668671171,472242961],[668712865,472319103],[668751177,472396996],[668792993,472473579],[668838110,472548265],[668886441,472620912],[668937895,472691382],[668992374,472759540],[669049775,472825257],[669109987,472888408],[669160602,472937055],[669172896,472948872],[669238383,473006535],[669306323,473061286],[669376586,473113022],[669449040,473161644],[669523545,473207059],[669585317,473241443],[669648266,473273623],[669691325,473293749],[669723777,473319902],[669794041,473371638],[669866494,473420261],[669940999,473465676],[670051532,473525233],[670165585,473577736],[670193991,473589746],[670285053,473625649],[670367622,473653862],[670451343,473678447],[670536057,473699357],[670621602,473716552],[670707816,473729999],[670794534,473739672],[670881592,473745554],[670968823,473747633],[671056062,473745904],[671143143,473740373],[671229899,473731048],[671316167,473717947],[671401780,473701096],[671427621,473694828],[671453320,473697695],[671540378,473703578],[671627610,473705657],[671631358,473705661],[671702138,473705671],[671788437,473703821],[671874576,473698248],[671960395,473688963],[672045733,473675984],[672131347,473659134],[672216145,473638566],[672299964,473614318],[672382647,473586437],[672407222,473577366],[672441950,473564288],[672516892,473534327],[672590564,473501367],[672662846,473465460],[672733620,473426667],[672808309,473381551],[672880958,473333220],[672951429,473281766],[673019590,473227287],[673085309,473169887],[673148462,473109675],[673174989,473082076],[673205054,473062519],[673260280,473025134],[673342466,472966417],[673421583,472903626],[673487302,472846226],[673550455,472786014],[673610922,472723104],[673668587,472657617],[673744133,472562206],[673813737,472462376],[673844482,472415288],[673899864,472325366],[673905951,472314324],[673923239,472311699],[674008854,472294850],[674059514,472282563],[674049685,472304775],[674017893,472386034],[673989674,472468603],[673965085,472552324],[673944170,472637037],[673926970,472722583],[673910706,472830748],[673900380,472939641],[673897185,472987116],[673893870,473052163],[673892675,473117282],[673894398,473204523],[673899926,473291605],[673909246,473378363],[673922342,473464632],[673931019,473509800],[673911228,473526978],[673856424,473578278],[673803583,473631598],[673752781,473686864],[673728970,473713763],[673697094,473750670],[673642337,473818608],[673590597,473888870],[673541970,473961321],[673496549,474035825],[673454422,474112239],[673415668,474190418],[673380361,474270213],[673348568,474351472],[673327849,474412098],[673292580,474406596],[673205861,474396920],[673118802,474391036],[673031570,474388955],[672945401,474390637],[672859384,474396029],[672836857,474397930],[672749027,474407296],[672661696,474420532],[672576081,474437381],[672491283,474457948],[672407463,474482194],[672324780,474510073],[672243391,474541533],[672163453,474576512],[672085116,474614946],[672008531,474656759],[671933149,474701808],[671869116,474739713],[671807220,474779996],[671746854,474822537],[671688100,474867277],[671668888,474882475],[671627271,474916314],[671561551,474973713],[671498398,475033923],[671437930,475096831],[671380265,475162316],[671325510,475230255],[671273771,475300517],[671225147,475372969],[671179728,475447473],[671137603,475523887],[671098851,475602066],[671063546,475681860],[671031755,475763119],[671003539,475845687],[670978951,475929408],[670958039,476014121],[670940841,476099665],[670927391,476185879],[670917715,476272597],[670911830,476359654],[670909748,476446886],[670910812,476516320],[670914286,476585676],[670915934,476610095],[670924092,476696929],[670918578,476778510],[670916496,476865741],[670918221,476952980],[670923749,477040061],[670933071,477126818],[670946168,477213086],[670969515,477327297],[670999476,477439955],[671021908,477514063],[671021361,477553529],[671023085,477640769],[671028614,477727850],[671037935,477814606],[671051032,477900874],[671053671,477915694],[671067029,477989100],[671083689,478070915],[671103750,478151963],[671127175,478232103],[671153926,478311196],[671181673,478383510],[671212199,478454696],[671245459,478524646],[671281403,478593256],[671306130,478638311],[671325332,478672501],[671370445,478747190],[671418773,478819841],[671470224,478890314],[671524700,478958476],[671575207,479016608],[671627914,479072752],[671673329,479119299],[671688729,479134412],[671689953,479138041],[671712587,479197640],[671737108,479256488],[671763493,479314523],[671791714,479371689],[671823720,479433998],[671868636,479516603],[671913748,479591293],[671944764,479637919],[671957975,479663986],[671991736,479725193],[672030582,479789939],[672071845,479853173],[672115466,479914804],[672161382,479974744],[672192415,480013709],[672200738,480023911],[672297671,480257304],[672427669,480591831],[672578562,480980852],[672580700,480986340],[672728529,481364159],[672737421,481386490],[672819327,481588631],[672834023,481623927],[672911002,481803942],[672938465,481865291],[673048804,482101073],[673139040,482300699],[673171412,482368861],[673309014,482645019],[673318503,482663815],[673448182,482917349],[673510493,483050276],[673541731,483113952],[673669037,483362222],[673778482,483588384],[673811172,483667543],[673804437,483690469],[673783519,483775181],[673766315,483860726],[673752859,483946940],[673743177,484033658],[673737286,484120716],[673735199,484207948],[673736918,484295189],[673742441,484382271],[673751757,484469029],[673764849,484555299],[673772976,484599076],[673795269,484712134],[673815087,484801754],[673838996,484890370],[673919807,485164697],[673941254,485232971],[674058176,485583143],[674061954,485594347],[674105820,485723184],[674096034,485762815],[674078829,485848359],[674065372,485934573],[674055689,486021291],[674049797,486108349],[674047708,486195582],[674050781,486310738],[674060480,486425527],[674063280,486450181],[674080154,486567587],[674096995,486653204],[674117555,486738004],[674141794,486821827],[674161722,486880945],[674154835,486905712],[674146484,486939177],[674131168,487005310],[674128849,487017140],[674126144,487020211],[674057072,487106944],[673992912,487197372],[673950791,487260367],[673916267,487313823],[673883460,487368350],[673841328,487444761],[673802569,487522938],[673767257,487602731],[673735459,487683988],[673707236,487766554],[673682641,487850274],[673661721,487934986],[673644516,488020530],[673630679,488109595],[673620869,488199193],[673615453,488261636],[673609937,488345837],[673607977,488430195],[673609695,488517435],[673615217,488604517],[673624532,488691276],[673637622,488777546],[673653382,488858208],[673672443,488938155],[673694772,489017250],[673720332,489095362],[673738380,489146908],[673745180,489166018],[673776632,489247409],[673811604,489327352],[673850030,489405692],[673891837,489482282],[673936944,489556976],[673956373,489586188],[673971547,489651346],[673991345,489723895],[674013856,489795648],[674028778,489840254],[674044629,489885807],[674076080,489967199],[674111052,490047141],[674149477,490125483],[674178700,490179019],[674189613,490201551],[674234448,490284015],[674267398,490339290],[674302108,490393476],[674339911,490450450],[674403321,490540531],[674471595,490626984],[674513078,490675064],[674556067,490721804],[674600518,490767155],[674646386,490811072],[674694282,490855495],[674765470,490918441],[674833403,490973204],[674903661,491024951],[674976109,491073584],[675050609,491119011],[675082833,491136490],[675105318,491159970],[675166947,491219053],[675231041,491275453],[675298974,491330217],[675369232,491381964],[675420827,491416600],[675445025,491435601],[675509823,491482419],[675576439,491526610],[675644769,491568104],[675721179,491610239],[675799356,491649000],[675879148,491684315],[675960405,491716116],[676042971,491744342],[676126691,491768940],[676211403,491789863],[676296948,491807070],[676368415,491818501],[676440249,491827337],[676479829,491831481],[676581652,491839518],[676683753,491842346],[676696146,491842335],[676728266,491842205],[676812400,491840094],[676896371,491834446],[676980030,491825269],[677063229,491812581],[677113001,491803003],[677132528,491870546],[677160396,491953235],[677181331,492008574],[677203649,492065029],[677231508,492131930],[677261772,492197777],[677294402,492262484],[677316474,492302572],[677316748,492312261],[677322461,492394356],[677331545,492476146],[677343986,492557493],[677350539,492593213],[677370577,492697124],[677387830,492777643],[677408384,492857384],[677465009,493059738],[677472693,493099118],[677554595,493712952],[677566652,493791409],[677572347,493822657],[677592205,493926914],[677597904,493984012],[677615221,494872231],[677595065,496397354],[677567158,497261336],[677566120,497321477],[677566238,497348088],[677571714,497841864],[677570140,498551006],[677570849,498608909],[677577089,498842270],[677581363,498929984],[677589484,499017427],[677640436,499460249],[677656943,499574547],[677665555,499620804],[677703263,499810887],[677726601,499914138],[677755369,500016009],[677811267,500195628],[677840026,500281188],[677869070,500356725],[677912184,500462421],[677988549,500677362],[677992230,500687631],[678012073,500740210],[678112821,500996208],[678132824,501045129],[678203317,501211234],[678225839,501272462],[678254967,501379503],[678276201,501452090],[678300165,501523822],[678341827,501641109],[678345541,501651472],[678376984,501732869],[678411948,501812817],[678450366,501891163],[678492165,501967760],[678495708,501973512],[678436071,501996325],[678420148,502002755],[678356848,502029596],[678294508,502058596],[678233201,502089722],[678173001,502122937],[678137567,502143777],[678111714,502159341],[678098782,502167386],[678084865,502175230],[678070721,502183277],[677989018,502232838],[677943523,502261944],[677855573,502321564],[677801674,502362440],[677758933,502382247],[677698229,502412928],[677685106,502419843],[677621340,502454942],[677571782,502484365],[677546318,502499984],[677484921,502539200],[677424992,502580625],[677366613,502624206],[677309859,502669884],[677259533,502713363],[677237483,502733732],[677194205,502759862],[677150763,502789176],[677120919,502807190],[677086247,502822944],[677071968,502830743],[677051366,502840183],[677019313,502849449],[676936624,502877314],[676856761,502908129],[676778290,502942333],[676739407,502960282],[676659525,502999332],[676616172,503022968],[676604200,503017108],[676574723,503003531],[676501048,502971373],[676426140,502942202],[676343574,502913973],[676259856,502889372],[676175144,502868446],[676089600,502851235],[676019102,502839939],[675948247,502831167],[675877123,502824930],[675805822,502821235],[675772379,502820100],[675708933,502818955],[675587191,502822396],[675465883,502833242],[675444875,502835767],[675431102,502837422],[675326791,502852758],[675282828,502861403],[675241172,502869594],[675156370,502890148],[675072545,502914382],[674989857,502942248],[674956780,502954536],[674911512,502971809],[674838790,503001204],[674767276,503033428],[674697081,503068431],[674628313,503106160],[674553616,503151263],[674480958,503199582],[674410477,503251023],[674342306,503305490],[674270296,503368633],[674201392,503435152],[674175123,503461754],[674120911,503518862],[674068989,503578060],[674014224,503645991],[673962473,503716246],[673913837,503788691],[673868406,503863189],[673826269,503939597],[673787504,504017771],[673752186,504097561],[673720382,504178816],[673683221,504290247],[673652666,504403667],[673642496,504446372],[673641747,504449972],[673624280,504509412],[673603354,504594123],[673586143,504679666],[673572679,504765878],[673562989,504852596],[673557091,504939653],[673554995,505026885],[673555278,505065191],[673555559,505081779],[673555191,505123873],[673555119,505136966],[673555194,505159211],[673555553,505199458],[673553894,505242405],[673552408,505315213],[673554119,505402454],[673559635,505489536],[673568943,505576295],[673582027,505662566],[673589893,505705040],[673595742,505734821],[673611909,505809552],[673630920,505883611],[673653055,505957792],[673657394,505975150],[673685497,506077910],[673719031,506179028],[673750477,506260422],[673758230,506278147],[673766572,506336901],[673775984,506385984],[673779084,506442675],[673788846,506537679],[673796023,506594212],[673809721,506685285],[673814120,506708351],[673814645,506712600],[673824367,506777111],[673831656,506822008],[673851096,506919339],[673875341,507015586],[673889521,507066506],[673911071,507138615],[673935319,507209862],[673966764,507291256],[674001730,507371201],[674026259,507421221],[674031244,507454094],[674037677,507486813],[674044292,507548477],[674057375,507634748],[674066245,507680732],[674066053,507688459],[674066119,507695026],[674065141,507706899],[674059205,507745624],[674049087,507843710],[674045847,507885102],[674031704,507928170],[674010547,508002067],[673992245,508076723],[673976825,508152027],[673953397,508278787],[673951250,508290604],[673937163,508381500],[673927271,508472947],[673917312,508590150],[673912603,508660081],[673910347,508730134],[673909367,508796988],[673909156,508821880],[673910082,508887322],[673912037,508951384],[673915455,509022200],[673921381,509092849],[674226526,510123644],[674371182,510612317],[674382604,510651833],[674391836,510698792],[674412387,510783595],[674436617,510867421],[674464480,510950111],[674495923,511031506],[674530887,511111452],[674568960,511189220],[674573146,511203841],[674600530,511285002],[674631973,511366398],[674666937,511446344],[674705355,511524689],[674747153,511601284],[674796387,511682477],[674849420,511761242],[674886153,511813097],[674905771,511839656],[674911382,511849938],[674915956,511865765],[674943819,511948455],[674965546,512005804],[674976425,512033241],[675004135,512099618],[675034213,512164955],[675066622,512229168],[675086579,512265409],[675105606,512314579],[675122998,512356693],[675148721,512416225],[675176360,512474892],[675205887,512532632],[675237270,512589384],[675244932,512601724],[675297579,512713309],[675310801,512739325],[675427125,512937917],[675452838,512976588],[675504275,513047073],[675558739,513115247],[675585860,513146709],[675624664,513217590],[675669762,513292290],[675718076,513364951],[675769514,513435436],[675823976,513503611],[675828359,513508537],[675850728,513549523],[675882993,513623304],[675921409,513701651],[675963206,513778247],[675996647,513834333],[676014512,513863213],[676052894,513922868],[676093367,513981124],[676135881,514037908],[676180382,514093149],[676237766,514158884],[676297963,514222053],[676305043,514228861],[676310511,514236354],[676327092,514257109],[676300237,514419844],[676221679,514450190],[676141731,514485152],[676063385,514523569],[675986788,514565366],[675912088,514610464],[675839427,514658778],[675768941,514710215],[675700767,514764678],[675647393,514810882],[675595683,514858942],[675549771,514903147],[675476809,514977146],[675407789,515054836],[675353018,515122763],[675301263,515193015],[675252621,515265457],[675207185,515339952],[675165042,515416358],[675126272,515494530],[675090949,515574318],[675059139,515655571],[675033155,515731095],[675013915,515790875],[674992942,515860331],[674974502,515930502],[674950143,516030544],[674924549,516151925],[674911634,516234029],[674897266,516339621],[674874276,516386878],[674837942,516471194],[674800007,516565101],[674776581,516625926],[674753675,516691967],[674733092,516758767],[674714855,516826246],[674707855,516856279],[674672658,516914016],[674630515,516990422],[674591745,517068593],[674556422,517148382],[674524612,517229634],[674518580,517247327],[674499895,517275344],[674462094,517336708],[674375802,517482611],[674367473,517496827],[674318722,517585968],[674235445,517747878],[674182294,517859581],[674136150,517974357],[674134372,517979291],[674126682,517993233],[674087912,518071404],[674052589,518151192],[674020780,518232445],[673983137,518345450],[673952288,518460495],[673941411,518506493],[673918913,518614974],[673905444,518701185],[673902683,518726187],[673890411,518771637],[673873002,518839061],[673859728,518880493],[673851006,518906747],[673832568,518949989],[673807724,519014316],[673770294,519126613],[673739573,519240929],[673724709,519303582],[673701870,519413499],[673688401,519499711],[673678705,519586428],[673672801,519673485],[673670699,519760717],[673672765,519856239],[673675968,519926557],[673669190,519954753],[673653805,520032037],[673640336,520118249],[673635335,520162976],[673628031,520183692],[673606206,520249841],[673595756,520264227],[673550387,520332388],[673507845,520402349],[673465703,520478755],[673426933,520556926],[673391610,520636713],[673359800,520717966],[673331565,520800528],[673306959,520884244],[673286027,520968953],[673268810,521054495],[673255341,521140706],[673245645,521227423],[673239741,521314480],[673237639,521401712],[673239345,521488952],[673244854,521576035],[673248050,521605835],[673247543,521615755],[673246336,521680810],[673246147,521764540],[673247852,521851780],[673253361,521938863],[673262664,522025623],[673275742,522111895],[673292570,522197514],[673313118,522282317],[673325798,522326192],[673314682,522349864],[673224199,522558012],[673162343,522700343],[673118786,522809191],[673095622,522876019],[673074837,522943623],[673056455,523011921],[673040499,523080825],[672984611,523343201],[672971905,523408097],[672970580,523415598],[672918347,523714507],[672901908,523827525],[672871483,524088898],[672863525,524172504],[672846185,524406748],[672842178,524478245],[672840733,524549841],[672844036,524669370],[672860204,524950133],[672865349,525018840],[672872857,525087330],[672915502,525422846],[672929138,525513473],[672950096,525617509],[672976543,525720287],[673051129,525981246],[673071043,526046667],[673093182,526111369],[673121227,526184464],[673152111,526256405],[673256551,526487121],[673300667,526611167],[673307529,526646085],[673328075,526730889],[673352300,526814716],[673380158,526897407],[673411597,526978803],[673446557,527058751],[673484970,527137098],[673526764,527213694],[673534178,527226494],[673609401,527355263],[673590227,527361050],[673522505,527384162],[673441109,527415602],[673361162,527450562],[673282815,527488977],[673206219,527530772],[673131519,527575868],[673058857,527624180],[672988372,527675615],[672920197,527730076],[672869612,527774234],[672859009,527780016],[672820464,527801591],[672752143,527842660],[672685514,527886420],[672620681,527932801],[672557747,527981728],[672412316,528099517],[672389009,528118687],[672323275,528176070],[672260107,528236265],[672199624,528299159],[672141943,528364631],[672068874,528456666],[672001337,528552833],[671950789,528629504],[671890789,528726412],[671848645,528802816],[671809875,528880986],[671774550,528960773],[671768490,528977045],[671726616,529053554],[671687845,529131724],[671377117,529654894],[671356201,529692643],[671178639,530028695],[671129908,530127409],[671013613,530380291],[671007472,530393777],[670869159,530700504],[670841010,530766020],[670815214,530832497],[670694599,531160563],[670662105,531256525],[670634755,531353062],[670569886,531606060],[670552799,531678241],[670538401,531751006],[670524931,531837216],[670515234,531923932],[670509329,532010988],[670507226,532098218],[670509770,532204369],[670505226,532254686],[670501477,532323800],[670500121,532393003],[670501826,532480242],[670506419,532552857],[670489856,532580012],[670434016,532683066],[670408433,532733774],[670359248,532838716],[670315834,532946114],[670242820,533076076],[670206556,533144133],[670172943,533213536],[670065472,533446799],[670057086,533465245],[670016148,533556523],[670000424,533592523],[669959463,533688876],[669922227,533783016],[669893992,533865577],[669869384,533949291],[669848452,534033999],[669831234,534119539],[669817764,534205749],[669808068,534292464],[669802162,534379520],[669800060,534466750],[669801586,534549538],[669806537,534632193],[669814905,534714571],[669826676,534796532],[669836719,534857472],[669839695,534875040],[669856523,534960658],[669877069,535045460],[669901294,535129285],[669928596,535211011],[669927609,535213414],[669906676,535298122],[669889458,535383662],[669886403,535401210],[669860599,535553439],[669848454,535635347],[669839710,535717688],[669834381,535800320],[669832478,535883102],[669834182,535970342],[669839690,536057423],[669839790,536058357],[669564580,535880880],[669488175,535838739],[669410004,535799972],[669330217,535764651],[669248965,535732844],[669166403,535704612],[669082689,535680007],[669043573,535670059],[668962644,535634172],[668881393,535602366],[668798831,535574134],[668715116,535549530],[668630408,535528601],[668544867,535511387],[668458657,535497921],[668371942,535488228],[668284887,535482327],[668197657,535480228],[668145202,535480799],[667862793,535487577],[667788716,535490729],[667714806,535496626],[667641165,535505258],[667567895,535516614],[667546531,535520451],[667171080,535589996],[667095042,535605613],[667019667,535624169],[666945069,535645636],[666871361,535669981],[666704024,535728878],[666688169,535734533],[666666299,535742582],[666391110,535845691],[666283376,535889672],[666178382,535939845],[665977507,536043119],[665920369,536074377],[665835646,536095067],[665829053,536096973],[665771089,536074285],[665688527,536046057],[665604813,536021457],[665520105,536000532],[665434565,535983321],[665348355,535969859],[665261641,535960169],[665174586,535954271],[665087357,535952176],[665023164,535953066],[664959032,535956015],[664845163,535963085],[664735298,535972955],[664626145,535988867],[664540531,536005701],[664455732,536026254],[664371911,536050486],[664289226,536078352],[664207836,536109797],[664127894,536144763],[664049554,536183182],[663990314,536215514],[663964042,536227369],[663894256,536262197],[663825881,536299720],[663738009,536353248],[663664459,536400689],[663563153,536470537],[663466334,536546483],[663400608,536603869],[663337447,536664068],[663276972,536726964],[663219298,536792438],[663151531,536877424],[663088481,536965966],[663044260,537031783],[663008463,537087003],[662974501,537143371],[662932366,537219776],[662893603,537297946],[662858286,537377733],[662826484,537458984],[662798256,537541545],[662773656,537625258],[662752731,537709965],[662735520,537795504],[662723861,537868576],[662714912,537942029],[662708687,538015762],[662705194,538089676],[662702874,538170444],[662689941,538212777],[662671170,538283349],[662654987,538354560],[662640135,538425925],[662629331,538481809],[662611913,538599446],[662601518,538717911],[662599620,538750713],[662598450,538760106],[662587088,538881276],[662583117,539002913],[662583758,539030275],[662576627,539065716],[662563164,539151924],[662553474,539238637],[662551111,539273524],[662541166,539287024],[662492531,539359466],[662447103,539433960],[662404967,539510365],[662366204,539588534],[662330887,539668321],[662299085,539749572],[662270857,539832132],[662246256,539915846],[662225331,540000552],[662208121,540086091],[662194658,540172299],[662184968,540259013],[662179069,540346066],[662176974,540433294],[662178093,540504720],[662181761,540576061],[662185233,540626125],[662185606,540630039],[662175706,540693329],[662166062,540779050],[662155036,540900602],[662149005,540988641],[662146864,541076860],[662148575,541164096],[662154090,541251175],[662163397,541337930],[662176480,541424196],[662193314,541509810],[662213865,541594608],[662238096,541678429],[662265961,541761114],[662279550,541796857],[662281921,541834302],[662291229,541921057],[662304311,542007324],[662320210,542088656],[662346588,542210172],[662329931,542203524],[662276693,542183150],[662243799,542171422],[662167664,542145021],[662113022,542104800],[662085569,542082606],[662024030,542036535],[661960765,541992863],[661895869,541951655],[661734926,541853747],[661699224,541832534],[661624828,541791454],[661548753,541753572],[661451002,541707462],[661369201,541671091],[661285854,541638417],[661203293,541610192],[661119579,541585596],[661034871,541564674],[660949332,541547467],[660885565,541537141],[660821498,541528880],[660757197,541522692],[660692730,541518584],[660502826,541509561],[660412221,541507312],[660292020,541510668],[660172238,541521242],[660013092,541540128],[659819517,541557025],[659734715,541566253],[659650384,541579090],[659564772,541595928],[659479976,541616484],[659396157,541640719],[659313476,541668588],[659232088,541700036],[659152150,541735005],[659073813,541773427],[658997227,541815229],[658931360,541854771],[658876611,541889086],[658819575,541926200],[658763834,541965233],[658709454,542006141],[658656497,542048874],[658590774,542106262],[658527617,542166462],[658467145,542229360],[658409475,542294835],[658354716,542362763],[658302972,542433016],[658254341,542505458],[658249604,542513228],[658227714,542540382],[658175970,542610635],[658127339,542683077],[658081915,542757572],[658039783,542833977],[658001024,542912148],[657965712,542991934],[657941260,543054413],[657913493,543095776],[657868069,543170271],[657825938,543246677],[657787179,543324847],[657773418,543355940],[657690493,543459467],[657679826,543472903],[657511174,543687196],[657493029,543704492],[657432558,543767389],[657374889,543832865],[657323767,543896090],[657299644,543928538],[657252211,543981999],[657197453,544049927],[657145709,544120180],[657097080,544192623],[657051129,544268026],[656883078,544558363],[656847834,544621888],[656814920,544686651],[656784380,544752567],[656756254,544819549],[656703518,544951820],[656698426,544958137],[656646683,545028390],[656598054,545100833],[656552630,545175328],[656510759,545251238],[656472217,545328891],[656437077,545408142],[656405404,545488841],[656247836,545917403],[656236291,545949712],[656053370,546475819],[656022261,546573258],[655996174,546672161],[655893600,547105730],[655776907,547542538],[655756856,547624484],[655740280,547707203],[655727312,547789776],[655717806,547872818],[655691224,548157583],[655687205,548207331],[655667844,548491105],[655665156,548538936],[655649154,548900997],[655636207,549193935],[655569591,549883792],[655562753,549977641],[655560337,550071708],[655560571,550106895],[655566260,550515136],[655489060,550556949],[655388520,550618724],[655331409,550656180],[655297479,550676981],[655156555,550727077],[655146413,550730713],[655065027,550762162],[654985091,550797132],[654906757,550835555],[654830172,550877359],[654755485,550922463],[654682835,550970782],[654612363,551022224],[654544201,551076691],[654478480,551134079],[654415325,551194279],[654354856,551257177],[654297188,551322652],[654242431,551390581],[654190689,551460833],[654171509,551489407],[654168405,551493071],[654123079,551537206],[654075366,551586619],[654060449,551602067],[654000807,551669685],[653946050,551737614],[653894309,551807866],[653845680,551880309],[653800259,551954803],[653757098,552033182],[653717486,552113414],[653708682,552132298],[653663860,552201517],[653612720,552284894],[653570591,552361299],[653531834,552439469],[653496525,552519255],[653464729,552600505],[653436507,552683065],[653411914,552766777],[653390995,552851482],[653373791,552937019],[653360334,553023225],[653350651,553109936],[653344758,553196987],[653342669,553284212],[653344386,553371445],[653346439,553403826],[653339007,553420618],[653307211,553501868],[653278990,553584428],[653254396,553668140],[653233477,553752845],[653225441,553792800],[653202087,553852477],[653173866,553935037],[653149272,554018749],[653141446,554050439],[653083822,554108197],[653025776,554168873],[652970329,554231932],[652915573,554299861],[652863832,554370113],[652815204,554442555],[652769783,554517050],[652751926,554548478],[652712505,554618978],[652703706,554634030],[652701120,554638219],[652682925,554671562],[652658427,554714329],[652619671,554792499],[652584362,554872285],[652552566,554953535],[652524345,555036094],[652499752,555119806],[652478833,555204511],[652461630,555290048],[652452833,555346399],[652417018,555390831],[652365277,555461083],[652316650,555533526],[652271228,555608020],[652233385,555676281],[652198235,555745966],[652165830,555816970],[652136221,555889184],[652115082,555943750],[652102101,555978197],[652073880,556060756],[652049413,556143009],[652005851,556177366],[651940131,556234755],[651876978,556294956],[651816510,556357854],[651758844,556423330],[651704089,556491258],[651652348,556561511],[651603722,556633953],[651558301,556708448],[651516173,556784853],[651477418,556863022],[651442109,556942808],[651410314,557024058],[651382094,557106617],[651357501,557190329],[651336584,557275034],[651319381,557360571],[651310442,557414970],[651303221,557463042],[651293645,557535884],[651286751,557609030],[651282548,557682379],[651281043,557755833],[651284194,557872378],[651287002,557922297],[651239970,558123265],[651221454,558196856],[651216405,558206014],[651177649,558284184],[651142341,558363969],[651110546,558445219],[651082325,558527778],[651057733,558611490],[651036815,558696195],[651027768,558741177],[651008292,558770444],[650965729,558840460],[650924297,558915604],[650416837,560334990],[650388617,560417549],[650384633,560431109],[650343149,560447141],[650263215,560482113],[650184883,560520537],[650108301,560562342],[650033076,560607807],[649984115,560634661],[649909430,560679766],[649836783,560728087],[649766314,560779530],[649698155,560833998],[649632437,560891387],[649569285,560951588],[649508819,561014486],[649451154,561079962],[649396400,561147891],[649344661,561218144],[649296036,561290586],[649286843,561305663],[649268935,561331326],[649232541,561387384],[649198040,561444626],[649155913,561521030],[649117160,561599200],[649081853,561678986],[649050059,561760235],[649015160,561864245],[649000222,561913174],[648980978,561980397],[648964095,562048253],[648954036,562091928],[648934135,562189352],[648920681,562275557],[648910999,562362266],[648905110,562449316],[648903023,562536539],[648904082,562587901],[648901168,562630962],[648899081,562718186],[648900800,562805417],[648906323,562892491],[648915638,562979241],[648928729,563065502],[648935311,563098960],[648942665,563149552],[648957630,563225624],[648963237,563277833],[648976327,563364094],[648993013,563448995],[649013356,563533096],[649022564,563567856],[649033223,563638093],[649050063,563723701],[649070622,563808493],[649094859,563892307],[649111888,563942822],[649125023,563988245],[649152894,564070923],[649184344,564152306],[649193992,564174360],[649202339,564216794],[649222898,564301586],[649247135,564385401],[649275005,564468078],[649303382,564541955],[649334660,564614651],[649368789,564686052],[649405717,564756047],[649428447,564797139],[649444381,564825401],[649492383,564904645],[649535009,564968173],[649541063,564979263],[649586167,565053949],[649634486,565126596],[649685927,565197067],[649740394,565265227],[649797399,565331217],[649854404,565397208],[649891272,565435899],[649930643,565481612],[649965931,565521354],[650153533,565714981],[650183889,565741515],[650230966,565790902],[650293863,565851370],[650359337,565909037],[650435230,565969900],[650473971,565999449],[650576382,566072584],[650683192,566139132],[650759596,566181261],[650837765,566220017],[650917550,566255326],[650998799,566287122],[651081358,566315344],[651165069,566339937],[651249774,566360856],[651263836,566363684],[651287748,566381806],[651377563,566446048],[651438574,566487189],[651495196,566523996],[651553028,566558870],[651610252,566590964],[651636416,566619125],[651703497,566688155],[651718377,566703108],[651739948,566766457],[651768432,566840604],[651799837,566913561],[651814336,566943870],[651834264,566996235],[651837124,567003053],[651845369,567027971],[651864211,567077194],[651870915,567119591],[651887751,567205201],[651908305,567289995],[651920422,567331903],[651997861,567551615],[653935193,566977040],[654377438,567036293],[654477106,566960654],[654561152,566951339],[654643286,566877545],[655081978,566807567],[655079342,566801934],[656114954,566377966],[657149409,566484935],[657614087,566568220],[659083011,566855652],[660259452,567172369],[660687044,567076122],[661188988,567256731],[662058970,567154019],[663213635,567156663],[664067751,567435319],[664937293,567527071],[665141575,567542503],[665313986,567559730],[665420944,567511371],[665550797,567291070],[666009131,566880844],[665995532,566282562],[666153689,565983807],[666513840,565879955],[666738380,566052478],[666744721,566546050],[667081499,566816054],[667441755,566667339],[667945448,566107663],[668336304,565704765],[668202450,565233323],[667542785,565156987],[667483959,564663291],[667606196,563698895],[667914594,563288319],[668401655,563431550],[668776593,563424956],[669242822,562865193],[669641074,562514659],[670203198,562628167],[670397412,562942715],[670366741,563226815],[670681106,563466869],[671191575,563228785],[671193292,562510875],[671465031,561763697],[672096068,561286598],[672125130,561675539],[673009905,561707581],[673579265,561933307],[673533259,562351983],[674116264,563131148],[675404413,563792395],[675884838,563584181],[675312704,564495141],[676076851,564781203],[676015793,565214801],[676553382,566143459],[676327986,566322383],[677211040,567027554],[677630758,567103388],[678633538,567898626],[680178142,568656000],[680591852,571080119],[681221760,571051820],[682299387,571862292],[682896191,573030513],[683736108,572972874],[684572571,574231493],[684477948,575996227],[684806498,576505650],[685466759,576327909],[686573446,577437720],[687199057,578994995],[687975061,580373200],[691655699,583285122],[692157319,586218297],[692243844,587445102],[694010936,588197990],[695301293,587872576],[696079922,588233801],[697491198,587579684],[698027680,588718079],[698688345,588390906],[699167616,588571802],[699888353,588214896],[700487047,588575655],[701357117,588428622],[701385608,588937304],[702432236,589927678],[703927918,591158764],[704915406,591849843],[705297631,594364120],[706161830,596131924],[707025878,597929674],[706660554,599723657],[707066576,600036529],[708961503,607701621],[713034582,609031049],[715294672,614663312],[712636736,620758216],[716762240,624063099],[718843903,628917267],[718960841,631910149],[717388597,633123557],[715038355,637521352],[721323140,639936759],[725532250,636121711],[727694365,634932565],[732265215,630759931],[736370237,622994861],[745231503,626259795],[747059756,629597270],[750247219,631546124],[749937559,639135638],[753515814,643588054],[755959081,642342634],[759504471,643256480],[763378929,645545829],[765036678,650401382],[772653676,649416820],[778872009,652976461],[785870447,656241337],[791293662,650279902],[794533591,649756392]]]}"

How should i fix this? Any workaround? The expected result is to have 1 row of record each within a [,] block

For example,

X = 794533591

Y = 649756392

(in one row, same for other block in the data above)

[Tom]

You definitely cannot store more than 32K characters into a single variable.

What is your source?  Is it really in some type of data base or is it just a file you are trying to read?  If so why use Hadoop instead of just reading the file?  You can read lines much longer than 32K from a file.  If it is a database can you have Hadoop return a output a file that you could read instead?

What is your output?  Again are you just trying to produce a file?  You can produce lines much longer than 32K to a file.

[imdickson]

This is the data architecture in this project and I am only allowed to read from Hadoop database which coincidentally they have record more than 32767 word count. This will be ran every now and then and it is not ideal to output to a file and read from file. 

For my output, I am generating x and y axis in row based, meaning splitting the extremely large column into row based for one area(location). No, i am not trying to produce a file as the output table will be used by another team in SAS Dataset for showing in map later in their WebUI application.

[Tom]

So if you have an external database that has a single field that is longer than 32K you need to split the field in that database.

Something like:

proc sql ;
connect to XXX ..... ;
create view from_db as 
select * from connection to xxx
(select id
,substr(longvar,1,30000) as longvar1
,substr(longvar,300001,60000) as longvar2
,substr(longvar,60001,90000) as longvar3
);
quit;

data want ;
  set from_db;
  ....
run;

[imdickson]

Thanks @Tom . I tried this just now. However, if you refer to my script that does transformation, there is a do loop to read "geometry" column and output to one row for every set of longitude and latitude. By splitting into 3 columns, there is a risk, which column 2 and column 3 beginning value might not be the full set of long/lat.

For example, the last few value of column 1 could be :
[333,444],[111,2

and column 2 starts with

22],[197,999]

How should i come across this? and so far i cant think of a workaround for this and amendment to the current do loop. WOuld you be able to advise on this?

[ChrisNZ]

I would probably split to the long column that contains the JSON string into new columns that contain value pairs in Hive.

Parsing these columns in SAS is then very easy.

See an example here http://bigdataprogrammers.com/split-one-column-into-multiple-columns-in-hive/

[imdickson]

Hi @ChrisNZ . Thanks for the info. Unfortunately, I am only allowed to read from this table as I am not the admin of Hadoop. I will keep this guide for my future use. Thanks again.

[ChrisNZ]

I meant to say to read the data partitioned as explained.

Pass the Hive query as SQL pass-through.

[imdickson]

I am trying it now

[ChrisNZ]

I would combine the use of the split and of the explode functions.

Split() can break the string into value pairs and explode() makes a row out of each pair.

See this example:

select exploded_sellers, orders
from somedf
lateral view outer explode(split(sellers,'--\\*\\*--')) t1 as exploded_sellers

from https://stackoverflow.com/questions/49885323/how-to-split-delimited-string-to-multiple-rows-in-hive-...