<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Tempindx and index page size in New SAS User</title>
    <link>https://communities.sas.com/t5/New-SAS-User/Tempindx-and-index-page-size/m-p/602342#M16810</link>
    <description>&lt;P&gt;Hi,&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;I 'm creating a new table in a proc sql using a table that has considerable lengths.&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;TABLE&gt;&lt;TBODY&gt;&lt;TR&gt;&lt;TD&gt;NAME&lt;/TD&gt;&lt;TD&gt;TYPE&lt;/TD&gt;&lt;TD&gt;LENGTH&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable1&lt;/TD&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;5000&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable2&lt;/TD&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;255&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable3&lt;/TD&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;15000&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable4&lt;/TD&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;5000&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable5&lt;/TD&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;5000&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable6&lt;/TD&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;15000&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable7&lt;/TD&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;5000&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable8&lt;/TD&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;25&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable9&lt;/TD&gt;&lt;TD&gt;1&lt;/TD&gt;&lt;TD&gt;8&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable10&lt;/TD&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;255&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable11&lt;/TD&gt;&lt;TD&gt;1&lt;/TD&gt;&lt;TD&gt;8&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable12&lt;/TD&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;5000&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable13&lt;/TD&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;5000&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable14&lt;/TD&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;15000&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable15&lt;/TD&gt;&lt;TD&gt;1&lt;/TD&gt;&lt;TD&gt;8&lt;/TD&gt;&lt;/TR&gt;&lt;/TBODY&gt;&lt;/TABLE&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;This proc sql gives the following output :&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;ERROR: Index TEMPINDX cannot be created on file WORK.'SASTMP-000000278'n because the length of the index value (15026 bytes) is too&lt;/P&gt;&lt;P&gt;large. The index page size (currently 32767) must be large enough to store three index values plus a small overhead&lt;/P&gt;&lt;P&gt;structure. Reduce the length of the index value or use the IBUFSIZE= option to increase the index page size (up to a maximum&lt;/P&gt;&lt;P&gt;of 32,767 bytes).&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;I alread found out that reducing these lengths solves the problem, however I'm stuck with a couple of questions as I don't understand exactly why the ERROR is happening :&lt;/P&gt;&lt;P&gt;1. What does 'the length of the index value'&amp;nbsp; mean in the error message ?&lt;/P&gt;&lt;P&gt;2. The maximum IBUFSIZE option 32,767 did not work for me. Still I got the error message.... Is there another solution&amp;nbsp;apart from reducing the lengths ?&lt;/P&gt;&lt;P&gt;3. The input data set for the proc sql is not big at all. Only 108 records. It seems that the length of the fields influences a memory buffer. Is that right ? How to prevent this by default ?&lt;/P&gt;&lt;P&gt;4. What is this tmpindex and how does this relate tot the index page size ? I'm confused by the word index because I normally consider this a method to make queries faster on fields that are indexed&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Thanks for clarifying !&lt;/P&gt;&lt;P&gt;Regards&lt;/P&gt;&lt;P&gt;B&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
    <pubDate>Thu, 07 Nov 2019 08:11:26 GMT</pubDate>
    <dc:creator>Billybob73</dc:creator>
    <dc:date>2019-11-07T08:11:26Z</dc:date>
    <item>
      <title>Tempindx and index page size</title>
      <link>https://communities.sas.com/t5/New-SAS-User/Tempindx-and-index-page-size/m-p/602342#M16810</link>
      <description>&lt;P&gt;Hi,&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;I 'm creating a new table in a proc sql using a table that has considerable lengths.&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;TABLE&gt;&lt;TBODY&gt;&lt;TR&gt;&lt;TD&gt;NAME&lt;/TD&gt;&lt;TD&gt;TYPE&lt;/TD&gt;&lt;TD&gt;LENGTH&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable1&lt;/TD&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;5000&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable2&lt;/TD&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;255&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable3&lt;/TD&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;15000&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable4&lt;/TD&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;5000&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable5&lt;/TD&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;5000&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable6&lt;/TD&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;15000&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable7&lt;/TD&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;5000&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable8&lt;/TD&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;25&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable9&lt;/TD&gt;&lt;TD&gt;1&lt;/TD&gt;&lt;TD&gt;8&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable10&lt;/TD&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;255&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable11&lt;/TD&gt;&lt;TD&gt;1&lt;/TD&gt;&lt;TD&gt;8&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable12&lt;/TD&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;5000&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable13&lt;/TD&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;5000&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable14&lt;/TD&gt;&lt;TD&gt;2&lt;/TD&gt;&lt;TD&gt;15000&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;Variable15&lt;/TD&gt;&lt;TD&gt;1&lt;/TD&gt;&lt;TD&gt;8&lt;/TD&gt;&lt;/TR&gt;&lt;/TBODY&gt;&lt;/TABLE&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;This proc sql gives the following output :&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;ERROR: Index TEMPINDX cannot be created on file WORK.'SASTMP-000000278'n because the length of the index value (15026 bytes) is too&lt;/P&gt;&lt;P&gt;large. The index page size (currently 32767) must be large enough to store three index values plus a small overhead&lt;/P&gt;&lt;P&gt;structure. Reduce the length of the index value or use the IBUFSIZE= option to increase the index page size (up to a maximum&lt;/P&gt;&lt;P&gt;of 32,767 bytes).&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;I alread found out that reducing these lengths solves the problem, however I'm stuck with a couple of questions as I don't understand exactly why the ERROR is happening :&lt;/P&gt;&lt;P&gt;1. What does 'the length of the index value'&amp;nbsp; mean in the error message ?&lt;/P&gt;&lt;P&gt;2. The maximum IBUFSIZE option 32,767 did not work for me. Still I got the error message.... Is there another solution&amp;nbsp;apart from reducing the lengths ?&lt;/P&gt;&lt;P&gt;3. The input data set for the proc sql is not big at all. Only 108 records. It seems that the length of the fields influences a memory buffer. Is that right ? How to prevent this by default ?&lt;/P&gt;&lt;P&gt;4. What is this tmpindex and how does this relate tot the index page size ? I'm confused by the word index because I normally consider this a method to make queries faster on fields that are indexed&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Thanks for clarifying !&lt;/P&gt;&lt;P&gt;Regards&lt;/P&gt;&lt;P&gt;B&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
      <pubDate>Thu, 07 Nov 2019 08:11:26 GMT</pubDate>
      <guid>https://communities.sas.com/t5/New-SAS-User/Tempindx-and-index-page-size/m-p/602342#M16810</guid>
      <dc:creator>Billybob73</dc:creator>
      <dc:date>2019-11-07T08:11:26Z</dc:date>
    </item>
    <item>
      <title>Re: Tempindx and index page size</title>
      <link>https://communities.sas.com/t5/New-SAS-User/Tempindx-and-index-page-size/m-p/602344#M16811</link>
      <description>&lt;P&gt;Have you already seen the SAS Note &lt;A href="http://support.sas.com/kb/62/575.html" target="_self"&gt;here&lt;/A&gt;?&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;P&gt;The error message says:&lt;/P&gt;
&lt;P&gt;"...&lt;SPAN&gt;must be large enough to store &lt;STRONG&gt;three&lt;/STRONG&gt; index values plus a small overhead structure&lt;/SPAN&gt;". Below code works if you set ibufsize to the maximum and the indexed variable isn't much longer than 10000 characters.&lt;/P&gt;
&lt;PRE&gt;&lt;CODE class=" language-sas"&gt;options ibufsize=32767;
proc options option=ibufsize;
run;

data test;
  length var $10000;
  do var='a','b','c';
    output;
  end;
  stop;
run;

proc sql;
  create index var on test(var);
quit;&lt;/CODE&gt;&lt;/PRE&gt;</description>
      <pubDate>Thu, 07 Nov 2019 08:57:03 GMT</pubDate>
      <guid>https://communities.sas.com/t5/New-SAS-User/Tempindx-and-index-page-size/m-p/602344#M16811</guid>
      <dc:creator>Patrick</dc:creator>
      <dc:date>2019-11-07T08:57:03Z</dc:date>
    </item>
  </channel>
</rss>

