<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Re: A huge dataset with 100+ variables and 2 million observations in Statistical Procedures</title>
    <link>https://communities.sas.com/t5/Statistical-Procedures/A-huge-dataset-with-100-variables-and-2-million-observations/m-p/62867#M2968</link>
    <description>Regression of that size.  No problem.  The linear regression procedures (REG, GLM, etc), use memory based on the number of variables and generally make one pass through the data for each execution of the procedure.&lt;BR /&gt;
&lt;BR /&gt;
Other regression type procedures (LOGISTIC, PHREG) use search algorithms that do run through the data multiple times and potentially take days to run.&lt;BR /&gt;
&lt;BR /&gt;
The reference manual has some information on the execution algorithms in the "details" section of each chapter.&lt;BR /&gt;
&lt;BR /&gt;
Doc Muhlbaier&lt;BR /&gt;
Duke</description>
    <pubDate>Fri, 06 May 2011 12:27:04 GMT</pubDate>
    <dc:creator>Doc_Duke</dc:creator>
    <dc:date>2011-05-06T12:27:04Z</dc:date>
    <item>
      <title>A huge dataset with 100+ variables and 2 million observations</title>
      <link>https://communities.sas.com/t5/Statistical-Procedures/A-huge-dataset-with-100-variables-and-2-million-observations/m-p/62866#M2967</link>
      <description>My company has a very dataset which requires to do a regession analysis. The dataset has over 2million observations for the customers, and 100 variables (many are categorical).&lt;BR /&gt;
&lt;BR /&gt;
I want to use SAS to run a regression model. But just worry about the massive size of the dataset. Will this cause computer crash if running for days or weeks?&lt;BR /&gt;
&lt;BR /&gt;
An suggestions?</description>
      <pubDate>Fri, 06 May 2011 11:05:08 GMT</pubDate>
      <guid>https://communities.sas.com/t5/Statistical-Procedures/A-huge-dataset-with-100-variables-and-2-million-observations/m-p/62866#M2967</guid>
      <dc:creator>bncoxuk</dc:creator>
      <dc:date>2011-05-06T11:05:08Z</dc:date>
    </item>
    <item>
      <title>Re: A huge dataset with 100+ variables and 2 million observations</title>
      <link>https://communities.sas.com/t5/Statistical-Procedures/A-huge-dataset-with-100-variables-and-2-million-observations/m-p/62867#M2968</link>
      <description>Regression of that size.  No problem.  The linear regression procedures (REG, GLM, etc), use memory based on the number of variables and generally make one pass through the data for each execution of the procedure.&lt;BR /&gt;
&lt;BR /&gt;
Other regression type procedures (LOGISTIC, PHREG) use search algorithms that do run through the data multiple times and potentially take days to run.&lt;BR /&gt;
&lt;BR /&gt;
The reference manual has some information on the execution algorithms in the "details" section of each chapter.&lt;BR /&gt;
&lt;BR /&gt;
Doc Muhlbaier&lt;BR /&gt;
Duke</description>
      <pubDate>Fri, 06 May 2011 12:27:04 GMT</pubDate>
      <guid>https://communities.sas.com/t5/Statistical-Procedures/A-huge-dataset-with-100-variables-and-2-million-observations/m-p/62867#M2968</guid>
      <dc:creator>Doc_Duke</dc:creator>
      <dc:date>2011-05-06T12:27:04Z</dc:date>
    </item>
    <item>
      <title>Re: A huge dataset with 100+ variables and 2 million observations</title>
      <link>https://communities.sas.com/t5/Statistical-Procedures/A-huge-dataset-with-100-variables-and-2-million-observations/m-p/62868#M2969</link>
      <description>Many thanks indeed, Duke.</description>
      <pubDate>Fri, 06 May 2011 15:32:11 GMT</pubDate>
      <guid>https://communities.sas.com/t5/Statistical-Procedures/A-huge-dataset-with-100-variables-and-2-million-observations/m-p/62868#M2969</guid>
      <dc:creator>bncoxuk</dc:creator>
      <dc:date>2011-05-06T15:32:11Z</dc:date>
    </item>
  </channel>
</rss>

