Bookmark and Share

Notice: On March 31, it was announced that Statalist is moving from an email list to a forum. The old list will shut down at the end of May, and its replacement, statalist.org is already up and running.


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: st: U.S. Census Data


From   Neil Shephard <nshephard@gmail.com>
To   statalist@hsphsun2.harvard.edu
Subject   Re: st: U.S. Census Data
Date   Thu, 6 May 2010 14:46:21 +0000

On Thu, May 6, 2010 at 2:31 PM, Nate Breznau
<nbreznau@bigsss.uni-bremen.de> wrote:
> I am wanting to end my usage of SPSS, and in general have successfully done
> so; however, in a project working with U.S. Census data I need to use a
> datafile that has over 30 million cases and 15 variables. This is the
> smallest version I can use for my purposes. Is there any way to alter Stata
> to work with such a monster file? I've pushed it to its maximum allowed
> memory and its not enough.

What version of Stata and on what platform are you using?

Number of cases is not a limiting factor since Intercooled/SE/MP
versions of Stata can all handle > 2000000000 observations (see
http://www.stata.com/help.cgi?limits).

More likely its a memory issue and there are various limits imposed by
a 32-bit OS, and also under M$-Windows.

So go for a 64-bit OS and possibly an alternative to M$-Windows (I've
no idea how much 64-bit Win systems can handle, but suspect its
similar to *NIX type systems which can have Gb's and Gb's of RAM).


Neil

-- 
"... no scientific worker has a fixed level of significance at which
from year to year, and in all circumstances, he rejects hypotheses; he
rather gives his mind to each particular case in the light of his
evidence and his ideas." - Sir Ronald A. Fisher (1956)

Email - nshephard@gmail.com
Website - http://slack.ser.man.ac.uk/
Photos - http://www.flickr.com/photos/slackline/
*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/


© Copyright 1996–2014 StataCorp LP   |   Terms of use   |   Privacy   |   Contact us   |   Site index