Statalist


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: st: RE: -expand-, -expandcl-, and -set mem-; limit to the number of obs?


From   Maarten buis <maartenbuis@yahoo.co.uk>
To   statalist@hsphsun2.harvard.edu
Subject   Re: st: RE: -expand-, -expandcl-, and -set mem-; limit to the number of obs?
Date   Sun, 11 Oct 2009 23:42:28 -0700 (PDT)

--------------------------
Maarten L. Buis
Institut fuer Soziologie
Universitaet Tuebingen
Wilhelmstrasse 36
72074 Tuebingen
Germany

http://www.maartenbuis.nl
--------------------------

--- Misha wrote:
> > "Why am I asking for so much memory?", you might
> > ask.  Well, I have a data set that, when expanded,
> > ought to give me about 2.63e+09 (i.e., nearly 
> > three billion) observations.

Many commands allow you to work with the unexpanded 
data by using fweights, see -help weight-. 
 
> How large is the .dta file you are using (not in
> observations, but in terms of disk space)?
> Keep in mind that the "size" of your dataset is more than
> just the number of observations; so, how many variables are
> in the dataset?  how many characters/digits are in your
> variables?  are there labels, notes, or other
> characteristics stored in your .dta file?  All of these
> will contribute to the amount of memory needed open the file
> in Stata (this is also why it is difficult to do a simple
> "back-of-the-envelope" calculation of the exact amount of
> memory you need).

Here is how to do such back of the envelope calculation:
http://www.stata.com/support/faqs/data/datacalc.cgi

Hope this helps,
Maarten 


      

*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/



© Copyright 1996–2014 StataCorp LP   |   Terms of use   |   Privacy   |   Contact us   |   What's new   |   Site index