[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

From |
"Martin Weiss" <martin.weiss1@gmx.de> |

To |
<statalist@hsphsun2.harvard.edu> |

Subject |
st: RE: -expand-, -expandcl-, and -set mem-; limit to the number of obs? |

Date |
Sun, 11 Oct 2009 12:39:27 +0200 |

<> Look at http://www.stata.com/statalist/archive/2009-07/msg00899.html and http://www.stata.com/support/faqs/win/winmemory.html HTH Martin -----Original Message----- From: owner-statalist@hsphsun2.harvard.edu [mailto:owner-statalist@hsphsun2.harvard.edu] On Behalf Of Misha Spisok Sent: Sonntag, 11. Oktober 2009 11:51 To: statalist@hsphsun2.harvard.edu Subject: st: -expand-, -expandcl-, and -set mem-; limit to the number of obs? Hello, Statalist! I have a few questions about Stata's ability to handle billions of observations. On the Stata webpage, "Which Stata is right for me," it indicates that the number of observations is unlimited for Stata versions other than Small Stata. The network computer I'm using has Stata 11.0 SE and claims to have 113,000MB of RAM available. At one point I managed to set the memory to 100g. However, on subsequent tries (after logging out and logging in), I get mixed results. Sometimes I can only set the memory to 16g (if I ask for more I get the "op. sys. refuses to provide memory" message); sometimes I can get only 32g; and sometimes I can get 100g. What could be the problem? "Why am I asking for so much memory?", you might ask. Well, I have a data set that, when expanded, ought to give me about 2.63e+09 (i.e., nearly three billion) observations. Whether I use -expand- or -expandcl- I run into the same problem, getting the message "no room to add more observations, etc." I've compressed and dropped as much as I can, but I still get this problem. Am I asking too much of Stata and/or "only" 113,000MB of RAM? Is there a back-of-the-envelope way to calculate how much RAM I would need to hold a given dataset? Thank you for your time and attention. Misha * * For searches and help try: * http://www.stata.com/help.cgi?search * http://www.stata.com/support/statalist/faq * http://www.ats.ucla.edu/stat/stata/ * * For searches and help try: * http://www.stata.com/help.cgi?search * http://www.stata.com/support/statalist/faq * http://www.ats.ucla.edu/stat/stata/

**Follow-Ups**:**Re: st: RE: -expand-, -expandcl-, and -set mem-; limit to the number of obs?***From:*"Eric A. Booth" <ebooth@ppri.tamu.edu>

**References**:**st: -expand-, -expandcl-, and -set mem-; limit to the number of obs?***From:*Misha Spisok <misha.spisok@gmail.com>

- Prev by Date:
**st: RE: RE: downloading data** - Next by Date:
**st: Tsgraph with multiple y axis** - Previous by thread:
**st: -expand-, -expandcl-, and -set mem-; limit to the number of obs?** - Next by thread:
**Re: st: RE: -expand-, -expandcl-, and -set mem-; limit to the number of obs?** - Index(es):

© Copyright 1996–2016 StataCorp LP | Terms of use | Privacy | Contact us | What's new | Site index |