Bookmark and Share

Notice: On March 31, it was announced that Statalist is moving from an email list to a forum. The old list will shut down on April 23, and its replacement, statalist.org is already up and running.


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: st: how to set the memory size


From   Lars Folkestad <lfolkestad@health.sdu.dk>
To   "statalist@hsphsun2.harvard.edu" <statalist@hsphsun2.harvard.edu>
Subject   Re: st: how to set the memory size
Date   Tue, 25 Oct 2011 14:15:30 +0200

There was a thead about this a few days ago. 

See also: 

http://m.nber.org//sys-admin/large-stata-datasets.htm

Mvh
Lars Folkestad


Den 25/10/2011 kl. 14.12 skrev "Daniel Feenberg" <feenberg@nber.org>:

> 
> 
> On Tue, 25 Oct 2011, Tuki wrote:
> 
>> Dear all,
>> 
>> I encountered a problem in processing a huge number of data in stata.  I try
>> to use the command “set memory”, unfortunately, my system only allow me to
>> set maximum memory to 900m. But I need to process more than 10 million
>> observation, which requires much more than 900m in stata.  How to increase
>> the memory of stata to meet my requirement of the space for the data?
> 
> I would guess that your system has 1.5 or 2GB of physical memory, and 
> since Stata requires all data reside in memory, that limits the size of 
> the dataset you can work with. You can probably upgrade to 4GB with some 
> new memory sticks (but only 3.5 GB will be usable with a 32 bit Stata 
> and OS). Look at -query memory- after loading a portion of the data, and 
> use that to predict how much you will need in total.
> 
> If you can partition your problem such that only some of the data needs to 
> be in memory, the -infile- and -using- statements will allow you to select 
> on row and column so that only the data you are actually using will be 
> taking up memory.
> 
> Dan Feenberg
> 
>> 
>> Many thanks in advance!
>> 
>> --
>> View this message in context: http://statalist.1588530.n2.nabble.com/how-to-set-the-memory-size-tp6928523p6928523.html
>> Sent from the Statalist mailing list archive at Nabble.com.
>> 
>> *
>> *   For searches and help try:
>> *   http://www.stata.com/help.cgi?search
>> *   http://www.stata.com/support/statalist/faq
>> *   http://www.ats.ucla.edu/stat/stata/

*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/


© Copyright 1996–2014 StataCorp LP   |   Terms of use   |   Privacy   |   Contact us   |   Site index