Bookmark and Share

Notice: On March 31, it was announced that Statalist is moving from an email list to a forum. The old list will shut down at the end of May, and its replacement, statalist.org is already up and running.


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: st: diagnose stata memory usage


From   Nick Sanders <sandersn@stanford.edu>
To   statalist@hsphsun2.harvard.edu
Subject   Re: st: diagnose stata memory usage
Date   Tue, 28 Dec 2010 10:14:51 -0800

Hi Andrea,

> I am using Stata/SE 11.0 on Windows XP SP3 32 bit and sometimes my
> do-files end with "op sys refuses to give memory" even on very small
> dataset.

I've had this problem in the past when working on a shared server. Despite the fact that there was well over several gigs of memory available, Stata would crash out with the "op sys refuses to give memory" or "op sys refuses to start new process" error. Are you trying to execute any shell processes within Stata? That is to say, are you doing things like "shell gunzip foo.dta.gz"? It was always shell commands that gave me issues.

Another possibility is that the command you are running requires a lot more space than the data itself. For example, "xtivreg2"  takes up a good chunk of memory beyond that of the data set itself. 

A more nitty-gritty step is to use "set trace on". That makes Stata display the "background" commands it's running to do each task. You then can use "set tracedepth" to see how in depth you would like to see (try "help trace" for more info). Be warned, you'll get a LOT of output in your log files, but at least you'll be able to see exactly where the memory constraint hits.  

What command is finally sending your do file over the edge?

-Nick

--
Nicholas J. Sanders, Ph.D.
Postdoctoral Fellow
Stanford Institute for Economic Policy Research
366 Galvez St, Room 228
Stanford, CA 94305



*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/


© Copyright 1996–2014 StataCorp LP   |   Terms of use   |   Privacy   |   Contact us   |   Site index