Statalist The Stata Listserver


[Date Prev][Date Next][Thread Prev][Thread Next][Date index][Thread index]

Re: st: Large dataset . Slow Stata


From   "Ben Jann" <ben.jann@gmail.com>
To   statalist@hsphsun2.harvard.edu
Subject   Re: st: Large dataset . Slow Stata
Date   Thu, 10 May 2007 10:48:36 +0200

I think the reason for the slow speed is that you are going into
virtual memory (How much memory did you allocate to Stata?). Get rid
of some variables or buy more RAM.
ben

On 5/10/07, Tobias Pfaff <tobiaspfaff@gmx.net> wrote:
Hello,

I am using Intercooled Stata 9.2 on a laptop with an AMD 1.79 GHz processor
and 512 MB ram. So far, Stata worked well with all datasets.

Now, we are analyzing a larger dataset with 70 variables and 180,000
observations. The dta-file has 224 MB. It takes alone two minutes to open
the file, not to mention the processing time of simple operations like
-drop- or -replace-. Is that normal? I have tried -compress-, which does not
have any major impact on the file size.

What is a PROFESSIONAL WAY to handle such a dataset?

1.) Upgrade my computer equipment?
2.) Split up my dataset (which would be a big nuisance for the analysis, I
think)?
3.) ANY OTHER STATA COMMAND OR TRICK?

Any help would be greatly appreciated.

Thanks,
Tobias Pfaff

University of Muenster
Germany

*
*   For searches and help try:
*   http://www.stata.com/support/faqs/res/findit.html
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/

*
*   For searches and help try:
*   http://www.stata.com/support/faqs/res/findit.html
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/



© Copyright 1996–2014 StataCorp LP   |   Terms of use   |   Privacy   |   Contact us   |   What's new   |   Site index