Bookmark and Share

Notice: On March 31, it was announced that Statalist is moving from an email list to a forum. The old list will shut down at the end of May, and its replacement, statalist.org is already up and running.


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: st: How many observations can Stata 11 handle?


From   Maarten Buis <maartenlbuis@gmail.com>
To   statalist@hsphsun2.harvard.edu
Subject   Re: st: How many observations can Stata 11 handle?
Date   Wed, 15 Feb 2012 15:02:27 +0100

On Wed, Feb 15, 2012 at 2:42 PM, Tunga Kantarcı wrote:
> Here is a short question. What is the maximum number of observations
> that Stata 11 can handle?

-help limits-

> I have an administrative data set which
> includes observations for about 3 million unique individuals, for 20
> variables.

I very much doubt that the maximum number of observations is the
problem here (unless you are using Small Stata, in which case you get
what you pay for). Instead I suspect a problem with memory,
specifically I suspect that one or more variables are stored as very
long strings. The solution to that is to either not load that/those
variable(s) by using -use varlist using filename- instead of -use
filename-. You can spot the offending variables using -desc using
filename-. Alternatively you can load only the offending variables,
fix them and merge them with the rest of the variables.

> I plan to draw a sample from the data set using SPSS and transfer the
> data to Stata 11 with the Stat-transfer data conversion program.

no need to use SPSS: to draw a 70% sample before opening the data you
can type -use <filename> if runiform() < .7-

Hope this helps,
Maarten

--------------------------
Maarten L. Buis
Institut fuer Soziologie
Universitaet Tuebingen
Wilhelmstrasse 36
72074 Tuebingen
Germany


http://www.maartenbuis.nl
--------------------------

*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/


© Copyright 1996–2014 StataCorp LP   |   Terms of use   |   Privacy   |   Contact us   |   Site index