Stata The Stata listserver
[Date Prev][Date Next][Thread Prev][Thread Next][Date index][Thread index]

Re: st: Stata corrupting data?


From   Alexandra Kalev <akalev@princeton.edu>
To   statalist@hsphsun2.harvard.edu
Subject   Re: st: Stata corrupting data?
Date   Thu, 12 Feb 2004 13:15:11 -0500 (EST)

It has happened to me as well, using the same version of Stata with a
large dataset (180M, memory allocated: 200M). Values of several variables
in several observations were corrupted and exiting Stata did not solve the
problem. I posted a query to the Stata list, but no one responded. Since
then I am just using smaller chunks of the data. Certainly a worrisome
experience.


On Thu, 12 Feb 2004, Deborah Garvey wrote:

> Hi, all.
>
> I use Intercooled Stata 7.0 Win 98/95/NT version (born 6/11/02) on a
> Dell OptiPlex GX110 with 512 MB RAM running Win 98.  My computer has
> about 7 GB disk space available for virtual memory.  (Obviously not the
> fastest machine on earth.)
>
> A worrisome event occurred yesterday while reading in a 1990 Census 5%
> PUMS CA sample abstracted from the IPUMS web site.  The data set is 312m
> in size with N = 1.46 m and 84 vars.
>
> I set memory at 375 m. After I read in the data to STATA, ran
> descriptive stats, and saved the data, I then did a quick cross-tab of 2
> variables that should've yielded a 2x2 matrix.  Instead, values were
> changed for a couple of observations, and I ended up with a 3x3 table.
> I not so calmly exited STATA, restarted my computer and checked the
> data.  They seem to be fine.
>
> The data were seriously corrupted when I initially attempted to read in
> 1990 and 2000 5% PUMS abstracts for CA simultaneously.  I verified with
> IPUMS that the problem was on my end, and not with their source data.
>
> Has this happened to anyone else before?   Is it just a matter of being
> more generous in allocating virtual memory?
>
> Deb Garvey
>
> ******************************
> Deborah Garvey, Ph.D.
> Department of Economics
> Kenna Hall
> Santa Clara University
> Santa Clara, CA  95053
> 408/554-5580
> 408/554-2331 (FAX)
> dgarvey@scu.edu
> http://lsb.scu.edu/~dgarvey
> **********************************
> *
> *   For searches and help try:
> *   http://www.stata.com/support/faqs/res/findit.html
> *   http://www.stata.com/support/statalist/faq
> *   http://www.ats.ucla.edu/stat/stata/
>
*
*   For searches and help try:
*   http://www.stata.com/support/faqs/res/findit.html
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/



© Copyright 1996–2014 StataCorp LP   |   Terms of use   |   Privacy   |   Contact us   |   What's new   |   Site index