Bookmark and Share

Notice: On April 23, 2014, Statalist moved from an email list to a forum, based at statalist.org.


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: st: RE: Large data set that won't open


From   John Antonakis <[email protected]>
To   [email protected]
Subject   Re: st: RE: Large data set that won't open
Date   Mon, 28 Jun 2010 23:03:57 +0200

Hi:

So, I am now running Stata with 6GB RAM and I don't have problems opening very large data sets. The problem was that I mistakenly was running Stata 32 bit, instead of 64 bit. The latter can better handle "giving" RAM to Stata. With Stata 32 bit, I was unable to give more than 1GB RAM to Stata; now, I am able to give it lots more.

Best,
J.

____________________________________________________

Prof. John Antonakis, Associate Dean Faculty of Business and Economics
Department of Organizational Behavior
University of Lausanne
Internef #618
CH-1015 Lausanne-Dorigny
Switzerland

Tel ++41 (0)21 692-3438
Fax ++41 (0)21 692-3305

Faculty page:
http://www.hec.unil.ch/people/jantonakis

Personal page:
http://www.hec.unil.ch/jantonakis
____________________________________________________



On 24.06.2010 10:56, John Antonakis wrote:
I have 4gb; just ordered 2 more gb. Maybe this will do the trick!

Best regards,
John Antonakis


On 24 juin 2010, at 10:05, "Martin Weiss" <[email protected]> wrote:

<>

The size of your RAM is hard to tell from your current memory allocation -
the latter is just a lower bound for the former. But I guess you do not have
6G of RAM, do you? You would still need additional RAM for computations,
then.
Note you can -use- a dataset with -if- and -in- qualifiers, so it is still
possible to get a subset into mem...


HTH
Martin

-----Original Message-----
From: [email protected]
[mailto:[email protected]] On Behalf Of John Antonakis
Sent: Donnerstag, 24. Juni 2010 09:37
To: [email protected]
Subject: st: Large data set that won't open

Hi:

I have a rather large data set that I cannot open in Stata; here are the particulars:

ls "D:\My Documents\STATA\upstata.dta",
5375.8M 6/23/10 10:44 upstata.dta
When I try to open the data set I get:

. use "D:\My Documents\STATA\upstata.dta", clear
no room to add more observations
An attempt was made to increase the number of observations beyond what is currently
   possible.  You have the following alternatives:

1. Store your variables more efficiently; see help compress. (Think of Stata's data area as the area of a rectangle; Stata can trade off width and length.)

    2.  Drop some variables or observations; see help drop.

3. Increase the amount of memory allocated to the data area using the set memory
        command; see help memory.
r(901);

Here is my current memory allocation:

. q memory

Current memory allocation

                   current                                 memory usage
   settable          value     description                 (1M = 1024k)
   --------------------------------------------------------------------
   set maxvar         5000     max. variables allowed           1.909M
   set memory         1024M    max. data space              1,024.000M
   set matsize        1000     max. RHS vars in models          7.713M
                                                           -----------
                                                            1,033.622M


It seems that I just don't have enough RAM to open this file. Is that correct?

Best,
J.

--
____________________________________________________

Prof. John Antonakis, Associate Dean Faculty of Business and Economics
Department of Organizational Behavior
University of Lausanne
Internef #618
CH-1015 Lausanne-Dorigny
Switzerland

Tel ++41 (0)21 692-3438
Fax ++41 (0)21 692-3305

Faculty page:
http://www.hec.unil.ch/people/jantonakis

Personal page:
http://www.hec.unil.ch/jantonakis
____________________________________________________

*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/

*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/

*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/
*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/


© Copyright 1996–2018 StataCorp LLC   |   Terms of use   |   Privacy   |   Contact us   |   Site index