Bookmark and Share

Notice: On March 31, it was announced that Statalist is moving from an email list to a forum. The old list will shut down on April 23, and its replacement, statalist.org is already up and running.


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: st: Split a huge dataset


From   Daniel Feenberg <feenberg@nber.org>
To   "statalist@hsphsun2.harvard.edu" <statalist@hsphsun2.harvard.edu>
Subject   Re: st: Split a huge dataset
Date   Fri, 23 Dec 2011 21:18:42 -0500 (EST)


On Fri, 23 Dec 2011, Debs Majumdar wrote:

Hi,

I am using Stata 12 SE which can read in a maximum of 32767 variables.

I am trying to read in some text files which contain around 45,000 to 50,000 variables. Is there anyway I can split the dataset into half, so that I can read in and perform some analysis on these dataset?

I expect you will run into other limits before you get to 45,000 variables, but if you keep reusing the same name in the infile statement or dictionary, I expect that will avoid the limit on the number of variables itself:

  infile dummy dummy dummy var1 var2 dummy dummy

may only be 3 variables from Stata's point of view, but I haven't actually tried to read more than 32767, of course.

Daniel Feenberg


Thanks,

Debs

*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/

*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/


© Copyright 1996–2014 StataCorp LP   |   Terms of use   |   Privacy   |   Contact us   |   Site index