Notice: On April 23, 2014, Statalist moved from an email list to a forum, based at statalist.org.
From | Nick Cox <njcoxstata@gmail.com> |
To | statalist@hsphsun2.harvard.edu |
Subject | Re: st: Importing subset of a pipe delimited textfile |
Date | Wed, 17 Oct 2012 09:49:37 +0100 |
I'd use -filefilter- to change the pipes to something that -infile- can handle. (Strictly, -in- is a qualifier, not an option.) Nick On Wed, Oct 17, 2012 at 9:13 AM, Rob Shaw <rob.shaw.uk@gmail.com> wrote: > I have a very large (around 4Gb) text file that has been pipe > delimited. It won't all fit in memory so I want to process it in > parts. > > For fixed datasets I would use infile with the in 1/10000000 option > then 10000001/2000000 etc. However, this dataset has been pipe > delimited so I would need to use insheet, but insheet doesn't seem to > permit the "in" option. * * For searches and help try: * http://www.stata.com/help.cgi?search * http://www.stata.com/support/faqs/resources/statalist-faq/ * http://www.ats.ucla.edu/stat/stata/