Re: st: RE: Insheet Command Problem

[Davia Downey <downeyd@gvsu.edu>]

Sarah and Kieran,

I use Stata IC 10.1 and I've downloaded large files into the program
before. The file is from the VRDC at Cornell which warehouses Census
economic and job data for each state. The file is about 1.2 GB,. There's
another file I was trying to use which was smaller but it turned out that
it didn't have all the years I needed.

Here are my steps that I've been using to read the file in:

cd "Users/daviadowney/Downloads/

. set memory 2g
(2097152k)

. insheet using 
"/Users/daviadowney/Downloads/qwi_la_se_county_naics3_all.csv", comma


This time everything worked ok and it was read in without any problems. I
think I must have not had enough assigned to memory, or my re-download and
unzip of the original file fixed the problem.


I am a little STATA challenged if you couldn't tell I was taught on SPSS
and know a little R, but I need to use STATA for a Fixed Effect regression
which SPSS doesn't have.

Thanks again for you patience and suggestions!


Davia Cox Downey
Assistant Professor of Public Administration
School of Public, Nonprofit &
Health Administration
Grand Valley State University



242C DeVos Center
401 West Fulton Street
Grand Rapids, MI  49504Email: downeyd@gvsu.edu









On 6/14/12 7:45 PM, "Kieran McCaul" <kieran.mccaul@uwa.edu.au> wrote:

>....
>
>I'd like to repeat Sarah's question:
>what do you get when you run -insheet- without the variable list?
>
>
>
>-----Original Message-----
>From: owner-statalist@hsphsun2.harvard.edu
>[mailto:owner-statalist@hsphsun2.harvard.edu] On Behalf Of Davia Downey
>Sent: Friday, 15 June 2012 7:01 AM
>To: statalist@hsphsun2.harvard.edu
>Subject: Re: st: RE: Insheet Command Problem
>
>Sarah,
>
>Do you know if I can use the drop command with insheet? It seems there's a
>problem with the size of the memory I'm setting. Even when I go up to 2g
>(it's only a 1.2 MB size file), it still won't read the entire file.
>
>Davia
>
>Davia Cox Downey
>Assistant Professor of Public Administration
>School of Public, Nonprofit &
>Health Administration
>Grand Valley State University
>
>
>
>242C DeVos Center
>401 West Fulton Street
>Grand Rapids, MI  49504Email: downeyd@gvsu.edu
>
>
>
>
>
>
>
>
>
>On 6/14/12 6:08 PM, "Sarah Edgington" <sedging@ucla.edu> wrote:
>
>>Davia,
>>I'm pretty sure the "error in line 4508597 of file" is a red herring. The
>>entire error you're seeing is because specifying fewer variable names
>>than
>>there are variables in varlist is invalid syntax.  As an experiment I
>>tried
>>doing the same thing with a csv file that I know works fine with
>>-insheet-
>>if I don't give a variable list.  When I specified a subset of the
>>variables
>>in the varlist (that is, when I used the invalid syntax) I got the error
>>message:
>>too few variables specified
>>error in line 2534 of file
>>
>>Since there are 2,534 lines in the file I was trying to -insheet- my
>>suspicion is that what Stata is really saying is "I got to the very end
>>of
>>the file and I still couldn't figure out how you wanted me to fit all
>>these
>>variables into seven variable names, sorry."
>>
>>You say that using -insheet- for the whole file "still doesn't seem to
>>work." What is the actual error message you get?  It sounds like the file
>>is
>>large enough that maybe it could be a memory issue but it's worth
>>figuring
>>out if there is some other problem with the file before trying to deal
>>with
>>that.
>>
>>-Sarah
>>
>>
>>-----Original Message-----
>>From: owner-statalist@hsphsun2.harvard.edu
>>[mailto:owner-statalist@hsphsun2.harvard.edu] On Behalf Of Davia Downey
>>Sent: Thursday, June 14, 2012 2:21 PM
>>To: statalist@hsphsun2.harvard.edu
>>Subject: Re: st: RE: Insheet Command Problem
>>
>>When I have TextEdit look for the line 4508597 it says it's an invalid
>>line
>>number. Is there a way I can rearrange the file in text edit in order to
>>read each line separately?
>>
>>Davia Cox Downey
>>Assistant Professor of Public Administration School of Public, Nonprofit
>>&
>>Health Administration Grand Valley State University
>>
>>
>>
>>242C DeVos Center
>>401 West Fulton Street
>>Grand Rapids, MI  49504Email: downeyd@gvsu.edu
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>On 6/14/12 5:01 PM, "Richard Herron" <richard.c.herron@gmail.com> wrote:
>>
>>>4508597
>>
>>
>>*
>>*   For searches and help try:
>>*   http://www.stata.com/help.cgi?search
>>*   http://www.stata.com/support/statalist/faq
>>*   http://www.ats.ucla.edu/stat/stata/
>>
>>*
>>*   For searches and help try:
>>*   http://www.stata.com/help.cgi?search
>>*   http://www.stata.com/support/statalist/faq
>>*   http://www.ats.ucla.edu/stat/stata/
>
>
>*
>*   For searches and help try:
>*   http://www.stata.com/help.cgi?search
>*   http://www.stata.com/support/statalist/faq
>*   http://www.ats.ucla.edu/stat/stata/
>
>*
>*   For searches and help try:
>*   http://www.stata.com/help.cgi?search
>*   http://www.stata.com/support/statalist/faq
>*   http://www.ats.ucla.edu/stat/stata/


*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/