Statalist


[Date Prev][Date Next][Thread Prev][Thread Next][Date index][Thread index]

st: RE: reading in huge dataset using "odbc"


From   "Rajesh Tharyan" <R.Tharyan@exeter.ac.uk>
To   <statalist@hsphsun2.harvard.edu>
Subject   st: RE: reading in huge dataset using "odbc"
Date   Mon, 14 Jul 2008 13:55:33 +0100

Hi,

1. Am I missing something here??? 200 variables and 1.2 million observations
means 6000 rows is it not? So if you want to read in the first 62000
observations You need to read in 62000/200 rows is it not?

2. Did you try other ways? Like saving the .mdb as a csv file or a tab
limited file etc?( which you can do by exporting from access)

Thanks
rajesh

-----Original Message-----
From: owner-statalist@hsphsun2.harvard.edu
[mailto:owner-statalist@hsphsun2.harvard.edu] On Behalf Of natalie chan
Sent: 13 July 2008 00:16
To: statalist@hsphsun2.harvard.edu
Subject: st: reading in huge dataset using "odbc"

Hi,

I am trying to read in a dataset with more than 200 variables and 1.2
million observations. The stata produced the message "obs must be
between 62593 and 62593. As a possible solution, try increasing memory
using -set memory-". I increased the memory but still it did not work.

I then decided to read in the dataset separately and then append the
sub-datasets. I read in the first 62000 observations, it was
successful. When I try to read in the observations 62001-124000, there
was no error message, but when I checked the data, there was no
observation read in and there was only the row of observation names
read in.

The commands I used are:

 odbc load in 1/62000, table ("firms")

 odbc load in 62001/124000, table ("firms")

Could anyone here give some advice? Thanks a lot.

*
*   For searches and help try:
*   http://www.stata.com/support/faqs/res/findit.html
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/

*
*   For searches and help try:
*   http://www.stata.com/support/faqs/res/findit.html
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/



© Copyright 1996–2014 StataCorp LP   |   Terms of use   |   Privacy   |   Contact us   |   What's new   |   Site index