Bookmark and Share

Notice: On March 31, it was announced that Statalist is moving from an email list to a forum. The old list will shut down on April 23, and its replacement, statalist.org is already up and running.


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

st: Missing (partial) records from ODBC load command


From   "Pi, Ron" <Ron.Pi@jud.ca.gov>
To   "statalist@hsphsun2.harvard.edu" <statalist@hsphsun2.harvard.edu>
Subject   st: Missing (partial) records from ODBC load command
Date   Thu, 23 Feb 2012 13:12:36 -0800

Dear all,

I've been using the -odbc load- command as a routine to extract data from a network database for many years, from Stata/SE 8 to my the Stata/MP 11 (running on Window 7, 64 bit). When it runs smoothly, as has been the case until recently, the process takes about 15 minutes to extract roughly 4 million records. Below is the command in a do-file that executes the extract. 

odbc load if stat_year==2011, exec("SELECT COURT_ID, SUMMARY_STATISTIC, STAT_MONTH, STAT_YEAR, ROW_ORDER") dsn("jbsis ") dialog(complete) user(ron) password(pi) lower

Recently the same command appears to extract the data with a big chunk of the records missing (about 10%), with no obvious pattern in the missing records. There were no warnings at the end of finishing the do-file. Memory does not appear to be the problem, as the extract file in Stata is less than 100 MB and the memory was set at 400 MB at the beginning of the process. 

I wonder if anyone has had similar experiences, has any suggestions as to the source of the problem, or how to diagnose the problem?

Thanks,
Ron

======================================
Ron Pi
Supervising Research Analyst
Office of Court Research 
Court Programs and Services Division
Judicial Council/Administrative Office of the Courts 
455 Golden Gate Avenue 
San Francisco, CA  94102-3688 
415-865-7652 Fax 415-865-4586, ron.pi@jud.ca.gov
www.courts.ca.gov
"Serving the courts for the benefit of all Californians." 


*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/


© Copyright 1996–2014 StataCorp LP   |   Terms of use   |   Privacy   |   Contact us   |   Site index