How can I use a dataset that is larger than the available RAM?
|
Title
|
|
Using a dataset that won't fit into RAM
|
|
Author
|
Alan Riley, StataCorp
|
|
Date
|
January 1996
|
Load the dataset using the virtual memory system. This step will require
that you start Stata with the /k option set large enough to hold the
dataset. Once the dataset is loaded into memory, use the
compress command
to see if the variables can be stored using less memory. If so, save this
dataset and exit from Stata. If you can now load the dataset into memory
using only the available memory on the computer, then the problem is solved.
If your dataset is compressed and still will not fit into the available RAM
of your computer, then use only those variables from the dataset that are
necessary to run the commands in your analysis. If this allows you to load
in the dataset using only the available memory on the computer, then the
problem is solved.
|
Warning:
If your analysis requires that you use the virtual
memory system, then your analysis will take an exceedingly long
time and will probably not finish before your patience runs out.
|
|
