Re: st: Big Datasets

[Orvalho Joaquim Augusto <orvaquim@cenfoss.co.mz>]

Thank you for the reply.

When I import them via odbc the data types are so big. So I have recoded 
some char/varchar into numbers. There is a sql script for it while the 
database is being fed.

I tried again it worked.

Using the hint you gave me I would need something around 500Mb with some 
 extra to stata breath.

Thank you again
Orvalho


Maarten buis wrote:

> Using:
> http://www.stata.com/support/faqs/data/howbig.html
>
> You can see that if all your variables are stored as default numeric
> variables your dataset would be about 211 mb, which is big but should
> be managable in your system. Does your dataset contain long strings?
>
> -- Maarten
>
> --- Orvalho Joaquim Augusto <orvaquim@cenfoss.co.mz> wrote:
>
> > I have a huge table under mysql.
> >
> > I am trying to import it to mysql without success.
> >
> > The has 150 columns and 366460 lines. The database is remote in a
> > server.
> >
> > I am trying to import in a machine with 1 Gb RAM, Linux (Ubuntu 7.04)
> >
> > and 1.7Ghz of CPU.
> >
> > I have set memory to 700m and above that the process is killed.
> >
> > Any clue?
> >
> > Orvalho
> > --
> > OpenSource Software Consultant
> > CENFOSS (www.cenfoss.co.mz)
> > orvaquim@cenfoss.co.mz
> > orvaquim@gmail.com
> >
> > *
> > *   For searches and help try:
> > *   http://www.stata.com/support/faqs/res/findit.html
> > *   http://www.stata.com/support/statalist/faq
> > *   http://www.ats.ucla.edu/stat/stata/
>
> -----------------------------------------
> Maarten L. Buis
> Department of Social Research Methodology
> Vrije Universiteit Amsterdam
> Boelelaan 1081
> 1081 HV Amsterdam
> The Netherlands
>
> visiting address:
> Buitenveldertselaan 3 (Metropolitan), room Z434
>
> +31 20 5986715
>
> http://home.fsw.vu.nl/m.buis/
> -----------------------------------------
>
>
>       __________________________________________________________
> Sent from Yahoo! Mail - a smarter inbox http://uk.mail.yahoo.com
>
> *
> *   For searches and help try:
> *   http://www.stata.com/support/faqs/res/findit.html
> *   http://www.stata.com/support/statalist/faq
> *   http://www.ats.ucla.edu/stat/stata/
--
OpenSource Software Consultant
CENFOSS (www.cenfoss.co.mz)
orvaquim@cenfoss.co.mz
orvaquim@gmail.com

*
*   For searches and help try:
*   http://www.stata.com/support/faqs/res/findit.html
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/