Statalist


[Date Prev][Date Next][Thread Prev][Thread Next][Date index][Thread index]

Re: st: Big Datasets


From   Orvalho Joaquim Augusto <[email protected]>
To   [email protected]
Subject   Re: st: Big Datasets
Date   Thu, 17 Jan 2008 17:52:15 +0200

Thank you for the reply.

When I import them via odbc the data types are so big. So I have recoded some char/varchar into numbers. There is a sql script for it while the database is being fed.

I tried again it worked.

Using the hint you gave me I would need something around 500Mb with some extra to stata breath.

Thank you again
Orvalho


Maarten buis wrote:

Using:
http://www.stata.com/support/faqs/data/howbig.html

You can see that if all your variables are stored as default numeric
variables your dataset would be about 211 mb, which is big but should
be managable in your system. Does your dataset contain long strings?

-- Maarten

--- Orvalho Joaquim Augusto <[email protected]> wrote:

I have a huge table under mysql.

I am trying to import it to mysql without success.

The has 150 columns and 366460 lines. The database is remote in a
server.

I am trying to import in a machine with 1 Gb RAM, Linux (Ubuntu 7.04)

and 1.7Ghz of CPU.

I have set memory to 700m and above that the process is killed.

Any clue?

Orvalho
--
OpenSource Software Consultant
CENFOSS (www.cenfoss.co.mz)
[email protected]
[email protected]

*
*   For searches and help try:
*   http://www.stata.com/support/faqs/res/findit.html
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/


-----------------------------------------
Maarten L. Buis
Department of Social Research Methodology
Vrije Universiteit Amsterdam
Boelelaan 1081
1081 HV Amsterdam
The Netherlands

visiting address:
Buitenveldertselaan 3 (Metropolitan), room Z434

+31 20 5986715

http://home.fsw.vu.nl/m.buis/
-----------------------------------------


      __________________________________________________________
Sent from Yahoo! Mail - a smarter inbox http://uk.mail.yahoo.com

*
*   For searches and help try:
*   http://www.stata.com/support/faqs/res/findit.html
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/

--
OpenSource Software Consultant
CENFOSS (www.cenfoss.co.mz)
[email protected]
[email protected]

*
*   For searches and help try:
*   http://www.stata.com/support/faqs/res/findit.html
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/



© Copyright 1996–2024 StataCorp LLC   |   Terms of use   |   Privacy   |   Contact us   |   What's new   |   Site index