Statalist


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

st: Problems in load large data or read several fields from CSV data


From   <[email protected]>
To   <[email protected]>
Subject   st: Problems in load large data or read several fields from CSV data
Date   Tue, 20 Jan 2009 11:54:56 -0000

Dear all,

I have a very large dataset in CSV format with 486,000 KB. The data
contains more than 100 fields and more than 300,000 recodes. I have
tried to open this file by set mem 500M (or 1000M) and used

insheet using filename.csv, clear

The error message shows that there is no enough memory to load the data.
Could anyone suggest me on the followings?

1) How to read only several fields from this CSV data file, say the
first, thirteenth and thirtieth?
2) What command should I try to load the whole data?

Many thanks,
Haiyan


-----Original Message-----
From: [email protected]
[mailto:[email protected]] On Behalf Of Nick Cox
Sent: 19 January 2009 21:47
To: [email protected]
Subject: st: -iquantile- available on SSC


Thanks to Kit Baum, a new package -iquantile- is now available from SSC.

This was discussed yesterday in my post 

<http://www.hsph.harvard.edu/cgi-bin/lwgate/STATALIST/archives/statalist
.0901/date/article-689.html> 

in a thread on fractional medians. I changed the problem, and the name,
but had fun. A capsule description follows my signature. The help file
is quite detailed with much commentary. Use -ssc inst iquantile- to
install if interested. 

Nick 
[email protected] 

iquantile Stata module to calculate interpolated quantiles

iquantile calculates and displays quantiles estimated by linear
interpolation in the mid-distribution function. The user may specify one
or more numeric variables, one or more grouping variables and one or
more quantiles.

Author 

Nicholas J. Cox, Durham University, UK
[email protected]

Stata 9 required 

Keywords: quantiles, order statistics, median, quartiles 


*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/

------------------------------------------------------------------------
This email is confidential and is intended solely for the person or
Entity to whom it is addressed.  If this is not you, please forward the
Message to [email protected].  We have scanned this email
before sending it, but cannot guarantee that malicious software is
absent and we shall carry no liability in this regard.

We advise that information intended to be kept confidential should not
Be sent by email.  We also advise that health concerns should be
Discussed with a medical professional in person or by telephone.
NHS Direct can also provide advice.  We shall not be liable for any
failure to follow this advice. University College London Hospitals NHS
Foundation Trust (UCLH).


*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/



© Copyright 1996–2024 StataCorp LLC   |   Terms of use   |   Privacy   |   Contact us   |   What's new   |   Site index