[Date Prev][Date Next][Thread Prev][Thread Next][Date index][Thread index]

st: Speed of RESHAPE and program speed optimization

From   Roy Wada <[email protected]>
To   <[email protected]>
Subject   st: Speed of RESHAPE and program speed optimization
Date   Mon, 8 Sep 2008 16:50:21 -0700

>Does anyone have any experience with this? Looking in the archive I
>saw that this problem has been around since 2004 at least... I found
>the suggestion of splitting the dataset into chunks but I doubt it
>could be significantly faster than my naive code above;

Have you tried it?

The last time I did something like this, cutting a large -reshape- 
into smaller chunks saved the operating time by more than half. 
The time savings will depend on your machine; mine was pushing 
the memory limit, hence the work-around.

The obvious tradeoff is the programming you would have to do. But 
it's much easier than going through -file-. Safer, too, I would imagine.

Cut them up into a group of 30 varialbes, slap unique identifiers, 
-reshape- smaller chucks together, and then -merge- the outputs 
from each -reshape- on the identifiers.


See how Windows connects the people, information, and fun that are part of your life.
*   For searches and help try:

© Copyright 1996–2024 StataCorp LLC   |   Terms of use   |   Privacy   |   Contact us   |   What's new   |   Site index