| |
[Date Prev][Date Next][Thread Prev][Thread Next][Date index][Thread index]
Re: st: Trimming data and statistics
Dear Maarten,
By the way, I notice that once in a while a subset of data has only one
observation, and yet
Stata also calculates the median. Just being curious, but how does Stata
calculate this ?
Akihito
-----------------------
From: Maarten buis <[email protected]>
Reply-To: [email protected]
To: [email protected]
Subject: Re: st: Trimming data and statistics
Date: Fri, 14 Apr 2006 10:27:17 +0100 (BST)
Akihito:
Trimming can be useful when dealing with a statistic that is sensitive to
outliers, e.g. the mean.
However, the median is already pretty robust against outliers. In your case
zero is really the
50th percentile or middle observation. It doesn't matter whether the most
negative value is
-.000001 or -10000000000000, the middle observation remains zero. This is
however not true for the
mean. This is what we mean when we say that median is robust against
outliers and the mean isn't.
Cutting of extreme values can thus be useful for the mean but is useless
for the median. This is
especially true if you cut of equal numbers of cases of the top and the
bottom end of the
distribution, in which case the middle observation remains unchanged, and I
cannot think of a
justification for cutting off more or less cases of the bottom end of the
distribution than the
top end.
HTH,
Maarten
--- Akihito Tokuhara <[email protected]> wrote:
> I have a dataset of more than 100,000 obs, of which about 75,000 obs are
> zero, another 16,000 are missing, 1,500 are negative (which is not
expected), the
> remained are positive.
>
> Because more than half of the sample is zero, the median is zero. I
don't know
> if trimming the data would make sense to get the median different from
zero.
> What I mean is whether or not that is not "torturing" data, or
distorting it?
-----------------------------------------
Maarten L. Buis
Department of Social Research Methodology
Vrije Universiteit Amsterdam
Boelelaan 1081
1081 HV Amsterdam
The Netherlands
visiting adress:
Buitenveldertselaan 3 (Metropolitan), room Z214
+31 20 5986715
http://home.fsw.vu.nl/m.buis/
-----------------------------------------
Send instant messages to your online friends http://uk.messenger.yahoo.com
*
* For searches and help try:
* http://www.stata.com/support/faqs/res/findit.html
* http://www.stata.com/support/statalist/faq
* http://www.ats.ucla.edu/stat/stata/
_________________________________________________________________
Express yourself instantly with MSN Messenger! Download today - it's FREE!
http://messenger.msn.click-url.com/go/onm00200471ave/direct/01/
*
* For searches and help try:
* http://www.stata.com/support/faqs/res/findit.html
* http://www.stata.com/support/statalist/faq
* http://www.ats.ucla.edu/stat/stata/