Notice: On April 23, 2014, Statalist moved from an email list to a forum, based at statalist.org.

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

From |
Nick Cox <[email protected]> |

To |
[email protected] |

Subject |
Re: st: Alternative to coefficient of variation (CV)/relative standard error as a measure of estimate's reliability/stability |

Date |
Wed, 13 Jun 2012 01:57:44 +0100 |

A simple-minded but I think reasonable first stab at this issue is that the CV is a fair criterion if SD (specifically SE) is indeed proportional to mean (generally estimate), so that SD / mean is approximately constant in a given kind of situation. If that is not true as a kind of first approximation then information is needed on the relation between variability and estimate to make a better judgement. One example that I studied in excruciating detail several years ago was the variability of annual rainfall in which many people had been led from the observation that variability of rainfall as measured by SD tends to increase with the mean to conclude that the CV was in some sense a better summary. However, in many cases it is more nearly true that SD varies as a power around 0.7 of the mean, in which case CV over-compensates. CV is, as you imply, even less appropriate for proportions. I'm not sure this will help you at all. I became sensitive to inappropriate uses of the CV years ago when I encountered examples even worse than those with annual rainfall and my best summary is that when the CV is not appropriate there is not usually a simpler or even different alternative that works well at all; rather analysis has to look directly at the structure of variability. Nick On Wed, Jun 13, 2012 at 12:37 AM, David Radwin <[email protected]> wrote: > I hope you will indulge me this statistics question that is not strictly > Stata-specific. I am looking for a statistic measuring an estimate's > reliability or stability as an alternative to the coefficient of variation > (CV), also known as the relative standard error. The CV is the standard > error of an estimate (proportion, mean, regression coefficient, etc.) > divided by the estimate itself, usually expressed as a percentage. For > example, if a survey finds 15% unemployment with a 6% standard error, the > CV is .06/.15 = .4 = 40%. > > Some US government agencies flag or suppress as unreliable any estimate > with a CV over a certain threshold such as 30% or 50%. But this standard > can be arbitrary (for example, 85% employment would have a much lower CV > of .06/.85 = 7%) and has other limitations. > > Can anyone suggest an alternative measure of stability or reliability? * * For searches and help try: * http://www.stata.com/help.cgi?search * http://www.stata.com/support/statalist/faq * http://www.ats.ucla.edu/stat/stata/

**Follow-Ups**:

**References**:

- Prev by Date:
**Re: st: RE: Difficulties iterating over a do-file within a foreach loop** - Next by Date:
**RE: st: RE: RE: RE: RE: Combining multiple observations by an ID variable** - Previous by thread:
**st: Alternative to coefficient of variation (CV)/relative standard error as a measure of estimate's reliability/stability** - Next by thread:
**Re: st: Alternative to coefficient of variation (CV)/relative standard error as a measure of estimate's reliability/stability** - Index(es):