[Date Prev][Date Next][Thread Prev][Thread Next][Date index][Thread index]

From |
"Lachenbruch, Peter" <Peter.Lachenbruch@oregonstate.edu> |

To |
<statalist@hsphsun2.harvard.edu> |

Subject |
RE: st: Verify randomization in a large sample |

Date |
Wed, 1 Oct 2008 08:38:05 -0700 |

I'm not clear on the question. Are you looking at the balance in each of three samples? Are you trying to find if the balance is the same from sample to sample? You didn't mention if the randomization is stratified/blocked - that could make a difference. Tony Peter A. Lachenbruch Department of Public Health Oregon State University Corvallis, OR 97330 Phone: 541-737-3832 FAX: 541-737-4001 -----Original Message----- From: owner-statalist@hsphsun2.harvard.edu [mailto:owner-statalist@hsphsun2.harvard.edu] On Behalf Of paul o'brien Sent: Wednesday, October 01, 2008 8:35 AM To: statalist@hsphsun2.harvard.edu Subject: Re: st: Verify randomization in a large sample can i come in here and ask if it is possible to estimate the probability that three samples are not truly random. i am reviewing a large RCT in which there appears to be a large imbalance in numbers in the three arms. i suspect that patients/doctors influenced the allocation. what i would like to know is the liklihood of this happening by chance. how do i do it? paul On 01/10/2008, Austin Nichols <austinnichols@gmail.com> wrote: > Kieran McCaul <kamccaul@meddent.uwa.edu.au>: > I'm not sure to whom this email is addressed, but let me suggest that > these points were implicit in the first sentence of my post: "The only > way to verify randomization is to observe the randomization > mechanism." I.e. while it is true that "If the study has demonstrably > been randomized, then all differences, no matter how extreme, are due > to chance," the only way for a study to have been `demonstrably > randomized' is for the details of random assignment to be made public. > If they are not, or there is no claim of randomization (but the > analyst want to treat categories of treatment as having been randomly > assigned), a test of balance is the usual crutch to fall back on. It > is also the standard test of any matching model. So yes, "Statistical > tests test a null hypothesis against an alternative" and the null in a > test of balance is that some treatment is randomly assigned. Whether > that is or is not what the original poster was looking for, I do not > know. > > On Tue, Sep 30, 2008 at 10:36 PM, Kieran McCaul > <kamccaul@meddent.uwa.edu.au> wrote: > > If the purpose is to check "balance" after randomization, I can't see how any statistical testing will help. > > > > Statistical tests test a null hypothesis against an alternative. > > > > The null is essentially "any differences are no greater than would be expected by chance alone'. The alternative is "differences are so large that they are unlikely to be due to chance". > > > > If the study has demonstrably been randomized, then all differences, no matter how extreme, are due to chance. > > > > Lack of balance, which some people seem to obsess about, is not an indication of failure of the randomization process. Lack of balance will occur. It will occur. Always. > > > > The purpose of randomisation is to remove bias, not achieve balance. > > > > Lack of balance will be a problem if it biases comparison between arms of the study. So adjust for the lack of balance in the analysis. > > > > > > > > -----Original Message----- > > From: owner-statalist@hsphsun2.harvard.edu [mailto:owner-statalist@hsphsun2.harvard.edu] On Behalf Of Austin Nichols > > Sent: Wednesday, 1 October 2008 10:05 AM > > To: statalist@hsphsun2.harvard.edu > > Subject: Re: st: Verify randomization in a large sample > > > > José Luis Chávez Calva <josechc@gmail.com>: > > The only way to verify randomization is to observe the randomization > > mechanism. But you can check the balance by comparing means of > > several variables in the dataset like age, gender, language, etc. > > across categories. For example, if you have treatment and control > > groups defined by a variable t (=0 for control and =1 for treatment), > > you can do > > hotelling age gender language etc, by(t) > > or > > reg t age gender language etc > > to get an F test of the null that all means are the same. Assuming > > variances may differ, you can > > reg t age gender language etc, r > > and for alternative models you can run logit or probit instead (to get > > a chi2 test). Presumably, for a categorical t you could run > > mlogit t age gender language etc > > or -mprobit- assuming a specific error distribution under the null of > > randomization (in which case the X vars should not help you predict > > t). All of that is just for comparisons of means; for higher moments > > you will need tests of equality of distributions (e.g. -ksmirnov-) or > > graphical methods (e.g. -qqplot-). > > > > On Tue, Sep 30, 2008 at 8:18 PM, José Luis Chávez Calva > > <josechc@gmail.com> wrote: > >> Dear Stata users: > >> > >> I have a dataset on household income with a large number of > >> individuals. The set contains one variable indicating the locality > >> where each individual lives and another one indicating the household > >> to which this individual belongs to. I would like to know how to > >> verify randomization both at locality and household level using > >> several variables in the dataset like age, gender, language, etc. > > * > * For searches and help try: > * http://www.stata.com/help.cgi?search > * http://www.stata.com/support/statalist/faq > * http://www.ats.ucla.edu/stat/stata/ > * * For searches and help try: * http://www.stata.com/help.cgi?search * http://www.stata.com/support/statalist/faq * http://www.ats.ucla.edu/stat/stata/ * * For searches and help try: * http://www.stata.com/help.cgi?search * http://www.stata.com/support/statalist/faq * http://www.ats.ucla.edu/stat/stata/

**Follow-Ups**:**Re: st: Verify randomization in a large sample***From:*"paul o'brien" <paul.obrien@afe2.org.uk>

**Re: st: Verify randomization in a large sample***From:*"José Luis Chávez Calva" <josechc@gmail.com>

**References**:**Re: st: Verify randomization in a large sample***From:*"Austin Nichols" <austinnichols@gmail.com>

**Re: st: Verify randomization in a large sample***From:*"paul o'brien" <paul.obrien@afe2.org.uk>

- Prev by Date:
**Re: st: Random seed revisited - how to get random seeds more efficiently?** - Next by Date:
**Re: st: Verify randomization in a large sample** - Previous by thread:
**Re: st: Verify randomization in a large sample** - Next by thread:
**Re: st: Verify randomization in a large sample** - Index(es):

© Copyright 1996–2014 StataCorp LP | Terms of use | Privacy | Contact us | What's new | Site index |