[Date Prev][Date Next][Thread Prev][Thread Next][Date index][Thread index]

Re: st: a stat question

From   Steven Samuels <>
Subject   Re: st: a stat question
Date   Sat, 5 Jul 2008 12:40:38 -0400


I think that you are right to be concerned. I would like to know more about comparability of sampled populations and of key measurements between old and new surveys.

1. Was there multi-stage probability sampling for both old and new surveys (cities as PSU's for example? If so, were the target populations the same?

2. Are the questions on the key variables are identical in both questionnaries? Do the questions differ in their placement and order? Did the questionnaires differ in length? Was there any calibration of old and new questions?

3. Were previous analyses appropriate to finite-population designs (e.g. standard errors based primarily on the number of PSU's?)


On Jul 3, 2008, at 9:42 PM, Data Analytics Corp. wrote:


I have a client who has been conducting a survey for several years, each year being a "wave". This year, the whole survey was changed: most of the questionnaire, sample design and size, locations (prior waves had only four cities, the new one has 8 cities). I was asked about doing some significance testing on a few variables. I was very uneasy about this because everything about the surveys is different. I feel that any comparisons would be shaky because so much has changed. Stat theory doesn't seem to say anything about comparing across different waves such as this. Any thoughts on doing significance tests on waves of surveys where everything about the surveys have changed from one wave to the next? Any literature I can be pointed to? I've run into this before with other clients, so it's a common occurrence.




Walter R. Paczkowski, Ph.D.
Data Analytics Corp.
44 Hamilton Lane
Plainsboro, NJ 08536
(V) 609-936-8999
(F) 609-936-3733

* For searches and help try:
*   For searches and help try:

© Copyright 1996–2017 StataCorp LLC   |   Terms of use   |   Privacy   |   Contact us   |   What's new   |   Site index