Bookmark and Share

Notice: On March 31, it was announced that Statalist is moving from an email list to a forum. The old list will shut down on April 23, and its replacement, is already up and running.

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: st: randomly drop duplicates

From   Nick Cox <>
To   "" <>
Subject   Re: st: randomly drop duplicates
Date   Fri, 31 May 2013 16:54:58 +0100

You are correct that -duplicates drop- does not include anything like
this. It's an official command but I can comment on the thinking
behind it. Certainly nothing like that was considered when
-duplicates- was first written. In retrospect I think that was right.

The main intent behind -duplicates- is essentially that you can
identify and if necessary -drop- redundant data.

-duplicates- offers you a way to decide  that you don't care about
dropping some kinds of information through its -force- option. Note
among other details that what that does is well-defined and

What Ann wants is, to my mind, more like subsampling. There are easy
ways to do that and subject to documenting a random number seed it is
reproducible. Nevertheless -duplicates- is already a moderately
complicated command and it seems best that its purpose not be muddied
by considerably broadening its scope.

This is no sense critical of what Ann wants to do. I just wanted to
comment briefly on the logic of -duplicates-.


On 31 May 2013 15:35, Ann Montgomery <> wrote:

> I'd like to drop duplicates randomly instead of dropping the first duplicate row. I can't find reference to this in -duplicates drop-?
*   For searches and help try:

© Copyright 1996–2015 StataCorp LP   |   Terms of use   |   Privacy   |   Contact us   |   Site index