Bookmark and Share

Notice: On April 23, 2014, Statalist moved from an email list to a forum, based at statalist.org.


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: st: identifying duplicate records


From   "Dimitriy V. Masterov" <[email protected]>
To   [email protected]
Subject   Re: st: identifying duplicate records
Date   Fri, 10 Feb 2012 09:22:36 -0500

Raoul,

I assume you've already tried the duplicates command on various
combination of the id variables and that did not work.

I would create a combination id that concatenates the dob, NHS # and
surname. Then use the user-written strgroup on this variable. This
approach will still require a bit of manual work.

A non-Stata approach is to use Google Refine.

DVM

On Fri, Feb 10, 2012 at 9:08 AM, raoul reulen <[email protected]> wrote:
> Hello
>
> Just wondering if I could get some advice. I have a large database
> with around 300,000 records of individuals. There can be more than one
> record per individual.  Now, how do I identify individuals? I assume
> that it is the same indivual if:
>
> Date of birth and NHS number are the same  OR
> date of birth and surname are the same OR
> surname and NHS number are the same.
>
> So there are various combinations possible. A date of birth could have
> typos in it; but if the NHS number and the surname are the same then I
> assume it is the same person. The NHS number can have typos, but if
> the date of birth and the surname are the same I will assume it is the
> same person.
>
>  What is the best way to approach this?  I want to end up with an
> id-number that identifies the individual.  Many thanks for your help.
>
> Raoul
> *
> *   For searches and help try:
> *   http://www.stata.com/help.cgi?search
> *   http://www.stata.com/support/statalist/faq
> *   http://www.ats.ucla.edu/stat/stata/

*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/


© Copyright 1996–2018 StataCorp LLC   |   Terms of use   |   Privacy   |   Contact us   |   Site index