TY - GEN
T1 - A generalized cost optimal decision model for record matching
AU - Verykios, Vassilios S.
AU - Moustakides, George V.
PY - 2004
Y1 - 2004
N2 - Record (or entity) matching or linkage is the process of identifying records in one or more data sources, that refer to the same real world entity or object. In record linkage, the ultimate goal of a decision model is to provide the decision maker with a tool for making decisions upon the actual matching status of a pair of records (i.e., documents, events, persons, cases, etc.). Existing models of record linkage rely on decision rules that minimize the probability of subjecting a case to clerical review, conditional on the probabilities of erroneous matches and erroneous non-matches. In practice though, (a) the value of an erroneous match is, in many applications, quite different from the value of an erroneous non-match, and (b) the cost and the probability of a misclassification, which is associated with the clerical review, is ignored in this way. In this paper, we present a decision model which is optimal, based on the cost of the record linkage operation, and general enough to accommodate multi-class or multi-decision case studies. We also present an example along with the results from applying the proposed model to large comparison spaces.
AB - Record (or entity) matching or linkage is the process of identifying records in one or more data sources, that refer to the same real world entity or object. In record linkage, the ultimate goal of a decision model is to provide the decision maker with a tool for making decisions upon the actual matching status of a pair of records (i.e., documents, events, persons, cases, etc.). Existing models of record linkage rely on decision rules that minimize the probability of subjecting a case to clerical review, conditional on the probabilities of erroneous matches and erroneous non-matches. In practice though, (a) the value of an erroneous match is, in many applications, quite different from the value of an erroneous non-match, and (b) the cost and the probability of a misclassification, which is associated with the clerical review, is ignored in this way. In this paper, we present a decision model which is optimal, based on the cost of the record linkage operation, and general enough to accommodate multi-class or multi-decision case studies. We also present an example along with the results from applying the proposed model to large comparison spaces.
KW - probabilistic decision model
KW - record matching
UR - http://www.scopus.com/inward/record.url?scp=77954013995&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=77954013995&partnerID=8YFLogxK
U2 - 10.1145/1012453.1012457
DO - 10.1145/1012453.1012457
M3 - Conference contribution
AN - SCOPUS:77954013995
SN - 1581139020
SN - 9781581139020
T3 - Proceedings of the ACM SIGMOD International Conference on Management of Data
SP - 20
EP - 26
BT - IQIS 2004 - International Workshop on Information Quality in Information Systems, Held in Conjunction with the 23rd ACM SIGMOD International Conference on Management of Data
T2 - International Workshop on Information Quality in Information Systems, IQIS 2004, Held in Conjunction with the 23rd ACM SIGMOD International Conference on Management of Data
Y2 - 18 June 2004 through 18 June 2004
ER -