This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Kleinman, K. P Articles by Abrams, A. M Search for Related Content PubMed PubMed Citation Articles by Kleinman, K. P Articles by Abrams, A. M Social Bookmarking                         What's this?

Assessing surveillance using sensitivity, specificity and timeliness

Department of Ambulatory Care and Prevention, Harvard Medical School and Harvard Pilgrim Health Care, Boston, MA, USA, ken.kleinman{at}gmail.com

Allyson M Abrams

Department of Ambulatory Care and Prevention, Harvard Medical School and Harvard Pilgrim Health Care, Boston, MA, USA

Monitoring ongoing processes of illness to detect sudden changes is an important aspect of practical epidemiology and medicine more generally. Most commonly, the monitoring has been restricted to a unidimensional stream of data over time. In such situations, analytic results from the industrial process monitoring have suggested optimal approaches to monitor the data streams. Data streams including spatial location as well as temporal sequence are becoming available. Monitoring methods that incorporate spatial data may prove superior to those that ignore it. However, analytically, optimal methods for spatial surveil-lance data may not exist. In the present article, we introduce and discuss evaluation metrics that can be used to compare the performance of statistical methods of surveillance. Our general approach is to generalize receiver operating characteristic (ROC) curves to incorporate the time of detection in addition to the usual test characteristics of sensitivity and specificity. In addition to weighting ordinary ROC curves by two measures of timeliness, we describe three three-dimensional generalizations of ROC curves that result in timeliness-ROC surfaces. Working in the context of surveillance of cases of disease to detect a sudden outbreak, we demonstrate these in an artificial example and in a previously described simulation context and show how the metrics differ. We also discuss the differences and under which circumstances one might prefer a given method.

Statistical Methods in Medical Research, Vol. 15, No. 5, 445-464 (2006)
DOI: 10.1177/0962280206071641


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				D. L. Buckeridge, A. Okhmatovskaia, S. Tu, M. O'Connor, C. Nyulas, and M. A. Musen Understanding Detection Performance in Public Health Surveillance: Modeling Aberrancy-detection Algorithms J. Am. Med. Inform. Assoc., November 1, 2008; 15(6): 760 - 769. [Abstract] [Full Text] [PDF]