Browse > Article

Diagnostic performance of enzyme-linked immnosorbent assays for diagnosing paratuberculosis in cattle: a meta-analysis  

Pak, Son-Il (Department of Veterinary Medicine, Kangwon National University)
Publication Information
Korean Journal of Veterinary Research / v.44, no.4, 2004 , pp. 669-676 More about this Journal
Abstract
To evaluate the diagnostic accuracy of two commercial ELISA tests (Allied- and CSL-ELISA) for the diagnosis of Mycobacterium paratuberculosis in cattle, Meta-analysis using English language papers published during 1990-2001 was performed. Diagnostic odds ratios (DOR) were analyzed using regression analysis together with summary receiver operating characteristic (ROC) curves. The difference in diagnostic performance between the two ELISA systems was evaluated by using linear regression. Publication bias was assessed by funnel plot and linear regression. The pooled sensitivity and specificity were 44% (95% CI, 38 to 51) and 98% (95% CI, 96 to 99) for the random-effect model. The DOR between studies was heterogeneous. The area under the fitted ROC curve (AUC) was 0.72 for the unweighted and 0.77 for the weighted model. Maximum joint sensitivity and specificity for the unweighted and weighted model from their summary ROC curve were 70% and 75%, respectively. Based on the fitted model, at a specificity of 95%, sensitivity was estimated to be 52% for the unweighted and 57% for the weighted model. From the final multivariable model study characteristic, the country was the only significant variable with an explained component variance of 13.3%. There were no significant differences in discriminatory power, sensitivity, and specificity between the two ELISA tests. The overall diagnostic accuracy of two commercial ELISA tests was moderate, as judged by the AUC, maximum joint sensitivity and specificity, and estimates from the fitted model and clinical usefulness of the tests for screening program is limited because of low sensitivity and heterogeneous of DOR. It is, therefore, recommended to use ELISA tests as a parallel testing with other diagnostic tests together to increase test sensitivity in the screening program.
Keywords
meta-analysis; Mycobacterium paratuberculosis; Diagnostic test;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Collins, M. T., Sockett, D. C., Goodger, W. J., Conrad, T. A., Thomas, C. B. and Carr, D. J. Herd prevalence and geographic distribution of, and risk factors for, bovine paratuberculosis in Wisconsin. J. Am. Vet. Med. Assoc. 1994, 204, 636-641
2 Diamond, G. A. Limited assurance. Am. J. Cardiol. 1989, 63, 99-100
3 Egger, M., Davey-Smith, G., Schneider, M. and Minder, C. Bias in meta-analysis detected by a single, graphical test. Brit. Med. J. 1997, 315, 629-634
4 Hedges L. V. Fixed effect models. In: Cooper H, Hedges LV. The handbook of research synthesis, pp. 285-299. Russell Sage Foundation, New York, 1994
5 Kahn, H. A. and Sempos, C. T. Statistical methods in epidemiology. Oxford University Press, New York, 1989
6 Littenberg, B. and Moses, L. E. Estimating diagnostic accuracy from multiple conflicting reports: a new metaanalytic method. Med. Decis. Making. 1993, 13, 313-321
7 Owens, D. K., Holodniy, M., McDonald, T. W., Scott, J. and Sonnad, S. A meta-analytic evaluation of the polymerase chain reaction for the diagnosis of HIVinfection in infants. JAMA. 1996, 275, 1342-1348
8 Yokomizo, Y., Kishima, M., Mori, Y. and Nishimori, K. Evaluation of enzyme-linked immunosorbent assay in comparison with complement fixation test for thediagnosis of subclinical paratuberculosis in cattle. J. Vet. Med. Sci. 1991, 53, 577-584
9 Ridge, S. E., Morgan, I. R., Sockett, D. C., Collins, M.T., Condron, R. J., Skilbeck, N. W. and Webber, J. J. Comparison of the Johne’s absorbed EIA andcomplement fixation test for diagnosis of Johne's disease in cattle. Aust. Vet. J. 1991, 68, 253-257
10 Collins, M. T., Sockett, D. C., Ridge, S. and Cox, J. C. Evaluation of a commercial enzyme-linked immunosorbent assay for Johne’s disease. J. Clin.Microbiol. 1991, 29, 272-276
11 Sockett, D. C., Conrad, T. A., Thomas, C. B. and Collins, M. T. Evaluation of four serological tests for bovine paratuberculosis. J. Clin. Microbiol. 1992, 30, 1134-1139
12 DerSimonian, R. and Laird, N. Meta analysis in clinical trials. Control Clin. Trials. 1986, 7, 177-188
13 Sockett, D. C., Carr, D. J., Richards, W. D. and Collins, M. T. A repository of specimens for comparison of diagnostic testing procedures for bovineparatuberculosis. J. Vet. Diagn. Invest. 1992, 4, 188-191
14 Cochran, W. G. The combination of estimates from different experiments. Biometrics. 1954, 10, 101-129
15 Midgette, A. S., Stukel, T. A. and Littenberg. B. A meta-analytic method for summarizing diagnostic test performances: receiver-operating-characteristic-summary point estimates. Med. Decis. Making. 1993, 13, 253-257
16 Sweeney, R. W., Whitlock, R. H., Buckley, C. L. and Spencer, P. A. Evaluation of a commercial enzymelinked immunosorbent assay for the diagnosis of paratuberculosis in dairy cattle. J. Vet. Diagn. Invest. 1995, 7, 488-493
17 Swets, J. A. Form of empirical ROCs in discrimination and diagnostic tasks: Implications for theory and measurement of performance. Psychol. Bullet. 1986,99, 181-198
18 Muskens, J., Barkema, H. W., Russchen, E., van Maanen, K., Schukken, Y. H. and Bakker, D. Prevalence and regional distribution of paratuberculosis in dairy herds in The Netherlands. Vet. Microbiol. 2000, 77, 253-261
19 Ferrer, R. L. Graphical methods for detecting bias in meta-analysis. Fam. Med. 1998, 30, 579-583
20 Milner, A. R., Mack, W. N., Coates, K. J., Hill, J., Gill, I. and Sheldrick, P. The sensitivity and specificity of a modified ELISA for the diagnosis of Johne's disease from a field trial in cattle. Vet. Microbiol. 1990, 25, 193-198
21 Hanley, J. A. and McNeil, B. J. The meaning and use of the area under an ROC curve. Radiology. 1982, 143, 29-36
22 Moses, L. E., Shapiro, D. and Littenberg. B. Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches andsome additional considerations. Stat. Med. 1993, 12, 1293-1316
23 Walter, S. D., Irwig, L. and Glasziou, P. P. Metaanalysis of diagnostic tests with imperfect reference standards. J. Clin. Epidemiol. 1999, 52, 943-951
24 Tang, J. L. and Liu, J. L. Y. Misleading funnel plot for detection of bias in meta-analysis. J. Clin. Epidemiol. 2000, 53, 477-484
25 Turner, R. M., Omar, R. Z., Yang, M., Goldstein, H. and Thompson, S. G. A multilevel model framework for meta-analysis of clinical trials with binary outcomes. Stat. Med. 2000, 19, 3417-3432
26 Cox, J. C., Drane, D. P., Jones, S. L., Ridge, S. and Milner, A. R. Development and evaluation of a rapid absorbed enzyme immunoassay test for the diagnosisof Johne’s disease in cattle. Aust. Vet. J. 1991, 68, 157-160
27 Whitlock, R. H., Wells, S. J., Sweeney, R. W. and van Tiem, J. ELISA and fecal culture for paratuberculosis (Johne’s disease): sensitivity and specificity of each method. Vet. Microbiol. 2000, 77, 387-398
28 Dargatz, D. A., Byrum, B. A., Barber, L. K., Sweeney, R. W., Whitlock, R. H., Shulaw, W. P., Jacobson, R. H. and Stabel, J.R. Evaluation of a commercial ELISA for diagnosis of paratuberculosis in cattle. J. Am. Vet. Med. Assoc. 2001, 218, 1163-1166