university website

van Houten, C.B., Naaktgeboren, CA, Ashkenazi-Hoffnung, L., Ashkenazi, S., Avis, W., Chistyakov, I., Corigliano, T., Galetto, A., Gangoiti, I., Gervaix, A, et al. Glikman, D., Ivaskeviciene, I., Kuperman, A.A., Lacroix, L, Loeffen, Y., Luterbacher, F., Meijssen, C.B., Mintegi, S, Nasrallah, B., Papan, C., van Rossu, A.M.C., Rudolph, H., Stein, M., R. Tal (Ronen), Tenenbaum, T., Usonis, V., R.A. van Voorden (Ronald), Weichert, S., Wildenbeest, J.G., de Winter-de Groot, KM, T.F.W. Wolfs (Tom), Mastboim, N., Gottlieb, T.M., Cohen, A., Oved, K, Eden, E, Feigin, P.D., Shani, L. and Bont, L.J.

2019-08-01

Expert panel diagnosis demonstrated high reproducibility as reference standard in infectious diseases

Publication

Publication

Journal of Clinical Epidemiology , Volume 112 p. 20- 27

Objective: If a gold standard is lacking in a diagnostic test accuracy study, expert diagnosis is frequently used as reference standard. However, interobserver and intraobserver agreements are imperfect. The aim of this study was to quantify the reproducibility of a panel diagnosis for pediatric infectious diseases. Study Design and Setting: Pediatricians from six countries adjudicated a diagnosis (i.e., bacterial infection, viral infection, or indeterminate) for febrile children. Diagnosis was reached when the majority of panel members came to the same diagnosis, leaving others inconclusive. We evaluated intraobserver and intrapanel agreement with 6 weeks and 3 years’ time intervals. We calculated the proportion of inconclusive diagnosis for a three-, five-, and seven-expert panel. Results: For both time intervals (i.e., 6 weeks and 3 years), intrapanel agreement was higher (kappa 0.88, 95%CI: 0.81-0.94 and 0.80, 95%CI: NA) compared to intraobserver agreement (kappa 0.77, 95%CI: 0.71-0.83 and 0.65, 95%CI: 0.52-0.78). After expanding the threeexpert panel to five or seven experts, the proportion of inconclusive diagnoses (11%) remained the same. Conclusion: A panel consisting of three experts provides more reproducible diagnoses than an individual expert in children with lower respiratory tract infection or fever without source. Increasing the size of a panel beyond three experts has no major advantage for diagnosis reproducibility.

Additional Metadata
Keywords Reference standard, Gold standard, Diagnosis, Expert panel, Infectious diseases, Reproducibility
Persistent URL doi.org/10.1016/j.jclinepi.2019.03.010, hdl.handle.net/1765/119419
Journal Journal of Clinical Epidemiology
Organisation Erasmus MC: University Medical Center Rotterdam
Citation
van Houten, C.B., Naaktgeboren, CA, Ashkenazi-Hoffnung, L., Ashkenazi, S., Avis, W., Chistyakov, I., … Bont, L.J. (2019). Expert panel diagnosis demonstrated high reproducibility as reference standard in infectious diseases. Journal of Clinical Epidemiology, 112, 20–27. doi:10.1016/j.jclinepi.2019.03.010


User Publication Person Organisation Collection
Close