Development and Validation of Models to Predict Hospital Admission for Emergency Department Patients

Authors

  • Bin Xie 2Department of Epidemiology & Biostatistics, University of Western Ontario, Ontario, Canada

DOI:

https://doi.org/10.6000/1929-6029.2013.02.01.07

Keywords:

Hospital admission, Emergency department, Wait times, Overcrowding, Coxian phase type distribution

Abstract

Background: Boarding, or patients waiting to be admitted to hospital, has been shown as a significant contributing factor at overcrowding in emergency departments (ED). Predicting hospital admission at triage has been proposed as having the potential to help alleviate ED overcrowding. The objective of this paper is to develop and validate a model to predict hospital admission at triage to help alleviate ED overcrowding.

Methods: Administrative records between April 1, 2010 and November 31, 2010 in an adult ED were used to derive and validate two prediction models, one based on Coxian phase type distribution (the PH model), the other based on logistic regression. Separate data sets were used for model development (data between April 1, 2010 and July 31, 2010) and validation (data between August 1, 2010 and November 31, 2010).

Results: There were a total of 14,542 ED visits and 2,602 (17.89%) hospital admissions in the derivation cohort. In both models, acuity levels, model of arrival, and main reason of the visit are strong predictors of hospital admission; number of patients at the ED, as well as gender, are also predictors, albeit with ORs closer to 1. Patient age and timing of visits are not strong predictors. The PH model has an AUC of 0.89 compared with AUC of 0.83 for logistic regression model; with a cut- off value of 0.50, the PH model correctly predicted 86.3% of visits, compared to 84.4% for the logistic regression model. Results of the validation cohort were similar: the PH model has an AUC of 0.88, compared to AUC of 0.83 for the logistic model.

Conclusions: PH and logistic models can be used to provide reasonably accurate prediction of hospital admission for ED patients, with the PH model offering more accurate predictions

Author Biography

Bin Xie, 2Department of Epidemiology & Biostatistics, University of Western Ontario, Ontario, Canada

Department of Obstetrics & Gyneocology; Department of Epidemiology & Biostatistics

References

Hoot NR, Aronsky D. Systematic review of emergency department crowding: Causes, effects, and solutions. Ann Emerg Med 2008; 52(2): 126-36. http://dx.doi.org/10.1016/j.annemergmed.2008.03.014 DOI: https://doi.org/10.1016/j.annemergmed.2008.03.014

Begley CE, Chang Y, Wood RC, et al. Emergency department diversion and trauma mortality: Evidence from houston, texas. J Trauma 2004; 57(6): 1260-5. http://dx.doi.org/10.1097/01.TA.0000135163.60257.A6 DOI: https://doi.org/10.1097/01.TA.0000135163.60257.A6

Moskop JC, Sklar DP, Geiderman JM, et al. Emergency department crowding, part 2--barriers to reform and strategies to overcome them. Ann Emerg Med 2009; 53(5): 612-7. http://dx.doi.org/10.1016/j.annemergmed.2008.09.024 DOI: https://doi.org/10.1016/j.annemergmed.2008.09.024

National ambulatory care reporting system. [Internet]. Toronto: CIHI; 2011 [updated Oct 2011; cited October 31, 2011]. Available from: http: //www.cihi.ca/CIHI-ext-portal/internet/en/document/types+of+care/hospital+care/emergency+care/services_nacrs.

Derlet RW, Richards JR. Overcrowding in the nation's emergency departments: Complex causes and disturbing effects. Ann Emerg Med 2000; 35(1): 63-8. http://dx.doi.org/10.1016/S0196-0644(00)70105-3 DOI: https://doi.org/10.1016/S0196-0644(00)70105-3

Sprivulis PC, Da Silva JA, Jacobs IG, et al. The association between hospital overcrowding and mortality among patients admitted via western australian emergency departments. Med J Aust 2006; 184(5): 208-12. DOI: https://doi.org/10.5694/j.1326-5377.2006.tb00203.x

Richardson DB. Increase in patient mortality at 10 days associated with emergency department overcrowding. Med J Aust 2006; 184(5): 213-6. DOI: https://doi.org/10.5694/j.1326-5377.2006.tb00204.x

Bernstein SL, Aronsky D, Duseja R, et al. The effect of emergency department crowding on clinically oriented outcomes. Acad Emerg Med 2009; 16(1): 1-10. http://dx.doi.org/10.1111/j.1553-2712.2008.00295.x DOI: https://doi.org/10.1111/j.1553-2712.2008.00295.x

Aaronson LS, Mural CM, Pfoutz SK. Seeking information: Where do pregnant women go? Health Educ Q 1988; 15(3): 335-45. http://dx.doi.org/10.1177/109019818801500307 DOI: https://doi.org/10.1177/109019818801500307

Bayley MD, Schwartz JS, Shofer FS, et al. The financial burden of emergency department congestion and hospital crowding for chest pain patients awaiting admission. Ann Emerg Med 2005; 45(2): 110-7. http://dx.doi.org/10.1016/j.annemergmed.2004.09.010 DOI: https://doi.org/10.1016/j.annemergmed.2004.09.010

Yonkers KA, Wisner KL, Stewart DE, et al. The management of depression during pregnancy: A report from the american psychiatric association and the american college of obstetricians and gynecologists. Gen Hosp Psychiatry 2009; 31(5): 403-13. http://dx.doi.org/10.1016/j.genhosppsych.2009.04.003 DOI: https://doi.org/10.1016/j.genhosppsych.2009.04.003

Leegon J, Jones I, Lanaghan K, et al. Predicting hospital admission in a pediatric emergency department using an artificial neural network. AMIA Annu Symp Proc 2006; 1004.

Hodgins MJ, Moore N, Legere L. Who is sleeping in our beds? factors predicting the ED boarding of admitted patients for more than 2 hours. J Emerg Nurs 2011; 37(3): 225-30. http://dx.doi.org/10.1016/j.jen.2010.02.020

American College of Emergency Physicians (ACEP). Boarding of admitted and intensive care patients in the emergency department. policy statement. Ann Emerg Med 2011; 58(1): 110. http://dx.doi.org/10.1016/j.annemergmed.2011.04.027 DOI: https://doi.org/10.1016/j.annemergmed.2011.04.027

Sun Y, Heng BH, Tay SY, et al. Predicting hospital admissions at emergency department triage using routine administrative data. Acad Emerg Med. 2011; 18(8): 844-50. http://dx.doi.org/10.1111/j.1553-2712.2011.01125.x DOI: https://doi.org/10.1111/j.1553-2712.2011.01125.x

Dexheimer JW, Leegon J, Aronsky D. Predicting hospital admission at triage in an emergency department. AMIA Annu Symp Proc 2007; 937.

Meisel ZF, Pollack CV, Mechem CC, et al. Derivation and internal validation of a rule to predict hospital admission in prehospital patients. Prehosp Emerg Care 2008; 12(3): 314-9. http://dx.doi.org/10.1080/10903120802096647 DOI: https://doi.org/10.1080/10903120802096647

van der Wulp I, Schrijvers AJ, van Stel HF. Predicting admission and mortality with the emergency severity index and the manchester triage system: A retrospective observational study. Emerg Med J 2009; 26(7): 506-9. http://dx.doi.org/10.1136/emj.2008.063768 DOI: https://doi.org/10.1136/emj.2008.063768

Leegon J, Jones I, Lanaghan K, et al. Predicting hospital admission for emergency department patients using a bayesian network. AMIA Annu Symp Proc 2005; 1022.

Beardsell I, Robinson S. Can emergency department nurses performing triage predict the need for admission? Emerg Med J 2011; 28(11): 959-62. http://dx.doi.org/10.1136/emj.2010.096362 DOI: https://doi.org/10.1136/emj.2010.096362

Kosowsky JM, Shindel S, Liu T, et al. Can emergency department triage nurses predict patients' dispositions? Am J Emerg Med 2001; 19(1): 10-4. http://dx.doi.org/10.1053/ajem.2001.20033 DOI: https://doi.org/10.1053/ajem.2001.20033

Holdgate A, Morris J, Fry M, Zecevic M. Accuracy of triage nurses in predicting patient disposition. Emerg Med Australas 2007; 19(4): 341-5. http://dx.doi.org/10.1111/j.1742-6723.2007.00996.x DOI: https://doi.org/10.1111/j.1742-6723.2007.00996.x

Price TG, Hooker EA, Neubauer J. Prehospital provider prediction of emergency department disposition: Implications for selective diversion. Prehosp Emerg Care 2005; 9(3): 322-5. http://dx.doi.org/10.1080/10903120590962012 DOI: https://doi.org/10.1080/10903120590962012

Brillman JC, Doezema D, Tandberg D, et al. Triage: Limitations in predicting need for emergent care and hospital admission. Ann Emerg Med 1996; 27(4): 493-500. http://dx.doi.org/10.1016/S0196-0644(96)70240-8 DOI: https://doi.org/10.1016/S0196-0644(96)70240-8

Ruger JP, Lewis LM, Richter CJ. Identifying high-risk patients for triage and resource allocation in the ED. Am J Emerg Med 2007; 25(7): 794-8. http://dx.doi.org/10.1016/j.ajem.2007.01.014 DOI: https://doi.org/10.1016/j.ajem.2007.01.014

Marshall AH, McClean SI. Using coxian phase-type distributions to identify patient characteristics for duration of stay in hospital. Health Care Manag Sci 2004; 7(4): 285-9. http://dx.doi.org/10.1007/s10729-004-7537-z DOI: https://doi.org/10.1007/s10729-004-7537-z

Faddy M, Graves N, Pettitt A. Modeling length of stay in hospital and other right skewed data: Comparison of phase-type, gamma and log-normal distributions. Value Health 2009; 12(2): 309-14. http://dx.doi.org/10.1111/j.1524-4733.2008.00421.x DOI: https://doi.org/10.1111/j.1524-4733.2008.00421.x

Faddy MJ, McClean SI. Using a multi-state model to enhance understanding of geriatric patient care. Aust Health Rev 2007; 31(1): 91-7. http://dx.doi.org/10.1071/AH070091 DOI: https://doi.org/10.1071/AH070091

Faddy MJ, McClean SI. Markov chain modelling for geriatric patient care. Methods Inf Med 2005; 44(3): 369-73. DOI: https://doi.org/10.1055/s-0038-1633979

Faddy MJ, McClean SI. Analysing data on lengths of stay of hospital patients using phase-type distributions. Appl Stochastic Models Bus Ind 1999; 15(4): 311-7. http://dx.doi.org/10.1002/(SICI)1526-4025(199910/12)15:4<311::AID-ASMB395>3.0.CO;2-S DOI: https://doi.org/10.1002/(SICI)1526-4025(199910/12)15:4<311::AID-ASMB395>3.0.CO;2-S

McClean SI, Faddy MJ, Millard PH. Markov Model-Based Clustering for Efficient Patient Care. CBMS 2005; 467-472.

Marshall AH, McClean SI, Shapcott CM, et al. Modelling patient duration of stay to facilitate resource management of geriatric hospitals. Health Care Manag Sci 2002; 5(4): 313-9. http://dx.doi.org/10.1023/A:1020394525938 DOI: https://doi.org/10.1023/A:1020394525938

Marshall AH, McClean SI, Millard PH. Addressing bed costs for the elderly: A new methodology for modelling patient outcomes and length of stay. Health Care Manag Sci 2004; 7(1): 27-33. http://dx.doi.org/10.1023/B:HCMS.0000005395.77308.d1 DOI: https://doi.org/10.1023/B:HCMS.0000005395.77308.d1

Xie H, Chaussalet TJ, Millard PH. A continuous time markov model for the length of stay of elderly people in institutional long-term care. J Royal Statist Soc 2005; 168: 51-61. http://dx.doi.org/10.1111/j.1467-985X.2004.00335.x DOI: https://doi.org/10.1111/j.1467-985X.2004.00335.x

Murray M, Bullard M, Grafstein E, et al. Revisions to the canadian emergency department triage and acuity scale implementation guidelines. CJEM 2004; 6(6): 421-7. DOI: https://doi.org/10.1017/S1481803500009428

Hodgins MJ, Moore N, Legere L. Who is sleeping in our beds? factors predicting the ED boarding of admitted patients for more than 2 hours. J Emerg Nurs 2011; 37(3): 225-30. http://dx.doi.org/10.1016/j.jen.2010.02.020 DOI: https://doi.org/10.1016/j.jen.2010.02.020

Powell ES, Khare RK, Venkatesh AK, et al. The relationship between inpatient discharge timing and emergency department boarding. J Emerg Med 2012; 42(2): 186-96. http://dx.doi.org/10.1016/j.jemermed.2010.06.028 DOI: https://doi.org/10.1016/j.jemermed.2010.06.028

Arkun A, Briggs WM, Patel S, et al. Emergency department crowding: Factors influencing flow. West J Emerg Med 2010; 11(1): 10-5.

R Development Core Team. R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing 2011.

Cox DR. Analysis of binary data. 2nd ed. Boca Raton: Chapman & Hall 1989.

Downloads

Published

2013-02-12

How to Cite

Xie, B. (2013). Development and Validation of Models to Predict Hospital Admission for Emergency Department Patients. International Journal of Statistics in Medical Research, 2(1), 55–66. https://doi.org/10.6000/1929-6029.2013.02.01.07

Issue

Section

General Articles