Pneumonia severity scores in resource poor settings
© The Author(s) 2014
Received: 30 April 2014
Accepted: 9 September 2014
Published: 22 September 2014
Clinical prognostc scores are increasingly used to streamline care in well-resourced setngs. The potental benefts of identfying patents at risk of clinical deterioraton and poor outcome, delivering appropriate higher level clinical care, and increasing efciency are clear. In this focused review, we examine the use and applicability of severity scores applied to patents with community acquired pneumonia in resource poor setngs. We challenge clinical researchers working in such systems to consider the generalisability of existng severity scores in their populatons, and where performance of scores is suboptmal, to promote eforts to develop and validate new tools for the beneft of patents and healthcare systems.
Severity scores are designed to identify patients at high risk of adverse outcome. They allow resources to be concentrated on such patients, with a strong emphasis on early intervention. Disease specific scores, as described here for community acquired pneumonia (CAP), may additionally direct clinical decisions regarding treatment and discharge.
Severity scores include factors strongly associated with adverse outcome. Combining multiple factors improve the identification of patients at highest or lowest prognostic risk. Given a well-defined cohort, statistical methods make the generation of such scores straightforward. In order to be clinically useful, they should be widely applicable, objectively measurable, and simple. Crucially, the implementation of severity score-associated pathways and treatment plans must have a proven positive impact for patients. This challenge requires an understanding of the benefits and limitations of severity scores by clinicians and service planners. This review highlights the current available tools, particularly those of relevance to resource-limited settings in low and middle income countries (LMICs). We discuss how future efforts might refine and implement such severity scores effectively, and highlight potential limitations of their use, in particular the risk of extrapolation to other diseases without specific validation.
2. The purpose of severity scores
To enable junior clinical staff to identify critically unwell patients, and prompt a senior response . For example, this might empower a ward nurse to contact on call doctor out-of-hours, and convey that urgent action may be required
To track the severity of a patient’s illness over time, and trigger intervention early in “treatment failure” (track and trigger). For example, relatively unskilled workers can be used to measure and record observations, and identify patients in need of attention with very little medical knowledge
To guide initial clinical management e.g. identify patients who could be managed in the community, who require intensive treatment unit care, or to determine whether oral or intravenous antibiotics are most appropriate
To enable comparison of quality of care between dissimilar patient populations For example, for auditing the performance of different hospitals.
Generic EWSs tend to focus on the first two goals. Disease specific severity scores, such as those for CAP, are typically promoted as guides to clinical management. These differences are mostly conceptual or historical, and such distinctions might hinder the development or application of future services.
3. The perfect severity score
The ideal CAP severity score, universally applied, would simply identify the risk of deterioration in patients, and indicate a proportionate intervention to maximise individual patient outcome and promote efficient service delivery.
Aiming for perfection — characteristics of an ideal severity score, and practical limitations
Includes routinely recorded data
Limitations of demographic and physiological data
Easy to calculate
All systems require training at roll-out and later reinforcement.
Memorable or computer-based tool
Paper and computer systems are limited by availability
Consistency and reliability
Training is required for reliable physiological measurements
Functioning medical equipment is needed for some variables
Scores may be validated for unrealistically well-defined circumstances
Useful in varied populations
Dissimilar environments and populations require revalidation of existing scores to ensure utility
Appropriately used in a validated population e.g. suspected pneumonia (CURB-65), gastrointestinal bleed (Blatchford Bleeding Score)
Disease specific scores are quickly unreliable where diagnoses are uncertain, unconfirmed, or over-generalised
Indicates a scale of response
Scores quantitatively reflect outcomes, or urgency. Linearity is ideal i.e. doubling the score indicates the patient is twice as ill
Most trigger scores are calibrated to “all or nothing” outcomes Triage systems are more finely graded and responsive but more complex
For triggering scores:
Early intervention is a key factor in improving outcome
Timely action in hospital systems requires significant human resources
Identifying patients too late to alter outcome is not clinically relevant
Trigger threshold in “Goldilocks” zone
Insensitive trigger misses the opportunities to act
Triggering too easily increases workload
High discrimination power is often practically unachievable
“Alarm fatigue” leads to reduced staff compliance with procedures
The application of severity scores is less straightforward to measure, but describes how well they are incorporated into existing clinical setting. Local implementation should promote consistent and widespread use within an organisation, and should provide resources and support to allow this. Without these, scoring systems remain research tools.
The intervention step links the severity score to a meaningful clinical action. Most commonly, this is a trigger to summon senior individuals or liaison with critical care facilities. Pneumonia scores are also commonly used to determine antibiotic choice. For low risk individuals, a useful action might be prompting patient discharge.
Delivering improved outcomes requires attention to all of these three areas. Application and intervention strategies often require systems change: national and local guidelines have begun to address these areas. For example, in the United Kingdom (UK), the British Thoracic Society has established CAP guidelines and, importantly, audit standards by which to judge their implementation .
4. Severity scores for community acquired pneumonia (CAP) are used to stratify risk in order to guide clinical management
Severity scores currently used or proposed for community acquired pneumonia
Scoring system [Ref]
Laboratory / Radiology
1 point each for: confusion; urea >7 mmol; rr ≥30; sbp <90 or dbp ≤60; age ≥65 years.
As CURB-65, without urea criterion
Complex weighted sum (20 variables, stratifying outcome to 5 risk categories)
1 point each for: male; wasting; non-ambulatory; T <35 or >38; sbp <90 or dbp <60
Sepsis scoreb 
4 categories: no SIRSc; SIRSc; severe sepsisd; septic shocke
ATS 2001 
2 categories: ICU or not
2 categories: ICU or not
Weighted sum stratifying to 2 categories: ICU or not
Weighted sum stratifying to 2 categories: ICU or not
The PSI/PORT (Pneumonia Severity Index/Patient Outcomes Research Team) was published in 1997 , and can identify low risk patients by calculation of a weighted score based on 20 variables. It remains the research standard , but requires a broad range of laboratory tests to implement. CURB-65 (Confusion, Urea, Respiratory rate, Blood pressure, Age > 65 years) and CRB-65 (Confusion, Respiratory rate, Blood pressure, Age > 65 years) severity scores for CAP are designed to more simply stratify patients according to risk, including those at low and high extremes (prompting consideration of out-patient and intensive care unit level care respectively). CURB-65 and CRB-65 have been widely validated in high income countries and predict 30 day mortality. However, of 40 studies included in a systematic review of articles published between 1980 and 2009 , only one study was derived from a LMIC. Given the paucity of evidence, recent validation efforts in new settings are welcome . The SWAT-Bp (male Sex, Wasting, non-Ambulatory, Temperature, Blood pressure) score was derived from an inpatient population in Malawi where CRB-65 performs less well than in Europe . Preliminary data suggests internal validity .
Criteria proposed in the ATS 2001 (American Thoracic Society) pneumonia guidelines , ATS-IDSA (American Thoracic Society-Infectious Disease Society of America) , SMART-COP (Systolic blood pressure, Multilobar infiltrate, Albumin, Respiratory rate, Tachycardia, Confusion, low Oxygen, low PH)  and SCAP (Severe Community-Acquired Pneumonia)  are derived from, and used in, high-income environments where ventilatory support and vasopressor use are common. These criteria aim to identify patients who should be considered for intensive care unit admission. Their successful adoption will mean that new severity scores in this setting should be validated against objective outcomes rather than “need for critical care” in order to prevent circularity.
Sepsis scores, although not deliberately calibrated for use in CAP, have similar, if slightly reduced, discriminatory value . This suggests that all of these tools are more generally measuring a pathological systemic inflammatory response .
5. Validation of severity scores is necessary in “new” populations
Even within one health system, clinicians should be aware of the scope and applicability of severity scores. Some systems continue to work well outside of their original disease definitions (CURB-65 predicts severity in chronic obstructive pulmonary disease exacerbation in the UK ). Conversely, even when appropriately used, CURB-65 has some limitations. For example, disease severity is underestimated in relatively young (<50 years) and old (>85 years) patients [20,21]. This is a problem where the ‘scoring’ variables (here, age) diverge significantly from the demographic represented in the derivation cohort. Where patterns of disease are atypical, more generalised scores may be more accurate, if unwieldy. One example is the superiority of the APACHE II (Acute Physiology and Chronic Health Evaluation II) score over CURB-65 in methicillin-resistant Staphylococcus aureus pneumonia .
An example of the loss of discriminating power in cohorts with different characteristics
CRB-65 = 0
5.1 Improving severity score performance in new settings
Strong risk factors are consistently incorporated into severity scores, such as indices of blood pressure, heart rate and conscious level (Table 2). It is unlikely that many novel physiological risk factors will be found, although mid-upper arm circumference does show promise in the Malawi study. Generic markers of infirmity such as inability to walk have been useful, and under-reported . Refinement of existing scores, rather than reinvention, may therefore be most appropriate. Historical factors might be helpful in this way and should be investigated, for example, prior use of antibiotics. Other patient information offers the opportunity to tune severity scores to local disease prevalence. In one study in Kenya with endemic rates of tuberculosis, 9% of acute respiratory disease consistent with pneumonia was found to be mycobacterial . In these circumstances, haemoptysis and chronicity might be investigated, or possibly incorporated into clinical pathways. Lastly, hypoxia as measured by peripheral oxygen saturations (SpO2) is becoming widely available. In well-resourced settings, its use can improve on CURB-65 . Even where oxygen availability may be severely limited, the use of SpO2 as a marker of severity rather than a criterion for supplemental oxygen may be worthwhile, but the data are lacking.
As such, we cannot currently recommend any of the available pneumonia severity scores in resource-limited settings such as Malawi. However, there are huge potential gains where improvements can be made, and relevant research is urgently needed.
6. Judicious implementation of clinical systems based on severity scores has significant advantages
The introduction of severity scores may directly improve clinical care. This could be a direct effect of identifying critically unwell patients. By the recording of pertinent severity markers, physicians are explicitly encouraged to assess the severity of patient illness. Incorporation of severity scores into undergraduate and postgraduate teaching gives physicians-in-training a practical framework on which to base their clinical decisions, especially when junior medical staff are frequently professionally isolated in rural areas. There are also potential benefits from standardising and auditing practice, making it easier to identify meaningful trends in patient outcome over time, or between facilities.
Indirectly, the incorporation of severity scores into quality improvement schemes can focus efforts on staff education, or hospital structures. For example, even where ward level nurse supervision is difficult, it is possible to cohort the most unwell patients in proximate areas, thereby improving the likelihood of timely medical input.
Implementation of “antimicrobial stewardship” tools are likely to have wider impact , and may conceivably have at their heart severity scores for common diseases such as pneumonia. For example, prescription of broad spectrum intravenous antimicrobials might be limited to patients with high severity scores.
Potential hazards lie in increasing administrative overhead, and reducing the flexibility of the healthcare system. To mitigate against these potential disadvantages, clinicians should understand the scope of the severity scores they are using, and the appropriateness of the score to their patient group. More pragmatically, scores which are simple, memorable, and require limited laboratory data (such as CURB-65) are likely to be the most successful.
6.1 Maximising impact — learning lessons from early warning score (EWS) implementation
EWSs were initially conceived to improve identification of deteriorating patients, and to facilitate nurses in triggering early senior medical reviews. In the UK, they have been widely adopted, although the use of multiple systems and poor early reliability, and sensitivity has been problematic . Clinicians have also expressed concerns over fragmentation of clinical work, and these shortcomings have been recognised. This has prompted action to standardise systems across different hospitals, and to promote “task shifting” — transferring defined tasks from doctors to other healthcare professionals — to optimise human resource allocation.
Where CAP severity scores identify large numbers of patients at high risk, there may be a similar effect to EWS systems. The demand for resources is likely to increase, and in resource limited settings this may frequently highlight shortfalls in oxygen availability , or critical care provision [30,31]. It is important that implementing CAP interventions at the expense of other essential services does not have an overall negative impact. However, prioritization of the critical unwell patient with CAP is likely to be key to improving outcomes. Severity scores, resource allocation (particularly human resources) and interventions should therefore be locally appropriate. Future research studies assessing their impact should examine the healthcare delivery in a broad context, including both patient outcome data and resource implicaions.
7. Conclusions and future directions
Severity risk scores can be an excellent tool to enable identification of both patients at risk of deterioration, and patients at lower risk who may not require hospital admission at all. For optimal use, their limitations must be understood, as must the population within which they were derived. To aid clinicians in resource-poor settings, two types of severity score will ideally develop.
Firstly, risk stratification tools should be validated, by refinement of existing systems (e.g. CURB-65) to improve their performance in new populations. This will be the most cost-effective option to implement. Secondly, the development of ‘track and trigger’ systems would additionally allow the identification of deteriorating patients, but carries resource implications in the repeated measurement of physiological markers. Further operational research is required following implementation of any risk score system to demonstrate its overall benefits. In the same way as CURB-65 performs well in many high income countries, it is possible that alternative systems might be suitable for a broad range of LMICs. This would allow standardised interventions, including “bundles of care”, analogous to the adult triage system proposed by the World Health Organization as part of the Integrated Management of Adolescent and Adult Illness project . Where sepsis and CAP scores work similarly, it was proposed that a more generic application of risk stratification could be incorporated into rapid treatment protocols, and implemented by healthcare workers other than doctors. Using broadly applicable severity markers in this setting could help the development of wider triage systems, which currently do not exist in many low resource setngs.
Scoring systems are used to focus resources.
They should be validated in a population in which they are to be used.
“Trigger” scores should prompt action which is likely to improve prognosis.
Trade-offs in sensitivity and specificity are unavoidable: with inappropriate implementation, severity scores can increase workload without improving outcomes.
Funding: The authors have no support or funding to report.
Competing interests: The authors have no competing interests to declare.
Provenance and peer review: Commissioned; no funding has been requested or received by the authors for the preparation of the manuscript; externally peer reviewed.
Copyright: This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
- Morgan RJ, Wright MM. In defence of early warning scores. Br J Anaesth 2007;99(5):747–8. http://www.dx.doi.org/10.1093/bja/aem286.PMID:17933804View ArticlePubMedGoogle Scholar
- Lim WS, Baudouin SV, George RC, Hill AT, Jamieson C, Le Jeune I et al.; Pneumonia Guidelines Commitee of the BTS Standards of Care Commitee. BTS guidelines for the management of community acquired pneumonia in adults: update 2009. Thorax 2009;64 Suppl 3:iii1–55. http://www.dx.doi.org/10.1136/thx.2009.121434. PMID:19783532PubMedGoogle Scholar
- Lim WS, van der Eerden MM, Laing R, Boersma WG, Karalus N, Town GI et al. Defning community acquired pneumonia severity on presentaton to hospital: an internatonal derivaton and validaton study. Thorax 2003;58(5):377–82. http://www.dx.doi.org/10.1136/thorax.58.5.377. PMID:12728155View ArticlePubMedPubMed CentralGoogle Scholar
- Fine MJ, Auble TE, Yealy DM, Hanusa BH, Weissfeld LA, Singer DE et al. A predicton rule to identfy low-risk patents with community-acquired pneumonia. N Engl J Med 1997;336(4):243–50. http://www.dx.doi.org/10.1056/NEJM199701233360402. PMID:8995086View ArticlePubMedGoogle Scholar
- Birkhamshaw E, Wait CJ, Innes M, Wait PI. Severity assessment of lower respiratory tract infecton in Malawi: derivaton of a novel index (SWAT-Bp) which outperforms CRB-65. PLoS ONE 2013;8(12):e82178. http://www.dx.doi.org/10.1371/journal.pone.0082178. PMID:24324763
- American College of Chest Physicians/Society of Critcal Care Medicine Consensus Conference: defnitons for sepsis and organ failure and guidelines for the use of innovatve therapies in sepsis. Crit Care Med 1992;20(6):864–74. http://dx.doi.org/10.1097/00003246-199206000-00025. PMID:1597042View ArticleGoogle Scholar
- Ewig S, Ruiz M, Mensa J, Marcos MA, Martnez JA, Arancibia F et al. Severe community-acquired pneumonia. Assessment of severity criteria. Am J Respir Crit Care Med 1998;158(4):1102–8. http://www.dx.doi.org/10.1164/ajrccm.158.4.9803114. PMID:9769267View ArticlePubMedGoogle Scholar
- Mandell LA, Wunderink RG, Anzueto A, Bartlet JG, Campbell GD, Dean NC et al.; Infectous Diseases Society of America; American Thoracic Society. Infectous Diseases Society of America/American Thoracic Society consensus guidelines on the management of community-acquired pneumonia in adults. Clin Infect Dis 2007;44 Suppl 2:S27–72. http://www.dx.doi.org/10.1086/511159. PMID:17278083View ArticlePubMedGoogle Scholar
- Charles PG, Wolfe R, Whitby M, Fine MJ, Fuller AJ, Strling R et al.; Australian Community-Acquired Pneumonia Study Collaboraton. SMART-COP: a tool for predictng the need for intensive respiratory or vasopressor support in community-acquired pneumonia. Clin Infect Dis 2008;47(3):375–84. http://www.dx.doi.org/10.1086/589754. PMID:18558884View ArticlePubMedGoogle Scholar
- España PP, Capelastegui A, Quintana JM, Bilbao A, Diez R, Pascual S et al. Validaton and comparison of SCAP as a predictve score for identfying low-risk patents in community-acquired pneumonia. J Infect 2010;60(2):106–13. http://www.dx.doi.org/10.1016/j.jinf.2009.11.013. PMID:19961875View ArticlePubMedGoogle Scholar
- Mart C, Garin N, Grosgurin O, Poncet A, Combescure C, Carballo S et al. Predicton of severe community-acquired pneumonia: a systematc review and meta-analysis. Crit Care 2012;16(4):R141. http://www.dx.doi.org/10.1186/cc11447. PMID:22839689View ArticleGoogle Scholar
- Royal College of Physicians. Natonal Early Warning Score (NEWS): Standardising the assessment of acute-illness severity in the NHS. London: RCP; 2012.Google Scholar
- Aujesky D, Fine MJ. The pneumonia severity index: a decade afer the inital derivaton and validaton. Clin Infect Dis 2008;47 Suppl 3:S133–9. http://www.dx.doi.org/10.1086/591394. PMID:18986279View ArticlePubMedGoogle Scholar
- Chalmers JD, Singanayagam A, Akram AR, Mandal P, Short PM, Choudhury G et al. Severity assessment tools for predictng mortality in hospitalised patents with community-acquired pneumonia. Systematc review and meta-analysis. Thorax 2010;65(10):878–83. http://www.dx.doi.org/10.1136/thx.2009.133280. PMID:20729231View ArticlePubMedGoogle Scholar
- Alavi-Moghaddam M, Bakhshi H, Rezaei B, Khashayar P. Pneumonia severity index compared to CURB-65 in predictng the outcome of community acquired pneumonia among patents referred to an Iranian emergency department: a prospectve survey. Braz J Infect Dis 2013;17(2):179–83. http://www.dx.doi.org/10.1016/j.bjid.2012.10.012. PMID:23453945View ArticlePubMedGoogle Scholar
- Buss I, Birkhamshaw E, Magadoro I, Innes M, Rylance J, Wait P. Validaton of a new index to predict mortality from community-acquired pneumonia in Malawi: the SWAT-BP score 43rd World Conference, IUATLD; 2012.Google Scholar
- Barlow G, Nathwani D, Davey P. The CURB65 pneumonia severity score outperforms generic sepsis and early warning scores in predictng mortality in community-acquired pneumonia. Thorax 2007;62(3):253–9. http://www.dx.doi.org/10.1136/thx.2006.067371. PMID:16928720View ArticlePubMedGoogle Scholar
- Howell MD, Donnino MW, Talmor D, Clardy P, Ngo L, Shapiro NI. Performance of severity of illness scoring systems in emergency department patents with infecton. Acad Emerg Med 2007;14(8):709–14. Available from: http://www.onlinelibrary.wiley.com/doi/10.1197/j.aem.2007.02.036/pdf. http://www.dx.doi.org/10.1111/j.1553–2712.2007.tb01866.x. PMID:17576773View ArticlePubMedGoogle Scholar
- Chang CL, Sullivan GD, Karalus NC, Mills GD, McLachlan JD, Hancox RJ. Predictng early mortality in acute exacerbaton of chronic obstructve pulmonary disease using the CURB65 score. Respirology 2011;16(1):146–51. http://www.dx.doi.org/10.1111/j.1440-1843.2010.01866.x. PMID:20920140View ArticlePubMedGoogle Scholar
- Chalmers JD, Singanayagam A, Hill AT. Predictng the need for mechanical ventlaton and/or inotropic support for young adults admited to the hospital with community-acquired pneumonia. Clin Infect Dis 2008;47(12):1571–4. http://www.dx.doi.org/10.1086/593195. PMID:18991510View ArticlePubMedGoogle Scholar
- Parsonage M, Nathwani D, Davey P, Barlow G. Evaluaton of the performance of CURB-65 with increasing age. Clin Microbiol Infect 2009;15(9):858–64. http://www.dx.doi.org/10.1111/j.1469–0691.2009.02908.x. PMID:19702590View ArticlePubMedGoogle Scholar
- Kollef KE, Reichley RM, Micek ST, Kollef MH. The modifed APACHE II score outperforms Curb65 pneumonia severity score as a predictor of 30-day mortality in patents with methicillin-resistant Staphylococcus aureus pneumonia. Chest 2008;133(2):363–9. http://www.dx.doi.org/10.1378/chest.07-1825. PMID:17951615View ArticlePubMedGoogle Scholar
- Bauer TT, Ewig S, Marre R, Sutorp N, Welte T, Group CS; CAPNETZ Study Group. CRB-65 predicts death from community-acquired pneumonia. J Intern Med 2006;260(1):93–101. http://www.dx.doi.org/10.1111/j.1365–2796.2006.01657.x. PMID:16789984View ArticlePubMedGoogle Scholar
- Rylance J, Baker T, Mushi E, Mashaga D. Use of an early warning score and ability to walk predicts mortality in medical patents admited to hospitals in Tanzania. Trans R Soc Trop Med Hyg 2009;103(8):790–4. http://www.dx.doi.org/10.1016/j.trstmh.2009.05.004. PMID:19540542View ArticlePubMedGoogle Scholar
- Scot JA, Hall AJ, Muyodi C, Lowe B, Ross M, Chohan B et al. Aetology, outcome, and risk factors for mortality among adults with acute pneumonia in Kenya. Lancet 2000;355(9211):1225–30. http://www.dx.doi.org/10.1016/S0140–6736(00)02089-4. PMID:10770305View ArticleGoogle Scholar
- Sanz F, Restrepo MI, Fernández E, Mortensen EM, Aguar MC, Cervera A et al.; Neumonía Adquirida en la Comunidad de la Comunidad Valenciana Study Group. Hypoxemia adds to the CURB-65 pneumonia severity score in hospitalized patents with mild pneumonia. Respir Care 2011;56(5):612–8. http://www.dx.doi.org/10.4187/respcare.00853. PMID:21276314View ArticlePubMedGoogle Scholar
- Hurst JM, Bosso JA. Antmicrobial stewardship in the management of community-acquired pneumonia. Curr Opin Infect Dis 2013;26(2):184–8. http://www.dx.doi.org/10.1097/QCO.0b013e32835d0a8f. PMID:23434896View ArticlePubMedGoogle Scholar
- Gao H, McDonnell A, Harrison DA, Moore T, Adam S, Daly K et al. Systematic review and evaluation of physiological track and trigger warning systems for identifying at-risk patients on the ward. Intensive Care Med 2007;33(4):667–79. s00134-007-0532-3. PMID:17318499View ArticlePubMedGoogle Scholar
- Belle J, Cohen H, Shindo N, Lim M, Velazquez-Berumen A, Ndihokubwayo JB et al. Infuenza preparedness in low-resource setngs: a look at oxygen delivery in 12 African countries. J Infect Dev Ctries 2010;4(7):419–24. PMID:20818088PubMedGoogle Scholar
- Riviello ED, Letchford S, Achieng L, Newton MW. Critcal care in resource-poor setngs: lessons learned and future directons. Crit Care Med 2011;39(4):860–7. http://www.dx.doi.org/10.1097/CCM.0b013e318206d6d5. PMID:21297458View ArticlePubMedGoogle Scholar
- Firth P, Ttendo S. Intensive care in low-income countries—a critcal need. N Engl J Med 2012;367(21):1974–6. http://www.dx.doi.org/10.1056/NEJMp1204957. PMID:23171093View ArticlePubMedGoogle Scholar
- WHO. IMAI District Clinician Manual: Hospital Care for Adolescents and Adults (Guidelines for the Management of Common Illnesses with Limited Resources — Volume 1). Geneva: World Health Organizaton, 2011Google Scholar