Making Health Care Safer: A Critical Review of Evidence Supporting Strategies to Improve Patient Safety5 March 2013

Nurse–Patient Ratios as a Patient Safety Strategy

FREE
A Systematic Review
    Author, Article and Disclosure Information

    Abstract

    A small percentage of patients die during hospitalization or shortly thereafter, and it is widely believed that more or better nursing care could prevent some of these deaths. The author systematically reviewed the evidence about nurse staffing ratios and in-hospital death through September 2012. From 550 titles, 87 articles were reviewed and 15 new studies that augmented the 2 existing reviews were selected. The strongest evidence supporting a causal relationship between higher nurse staffing levels and decreased inpatient mortality comes from a longitudinal study in a single hospital that carefully accounted for nurse staffing and patient comorbid conditions and a meta-analysis that found a “dose–response relationship” in observational studies of nurse staffing and death. No studies reported any serious harms associated with an increase in nurse staffing. Limiting any stronger conclusions is the lack of an evaluation of an intervention to increase nurse staffing ratios. The formal costs of increasing the nurse–patient ratio cannot be calculated because there has been no evaluation of an intentional change in nurse staffing to improve patient outcomes.

    Key Summary Points

    Cross-sectional studies, mostly in intensive care unit or postsurgical settings, support a relationship between the number of nurses staffed per patient and inpatient mortality.

    The strongest evidence supporting a causal relationship between higher nurse staffing levels and decreased inpatient mortality comes from a longitudinal study in a single hospital that carefully accounted for nurse staffing levels and found decreases in mortality of 2% to 7%.

    Limiting any stronger conclusions is the lack of an evaluation of an intervention to increase nurse staffing ratios.

    The Problem

    A small percentage of hospitalized patients die during or shortly after hospitalization. Evidence suggests that some proportion of these deaths could probably be prevented with more nursing care. For example, in 1 early study of 232 342 surgical discharges from several Pennsylvania hospitals, 4535 patients (2%) died within 30 days of hospitalization; the investigators estimated that the difference between 4:1 and 8:1 patient–nurse ratios may be approximately 1000 deaths in a group of this size (1). Other studies have produced roughly similar estimates, namely approximately 1 to 5 fewer deaths per 1000 inpatient days with more nurse staffing per patient (2–4). The rationale for suggesting that increasing the ratio of registered nurses (RNs) to patients will lead to decreased illness or mortality rates rests on the belief that improved attention to patients is the critical factor. This systematic review examined the evidence on the effects of interventions aimed at increasing nurse–patient ratios on patient illness and death.

    Patient Safety Strategies

    There has been no evaluation of an intentional change in RN staffing to improve patient outcomes; therefore, the patient safety strategy referred to in this article remains somewhat unclear. Most studies have been cross-sectional or longitudinal assessments of differences in nursing staff variables, with the most commonly assessed measure being the proportion of RN time per some measure of inpatient load and the most commonly assessed outcome being mortality. However, many other factors have been proposed as being causal with respect to the relationship between nursing care and reductions in hospital mortality, potentially in addition to or instead of a simple nurse–patient ratio. These factors include measures of nursing burnout, job satisfaction, teamwork, nurse turnover, nursing leadership in hospitals, and nurse practice environment.

    Several research groups have proposed conceptual frameworks to explain why more effective nursing care may reduce inpatient mortality (5–8). Underlying all of these conceptual frameworks is the belief that surveillance is a critical factor that can be improved with more staff, better-educated staff, or a better working environment (9). A representative framework by Aiken and colleagues (8) posits that nurse–patient ratios, along with staffing skill mix, can lead to better surveillance, which, along with many other factors, can influence the process of care and lead to better patient outcomes (Figure 1).

    Figure 1. Hospital organization, nursing organization, and patient outcomes.

    From reference 8, with permission.

    Review Processes

    Two existing reviews relevant to the topic were identified, by using methods described by Whitlock and colleagues (10). These reviews were supplemented by searching the Web of Science for articles published from 2009 (the end date of the search from the most recent review) to September 2012 that cited any of 4 key articles in this field, including the older of the 2 reviews, and was limited to studies published in English. For a complete description of the search strategies, literature flow diagram, and evidence tables, see the Supplement. The update search identified 546 titles, and 4 articles came from reference mining. Titles and abstracts were reviewed and selected if they reported empirical data on the relationship between nurse staffing ratios and mortality or nursing-sensitive outcomes, such as pressure ulcers and failure to rescue. Because several cross-sectional studies have assessed this relationship, only 1 additional cross-sectional study was included for detailed review. The exception was a cross-sectional study that evaluated a quasi-intervention (11). Nine longitudinal studies were identified (12–20). Four simulation studies reported on costs, and 1 systematic review article was included (21–25). Two frameworks were also included (6, 7). No experimental studies were identified.

    The assessment of multiple systematic reviews (AMSTAR) criteria was used to assess the quality of the systematic reviews (26). Only criteria relevant to a particular review were applied; for example, 2 of the 11 AMSTAR criteria are only applicable to reviews that involve meta-analysis. In addition, the AMSTAR criteria requiring a list of all excluded studies were not applied. New studies were not formally assessed for study quality, but their strengths and limitations are discussed later.

    This review was supported by the Agency for Healthcare Research and Quality, which had no role in the selection or review of the evidence or the decision to submit this manuscript for publication.

    Benefits and Harms
    Benefits

    Two recent relevant systematic reviews on this topic, a meta-analysis (27) and a narrative review (28), respectively scored 10 out of 10 relevant criteria and 7 out of 9 relevant criteria according to AMSTAR.

    The meta-analysis included 28 studies, of which 17 were cohort studies, 7 were cross-sectional studies, and 4 were case–control studies (no experimental studies were identified). Most were U.S. studies, and the average level of staffing was 3.0 patients per RN for the intensive care unit (ICU) setting, 4.0 patients per RN in the surgical setting, and 4.4 patients per RN for the medical setting. It found a consistent relationship between higher RN staffing and lower hospital-related mortality: An increase of 1 RN full-time equivalent (FTE) per patient day was related to a 9% reduction in the odds of death in the ICU, a 16% reduction in the surgical setting, and a 6% reduction in the medical setting. With respect to other outcomes, lower rates of hospital-acquired pneumonia, pulmonary failure, unplanned extubation, failure to rescue, and nosocomial bloodstream infections were related to higher RN staffing in pooled analyses of several studies. However, several other outcomes that were presumed to have strong sensitivity to nurse staffing levels did not show consistent relationships, including falls, pressure ulcers, and urinary tract infections.

    The authors also conducted an indirect analysis of the potential for a dose–response relationship. This analysis assessed the effect across studies of additional RNs per shift. In each case, comparisons of quartiles of nurse staffing levels showed the expected relationship (Figure 2). In other words, if the relationship between nurse staffing and mortality is causal, the difference in the risk for death should be greater between the first and third quartiles of nurse staffing than it is between the first and second quartiles because the difference in staffing between the first and third quartiles is greater than that between the first and second quartiles.

    Figure 2. Pooled odds ratio of quartiles of nurse staffing levels.

    Odds ratios are based on pooled analysis consistent across the studies (heterogeneity not significant). From reference 27, with permission. RN = registered nurse.

    The authors of the meta-analysis concluded that a consistent relationship has been shown but identified several limitations in the literature with respect to establishing that this relationship is causal. The authors ultimately concluded that the arguments for a causal relationship are “mixed,” and they called for future research to address the role of nurse staffing and competence on the effectiveness of patient care, “taking greater cognizance of other relevant factors such as patient and hospital characteristics and quality of medical care” (27).

    The narrative review identified literature published through 2009 and was restricted to studies that used hospital-related mortality as the outcome; the authors identified 17 studies (10 of which were not included in the first review and 7 that were published since 2007) (28). Although this review was narrative, the 2 reviews had broadly similar results: 14 of 17 studies found a statistically significant relationship between nurse staffing variables and lower mortality rates. In addition, the narrative review identified mixed findings for mortality among 5 studies assessing the characteristics of the nurse work environment and work relationships, 3 studies assessing nurses' responses to work and the work environment (for example, burnout), and 7 studies assessing nurses' educational preparation and experience. Only 1 study, which had a cross-sectional design, assessed nursing process-of-care variables; it found a relationship between the use of care maps and lower hospital-associated mortality, with an estimated effect size of 10 fewer deaths per 1000 acute medicine discharged patients. Like the meta-analysis, the narrative review concluded that a strong relationship exists but more research is needed to understand the reasons why this relationship between higher nurse staffing and lower hospital mortality may be causal (that is, they called for a theoretical model that explains the relationship in ways that can be tested and refined).

    Thus, these 2 reviews came to broadly similar conclusions. Mostly cross-sectional studies consistently report that higher RN staffing is related to lower hospital-related mortality.

    However, many factors can confound the observed relationship. In cross-sectional studies, hospitals that are “better” in other ways may also be better staffed with more RNs. For example, 1 published study of electronic health record implementation showed that hospitals with electronic health records have higher nurse staffing ratios and lower patient mortality (29). If the cross-sectional relationship is confounded, then critics worry that adoption of fixed nurse–patient ratios will not necessarily lead to better health outcomes, that such a policy is “an inflexible solution that is unlikely to lead to optimal use of resources” (30).

    The results of the updated search are as follows. Nine longitudinal studies and one new systematic review (12–20, 25) were identified. The systematic review included studies that assessed nurse staffing ratios and outcomes restricted to adult ICU settings (25) and reached conclusions similar to the previous reviews: a consistent relationship between increased nurse staffing and better patient outcomes in observational studies, evidence that falls short of causality. One longitudinal study narratively reported that increased nurse staffing was related to “significantly (P ≤ 0.01) decreased rates of decubiti, pneumonia, and sepsis,” but data were not presented (20). The cross-sectional study addresses the effect of an “intervention” to change nurse staffing ratios, implemented in response to a 2004 California law requiring minimum nurse–patient ratios in acute care hospitals (11). This legislation mandated patient–nurse staffing levels of 5:1, 4:1, and 2:1 for medical or surgical units, pediatric units, and ICUs, respectively. The California legislative mandate does not require nurse staffing to be met with RNs (that is, licensed vocational [practical] nurses can also meet the mandate).

    Aiken and colleagues (11) assessed the relationship between nurse staffing and mortality in 2006, 2 years after the California mandate, comparing data from California with those of 2 states without mandates, New Jersey and Pennsylvania. Data about workloads were drawn from a survey of RNs in the 3 states (22 336 nurses in total); the response rate was 35.4%. Hospital data came from the American Hospital Association, and patient and outcome data came from state hospital discharge databases.

    The authors reported that their survey data showed substantial adherence to the California mandate, with 88% of medical or surgical nurses, 85% of pediatric nurses, and 85% of ICU nurses reporting that the staffing of their last shift was within the mandated ratio. In logistic regression analyses adjusted for many patient characteristics and 3 hospital characteristics (such as bed size, teaching status, and technology use), Aiken and colleagues found statistically significant relationships between the estimation of the average number of patients per nurse and 2 outcomes: 30-day mortality and failure to rescue (11).

    Although the study collected data after implementation of the California staffing mandate, it did not test the effect of that mandate per se because it had no comparison data from the period before the mandate went into effect. The possibility that the relationship is causal is blunted by longitudinal studies that examined measures from before and after the California mandate, which showed the expected changes in nurse staffing and proportion of licensed staff per patient but no improvement in other patient outcomes believed to be nursing-sensitive (such as falls, pressure ulcers, and failure to rescue) (16, 17, 19). In fact, an unexpected statistically significant increase in pressure ulcers was related to a greater number of hours of care for the patient (which may have been because of greater detection). These studies did not assess mortality.

    Five additional longitudinal studies add further information to this picture. The first is a longitudinal assessment of nurse staffing and hospital mortality and failure to rescue in 283 California hospitals between 1996 and 2001, which had access to direct measures of nurse staffing (14). In multivariable models that included many hospital market characteristics as well as risk adjustment using the Medstat Disease Staging methodology to produce a predicted probability for complications or death, the authors found that an increase of 1 RN FTE per 1000 inpatient days was related to a statistically significant decrease in mortality of 4.3%.

    The second longitudinal study assessed care at 39 Michigan hospitals between 2003 and 2006; it included adults admitted through the emergency department with acute myocardial infarction, heart failure, stroke, pneumonia, hip fracture, or gastrointestinal bleeding (15). This study simultaneously controlled for 4 factors—high hospital occupancy on hospitalization, weekend hospitalization, seasonal influenza, and nurse staffing levels—each of which had a statistically significant effect on in-hospital mortality. Each additional RN FTE per patient day was related to a 0.25% decrease in mortality.

    The third longitudinal study assessed the effect of a mandate in 3 Western Australia public hospitals to implement a new staffing method, the Nursing Hours per Patient Day (12). The study assessed 3 periods: 20 months before implementation, 7 months of a “transition period,” and 2 months after implementation. The authors found that the total nursing hours and RN hours increased during the observation period. However, the percentage of total nursing hours provided by RNs decreased (from 87% to 84%). Also, the article stated that “although the nursing hours increased for all three hospitals (in the post-implementation period), the changes were not statistically significant” (12). Mortality rates were reduced during this period. Among many other outcomes, some improved, others did not, and some changes were inconsistent across hospitals. Although the study was described as an interrupted time series, it was analyzed as a before–after study.

    The fourth longitudinal study assessed changes in nurse staffing over 9 years in 124 Florida hospitals and related these to changes in Agency for Healthcare Research and Quality Patient Safety Indicators (18). The study used both initial staffing ratios and changes in staffing ratios. Results were mixed but generally favored better patient safety outcomes with higher RN staffing levels.

    The methodologically strongest longitudinal study is that of Needleman and colleagues (13). The researchers used data over time from a single hospital to assess the relationship between natural differences in levels of RN staffing in the same hospital and inpatient mortality. The study is further characterized by a careful matching of nurse staffing on a shift-by-shift basis with the actual patients cared for during that shift. Knowing the actual patients cared for allowed for more sophisticated adjustments of risk for death at the patient level. The study was done at a tertiary academic hospital between 2003 and 2006 and included 197 691 hospitalizations and 176 696 nursing shifts across 43 hospital units. The patients themselves averaged 60 years of age, and approximately 50% were covered under Medicare. The variable of interest was exposure of the patient to nursing care that was below the target level (for that type of unit) for that shift (that is, the proportion of shifts below target level staffing on a per-patient basis). An additional exposure variable was a “high-turnover” shift (that is, a shift with many hospitalizations, discharges, or transfers). The authors found that exposure to each shift of below-target staffing or high turnover was related to a 2% to 7% increase in mortality, with higher levels of risk if the high-turnover or below-target shift occurred in the first 5 days after hospitalization. For patients who were not in an ICU, this risk was increased by 12% and 15% during below-target and high-turnover shifts, respectively.

    The data from Needleman and colleagues contribute to the “causality” determination because the study is longitudinal in 1 hospital, thus controlling for the “hospital effect” potentially present in all cross-sectional studies, and has detailed measures of exposure and confounding variables. These results and the dose–response analysis from the meta-analysis provide the strongest evidence in support of causality.

    Harms

    The survey administered as part of the cross-sectional study previously described, which collected data 2 years after the California mandate for minimum nurse staffing ratios (11), found that some California nurses perceived that they had less support from the use of licensed vocational nurses, unlicensed personnel, and nonnursing support services (such as housekeeping and unit clerks) after implementation of the mandate. For example, 25% of RNs reported that they perceived that they had decreased use of licensed vocational nurses after the mandate, whereas 10% perceived that they had increased use and 56% reported that use remained the same.

    The longitudinal assessments from California (16–19) and Western Australia (12) reported an increase in pressure ulcers related to increased nurse staffing, although this development may reflect increased detection. Few other studies mentioned an explicit assessment of potential unexpected adverse outcomes.

    Implementation Considerations and Costs
    Implementation Contexts

    Because no published studies of an assessment of an “implementation” were found, the contexts in which interventions have been implemented cannot be directly assessed. However, the cross-sectional and longitudinal studies that have been published and have consistently shown a relationship between staffing levels and patient outcomes have included a broad array of hospitals, often all or nearly all of the hospitals (except for very small ones) in a state. Therefore, if the relationship between increased RN staffing and inpatient mortality is a causal one, it very likely applies to most hospitals and contexts. This strategy is most likely to be implemented when mandated by state or federal policy.

    As previously noted, the relationship between staffing and mortality that underpins this strategy has been seen in various hospitals and contexts. The effect, if causal, is probably relatively insensitive to the usual effects of contexts considered in other patient safety strategy reviews. Of note, the recent study by Needleman and colleagues was conducted in a tertiary medical center that has a lower-than-expected in-hospital mortality rate and a reputation for excellence. Therefore, the relationship between increased RN staffing and lower mortality, if causal, is potentially applicable even to high-performing hospitals.

    Costs

    Four simulation studies reported information about costs. The first used 2003 data from 28 Belgian cardiac surgery centers to assess the costs and outcomes of increasing nurse staffing. Assuming a causal relationship between this staffing increase and an outcome of 5 fewer patient deaths per 1000 elective hospitalizations, the authors concluded that the incremental cost-effectiveness ratio was €26 372 (approximately $35 000) per avoided death and €2639 (approximately $3500) per life-year gained (21).

    The second simulation study was conducted by the University of Minnesota Evidence-based Practice Center, which produced the systematic review on nurse staffing (22). It used its own meta-analysis as the basis for estimating the potential monetary benefits of increased RN staffing. Assuming that those relationships were causal and taking a societal perspective, the authors concluded that increasing RN staffing by 1 FTE per patient day was related to positive savings–cost ratios across a broad range of clinical settings. For example, the net cost of adding 1 RN FTE per 1000 hospitalized ICU patients was an estimated $590 000, whereas the net benefit (in terms of life-years saved and productivity) was an estimated $1.5 million, for a benefit–cost ratio of 2.51. However, hospitals did not save money because the net cost of adding an extra RN FTE was not offset by the expected 24% decrease in length of stay.

    A third simulation study (24) used data from studies by Aiken and colleagues and Needleman and colleagues to estimate benefits in mortality and length of stay, respectively, and estimated an incremental cost-effectiveness ratio between $25 000 and $136 000 per life saved as patient–RN staffing ratios decreased from 8:1 to 4:1. The model was most sensitive to the estimate of effect on mortality.

    Lastly, 1 additional study from Portugal estimated that increasing neonatal nurse staffing to “adequate” would increase staff costs more than 30% of the current rate (23).

    Discussion

    Nurse staffing ratios have a relationship with reductions in hospital-related mortality in most published studies. However, lack of a published evaluation of an intentional change in RN staffing from some initial value (for example, 6 patients to 1 RN on general medical wards) to some lower patient–RN staffing value (such as 5:1 or 4:1) limits conclusions on increasing nurse staffing ratios as a patient safety strategy. All longitudinal published studies to date have assessed natural variations in RN staffing. The concern also remains that mortality is not reduced by increased nurse staffing but by something the nurses do. Determining what this is and how it can best be facilitated should be the goal of an effective patient safety strategy.

    Limitations of this review include those of the original articles, such as lack of rigorous evaluations of an intentional intervention, low response rates to surveys that collect explanatory variables (such as RN staffing), potentially poor matching of RN staffing to actual patients cared for and their risk for death, and lack of replication of the 1 high-quality longitudinal study that has been published; and the possibility that some relevant evidence was not found, either because it was not identified during the search or because some completed evaluations have not been unpublished.

    To further advance this field, studies assessing an intentional change in nurse staffing ratios are needed. It may be impractical for such a study to be a randomized, controlled trial, but high-quality evidence could come from a time series analysis or a controlled before-and-after study, particularly if it included the necessary process variables to serve as a test of a conceptual framework for how increased staffing can influence outcomes.

    References

    • 1. Aiken LH Clarke SP Sloane DM Sochalski J Silber JH Hospital nurse staffing and patient mortality, nurse burnout, and job dissatisfaction. JAMA2002;288:1987-93. [PMID: 12387650] CrossrefMedlineGoogle Scholar
    • 2. Aiken LH Clarke SP Sloane DM Lake ET Cheney T Effects of hospital care environment on patient mortality and nurse outcomes. J Nurs Adm2008;38:223-9. [PMID: 18469615] CrossrefMedlineGoogle Scholar
    • 3. Tourangeau AE Giovannetti P Tu JV Wood M Nursing-related determinants of 30-day mortality for hospitalized patients. Can J Nurs Res2002;33:71-88. [PMID: 11998198] MedlineGoogle Scholar
    • 4. Person SD Allison JJ Kiefe CI Weaver MT Williams OD Centor RM et alNurse staffing and mortality for Medicare patients with acute myocardial infarction. Med Care2004;42:4-12. [PMID: 14713734] CrossrefMedlineGoogle Scholar
    • 5. Tourangeau AE Doran DM McGillis Hall L O'Brien Pallas L Pringle D Tu JV et alImpact of hospital nursing care on 30-day mortality for acute medical patients. J Adv Nurs2007;57:32-44. [PMID: 17184372] CrossrefMedlineGoogle Scholar
    • 6. Thornlow DK Anderson R Oddone E Cascade iatrogenesis: factors leading to the development of adverse events in hospitalized older adults. Int J Nurs Stud2009;46:1528-35. [PMID: 19643409] CrossrefMedlineGoogle Scholar
    • 7. Despins LA Scott-Cawiezell J Rouder JN Detection of patient risk by nurses: a theoretical framework. J Adv Nurs2010;66:465-74. [PMID: 20423428] CrossrefMedlineGoogle Scholar
    • 8. Aiken LH Clarke SP Sloane DM Hospital staffing, organization, and quality of care: cross-national findings. Nurs Outlook2002;50:187-94. [PMID: 12386653] CrossrefMedlineGoogle Scholar
    • 9. Aiken LH Sochalski J Lake ET Studying outcomes of organizational change in health services. Med Care1997;35:NS6-18. [PMID: 9366875] CrossrefMedlineGoogle Scholar
    • 10. Whitlock EP Lin JS Chou R Shekelle P Robinson KA Using existing systematic reviews in complex systematic reviews. Ann Intern Med2008;148:776-82. [PMID: 18490690] LinkGoogle Scholar
    • 11. Aiken LH Sloane DM Cimiotti JP Clarke SP Flynn L Seago JA et alImplications of the California nurse staffing mandate for other states. Health Serv Res2010;45:904-21. [PMID: 20403061] CrossrefMedlineGoogle Scholar
    • 12. Twigg D Duffield C Bremner A Rapley P Finn J The impact of the nursing hours per patient day (NHPPD) staffing method on patient outcomes: a retrospective analysis of patient and staffing data. Int J Nurs Stud2011;48:540-8. [PMID: 20696429] CrossrefMedlineGoogle Scholar
    • 13. Needleman J Buerhaus P Pankratz VS Leibson CL Stevens SR Harris M Nurse staffing and inpatient hospital mortality. N Engl J Med2011;364:1037-45. [PMID: 21410372] CrossrefMedlineGoogle Scholar
    • 14. Harless DW Mark BA Nurse staffing and quality of care with direct measurement of inpatient staffing. Med Care2010;48:659-63. [PMID: 20548254] CrossrefMedlineGoogle Scholar
    • 15. Schilling PL Campbell DA Jr Englesbe MJ Davis MM A comparison of in-hospital mortality risk conferred by high hospital occupancy, differences in nurse staffing levels, weekend admission, and seasonal influenza. Med Care2010;48:224-32. [PMID: 20168260] CrossrefMedlineGoogle Scholar
    • 16. Burnes Bolton L Aydin CE Donaldson N Brown DS Sandhu M Fridman M et alMandated nurse staffing ratios in California: a comparison of staffing and nursing-sensitive outcomes pre- and postregulation. Policy Polit Nurs Pract2007;8:238-50. [PMID: 18337430] CrossrefMedlineGoogle Scholar
    • 17. Donaldson N Bolton LB Aydin C Brown D Elashoff JD Sandhu M Impact of California's licensed nurse-patient ratios on unit-level nurse staffing and patient outcomes. Policy Polit Nurs Pract2005;6:198-210. [PMID: 16443975] CrossrefMedlineGoogle Scholar
    • 18. Unruh LY Zhang NJ Nurse staffing and patient safety in hospitals: new variable and longitudinal approaches. Nurs Res2012;61:3-12. [PMID: 22166905] CrossrefMedlineGoogle Scholar
    • 19. Cook A Gaynor M Stephens M Jr Taylor L The effect of a hospital nurse staffing mandate on patient health outcomes: evidence from California's minimum staffing regulation. J Health Econ2012;31:340-8. [PMID: 22425767] CrossrefMedlineGoogle Scholar
    • 20. Duffield C Diers D O'Brien-Pallas L Aisbett C Roche M King M et alNursing staffing, nursing workload, the work environment and patient outcomes. Appl Nurs Res2011;24:244-55. [PMID: 20974086] CrossrefMedlineGoogle Scholar
    • 21. Van den Heede K Simoens S Diya L Lesaffre E Vleugels A Sermeus W Increasing nurse staffing levels in Belgian cardiac surgery centres: a cost-effective patient safety intervention? J Adv Nurs2010;66:1291-6. [PMID: 20546363] CrossrefMedlineGoogle Scholar
    • 22. Shamliyan TA Kane RL Mueller C Duval S Wilt TJ Cost savings associated with increased RN staffing in acute care hospitals: simulation exercise. Nurs Econ2009;27:302-14, 331. [PMID: 19927445] MedlineGoogle Scholar
    • 23. Fugulin FMT Lima AFC Castilho V Bochembuzio L Costa JA Castro L et alCost of nursing staffing adequacy in a neonatal unit. Revista da Escola de Enfermagem da Usp2011;45:1582-8. CrossrefMedlineGoogle Scholar
    • 24. Rothberg MB Abraham I Lindenauer PK Rose DN Improving nurse-to-patient staffing ratios as a cost-effective safety intervention. Med Care2005;43:785-91. [PMID: 16034292] CrossrefMedlineGoogle Scholar
    • 25. McGahan M Kucharski G Coyer F Winner ACCCN Best Nursing Review Paper 2011 sponsored by ElsevierNurse staffing levels and the incidence of mortality and morbidity in the adult intensive care unit: a literature review. Aust Crit Care2012;25:64-77. [PMID: 22515951] CrossrefMedlineGoogle Scholar
    • 26. Shea BJ Grimshaw JM Wells GA Boers M Andersson N Hamel C et alDevelopment of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol2007;7:10. [PMID: 17302989] CrossrefMedlineGoogle Scholar
    • 27. Kane RL Shamliyan TA Mueller C Duval S Wilt TJ The association of registered nurse staffing levels and patient outcomes: systematic review and meta-analysis. Med Care2007;45:1195-204. [PMID: 18007170] CrossrefMedlineGoogle Scholar
    • 28. Tourangeau AE Mortality rate as a nurse-sensitive outcome. In: Doran DM. Nursing Outcomes: The State of the Science. Sudbury, MA: Jones & Bartlett; 2011. Google Scholar
    • 29. Furukawa MF Raghu TS Shao BB Electronic medical records, nurse staffing, and nurse-sensitive patient outcomes: evidence from California hospitals, 1998-2007. Health Serv Res2010;45:941-62. [PMID: 20403065] CrossrefMedlineGoogle Scholar
    • 30. Griffiths P RN+RN=better care? What do we know about the association between the number of nurses and patient outcomes? [Editorial]. Int J Nurs Stud2009;46:1289-90. [PMID: 19647533] CrossrefMedlineGoogle Scholar
    • 31. Stone PW Pogorzelska M Kunches L Hirschhorn LR Hospital staffing and health care-associated infections: a systematic review of the literature. Clin Infect Dis2008;47:937-44. [PMID: 18767987] CrossrefMedlineGoogle Scholar
    • 32. Cummings GG MacGregor T Davey M Lee H Wong CA Lo E et alLeadership styles and outcome patterns for the nursing workforce and work environment: a systematic review. Int J Nurs Stud2010;47:363-85. [PMID: 19781702] CrossrefMedlineGoogle Scholar
    • 33. Butler M Collins R Drennan J Halligan P O'Mathúna DP Schultz TJ et alHospital nurse staffing models and patient and staff-related outcomes. Cochrane Database Syst Rev2011;:CD007019. [PMID: 21735407] MedlineGoogle Scholar
    • 34. Flynn M McKeown M Nurse staffing levels revisited: a consideration of key issues in nurse staffing levels and skill mix research. J Nurs Manag2009;17:759-66. [PMID: 19694919] CrossrefMedlineGoogle Scholar
    • 35. Cho SH Hwang JH Kim J Nurse staffing and patient mortality in intensive care units. Nurs Res2008;57:322-30. [PMID: 18794716] CrossrefMedlineGoogle Scholar
    • 36. Kiekkas P Sakellaropoulos GC Brokalaki H Manolis E Samios A Skartsani C et alAssociation between nursing workload and mortality of intensive care unit patients. J Nurs Scholarsh2008;40:385-90. [PMID: 19094155] CrossrefMedlineGoogle Scholar
    • 37. Hamilton KE Redshaw ME Tarnow-Mordi W Nurse staffing in relation to risk-adjusted mortality in neonatal care. Arch Dis Child Fetal Neonatal Ed2007;92:F99-F103. [PMID: 17088341] CrossrefMedlineGoogle Scholar
    • 38. Mark BA Harless DW Berman WF Nurse staffing and adverse events in hospitalized children. Policy Polit Nurs Pract2007;8:83-92. [PMID: 17652626] CrossrefMedlineGoogle Scholar
    • 39. Rafferty AM Clarke SP Coles J Ball J James P McKee M et alOutcomes of variation in hospital nurse staffing in English hospitals: cross-sectional analysis of survey data and discharge records. Int J Nurs Stud2007;44:175-82. [PMID: 17064706] CrossrefMedlineGoogle Scholar
    • 40. Stone PW Mooney-Kane C Larson EL Horan T Glance LG Zwanziger J et alNurse working conditions and patient safety outcomes. Med Care2007;45:571-8. [PMID: 17515785] CrossrefMedlineGoogle Scholar
    • 41. Estabrooks CA Midodzi WK Cummings GG Ricker KL Giovannetti P The impact of hospital nursing characteristics on 30-day mortality. Nurs Res2005;54:74-84. [PMID: 15778649] CrossrefMedlineGoogle Scholar
    • 42. Halm M Peterson M Kandels M Sabo J Blalock M Braden R et alHospital nurse staffing and patient mortality, emotional exhaustion, and job dissatisfaction. Clin Nurse Spec2005;19:241-51. [PMID: 16179855] CrossrefMedlineGoogle Scholar
    • 43. Aiken LH Clarke SP Cheung RB Sloane DM Silber JH Educational levels of hospital nurses and surgical patient mortality. JAMA2003;290:1617-23. [PMID: 14506121] CrossrefMedlineGoogle Scholar
    • 44. Sasichay-Akkadechanunt T Scalzi CC Jawad AF The relationship between nurse staffing and patient outcomes. J Nurs Adm2003;33:478-85. [PMID: 14501564] CrossrefMedlineGoogle Scholar
    • 45. Needleman J Buerhaus P Mattke S Stewart M Zelevinsky K Nurse-staffing levels and the quality of care in hospitals. N Engl J Med2002;346:1715-22. [PMID: 12037152] CrossrefMedlineGoogle Scholar
    • 46. Tarnow-Mordi WO Hau C Warden A Shearer AJ Hospital mortality in relation to staff workload: a 4-year study in an adult intensive-care unit. Lancet2000;356:185-9. [PMID: 10963195] CrossrefMedlineGoogle Scholar

    Comments