Background

Detecting delirium with standardized assessment tools such as the Confusion Assessment Method for the Intensive Care Unit (CAM-ICU) is important, but such detection is frequently hampered by poor documentation and inappropriate “unable to assess” responses (in noncomatose patients).

Objective

To identify patient, clinical, and workplace factors that may impede or facilitate appropriate delirium assessment through use of the CAM-ICU, specifically documentation and inappropriate “unable to assess” responses.

Methods

An electronic health record–based data set was used to quantify CAM-ICU documentation and inappropriate “unable to assess” responses during 24 months. Associated patient (eg, age), clinical (eg, diagnosis), and workplace (eg, geographic location within the ICU, shift) factors were evaluated with multivariable regression.

Results

Of 28 586 CAM-ICU documentation opportunities, 66% were documented; 16% of documentations in alert or lightly sedated patients had inappropriate “unable to assess” responses. Night shift was associated with lower CAM-ICU documentation rates (P = .001), whereas physical restraints and location on side B (rather than side A) of the ICU were associated with higher documentation rates (P < .05 for both). Age older than 80 years, non-White race, intubation, and physical restraints were associated with more inappropriate “unable to assess” responses (all P < .05), as was infusion of propofol, midazolam, dexmedetomidine, or fentanyl (all P < .05).

Conclusion

Data from electronic health records can identify patient, clinical, and workplace factors associated with CAM-ICU documentation and inappropriate “unable to assess” responses, which can help target quality improvement efforts related to delirium assessment.

Delirium, an acute fluctuating alteration in mental status characterized by inattention and disorganized thinking, is prevalent during critical illness; it affects up to 80% of patients in intensive care units (ICUs).1  Studies have demonstrated that delirium in the ICU is independently associated with numerous adverse short-and long-term outcomes, including prolonged ICU and hospital lengths of stay and disabling cognitive, physical, and mental health impairments.26  As a consequence, delirium is estimated to cost the US health care system up to $150 billion per year.5  Although prevalent, delirium is potentially modifiable, with risk factors such as oversedation and immobility representing key targets for preventive efforts.

Despite interest in delirium in the ICU, up to 72% of episodes go unrecognized by health care professionals, possibly because most do not involve consistent hyperactivity that is easily identifiable at the bedside, but rather involve hypoactivity with intermittent short bouts of hyperactivity (the mixed sub-type).710  Fortunately, easy-to-use bedside tools such as the Confusion Assessment Method for the Intensive Care Unit (CAM-ICU)11  and the Intensive Care Delirium Screening Checklist12  have been validated to aid in the detection of delirium in critically ill patients. These tools are fundamental for delirium management, and recent clinical practice guidelines strongly recommend their use on a daily basis.13 

Despite established guidelines and widespread efforts to prevent delirium in the ICU, completion of delirium assessments is highly variable, with reported rates as low as 38% in usual care settings.

Despite established guidelines and widespread efforts to prevent delirium in the ICU, completion of delirium assessments by ICU staff (usually bedside nurses) is highly variable, with reported rates as low as 38% in usual care settings and as high as 84% to 95% following rigorous intervention efforts.1417  Even when documented, CAM-ICU responses can be scored incorrectly, particularly in patients with hypoactive delirium, those with neurological or neurosurgical diagnoses, and those hospitalized in ICUs that lack an established delirium detection and prevention infrastructure.8  Specifically, inappropriate “unable to assess” (IUTA) responses, defined as an “unable to assess” response despite a patient being noncomatose (ie, alert or lightly sedated), are particularly common, accounting for 19% to 30% of documented CAM-ICU scores.18,19 

Prior studies have evaluated barriers to delirium assessment, focusing on staff-related barriers such as lack of education and perceived difficulty of use of validated delirium assessment tools; however, patient-related factors such as age, primary language, and receipt of sedative infusions may also be significant barriers that have been difficult to evaluate through staff surveys.2022  To evaluate these issues further, we analyzed patient, clinical, and workplace factors associated with CAM-ICU documentation and IUTA responses using an electronic health record (EHR)–based data set.

Study Design and Data Source

As part of a delirium quality improvement project in our academic medical ICU (MICU), we teamed with the Office of Health Informatics and Analytics at the University of California, Los Angeles, to design an EHR-derived data set comprising various patient (eg, age, primary language), clinical (diagnosis, sedation, physical restraints), and workplace (eg, shift, location within the ICU) variables that could potentially inform and improve practices surrounding delirium. Our delirium data set included every patient present at 12 AM in any of the 24 beds in the closed MICU. In this MICU, nursing staff began CAM-ICU documentation on March 1, 2013, the day a new EHR system was introduced containing a CAM-ICU documentation flowsheet. After nurses received appropriate training, their monthly CAM-ICU documentation rates rose quickly, plateauing by late 2014. Hence, for this analysis we chose the 24-month period spanning January 1, 2015, to December 31, 2016, during which CAM-ICU documentation rates remained consistent at 65% to 70%.

The 24-bed MICU involved in this analysis has a nurse-to-patient ratio of 1:2, with nurses on the day shift working 7 AM to 7 PM and nurses on the night shift working 7 PM to 7 AM. Notably, during the time frame of this analysis, individual nurses tended to work in 1 of 2 connected V-shaped halves of the ICU—side A, containing beds 1 through 12, or side B, containing beds 13 through 24; patients were randomly assigned to the first available bed and cared for by 1 of 2 separate ICU teams. As our hospital also has separate neurological, surgical/trauma, cardiothoracic, and liver ICUs, our MICU population consisted primarily of medically complex nonneurological, nonsurgical patients with respiratory failure, shock, or both.

CAM-ICU Assessments

Nursing staff assessed delirium twice daily (once per shift, usually at 8 AM and 8 PM) using the CAM-ICU. In our MICU, this assessment was performed in English and involved bedside performance of the 4 features of the CAM-ICU; this assessment includes a level-of-consciousness evaluation (feature 3) using a modified Riker Sedation-Agitation Scale (SAS), with scores of −3 to 3 replacing the traditional 1 to 7 ordinal scale.23  The Supplemental Table compares the traditional and modified Riker SAS. On the basis of this modified scale, patients with scores of −1 or higher (paralleling a traditional Riker SAS score ≥3) were deemed “noncomatose” and were subsequently evaluated for delirium with the CAM-ICU. Although the Richmond Agitation-Sedation Scale24  is often used to evaluate the level-of-consciousness component of the CAM-ICU, the Riker SAS has been shown to be comparable to the Richmond Agitation- Sedation Scale for assessing delirium and, with the Richmond Agitation-Sedation Scale, is recommended in clinical practice guidelines for monitoring the quality and depth of sedation.25,26 

Supplemental Table

Comparison of the traditional and modified versions of the Riker Sedation-Agitation Scale

Comparison of the traditional and modified versions of the Riker Sedation-Agitation Scale
Comparison of the traditional and modified versions of the Riker Sedation-Agitation Scale

Outcomes

Our primary outcome was CAM-ICU documentation (ie, a “positive,” “negative,” or “unable to assess” response). Among documented CAM-ICU assessments, we also evaluated the proportion of IUTA responses, defined as an “unable to assess” response despite a modified Riker SAS score of −1 or higher (when the patient was alert or sedated, ie, not comatose). Specifically, we calculated this proportion by dividing the total number of IUTA responses by the number of documented CAM-ICU assessments in noncomatose patients (ie, should be able to assess with a CAM-ICU score of “positive” or “negative”). Hence the denominator used to calculate the proportion of IUTA responses excluded “unable to assess” responses in comatose (modified Riker SAS score of −2 or −3) patients whose “unable to assess” scores were appropriate.

On the basis of our clinical experience and prior research, we selected patient- and ICU-level factors that could influence CAM-ICU nondocumentation and IUTA responses. We analyzed factors that possibly influence nursing practices, such as shift (weekend vs weekday, night vs day) and geographic location of the patient in the ICU (side A vs side B); we also included month of the year (July vs all other months) as a factor to evaluate whether the presence of new residents influenced CAM-ICU performance. We analyzed demographic factors including patient age, race, and primary language (the CAM-ICU was conducted only in English at our institution). Clinical characteristics included diagnosis category at admission, intubation status, presence of physical restraints, and use of sedative infusions.

After appropriate training, CAM-ICU documentation rates rose quickly but plateaued at 65% to 70%.

Statistical Analysis

We used descriptive statistics to report CAM-ICU documentation rates and patient and ICU characteristics. Using multivariable logistic regression, we evaluated the adjusted odds ratio (OR) of patient (eg, age category, primary language), clinical (admission diagnosis type, sedation), and workplace (eg, shift, geographic side of the ICU) factors with CAM-ICU documentation (primary outcome) and IUTA responses (secondary outcome). In all models, we used gener-alized estimating equations to account for repeated time-varying measures (eg, CAM-ICU assessments). For patients who were admitted multiple times during the data collection period, we confined our analysis to each patient’s first admission. We used variance inflation factors to evaluate for multicollinearity and detected none. We analyzed data using Stata 15.1 software (StataCorp).

Within the context of ongoing quality improvement efforts in our MICU, our institutional review board deemed this project to be a quality improvement project and thus exempt from full review.

Patient Characteristics

The data set included 1942 patients. The patients’ demographic characteristics are shown in Table 1; most were White, male, and spoke English as their primary language. Clinical factors are also described in Table 1, including diagnosis at admission, need for intubation and physical restraints, receipt of sedative infusions, and length of stay. Only 22% of patients screened positive for delirium during their ICU stay.

Table 1

Demographic and clinical variables for 1942 patients

Demographic and clinical variables for 1942 patients
Demographic and clinical variables for 1942 patients

CAM-ICU Documentation

During the 24-month analysis, there were 28 586 CAM-ICU documentation opportunities. Overall, 66% (n = 18 779) of these opportunities were indeed documented (monthly range, 64%-69%); documentation did not differ substantially on the basis of reported sedation-agitation score (ie, alert, sedated, or comatose).

In the multivariable model (Table 2), CAM-ICU documentation was higher during the day shift (vs night shift, P = .001) and for patients requiring physical restraints (P = .001), those from side B of the ICU (P = .001), and those receiving an infusion of dexmedetomidine (P = .001). We found no significant differences in documentation rate based on patient age, sex, race, ethnicity, or primary language (Table 2).

Table 2

Multivariable analysis of factors associated with documented CAM-ICU assessments and inappropriate “unable to assess” responses

Multivariable analysis of factors associated with documented CAM-ICU assessments and inappropriate “unable to assess” responses
Multivariable analysis of factors associated with documented CAM-ICU assessments and inappropriate “unable to assess” responses

IUTA Responses on the CAM-ICU

Of 18 779 documented CAM-ICU assessments, 3776 (20%) were done in patients without a Riker SAS score or who were comatose and thus were excluded from analysis. Of the remaining 15 003 CAM-ICU assessments in alert or lightly sedated patients, 2368 (16%) were documented as “unable to assess” and therefore deemed as an IUTA response. Notably, when patients were intubated or receiving propofol, midazolam, or fentanyl infusions, more than 50% of all documented CAM-ICU assessments fell into the IUTA category.

In the multivariable model (Table 2), factors associated with an IUTA response included age older than 80 years (P = .001), non-White race (P = .005), intubation (P < .001), use of physical restraints (P < .001), the infusion of any sedative (P < .05), sepsis (P < .001), and weekday (P = .04).

Prior studies involving focus groups or surveys of delirium stakeholders (ie, physicians, nurses, and pharmacists) identified common barriers to the detection of delirium in the ICU; these barriers included the time required to perform an assessment, intubation, and a lack of nurse education.15,2729  Although those staff believed that delirium was a problem, they expressed concern that delirium detection efforts were undermined by providers (eg, physicians) who did not prioritize delirium and a general lack of effective treatments.17,30,31  Although informative, these survey-based studies were vulnerable to recall and selection bias, along with the Hawthorne effect.20,21 

As a novel approach, we applied a multivariable regression model using a large EHR-based data set, which we compiled using data from 28 586 CAM-ICU opportunities across 1942 patients in a MICU. We aimed to understand the patient, clinical, and workplace factors associated with completion of delirium assessments (ie, CAM-ICU documentation) and with IUTA responses. Nearly 2 years after implementation of the CAM-ICU, we observed that only two-thirds of CAM-ICU assessments were documented. Only 22% of our patients ever tested positive for delirium—far lower than the 47% to 80% prevalence reported in other MICU populations—suggesting that delirium may have gone undetected in many cases.1,3234  Consistent with the published literature, intubation and sedative infusions posed significant barriers to completely or accurately assessing delirium. As a novel finding, older age, non-White race, night shift, and the patient’s geographic location in the ICU also were associated with incomplete or inaccurate CAM-ICU assessments.

Patient’s age >80 years, non-White race, intubation, and use of physical restraints were associated with more inappropriate “unable to assess” responses.

Our primary finding was an overall CAM-ICU documentation rate of 66%. This rate is consistent with those from prior ICU studies, which demonstrated 40% to 60% completion rates preceding a dedicated delirium intervention and 65% to 90% afterward.1517  We also found an overall rate of IUTA responses (“unable to assess” CAM-ICU scores in alert or mildly sedated patients) of 17%; this value is comparable to those from 2 prior studies reporting IUTA rates (19% and 24%).18,19  Notably, one of those studies reported an IUTA rate as a proportion of only “unable to assess” responses; had all evaluations of noncomatose patients been used as a denominator, the IUTA rate would have been 9% rather than 24%.19 

To our knowledge, this study is the first to describe both geographic and shift-based imbalances in delirium assessment within a single unit. Previous studies involving handwashing demonstrated interunit variation within the same hospital, most likely due to a combination of staff and leadership issues.35,36  The lower CAM-ICU documentation rates, however, along with likely higher IUTA rates for the same geographic ICU area and lower CAM-ICU documentation rates for specific shifts, suggest that clusters of staff may have lacked motivation or knowledge regarding delirium assessment. The main difference between geographic locations and shifts is the staff performing delirium assessments (as opposed to physicians and leaders), suggesting strongly that practice variations may be due to differences in age, seniority (ie, years of ICU experience), certifications, and/or collegial relationships, factors that may influence collective interest and engagement in evidence-based practices.20  Because all staff received the same delirium-related training, future studies can evaluate staff demographics, attitudes, and beliefs to determine causes of practice variability.

Consistent with prior studies suggesting mechanical ventilation as the single largest factor influencing IUTA responses, our EHR-based analysis demonstrated a significant association between intubation and CAM-ICU accuracy.28,29  That association was unexpected, however, because intubated patients had CAM-ICU documentation rates no worse than the rates in patients who were not intubated, but they were more likely to have IUTA responses.

Similar to results in intubated patients, we expected to observe lower CAM-ICU completion and higher IUTA rates in patients receiving a sedative infusion, a well-known barrier to CAM-ICU assessment completion.28  Dexmedetomidine was the only infusion associated with higher rates of CAM-ICU documentation, whereas midazolam, propofol, and fentanyl had no association. Our findings suggest that dexmedetomidine might facilitate delirium assessment, whereas sedatives such as fentanyl might have the opposite effect. Whether and how specific sedative infusions affect nurses’ ability to evaluate delirium requires further investigation.

Finally, we found that older age (>80 years old) and non-White race were associated with higher rates of IUTA responses. Although IUTA and age have not, to our knowledge, been studied previously, studies of patients outside an ICU have suggested difficulties detecting delirium in older patients because of sensory impairments and dementia.37,38  More IUTA responses for non-White patients is a unique finding, as prior research did not highlight race as a factor influencing the documentation of delirium.3840  The influence of patient race and primary language pose an intriguing area of investigation, and for ICUs with diverse populations such as ours, these factors represent important areas for dramatic improvements in detecting delirium in the ICU.

Although the results of our analysis highlight novel targets for improving delirium assessment, the method we used is broadly applicable. Qualitative methods (ie, surveys and focus groups) are valuable, but they are limited by bias and the inability to quantify the extent of reported problems. As our EHR-based technique pinpointed otherwise unrecognized performance factors (ie, staff on one side of the ICU documenting more than staff on the other side), we believe that such a data-driven technique could be used to inform subsequent qualitative evaluations as a method to streamline institutional efforts to improve care.

Strengths and Limitations

Strengths of our study include use of a large EHR-based data set and a multivariable model to evaluate factors previously described using qualitative methods. To our knowledge, it includes more patients and a longer observational period than any prior study. Because it was retrospective, there was no risk of a Hawthorne effect. As a result, we were able to highlight targeted areas of improvement to help develop and inform ongoing efforts to detect delirium.

Despite these strengths, our analysis has some limitations. First, given the large data set, the analysis was vulnerable to unmeasured confounding and missing or inaccurate data. Our data set did, however, have minimal missing data; items such as sedation scores were more than 90% complete. Second, we did not access nursing notes, which could have provided specific reasons for CAM-ICU nondocumentation or an IUTA response, such as patient refusal or neurological impairment. Implementation of this field in an EHR may provide a significantly improved understanding of barriers to delirium assessment. Compared with interviews and surveys, through which one can try to assess health care professionals’ intentions or feelings, EHRs do not allow such reasoning to be easily understood. Furthermore, because our data were limited to those in EHRs, we did not have access to nursing demographic data (years of experience, certifications, etc); inclusion of such data is a consideration for future quality improvement work. Last, because we obtained our data from a medically complex nonneurological and nonsurgical patient population in a single academic MICU, our findings may not be generalizable to populations in other ICUs, particularly those with mixed patient populations. Future analyses could involve multiple centers, acknowledging the challenge of harmonizing queries from EHR systems that have been customized to the specific needs of each ICU and health system.

We used a large EHR-derived data set to evaluate patient, clinical, and workplace factors affecting CAM-ICU documentation and IUTA responses. Only two-thirds of CAM-ICU opportunities had been documented; of those, one-sixth had an IUTA response. Unsurprisingly, intubation and sedative infusions posed barriers to documentation, whereas novel factors such as geographic side of the ICU, night shift, older patient age, and non-White patient race were identified as specific targets for delirium improvement efforts. Our EHR-based approach provides an automated, objective, and generalizable method for evaluating barriers to and facilitators of delirium detection on a large scale, the results of which can subsequently be used to jumpstart and inform improvement efforts. Because of the limitations of EHR-abstracted data in allowing an understanding of nurses’ knowledge and intent, which are often better assessed with surveys and interviews, this analytic process provides a complementary tool to improve delirium assessment in an ICU.

The authors thank the University of California, Los Angeles, Office of Health Informatics and Analytics for facilitating the data query used for this analysis. They also thank Atul Malhotra, MD, for providing helpful comments on the manuscript.

1
Ely
EW
,
Shintani
A
,
Truman
B
, et al
.
Delirium as a predictor of mortality in mechanically ventilated patients in the intensive care unit
.
JAMA
.
2004
;
291
(
14
):
1753
1762
.
2
Pisani
MA
,
Kong
SYJ
,
Kasl
SV
,
Murphy
TE
,
Araujo
KLB
,
Van Ness
PH
.
Days of delirium are associated with 1-year mortality in an older intensive care unit population
.
Am J Respir Crit Care Med
.
2009
;
180
(
11
):
1092
1097
.
3
Maldonado
JR
.
Acute brain failure: pathophysiology, diagnosis, management, and sequelae of delirium
.
Crit Care Clin
.
2017
;
33
(
3
):
461
519
.
4
Vasilevskis
EE
,
Chandrasekhar
R
,
Holtze
CH
, et al
.
The cost of ICU delirium and coma in the intensive care unit patient
.
Med Care
.
2018
;
56
(
10
):
890
897
.
5
Leslie
DL
,
Marcantonio
ER
,
Zhang
Y
,
Leo-Summers
L
,
Inouye
SK
.
One-year health care costs associated with delirium in the elderly population
.
Arch Intern Med
.
2008
;
168
(
1
):
27
32
.
6
Luetz
A
,
Weiss
B
,
Boettcher
S
,
Burmeister
J
,
Wernecke
K-D
,
Spies
C
.
Routine delirium monitoring is independently associated with a reduction of hospital mortality in critically ill surgical patients: a prospective, observational cohort study
.
J Crit Care
.
2016
Oct
;
35
:
168
173
.
7
Spronk
PE
,
Riekerk
B
,
Hofhuis
J
,
Rommes
JH
.
Occurrence of delirium is severely underestimated in the ICU during daily care
.
Intensive Care Med
.
2009
;
35
(
7
):
1276
1280
.
8
van Eijk
MM
,
van den Boogaard
M
,
van Marum
RJ
, et al
.
Routine use of the Confusion Assessment Method for the Intensive Care Unit: a multicenter study
.
Am J Respir Crit Care Med
.
2011
;
184
(
3
):
340
344
.
9
van Eijk
MMJ
,
van Marum
RJ
,
Klijn
IAM
,
de Wit
N
,
Kesecioglu
J
,
Slooter
AJC
.
Comparison of delirium assessment tools in a mixed intensive care unit
.
Crit Care Med
.
2009
;
37
(
6
):
1881
1885
.
10
Krewulak
KD
,
Stelfox
HT
,
Leigh
JP
,
Ely
EW
,
Fiest
KM
.
Incidence and prevalence of delirium subtypes in an adult ICU
.
Crit Care Med
.
2018
;
46
(
12
):
2029
2035
.
11
Ely
EW
,
Inouye
SK
,
Bernard
GR
, et al
.
Delirium in mechanically ventilated patients: validity and reliability of the Confusion Assessment Method for the Intensive Care Unit (CAM-ICU)
.
JAMA
.
2001
;
286
(
21
):
2703
2710
.
12
Devlin
JW
,
Fong
JJ
,
Schumaker
G
,
O’Connor
H
,
Ruthazer
R
,
Garpestad
E
.
Use of a validated delirium assessment tool improves the ability of physicians to identify delirium in medical intensive care unit patients
.
Crit Care Med
.
2007
;
35
(
12
):
2721
2724
.
13
Devlin
JW
,
Skrobik
Y
,
Gélinas
C
, et al
.
Clinical practice guidelines for the prevention and management of pain, agitation/sedation, delirium, immobility, and sleep disruption in adult patients in the ICU
.
Crit Care Med
.
2018
;
46
(
9
):
e825
e873
. doi:
14
Riekerk
B
,
Pen
EJ
,
Hofhuis
JGM
,
Rommes
JH
,
Schultz
MJ
,
Spronk
PE
.
Limitations and practicalities of CAM-ICU implementation, a delirium scoring system, in a Dutch intensive care unit
.
Intensive Crit Care Nurs
.
2009
;
25
(
5
):
242
249
.
15
Pun
BT
,
Gordon
SM
,
Peterson
JF
, et al
.
Large-scale implementation of sedation and delirium monitoring in the intensive care unit: a report from two medical centers
.
Crit Care Med
.
2005
;
33
(
6
):
1199
1205
.
16
Soja
SL
,
Pandharipande
PP
,
Fleming
SB
, et al
.
Implementation, reliability testing, and compliance monitoring of the Confusion Assessment Method for the Intensive Care Unit in trauma patients
.
Intensive Care Med
.
2008
;
34
(
7
):
1263
1268
.
17
Hickin
SL
,
White
S
,
Knopp-Sihota
J
.
Nurses’ knowledge and perception of delirium screening and assessment in the intensive care unit: long-term effectiveness of an education-based knowledge translation intervention
.
Intensive Crit Care Nurs
.
2017
Aug
;
41
:
43
49
.
18
Swan
JT
.
Decreasing inappropriate unable-to-assess ratings for the Confusion Assessment Method for the Intensive Care Unit
.
Am J Crit Care
.
2014
;
23
(
1
):
60
69
.
19
Terry
KJ
,
Anger
KE
,
Szumita
PM
.
Prospective evaluation of inappropriate unable-to-assess CAM-ICU documentations of critically ill adult patients
.
J Intensive Care
.
2015
Nov
;
3
:
52
.
20
Oosterhouse
KJ
,
Vincent
C
,
Foreman
MD
,
Gruss
VA
,
Corte
C
,
Berger
B
.
Intensive care unit nurses’ beliefs about delirium assessment and management
.
AACN Adv Crit Care
.
2016
;
27
(
4
):
379
393
.
21
Oxenbøll-Collet
M
,
Egerod
I
,
Christensen
V
,
Jensen
J
,
Thomsen
T
.
Nurses’ and physicians’ perceptions of Confusion Assessment Method for the Intensive Care Unit for delirium detection: focus group study
.
Nurs Crit Care
.
2018
;
23
(
1
):
16
22
.
22
Elliott
SR
.
ICU delirium: a survey into nursing and medical staff knowledge of current practices and perceived barriers towards ICU delirium in the intensive care unit
.
Intensive Crit Care Nurs
.
2014
;
30
(
6
):
333
338
.
23
Riker
RR
,
Picard
JT
,
Fraser
GL
.
Prospective evaluation of the Sedation-Agitation Scale for adult critically ill patients
.
Crit Care Med
.
1999
;
27
(
7
):
1325
1329
.
24
Ely
EW
,
Truman
B
,
Shintani
A
, et al
.
Monitoring sedation status over time in ICU patients: reliability and validity of the Richmond Sedation-Agitation Scale (RASS)
.
JAMA
.
2003
;
289
(
22
):
2983
2991
.
25
Khan
BA
,
Guzman
O
,
Campbell
NL
, et al
.
Comparison and agreement between the Richmond Agitation-Sedation Scale and the Riker Sedation-Agitation Scale in evaluating patients’ eligibility for delirium assessment in the ICU
.
Chest
.
2012
;
142
(
1
):
48
54
.
26
Barr
J
,
Fraser
GL
,
Puntillo
K
, et al;
American College of Critical Care Medicine
.
Clinical practice guidelines for the management of pain, agitation, and delirium in adult patients in the intensive care unit
.
Crit Care Med
.
2013
;
41
(
1
):
263
306
.
27
van den Boogaard
M
,
Pickkers
P
,
van der Hoeven
H
,
Roodbol
G
,
van Achterberg
T
,
Schoonhoven
L
.
Implementation of a delirium assessment tool in the ICU can influence haloperidol use
.
Crit Care
.
2009
;
13
(
4
):
R131
.
28
Scott
P
,
McIlveney
F
,
Mallice
M
.
Implementation of a validated delirium assessment tool in critically ill adults
.
Intensive Crit Care Nurs
.
2013
;
29
(
2
):
96
102
.
29
Devlin
JW
,
Fong
JJ
,
Howard
EP
, et al
.
Assessment of delirium in the intensive care unit: nursing practices and perceptions
.
Am J Crit Care
.
2008
;
17
(
6
):
555
565
;
quiz 566
.
30
Zamoscik
K
,
Godbold
R
,
Freeman
P
.
Intensive care nurses’ experiences and perceptions of delirium and delirium care
.
Intensive Crit Care Nurs
.
2017
Jun
;
40
:
94
100
.
31
Law
TJ
,
Leistikow
NA
,
Hoofring
L
,
Krumm
SK
,
Neufeld
KJ
,
Needham
DM
.
A survey of nurses’ perceptions of the intensive care delirium screening checklist
.
Dynamics
.
2012
;
23
(
4
):
18
24
.
32
Micek
ST
,
Anand
NJ
,
Laible
BR
,
Shannon
WD
,
Kollef
MH
.
Delirium as detected by the CAM-ICU predicts restraint use among mechanically ventilated medical patients
.
Crit Care Med
.
2005
;
33
(
6
):
1260
1265
.
33
Thomason
JWW
,
Shintani
A
,
Peterson
JF
,
Pun
BT
,
Jackson
JC
,
Ely
EW
.
Intensive care unit delirium is an independent predictor of longer hospital stay: a prospective analysis of 261 non-ventilated patients
.
Crit Care
.
2005
;
9
(
4
):
R375
R381
.
34
Kamdar
BB
,
King
LM
,
Collop
NA
, et al
.
The effect of a quality improvement intervention on perceived sleep quality and cognition in a medical ICU
.
Crit Care Med
.
2013
;
41
(
3
):
800
809
.
35
White
CM
,
Statile
AM
,
Conway
PH
, et al
.
Utilizing improvement science methods to improve physician compliance with proper hand hygiene
.
Pediatrics
.
2012
;
129
(
4
):
e1042
e1050
.
36
Saint
S
,
Bartoloni
A
,
Virgili
G
, et al
.
Marked variability in adherence to hand hygiene: a 5-unit observational study in Tuscany
.
Am J Infect Control
.
2009
;
37
(
4
):
306
310
.
37
Rice
KL
,
Bennett
M
,
Gomez
M
,
Theall
KP
,
Knight
M
,
Foreman
MD
.
Nurses’ recognition of delirium in the hospitalized older adult
.
Clin Nurse Spec
.
2011
;
25
(
6
):
299
311
.
38
Inouye
SK
,
Foreman
MD
,
Mion
LC
,
Katz
KH
,
Cooney
LM
Jr
.
Nurses’ recognition of delirium and its symptoms: comparison of nurse and researcher ratings
.
Arch Intern Med
.
2001
;
161
(
20
):
2467
2473
.
39
Khan
BA
,
Perkins
A
,
Hui
SL
, et al
.
Relationship between African-American race and delirium in the ICU
.
Crit Care Med
.
2016
;
44
(
9
):
1727
1734
.
40
Collins
N
,
Blanchard
MR
,
Tookman
A
,
Sampson
EL
.
Detection of delirium in the acute hospital
.
Age Ageing
.
2010
;
39
(
1
):
131
135
.

Footnotes

FINANCIAL DISCLOSURES

This work was performed at the University of California, Los Angeles (UCLA). During this project, Dr Kamdar was supported by a grant through the UCLA Clinical Translational Science Institute (CTSI) and the National Institutes of Health (NIH)/National Center for Advancing Translational Sciences (UL1TR000124). He is currently supported by a Paul B. Beeson Career Development Award through the National Institute on Aging, NIH (K76AG059936). Dr Buhr has received support from the National Center for Advancing Translational Sciences, NIH (TL1 TR001883-01).

 

SEE ALSO

For more about delirium assessment, visit the Critical Care Nurse website, www.ccnonline.org, and read the article by Yuhas et al, “Delirium Detection and Treatment in the Intensive Care Unit” (August 2021).

 

To purchase electronic or print reprints, contact American Association of Critical-Care Nurses, 27071 Aliso Creek Road, Aliso Viejo, CA 92656. Phone, (800) 899-1712 or (949) 362-2050 (ext 532); fax, (949) 362-2049; email, [email protected].