Low cardiac output syndrome is a transient constellation of signs and symptoms that indicate the heart’s inability to supply sufficient oxygen to tissues and end-organs to meet metabolic demand. Because the term lacks a standard clinical definition, the bedside diagnosis of this syndrome can be difficult.
To evaluate concordance among pediatric cardiac intensive care unit nurses in their identification of low cardiac output syndrome in pediatric patients after cardiac surgery.
An anonymous survey was distributed to 69 pediatric cardiac intensive care unit nurses. The survey described 10 randomly selected patients aged 6 months or younger who had undergone corrective or palliative cardiac surgery at a freestanding children’s hospital in a tertiary academic center. For each patient, data were presented corresponding to 5 time points (0, 6, 12, 18, and 24 hours postoperatively). The respondent was asked to indicate whether the patient had low cardiac output syndrome (yes or no) at each time point on the basis of the data presented.
The response rate was 46% (32 of 69 nurses). The overall Fleiss k value was 0.30, indicating fair agreement among raters. When the results were analyzed by years of experience, agreement remained only slight to fair.
Regardless of years of experience, nurses have difficulty agreeing on the presence of low cardiac output syndrome. Further research is needed to determine whether the development of objective guidelines could improve recognition and facilitate communication between the pediatric cardiac intensive care unit nurse and the medical team.
This article has been designated for CE contact hour(s). The evaluation tests your knowledge of the following objectives:
Review current literature and clinical diagnostic criteria for low cardiac output syndrome (LCOS) in pediatric patients
Analyze concordance of LCOS diagnosis among pediatric cardiac intensive care nurses at a tertiary referral pediatric center
Identify LCOS in pediatric patients after palliative or corrective cardiac surgery
To complete evaluation for CE contact hour(s) for test C1923, visit www.ccnonline.org and click the “CE Articles” button. No CE fee for AACN members. This test expires on April 1, 2022.
The American Association of Critical-Care Nurses is an accredited provider of continuing nursing education by the American Nurses Credentialing Center’s Commission on Accreditation. AACN has been approved as a provider of continuing education in nursing by the State Boards of Registered Nursing of California (#01036) and Louisiana (#LSBN12).
Low cardiac output syndrome (LCOS) is the leading cause of morbidity and mortality in pediatric patients after cardiac surgery.1,2 Wernovsky et al3 reported the presence of LCOS in as many as 25% of infants who had undergone an arterial switch operation, with the cardiac index lowest at 9 to 12 hours postoperatively. Early recognition of this common and severe complication of cardiac surgery is crucial. For up to 12 hours, bedside nurses play a vital role in recognizing the subtle symptoms of LCOS and reporting its insidious onset to the medical team. These nurses are in a position to witness minute-by-minute changes in the patient’s status, enabling early detection of LCOS, which may otherwise be missed.
Low cardiac output syndrome is a transient constellation of signs and symptoms indicating the inability of the heart to deliver sufficient oxygen to tissues and end organs to meet metabolic demand.4,5 Objective measurements commonly used as surrogates to establish the presence of LCOS include heart rate, blood pressure, central venous pressure, near-infrared spectroscopy (NIRS), urine output, and serum lactate level.4,5 Despite the abundance of clinical measurements, LCOS remains difficult to identify and characterize without more costly and invasive measures.4,6∓8 It is crucial that clinical measurements provoke a standardized and cohesive response by nurses, who then document the necessary data and report it to the medical team. The purpose of this study was to evaluate concordance among pediatric cardiac intensive care unit (PCICU) nurses in their identification of LCOS in pediatric patients after cardiac surgery.
LCOS is a transient constellation of signs and symptoms indicating the inability of the heart to deliver sufficient oxygen to tissues and end organs to meet metabolic demand.
Participants and Setting
The study protocol was approved by the university institutional review board. A survey on LCOS was created and distributed anonymously to all 69 PCICU nurses employed at a freestanding children’s hospital in a tertiary academic center with an independent 18-bed PCICU. The study data were collected and managed using research electronic data capture (REDCap).9 REDCap is a secure, web-based application designed to support data capture for research studies, providing (1) an intuitive interface for validated data entry, (2) audit trails for tracking data manipulation and export procedures, (3) automated export procedures for seamless data downloads to common statistical packages, and (4) procedures for importing data from external sources.
We accessed the Credentials Application Tracking System at our institution and collected data on the total years of experience of all 69 PCICU nurses to whom the survey was distributed. Level of experience was split into 4 categories: less than 2 years, 2 to 4.9 years, 5 to 9.9 years, and 10 years or more. All PCICU nurses received an email with a link to the REDCap survey and were given 12 days to complete the survey. They also received several emails (survey days 1, 7, 9, 10, 11, and 12) with reminders designed to maximize participation. Participants were first asked to indicate their level of nursing experience. The survey then presented 10 clinical scenarios. Each scenario involved a patient aged 6 months or less who had undergone corrective or palliative cardiac surgery at our institution between 2010 and 2016 (this period was chosen because of its stability in cardiothoracic surgical staffing). The cardiothoracic surgical database had been randomly queried for 10 patients who fit the aforementioned inclusion criteria. For each patient, a brief history and diagnoses were presented (Table 1). Then, clinical data for 5 time points (0, 6, 12, 18, and 24 hours postoperatively) for that patient were presented: vital signs (temperature, heart rate, respiratory rate, oxygen saturation, arterial blood pressure), arterial blood gas values, fraction of inspired oxygen, urine output, dorsalis pedis pulse strength (as documented by the bedside nurse), serum lactate level, and NIRS. All data were retrieved from our institution’s electronic health record. For each time point, the respondent was asked to indicate whether the patient had low cardiac output on the basis of the clinical data presented for that time (yes or no). A sample patient scenario with full clinical data is shown in Table 2.
In the absence of widely accepted criteria for LCOS, this study used criteria similar to those used by Hoffman et al10 in the PRIMACORP (Prophylactic Intravenous Use of Milrinone After Cardiac Operation in Pediatrics) study. In that study, the presence of metabolic acidosis was the sine qua non for the diagnosis of LCOS.10 The criteria used for LCOS in our study included the following clinical signs and symptoms: tachycardia (heart rate > 180/min), oliguria (urine output < 0.5 mL/kg per hour), weak peripheral pulses (a surrogate for poor peripheral perfusion), cardiac arrest, a difference of 30 points or more in arterial versus mixed venous oxygen saturation (with NIRS used as a surrogate for systemic venous saturation), and metabolic acidosis (indicated by an increased base deficit > 4 or a lactate level > 2 mg/dL).10–15 For a positive diagnosis of LCOS, the patient had to meet at least 1 of the 2 definitions of metabolic acidosis, plus 1 other criterion. Using these criteria, an “answer key” was developed indicating yes or no for whether the patient was experiencing LCOS at each time point.
Agreement among nurses was measured with Fleiss κ. Agreement for each nurse with the “answer key” was measured with Cohen κ. Two-way analysis of variance (ANOVA) was used to evaluate the impact of nursing experience and time points on the κ agreement. A κ value of 0.20 or less indicates slight agreement; 0.21 to 0.40, fair agreement; 0.41 to 0.60, moderate agreement; 0.61 to 0.80, good agreement; and 0.81 to 1.00, very good agreement.
The overall survey response rate was 46% (32 of 69 nurses). Nurses with less than 2 years of experience had the lowest response rate, 24% (6 of 25 nurses). Nurses with 2 to 4.9 years of experience had the highest response rate, 75% (12 of 16 nurses). Nurses with 5 to 9.9 years of experience had a response rate of 44% (8 of 18 nurses). Nurses with 10 or more years of experience had a response rate of 60% (6 of 10 nurses).
Agreement Among Nurses
The overall Fleiss κ value among nurses was 0.30 (95% CI, 0.29–0.31), indicating fair interrater agreement. Fair agreement existed across all experience categories (Table 3). Experience level had no effect on agreement among nurses, with 2-way ANOVA comparing agreement among nurses at the various experience levels showing no statistically significant differences (Table 4). Agreement among nurses by time point was also slight to fair for all hours except hour 18, when the κ value (0.44) indicated moderate agreement (Table 5). In the 2-way ANOVA comparing agreement among nurses at the various time points, a statistically significant difference was found only between 0 hours and 18 hours (P = .004; Table 4). The overall agreement among nurses returned to fair at the 24-hour time point (Table 5).
Nurse Agreement With “Answer Key”
Experience level had no effect on nurse agreement with the “answer key.” Assessment of respondent agreement with the “answer key” by level of experience showed slight to fair agreement (Table 3). In the 2-way ANOVA comparing nurse agreement with the “answer key” at the various experience levels, no statistically significant differences were found (Table 6). In assessment of respondent agreement with the “answer key” by time point, agreement was slight to fair except at hour 18 (Table 5), when the κ value (0.49) indicated moderate agreement. In the 2-way ANOVA comparing nurse agreement with the “answer key” for the various time points, a statistically significant difference was found only between 0 hours and 18 hours (P < .001; Table 6). At 24 hours, agreement returned to fair (Table 5).
Nurses act as a bridge between the patient and the medical team, relaying critical clinical information to other health care providers. Many different clinical measurements have been used in an attempt to determine the presence of LCOS. This variation is probably responsible for the significant differences in interpretation at the bedside. No single bedside measurement is available that definitively correlates with LCOS in the pediatric cardiac population. Therefore, nurses must sift through multiple data points and be able to recognize subtle symptoms that might indicate LCOS. In the absence of a standard definition or a validated scoring system, nurse-to-nurse interpretation may vary widely. Nurses are on the frontlines of caring for these critically ill patients, who can experience transient changes in cardiac output; however, literature on nursing bedside evaluation of LCOS is scarce. The results of our survey should bring attention to this void in the nursing literature and raise awareness of the need for further research and education in this area.
An LCOS scoring system might be the best method of increasing nursing bedside recognition of symptoms, facilitating communication with the medical team, and subsequently improving patient outcomes.
Although some studies have been conducted that systematically approached the definition of LCOS, they were led by physicians and did not take into account the unique perspective of the bedside nurse. Several scoring systems have been created that are designed to evaluate patients for the condition and predict poor outcomes in the postoperative period.16,17 Ulate et al17 developed an LCOS score that used specific criteria to identify LCOS; they found the score to be useful as a predictor of morbidity and resource use in their patient population. Such scoring systems may serve as useful bedside nursing tools facilitating awareness of the presence of LCOS and appropriate communication with the medical team. Not all of these scoring systems have been validated; therefore, additional study is needed before their wide-spread implementation.
At hour 18, we found a clinically relevant increase to moderate agreement among nurses, as well as an increase to moderate agreement with the “answer key.” At hour 24, however, agreement among nurses and with the “answer key” returned to only fair overall. These findings indicate that agreement among nurses as well as with the “answer key” is not related to time or level of experience. This unpredictability of agreement also emphasizes the need for nursing education on the signs and symptoms of LCOS (tachycardia, oliguria, peripheral perfusion, increasing difference in arterial versus mixed venous oxygen saturation, and metabolic acidosis).
This was a prospective, observational, one-time survey conducted at a single center. The survey involved a small number of participants, particularly in the highest experience category. Because participation was voluntary, a potential sampling bias exists, making it difficult to generalize the results to other intensive care unit nurses. Invasive measures to objectively determine the presence of LCOS were not available. Also, the challenge of determining the clinical status of a patient without an in-person bedside examination—given limited clinical information, laboratory test results, and vital signs— coupled with the absence of a diagnostic gold standard for LCOS constitutes a major limitation of our study. Future research might include expanding the study to other institutions via the Pediatric Cardiac Intensive Care Society network of nurses and physicians to determine whether the results are generalizable.
Our study shows that, regardless of level of experience, nurses have difficulty agreeing among themselves as well as with an “answer key” in the determination of LCOS. This lack of concordance leaves less experienced nurses, who often rely on the leadership of their more experienced counterparts, without clear guidance. Given that pediatric cardiac critical care is a highly specialized, high-risk patient care environment, implementation of an LCOS scoring system might be the best method of increasing nursing bedside recognition of symptoms, facilitating communication with the medical team, and subsequently improving patient outcomes.
To purchase electronic or print reprints, contact the American Association of Critical-Care Nurses, 101 Columbia, Aliso Viejo, CA 92656. Phone, (800) 899-1712 or (949) 362-2050 (ext 532); fax, (949) 362-2049; email, firstname.lastname@example.org.
Now that you’ve read the article, create or contribute to an online discussion about this topic using eLetters. Just visit www.ccnonline.org and select the article you want to comment on. In the full-text or PDF view of the article, click “Responses” in the middle column and then “Submit a response.”
To learn more about pediatric critical care, read “Long-Term Effects of Saline Instilled During Endotracheal Suction in Pediatric Intensive Care” by McKinley et al in the American Journal of Critical Care, November 2018;27:486-494. Available at www.ajcconline.org.