Jennifer G. Chester

Vital signs constitute a fundamental component of the physical examination and serve key diagnostic and monitoring purposes. The brain is as vital to life as the cardiovascular, respiratory, and immune/thermoregulatory systems, yet currently no vital sign exists that would allow rapid, reliable, and easily reproducible assessment of cognition.1 As a result, acute mental status changes frequently go undetected and untreated.24 Delirium is defined as an acute change in attention with fluctuations in cognition, thought, and/or consciousness throughout the course of the day.5 Because delirium in older patients is common and is associated with increased morbidity, mortality, functional decline, and costs,69 development and validation of a rapid, objective screening assessment could be used by nursing staff to identify patients at high risk for delirium.

Current recommendations for inpatient delirium monitoring usually involve daily cognitive screening with a standardized screening instrument.6 Because this process is often time‐consuming (8‐12 minutes), most patients do not undergo routine screening. To facilitate clinical implementation, we focused on developing a brief (<30‐second) inpatient screening measure of a feature of mental status that could be administered serially. The purpose of this study was to (1) develop a brief screening tool for a core feature of mental status and (2) validate this screening tool for delirium in an older inpatient population.

METHODS

Consensus Panel

In June 2009, the Veterans Administration sponsored an interdisciplinary conference that solicited input on identifying the most targetable components of delirium and discussing potential clinical instruments. Following this, a consensus panel of 8 representatives from medicine, geriatrics, nursing, psychiatry, and psychology used a modified Delphi method to target characteristic features of delirium and identify instruments that could best capture mental status change. While inattention was agreed upon as the core cognitive feature of delirium, the group came to consensus that capturing the acute onset and fluctuating nature of delirium was better suited as a vital sign. To meet these criteria, the group modified the Richmond Agitation Sedation Scale (RASS).10

The RASS is an observational instrument that has been validated in the intesive care unit setting for objectively determining level of sedation. It has been shown to be highly reliable and associated with delirium.11 The RASS is a quick, objective scale of consciousness with a scoring system that captures both hyperactive and hypoactive levels of consciousness. A disadvantage of using the RASS includes its limited attention assessment. The Consensus panel modified the RASS to improve its assessment of attention, using a brief open‐ended question that was asked before scoring (Figure 1).

Figure 1

RESULTS

Characteristics of the study population are presented in Table 1. Because this was a VA population, the vast majority (94%) of participants were men, with a mean age of 81 years (range, 66‐96 years), and 89% were white. This population had a high Charlson Comorbidity Index (mean SD, 4.0 2.4), which was reflected in functional assessments, with 37% reporting difficulty with activities of daily living and 58% reporting difficulty with instrumental activities of daily living. Despite the age and comorbidity, delirium prevalence was 11% (n = 10) and incidence was 14% (n = 13). Interrater reliability of the mRASS yielded 98% agreement with a weighted kappa of 0.48 (P < 0.001).

When the mRASS was analyzed as a single‐day independent assessment, any abnormal score (ie, a score 0) had a sensitivity of 64% and a specificity of 93% for delirium relative to the expert evaluation (Table 2). With an abnormal mRASS as 2 or 2, the sensitivity fell to 34%, while the specificity increased to 99.6%.

When the mRASS was used longitudinally to detect change in delirium during the hospital stay among all participants, it had a sensitivity of 74% and specificity of 92% for any change. Increasing the stringency of the criteria by looking at a change of 2 mRASS points decreased the sensitivity (22%) and increased the specificity (100%).

To capture the potential of the mRASS administered on a longitudinal basis as a diagnostic aid, the prevalent cases of delirium were excluded. In this analysis, any change in the mRASS had a sensitivity of 85% and a specificity of 92% for incident delirium. With more stringent criteria of a change of 2 points, the sensitivity was 23% and the specificity was 100%.

DISCUSSION

In this study, we developed a modified RASS (mRASS) for serial mental status assessment. Whereas a single measurement of the mRASS had modest sensitivity and good specificity for delirium, longitudinal measurement increased the sensitivity with no loss in specificity. Importantly, the <30 seconds required for the mRASS could be incorporated into daily workflow and provides an objective measure of consciousness. As such, we believe the mRASS can potentially serve as a longitudinal measure of consciousnessmuch like a vital sign for mental status.

Altered consciousness is a clinical and diagnostic feature of delirium,5, 13 and fluctuation in mental status is a diagnostic feature of delirium. As such, a screening instrument able to quantify the level of consciousness longitudinally and allow comparison to prior and subsequent determinations has face validity as a delirium screening instrument.

The mRASS has other features that make it appropriate for serial measurement in a manner similar to a vital sign. First, it objectively described consciousness on a scale, which is an improvement relative to many of the subjective descriptions clinically used. Consistent with other studies of the RASS,10, 11 the mRASS has good interrater reliability, allowing a common language to be used to describe level of consciousness across health care settings that can become the basis for a systematic and standardized monitor of cognitive change, improving continuity of care and communication between providers. It can be further used to objectively establish a patient's baseline and monitor change longitudinally.

The current study is limited by the lack of diversity and small size of the study population, which limits external validity (generalizability). Additional studies evaluating the utility of the mRASS by a variety of health care team members in a larger, more ethnically/racially diverse and heterogeneous population should be completed before we can determine if it can perform as a mental status vital sign, and if it is associated with better patient outcomes. Additionally, this study selected patients who were physically and cognitively capable of enrolling and excluded patients with severe cognitive and sensory impairment who were unable to provide consent to participate. Thus, some of the sickest, frailest, and most cognitively impaired patients were excluded. Unfortunately, this study therefore excluded a population significantly more vulnerable to the development of delirium.

Because a change in mental status (such as delirium) is common, morbid, and costly, a brief tool that can reliably and effectively assess mental status is needed. The mRASS used in this study provided an objective measurement of consciousness, a key component of mental status, and was demonstrated to reliably screen for presence or absence of delirium when administered longitudinally. Further study in diverse populations with administration by a variety of health care team members is needed to determine whether the mRASS can accurately serve as a mental status vital sign. If adopted widely, the mRASS could be used alongside the traditional vital signs to establish patient baselines, monitor change, improve provider communication, and potentially improve patient outcomes.

Vital signs constitute a fundamental component of the physical examination and serve key diagnostic and monitoring purposes. The brain is as vital to life as the cardiovascular, respiratory, and immune/thermoregulatory systems, yet currently no vital sign exists that would allow rapid, reliable, and easily reproducible assessment of cognition.1 As a result, acute mental status changes frequently go undetected and untreated.24 Delirium is defined as an acute change in attention with fluctuations in cognition, thought, and/or consciousness throughout the course of the day.5 Because delirium in older patients is common and is associated with increased morbidity, mortality, functional decline, and costs,69 development and validation of a rapid, objective screening assessment could be used by nursing staff to identify patients at high risk for delirium.

Current recommendations for inpatient delirium monitoring usually involve daily cognitive screening with a standardized screening instrument.6 Because this process is often time‐consuming (8‐12 minutes), most patients do not undergo routine screening. To facilitate clinical implementation, we focused on developing a brief (<30‐second) inpatient screening measure of a feature of mental status that could be administered serially. The purpose of this study was to (1) develop a brief screening tool for a core feature of mental status and (2) validate this screening tool for delirium in an older inpatient population.

METHODS

Consensus Panel

In June 2009, the Veterans Administration sponsored an interdisciplinary conference that solicited input on identifying the most targetable components of delirium and discussing potential clinical instruments. Following this, a consensus panel of 8 representatives from medicine, geriatrics, nursing, psychiatry, and psychology used a modified Delphi method to target characteristic features of delirium and identify instruments that could best capture mental status change. While inattention was agreed upon as the core cognitive feature of delirium, the group came to consensus that capturing the acute onset and fluctuating nature of delirium was better suited as a vital sign. To meet these criteria, the group modified the Richmond Agitation Sedation Scale (RASS).10

The RASS is an observational instrument that has been validated in the intesive care unit setting for objectively determining level of sedation. It has been shown to be highly reliable and associated with delirium.11 The RASS is a quick, objective scale of consciousness with a scoring system that captures both hyperactive and hypoactive levels of consciousness. A disadvantage of using the RASS includes its limited attention assessment. The Consensus panel modified the RASS to improve its assessment of attention, using a brief open‐ended question that was asked before scoring (Figure 1).

Figure 1

RESULTS

Characteristics of the study population are presented in Table 1. Because this was a VA population, the vast majority (94%) of participants were men, with a mean age of 81 years (range, 66‐96 years), and 89% were white. This population had a high Charlson Comorbidity Index (mean SD, 4.0 2.4), which was reflected in functional assessments, with 37% reporting difficulty with activities of daily living and 58% reporting difficulty with instrumental activities of daily living. Despite the age and comorbidity, delirium prevalence was 11% (n = 10) and incidence was 14% (n = 13). Interrater reliability of the mRASS yielded 98% agreement with a weighted kappa of 0.48 (P < 0.001).

When the mRASS was analyzed as a single‐day independent assessment, any abnormal score (ie, a score 0) had a sensitivity of 64% and a specificity of 93% for delirium relative to the expert evaluation (Table 2). With an abnormal mRASS as 2 or 2, the sensitivity fell to 34%, while the specificity increased to 99.6%.

When the mRASS was used longitudinally to detect change in delirium during the hospital stay among all participants, it had a sensitivity of 74% and specificity of 92% for any change. Increasing the stringency of the criteria by looking at a change of 2 mRASS points decreased the sensitivity (22%) and increased the specificity (100%).

To capture the potential of the mRASS administered on a longitudinal basis as a diagnostic aid, the prevalent cases of delirium were excluded. In this analysis, any change in the mRASS had a sensitivity of 85% and a specificity of 92% for incident delirium. With more stringent criteria of a change of 2 points, the sensitivity was 23% and the specificity was 100%.

DISCUSSION

In this study, we developed a modified RASS (mRASS) for serial mental status assessment. Whereas a single measurement of the mRASS had modest sensitivity and good specificity for delirium, longitudinal measurement increased the sensitivity with no loss in specificity. Importantly, the <30 seconds required for the mRASS could be incorporated into daily workflow and provides an objective measure of consciousness. As such, we believe the mRASS can potentially serve as a longitudinal measure of consciousnessmuch like a vital sign for mental status.

Altered consciousness is a clinical and diagnostic feature of delirium,5, 13 and fluctuation in mental status is a diagnostic feature of delirium. As such, a screening instrument able to quantify the level of consciousness longitudinally and allow comparison to prior and subsequent determinations has face validity as a delirium screening instrument.

The mRASS has other features that make it appropriate for serial measurement in a manner similar to a vital sign. First, it objectively described consciousness on a scale, which is an improvement relative to many of the subjective descriptions clinically used. Consistent with other studies of the RASS,10, 11 the mRASS has good interrater reliability, allowing a common language to be used to describe level of consciousness across health care settings that can become the basis for a systematic and standardized monitor of cognitive change, improving continuity of care and communication between providers. It can be further used to objectively establish a patient's baseline and monitor change longitudinally.

The current study is limited by the lack of diversity and small size of the study population, which limits external validity (generalizability). Additional studies evaluating the utility of the mRASS by a variety of health care team members in a larger, more ethnically/racially diverse and heterogeneous population should be completed before we can determine if it can perform as a mental status vital sign, and if it is associated with better patient outcomes. Additionally, this study selected patients who were physically and cognitively capable of enrolling and excluded patients with severe cognitive and sensory impairment who were unable to provide consent to participate. Thus, some of the sickest, frailest, and most cognitively impaired patients were excluded. Unfortunately, this study therefore excluded a population significantly more vulnerable to the development of delirium.

Because a change in mental status (such as delirium) is common, morbid, and costly, a brief tool that can reliably and effectively assess mental status is needed. The mRASS used in this study provided an objective measurement of consciousness, a key component of mental status, and was demonstrated to reliably screen for presence or absence of delirium when administered longitudinally. Further study in diverse populations with administration by a variety of health care team members is needed to determine whether the mRASS can accurately serve as a mental status vital sign. If adopted widely, the mRASS could be used alongside the traditional vital signs to establish patient baselines, monitor change, improve provider communication, and potentially improve patient outcomes.

Vital signs constitute a fundamental component of the physical examination and serve key diagnostic and monitoring purposes. The brain is as vital to life as the cardiovascular, respiratory, and immune/thermoregulatory systems, yet currently no vital sign exists that would allow rapid, reliable, and easily reproducible assessment of cognition.1 As a result, acute mental status changes frequently go undetected and untreated.24 Delirium is defined as an acute change in attention with fluctuations in cognition, thought, and/or consciousness throughout the course of the day.5 Because delirium in older patients is common and is associated with increased morbidity, mortality, functional decline, and costs,69 development and validation of a rapid, objective screening assessment could be used by nursing staff to identify patients at high risk for delirium.

Current recommendations for inpatient delirium monitoring usually involve daily cognitive screening with a standardized screening instrument.6 Because this process is often time‐consuming (8‐12 minutes), most patients do not undergo routine screening. To facilitate clinical implementation, we focused on developing a brief (<30‐second) inpatient screening measure of a feature of mental status that could be administered serially. The purpose of this study was to (1) develop a brief screening tool for a core feature of mental status and (2) validate this screening tool for delirium in an older inpatient population.

METHODS

Consensus Panel

In June 2009, the Veterans Administration sponsored an interdisciplinary conference that solicited input on identifying the most targetable components of delirium and discussing potential clinical instruments. Following this, a consensus panel of 8 representatives from medicine, geriatrics, nursing, psychiatry, and psychology used a modified Delphi method to target characteristic features of delirium and identify instruments that could best capture mental status change. While inattention was agreed upon as the core cognitive feature of delirium, the group came to consensus that capturing the acute onset and fluctuating nature of delirium was better suited as a vital sign. To meet these criteria, the group modified the Richmond Agitation Sedation Scale (RASS).10

The RASS is an observational instrument that has been validated in the intesive care unit setting for objectively determining level of sedation. It has been shown to be highly reliable and associated with delirium.11 The RASS is a quick, objective scale of consciousness with a scoring system that captures both hyperactive and hypoactive levels of consciousness. A disadvantage of using the RASS includes its limited attention assessment. The Consensus panel modified the RASS to improve its assessment of attention, using a brief open‐ended question that was asked before scoring (Figure 1).

Figure 1

RESULTS

Characteristics of the study population are presented in Table 1. Because this was a VA population, the vast majority (94%) of participants were men, with a mean age of 81 years (range, 66‐96 years), and 89% were white. This population had a high Charlson Comorbidity Index (mean SD, 4.0 2.4), which was reflected in functional assessments, with 37% reporting difficulty with activities of daily living and 58% reporting difficulty with instrumental activities of daily living. Despite the age and comorbidity, delirium prevalence was 11% (n = 10) and incidence was 14% (n = 13). Interrater reliability of the mRASS yielded 98% agreement with a weighted kappa of 0.48 (P < 0.001).

When the mRASS was analyzed as a single‐day independent assessment, any abnormal score (ie, a score 0) had a sensitivity of 64% and a specificity of 93% for delirium relative to the expert evaluation (Table 2). With an abnormal mRASS as 2 or 2, the sensitivity fell to 34%, while the specificity increased to 99.6%.

When the mRASS was used longitudinally to detect change in delirium during the hospital stay among all participants, it had a sensitivity of 74% and specificity of 92% for any change. Increasing the stringency of the criteria by looking at a change of 2 mRASS points decreased the sensitivity (22%) and increased the specificity (100%).

To capture the potential of the mRASS administered on a longitudinal basis as a diagnostic aid, the prevalent cases of delirium were excluded. In this analysis, any change in the mRASS had a sensitivity of 85% and a specificity of 92% for incident delirium. With more stringent criteria of a change of 2 points, the sensitivity was 23% and the specificity was 100%.

DISCUSSION

In this study, we developed a modified RASS (mRASS) for serial mental status assessment. Whereas a single measurement of the mRASS had modest sensitivity and good specificity for delirium, longitudinal measurement increased the sensitivity with no loss in specificity. Importantly, the <30 seconds required for the mRASS could be incorporated into daily workflow and provides an objective measure of consciousness. As such, we believe the mRASS can potentially serve as a longitudinal measure of consciousnessmuch like a vital sign for mental status.

Altered consciousness is a clinical and diagnostic feature of delirium,5, 13 and fluctuation in mental status is a diagnostic feature of delirium. As such, a screening instrument able to quantify the level of consciousness longitudinally and allow comparison to prior and subsequent determinations has face validity as a delirium screening instrument.

The mRASS has other features that make it appropriate for serial measurement in a manner similar to a vital sign. First, it objectively described consciousness on a scale, which is an improvement relative to many of the subjective descriptions clinically used. Consistent with other studies of the RASS,10, 11 the mRASS has good interrater reliability, allowing a common language to be used to describe level of consciousness across health care settings that can become the basis for a systematic and standardized monitor of cognitive change, improving continuity of care and communication between providers. It can be further used to objectively establish a patient's baseline and monitor change longitudinally.

The current study is limited by the lack of diversity and small size of the study population, which limits external validity (generalizability). Additional studies evaluating the utility of the mRASS by a variety of health care team members in a larger, more ethnically/racially diverse and heterogeneous population should be completed before we can determine if it can perform as a mental status vital sign, and if it is associated with better patient outcomes. Additionally, this study selected patients who were physically and cognitively capable of enrolling and excluded patients with severe cognitive and sensory impairment who were unable to provide consent to participate. Thus, some of the sickest, frailest, and most cognitively impaired patients were excluded. Unfortunately, this study therefore excluded a population significantly more vulnerable to the development of delirium.

Because a change in mental status (such as delirium) is common, morbid, and costly, a brief tool that can reliably and effectively assess mental status is needed. The mRASS used in this study provided an objective measurement of consciousness, a key component of mental status, and was demonstrated to reliably screen for presence or absence of delirium when administered longitudinally. Further study in diverse populations with administration by a variety of health care team members is needed to determine whether the mRASS can accurately serve as a mental status vital sign. If adopted widely, the mRASS could be used alongside the traditional vital signs to establish patient baselines, monitor change, improve provider communication, and potentially improve patient outcomes.