Hospital Medicine

Health care organizations began implementing Lean management and high reliability organization (HRO) principles in the 1990s to improve quality and efficiency by aligning leaders and staff to a shared vision, fostering a culture of continuous improvement, identifying the root causes of complex problems, and engaging frontline staff as drivers of improvement efforts.¹ There are 4 components for establishing a Lean management system: (1) leader standard work; (2) visual management; (3) daily accountability; and (4) discipline to institute the first 3 components.² Leader standard work promotes continuous improvement by setting a standard routine of behaviors, actions, and tools consistently performed by leadership. These include routine and frequent frontline check-ins (ie, Gemba walks) as well as standardization of employee onboarding, training, and evaluations. Visual management refers to the process of making problems and abnormal conditions readily apparent to staff and leadership.³

The US Department of Veterans Affairs (VA) is committed to implementing similar principles of HROs, which focus on error analysis and process improvement to foster a culture of safety, leadership commitment, and staff engagement.^4,5 Visual management is an important tool for HROs; it reflects the mindset of promoting transparency, teamwork, and openness.^6,7

Visual management boards (VMBs), such as huddle boards, Gemba boards, or visibility walls, are critical tools that can promote daily accountability and the core principles of Lean thinking and HROs.^1,6,8,9 Accountability is enhanced through frequent real-time, data-driven feedback between staff and leadership. This is often facilitated with a huddle, a structured and disciplined team meeting that provides bidirectional information.¹ Frequently, a VMB is incorporated into the structure and flow of the huddle.

In a literature review of 20 years of implementation of Lean management systems in health care, Winner and colleagues report that while the frequency and duration of huddles vary, they are often united by several characteristics, including the involvement of the unit team, focus on feedback, problem identification and solutions, and central location around a visual board.¹ VMBs most often take the form of a magnetic, dry-erase board located in a hall or conference room central to the work area.¹ In addition to identifying and tracking problems in the place of work, VMBs can also provide a representation of key performance indicators and metrics, disseminate essential unit information, and acknowledge the work and successes of staff and leaders.^6,8-12

This article outlines the commitment of the Lieutenant Colonel Charles S. Kettles VA Medical Center (VAMC) within the VA Ann Arbor Healthcare System (VAAAHS) to the HRO principle of visual management. We describe the incorporation of VMBs throughout VAAAHS and provide a detailed report of the development and use at a large outpatient subspecialty clinic.

Implementation

The goal of implementing visual management tools at VAAAHS was to empower staff members to identify problems and process improvements, enhance teamwork, and improve communication between staff and section leadership. The Systems Redesign and Improvement Program (SR), which supports Veteran Health Administration high reliability initiatives, helped implement VMBs in VAAAHS departments. Each board was designed to meet the specialized needs of each respective team and could be a physical board, virtual board, or combination. However, all boards sought to create standardized work and identify department needs.

The VAAAHS outpatient cardiology section VMB complemented an existing daily huddle framework. The cardiology section is large and diverse, with 6 subspecialty clinics, and team members who work in multiple locations. The clinic team includes 19 faculty physicians, 14 cardiology fellow physicians,9 nurse care managers, 13 nurse practitioners, 2 licensed practical nurses, and 5 medical support assistants at both the Lieutenant Colonel Charles S. Kettles VAMC and Toledo, Ohio, community based outpatient clinic. Prior to VMB implementation, a morning huddle with clinic team members led by a cardiology manager was an unstructured group discussion about clinic operations for the day. While the daily huddle had a positive impact on staff orientation to daily goals, it did not fully meet the aims of staff empowerment, problem identification and tracking, and knowledge distribution. The VMB was codeveloped with cardiology and the SR program with these goals in mind.

Cardiology was the first VAAAHS outpatient subspecialty clinic to institute a VMB. Two boards were created: a large standard VMB (Figure 1) and a smaller kudos board (Figure 2), which were placed in a central hallway in which staff members and patients pass frequently throughout the day. This location was chosen to promote engagement and promote the VAAAHS commitment to continuous improvement. The VMB focused on identifying and tracking problems, information sharing, and metric monitoring. The goal of the smaller kudos board was to highlight staff achievements and provide an opportunity for patient feedback.

The SR program required that the board incorporate problem identification and a uniform VAAAHS ticket tracking system. Each department could customize the VMB to fit its needs. Staff members are asked to define a problem, complete a ticket describing the issue, consider possible root causes, and suggest solutions. This approach empowers staff to take ownership, make a problem visible, and identify a solution. The problem is then discussed in group huddles using an Impact and Effort Matrix, a tool focused on categorizing and prioritizing those interventions that require low effort and lead to high impact.¹³

Tickets move along the board as they are addressed using a Plan-Do-Study-Act problem-solving model.¹⁴ Plan involves identifying and assigning leadership for the problem and understanding its root causes. Do involves implementing an action plan. Study involves evaluating the results. Finally, Act involves determining whether the plan was successful, and if so, standardizing the improvement and using it regularly.¹⁴ Complicated projects that require higher effort or additional resources are moved to the roll-up and parking lot, so they may be addressed by leadership at an appropriate time. Roll up is the escalation of process improvement tickets that frontline staff are unable to resolve with their current resources. The parking lot is for tickets that staff want to address later based on priority determined using an impact vs effort matrix. This allows for enhanced bidirectional communication between the department and high-level leadership, showing a commitment to HRO principles at all levels. The cardiology department customized its board to include essential clinic information, such as faculty staffing for the clinic that day and clinic metric information (eg, patient satisfaction scores, and appointment wait times). The kudos board, a space for patient feedback and to celebrate staff accomplishments, was located across the hall closest to the waiting area.

After the VMB was implemented as a new component to the daily team huddle, the group discussion physically moved to just in front of the board; pertinent clinic information is discussed daily, and the ticketing system is discussed 1 to 3 times per week, depending on ticket progress. Open and unresolved tickets are reviewed for updates on the status by the responsible team member, who receives ongoing feedback and assistance.

Program Impact

A total of 55 improvement opportunity tickets were submitted by staff members during the initial 23 months after the implementation of the outpatient cardiology clinic VMB. Most were submitted by nurse practitioners, although there were contributions from all faculty and staff. The high percentage of ticket submissions by nurse practitioners may be related to their full-time daily presence in the clinic, whereas some other staff members are part-time (most physicians are present 1 day each week). Improvement opportunities were noted within a variety of areas, including clinic facilities (eg, clinic equipment), communication between the clinic and patients (eg, telephone calls from patients or appointment letters), and patient care (eg, medication reconciliation and laboratory requisition).

In an improvement opportunity ticket, a staff member identified that the low seating in the patient waiting area was a fall risk and not diversified for varying body types. They posted a ticket, and the issue was discussed as a group. This staff member assumed ownership of the problem and placed an interior design request for taller chairs and bariatric options. The ticket was resolved when the waiting area was upgraded to include safer and more inclusive seating options for patients. Of 55 tickets submitted by staff as of June 2024, 45 have identified solutions, 4 are in process, and 6 have been placed in the parking lot. On average, the morning huddle spends about 5 to 10 minutes addressing tickets, but on occasion, more complex topics require additional time. The kudos board receives feedback from patients who express their gratitude, and serves as a space to celebrate awards received by staff members.

Implementing a VMB into daily huddles within the cardiology clinic led to increased staff engagement and ownership of challenges, as well as improved communication between frontline workers and leadership. VMBs have proven to be useful for annual staff performance evaluations because staff members who engaged in the board and volunteered to take accountability for ticket resolution could use those accomplishments in their assessments. Finally, VMBs made quality improvement and safety work accessible by normalizing frequent conversations. This empowered staff to engage in improvement projects and even led some members to enroll in formal Lean training.

The outpatient cardiology clinic VMB at the VAAAHS was identified as a best practice during a site visit by the Promising Practice Team in the Veterans Health Administration Office of Integrated Veteran Care. The outpatient cardiology clinic leadership team, including the authors of this article, was invited to present our visual management work as a main topic at the January 2024 Office of Integrated Veteran Care collaborative meeting.

Further Implementation

The SR program has collaborated with additional VAAAHS teams to implement VMBs. Forty-four physical VMBs and 20 virtual VMBs are currently in use throughout the VAAAHS. Virtual VMB content is similar to a physical board and can be modified by each team to meet its particular needs. Several virtual VMBs have been implemented at the VAAAHS and can achieve the same goals of staff teamwork, empowerment, and engagement. Each team can choose the format of the VMB that best fits their needs, which may be partially influenced by the team’s overall interaction style (on-site teams may function better with a physical VMB, and off-site teams may find a virtual VMB works best). VMBs have been implemented in various work areas, including laboratories, inpatient wards, subspecialty outpatient clinics, procedural areas, and the engineering department. In fiscal year 2024, 180 tickets were electronically submitted by teams across the VAAAHS, of which 170 identified solutions and were marked completed. Ticket counts may be underestimated since not all physical board tickets are reported in the electronic system. The SR program periodically attends morning huddles of various teams and obtains feedback on their VMBs, a practice that highlights its contribution to staff engagement, transparency, teamwork, and continuous improvement (Table). A goal of the SR program is to identify areas of the VAAAHS in which VMBs would add value to the team and implement them as necessary.

Discussion

VMBs are common in health care and are implemented to promote the core principlesof Lean thinking and HROs, including visual management and daily accountability. The goals of a visual management tool are to make problems visible and document their management. A VMB can serve as a focal point for team discussion and a physical space to track each problem through its initial identification, understanding of root causes, consideration of potential solutions, and recording of intervention results.

A VMB can foster a culture of safety, leadership commitment, and continuous process improvement when designed and implemented to reflect team needs. VMBs can empower staff members to share work concerns and openly promote engagement. As a central place for discussion between staff and leaders, VMBs can also foster teamwork and communication. The daily huddle provides a safe, productive working environment by ensuring that lines of communication are open among all team members, regardless of role or leadership designation.

Limitations

This article focused on the implementation of 1 type of visual management tool. It provides an in-depth discussion of the development, implementation, and experience with a VMB at multiple clinics of a single section in 1 health care system. These reported experiences may not represent other VA facilities. Perceptions of the impact and usefulness of the VMB were mostly anecdotal. Further evaluation of the VMB implementation experience and utility at other VA health care systems would provide additional insight into the optimal implementation of VMBs.

Conclusions

Through increased transparency, empowerment, and communication, VMBs are an important tool in the visual management tool belt for organizations committed to HROs and Lean management. Given the successful institution of VMBs at the VAAAHS, the description of our experience may aid other VA systems for the incorporation of visual management into the daily culture of their respective health care teams.

Health care organizations began implementing Lean management and high reliability organization (HRO) principles in the 1990s to improve quality and efficiency by aligning leaders and staff to a shared vision, fostering a culture of continuous improvement, identifying the root causes of complex problems, and engaging frontline staff as drivers of improvement efforts.¹ There are 4 components for establishing a Lean management system: (1) leader standard work; (2) visual management; (3) daily accountability; and (4) discipline to institute the first 3 components.² Leader standard work promotes continuous improvement by setting a standard routine of behaviors, actions, and tools consistently performed by leadership. These include routine and frequent frontline check-ins (ie, Gemba walks) as well as standardization of employee onboarding, training, and evaluations. Visual management refers to the process of making problems and abnormal conditions readily apparent to staff and leadership.³

The US Department of Veterans Affairs (VA) is committed to implementing similar principles of HROs, which focus on error analysis and process improvement to foster a culture of safety, leadership commitment, and staff engagement.^4,5 Visual management is an important tool for HROs; it reflects the mindset of promoting transparency, teamwork, and openness.^6,7

Visual management boards (VMBs), such as huddle boards, Gemba boards, or visibility walls, are critical tools that can promote daily accountability and the core principles of Lean thinking and HROs.^1,6,8,9 Accountability is enhanced through frequent real-time, data-driven feedback between staff and leadership. This is often facilitated with a huddle, a structured and disciplined team meeting that provides bidirectional information.¹ Frequently, a VMB is incorporated into the structure and flow of the huddle.

In a literature review of 20 years of implementation of Lean management systems in health care, Winner and colleagues report that while the frequency and duration of huddles vary, they are often united by several characteristics, including the involvement of the unit team, focus on feedback, problem identification and solutions, and central location around a visual board.¹ VMBs most often take the form of a magnetic, dry-erase board located in a hall or conference room central to the work area.¹ In addition to identifying and tracking problems in the place of work, VMBs can also provide a representation of key performance indicators and metrics, disseminate essential unit information, and acknowledge the work and successes of staff and leaders.^6,8-12

This article outlines the commitment of the Lieutenant Colonel Charles S. Kettles VA Medical Center (VAMC) within the VA Ann Arbor Healthcare System (VAAAHS) to the HRO principle of visual management. We describe the incorporation of VMBs throughout VAAAHS and provide a detailed report of the development and use at a large outpatient subspecialty clinic.

Implementation

The goal of implementing visual management tools at VAAAHS was to empower staff members to identify problems and process improvements, enhance teamwork, and improve communication between staff and section leadership. The Systems Redesign and Improvement Program (SR), which supports Veteran Health Administration high reliability initiatives, helped implement VMBs in VAAAHS departments. Each board was designed to meet the specialized needs of each respective team and could be a physical board, virtual board, or combination. However, all boards sought to create standardized work and identify department needs.

The VAAAHS outpatient cardiology section VMB complemented an existing daily huddle framework. The cardiology section is large and diverse, with 6 subspecialty clinics, and team members who work in multiple locations. The clinic team includes 19 faculty physicians, 14 cardiology fellow physicians,9 nurse care managers, 13 nurse practitioners, 2 licensed practical nurses, and 5 medical support assistants at both the Lieutenant Colonel Charles S. Kettles VAMC and Toledo, Ohio, community based outpatient clinic. Prior to VMB implementation, a morning huddle with clinic team members led by a cardiology manager was an unstructured group discussion about clinic operations for the day. While the daily huddle had a positive impact on staff orientation to daily goals, it did not fully meet the aims of staff empowerment, problem identification and tracking, and knowledge distribution. The VMB was codeveloped with cardiology and the SR program with these goals in mind.

Cardiology was the first VAAAHS outpatient subspecialty clinic to institute a VMB. Two boards were created: a large standard VMB (Figure 1) and a smaller kudos board (Figure 2), which were placed in a central hallway in which staff members and patients pass frequently throughout the day. This location was chosen to promote engagement and promote the VAAAHS commitment to continuous improvement. The VMB focused on identifying and tracking problems, information sharing, and metric monitoring. The goal of the smaller kudos board was to highlight staff achievements and provide an opportunity for patient feedback.

The SR program required that the board incorporate problem identification and a uniform VAAAHS ticket tracking system. Each department could customize the VMB to fit its needs. Staff members are asked to define a problem, complete a ticket describing the issue, consider possible root causes, and suggest solutions. This approach empowers staff to take ownership, make a problem visible, and identify a solution. The problem is then discussed in group huddles using an Impact and Effort Matrix, a tool focused on categorizing and prioritizing those interventions that require low effort and lead to high impact.¹³

Tickets move along the board as they are addressed using a Plan-Do-Study-Act problem-solving model.¹⁴ Plan involves identifying and assigning leadership for the problem and understanding its root causes. Do involves implementing an action plan. Study involves evaluating the results. Finally, Act involves determining whether the plan was successful, and if so, standardizing the improvement and using it regularly.¹⁴ Complicated projects that require higher effort or additional resources are moved to the roll-up and parking lot, so they may be addressed by leadership at an appropriate time. Roll up is the escalation of process improvement tickets that frontline staff are unable to resolve with their current resources. The parking lot is for tickets that staff want to address later based on priority determined using an impact vs effort matrix. This allows for enhanced bidirectional communication between the department and high-level leadership, showing a commitment to HRO principles at all levels. The cardiology department customized its board to include essential clinic information, such as faculty staffing for the clinic that day and clinic metric information (eg, patient satisfaction scores, and appointment wait times). The kudos board, a space for patient feedback and to celebrate staff accomplishments, was located across the hall closest to the waiting area.

After the VMB was implemented as a new component to the daily team huddle, the group discussion physically moved to just in front of the board; pertinent clinic information is discussed daily, and the ticketing system is discussed 1 to 3 times per week, depending on ticket progress. Open and unresolved tickets are reviewed for updates on the status by the responsible team member, who receives ongoing feedback and assistance.

Program Impact

A total of 55 improvement opportunity tickets were submitted by staff members during the initial 23 months after the implementation of the outpatient cardiology clinic VMB. Most were submitted by nurse practitioners, although there were contributions from all faculty and staff. The high percentage of ticket submissions by nurse practitioners may be related to their full-time daily presence in the clinic, whereas some other staff members are part-time (most physicians are present 1 day each week). Improvement opportunities were noted within a variety of areas, including clinic facilities (eg, clinic equipment), communication between the clinic and patients (eg, telephone calls from patients or appointment letters), and patient care (eg, medication reconciliation and laboratory requisition).

In an improvement opportunity ticket, a staff member identified that the low seating in the patient waiting area was a fall risk and not diversified for varying body types. They posted a ticket, and the issue was discussed as a group. This staff member assumed ownership of the problem and placed an interior design request for taller chairs and bariatric options. The ticket was resolved when the waiting area was upgraded to include safer and more inclusive seating options for patients. Of 55 tickets submitted by staff as of June 2024, 45 have identified solutions, 4 are in process, and 6 have been placed in the parking lot. On average, the morning huddle spends about 5 to 10 minutes addressing tickets, but on occasion, more complex topics require additional time. The kudos board receives feedback from patients who express their gratitude, and serves as a space to celebrate awards received by staff members.

Implementing a VMB into daily huddles within the cardiology clinic led to increased staff engagement and ownership of challenges, as well as improved communication between frontline workers and leadership. VMBs have proven to be useful for annual staff performance evaluations because staff members who engaged in the board and volunteered to take accountability for ticket resolution could use those accomplishments in their assessments. Finally, VMBs made quality improvement and safety work accessible by normalizing frequent conversations. This empowered staff to engage in improvement projects and even led some members to enroll in formal Lean training.

The outpatient cardiology clinic VMB at the VAAAHS was identified as a best practice during a site visit by the Promising Practice Team in the Veterans Health Administration Office of Integrated Veteran Care. The outpatient cardiology clinic leadership team, including the authors of this article, was invited to present our visual management work as a main topic at the January 2024 Office of Integrated Veteran Care collaborative meeting.

Further Implementation

The SR program has collaborated with additional VAAAHS teams to implement VMBs. Forty-four physical VMBs and 20 virtual VMBs are currently in use throughout the VAAAHS. Virtual VMB content is similar to a physical board and can be modified by each team to meet its particular needs. Several virtual VMBs have been implemented at the VAAAHS and can achieve the same goals of staff teamwork, empowerment, and engagement. Each team can choose the format of the VMB that best fits their needs, which may be partially influenced by the team’s overall interaction style (on-site teams may function better with a physical VMB, and off-site teams may find a virtual VMB works best). VMBs have been implemented in various work areas, including laboratories, inpatient wards, subspecialty outpatient clinics, procedural areas, and the engineering department. In fiscal year 2024, 180 tickets were electronically submitted by teams across the VAAAHS, of which 170 identified solutions and were marked completed. Ticket counts may be underestimated since not all physical board tickets are reported in the electronic system. The SR program periodically attends morning huddles of various teams and obtains feedback on their VMBs, a practice that highlights its contribution to staff engagement, transparency, teamwork, and continuous improvement (Table). A goal of the SR program is to identify areas of the VAAAHS in which VMBs would add value to the team and implement them as necessary.

Discussion

VMBs are common in health care and are implemented to promote the core principlesof Lean thinking and HROs, including visual management and daily accountability. The goals of a visual management tool are to make problems visible and document their management. A VMB can serve as a focal point for team discussion and a physical space to track each problem through its initial identification, understanding of root causes, consideration of potential solutions, and recording of intervention results.

A VMB can foster a culture of safety, leadership commitment, and continuous process improvement when designed and implemented to reflect team needs. VMBs can empower staff members to share work concerns and openly promote engagement. As a central place for discussion between staff and leaders, VMBs can also foster teamwork and communication. The daily huddle provides a safe, productive working environment by ensuring that lines of communication are open among all team members, regardless of role or leadership designation.

Limitations

This article focused on the implementation of 1 type of visual management tool. It provides an in-depth discussion of the development, implementation, and experience with a VMB at multiple clinics of a single section in 1 health care system. These reported experiences may not represent other VA facilities. Perceptions of the impact and usefulness of the VMB were mostly anecdotal. Further evaluation of the VMB implementation experience and utility at other VA health care systems would provide additional insight into the optimal implementation of VMBs.

Conclusions

Through increased transparency, empowerment, and communication, VMBs are an important tool in the visual management tool belt for organizations committed to HROs and Lean management. Given the successful institution of VMBs at the VAAAHS, the description of our experience may aid other VA systems for the incorporation of visual management into the daily culture of their respective health care teams.

Health care organizations began implementing Lean management and high reliability organization (HRO) principles in the 1990s to improve quality and efficiency by aligning leaders and staff to a shared vision, fostering a culture of continuous improvement, identifying the root causes of complex problems, and engaging frontline staff as drivers of improvement efforts.¹ There are 4 components for establishing a Lean management system: (1) leader standard work; (2) visual management; (3) daily accountability; and (4) discipline to institute the first 3 components.² Leader standard work promotes continuous improvement by setting a standard routine of behaviors, actions, and tools consistently performed by leadership. These include routine and frequent frontline check-ins (ie, Gemba walks) as well as standardization of employee onboarding, training, and evaluations. Visual management refers to the process of making problems and abnormal conditions readily apparent to staff and leadership.³

The US Department of Veterans Affairs (VA) is committed to implementing similar principles of HROs, which focus on error analysis and process improvement to foster a culture of safety, leadership commitment, and staff engagement.^4,5 Visual management is an important tool for HROs; it reflects the mindset of promoting transparency, teamwork, and openness.^6,7

Visual management boards (VMBs), such as huddle boards, Gemba boards, or visibility walls, are critical tools that can promote daily accountability and the core principles of Lean thinking and HROs.^1,6,8,9 Accountability is enhanced through frequent real-time, data-driven feedback between staff and leadership. This is often facilitated with a huddle, a structured and disciplined team meeting that provides bidirectional information.¹ Frequently, a VMB is incorporated into the structure and flow of the huddle.

In a literature review of 20 years of implementation of Lean management systems in health care, Winner and colleagues report that while the frequency and duration of huddles vary, they are often united by several characteristics, including the involvement of the unit team, focus on feedback, problem identification and solutions, and central location around a visual board.¹ VMBs most often take the form of a magnetic, dry-erase board located in a hall or conference room central to the work area.¹ In addition to identifying and tracking problems in the place of work, VMBs can also provide a representation of key performance indicators and metrics, disseminate essential unit information, and acknowledge the work and successes of staff and leaders.^6,8-12

This article outlines the commitment of the Lieutenant Colonel Charles S. Kettles VA Medical Center (VAMC) within the VA Ann Arbor Healthcare System (VAAAHS) to the HRO principle of visual management. We describe the incorporation of VMBs throughout VAAAHS and provide a detailed report of the development and use at a large outpatient subspecialty clinic.

Implementation

The goal of implementing visual management tools at VAAAHS was to empower staff members to identify problems and process improvements, enhance teamwork, and improve communication between staff and section leadership. The Systems Redesign and Improvement Program (SR), which supports Veteran Health Administration high reliability initiatives, helped implement VMBs in VAAAHS departments. Each board was designed to meet the specialized needs of each respective team and could be a physical board, virtual board, or combination. However, all boards sought to create standardized work and identify department needs.

The VAAAHS outpatient cardiology section VMB complemented an existing daily huddle framework. The cardiology section is large and diverse, with 6 subspecialty clinics, and team members who work in multiple locations. The clinic team includes 19 faculty physicians, 14 cardiology fellow physicians,9 nurse care managers, 13 nurse practitioners, 2 licensed practical nurses, and 5 medical support assistants at both the Lieutenant Colonel Charles S. Kettles VAMC and Toledo, Ohio, community based outpatient clinic. Prior to VMB implementation, a morning huddle with clinic team members led by a cardiology manager was an unstructured group discussion about clinic operations for the day. While the daily huddle had a positive impact on staff orientation to daily goals, it did not fully meet the aims of staff empowerment, problem identification and tracking, and knowledge distribution. The VMB was codeveloped with cardiology and the SR program with these goals in mind.

Cardiology was the first VAAAHS outpatient subspecialty clinic to institute a VMB. Two boards were created: a large standard VMB (Figure 1) and a smaller kudos board (Figure 2), which were placed in a central hallway in which staff members and patients pass frequently throughout the day. This location was chosen to promote engagement and promote the VAAAHS commitment to continuous improvement. The VMB focused on identifying and tracking problems, information sharing, and metric monitoring. The goal of the smaller kudos board was to highlight staff achievements and provide an opportunity for patient feedback.

The SR program required that the board incorporate problem identification and a uniform VAAAHS ticket tracking system. Each department could customize the VMB to fit its needs. Staff members are asked to define a problem, complete a ticket describing the issue, consider possible root causes, and suggest solutions. This approach empowers staff to take ownership, make a problem visible, and identify a solution. The problem is then discussed in group huddles using an Impact and Effort Matrix, a tool focused on categorizing and prioritizing those interventions that require low effort and lead to high impact.¹³

Tickets move along the board as they are addressed using a Plan-Do-Study-Act problem-solving model.¹⁴ Plan involves identifying and assigning leadership for the problem and understanding its root causes. Do involves implementing an action plan. Study involves evaluating the results. Finally, Act involves determining whether the plan was successful, and if so, standardizing the improvement and using it regularly.¹⁴ Complicated projects that require higher effort or additional resources are moved to the roll-up and parking lot, so they may be addressed by leadership at an appropriate time. Roll up is the escalation of process improvement tickets that frontline staff are unable to resolve with their current resources. The parking lot is for tickets that staff want to address later based on priority determined using an impact vs effort matrix. This allows for enhanced bidirectional communication between the department and high-level leadership, showing a commitment to HRO principles at all levels. The cardiology department customized its board to include essential clinic information, such as faculty staffing for the clinic that day and clinic metric information (eg, patient satisfaction scores, and appointment wait times). The kudos board, a space for patient feedback and to celebrate staff accomplishments, was located across the hall closest to the waiting area.

After the VMB was implemented as a new component to the daily team huddle, the group discussion physically moved to just in front of the board; pertinent clinic information is discussed daily, and the ticketing system is discussed 1 to 3 times per week, depending on ticket progress. Open and unresolved tickets are reviewed for updates on the status by the responsible team member, who receives ongoing feedback and assistance.

Program Impact

A total of 55 improvement opportunity tickets were submitted by staff members during the initial 23 months after the implementation of the outpatient cardiology clinic VMB. Most were submitted by nurse practitioners, although there were contributions from all faculty and staff. The high percentage of ticket submissions by nurse practitioners may be related to their full-time daily presence in the clinic, whereas some other staff members are part-time (most physicians are present 1 day each week). Improvement opportunities were noted within a variety of areas, including clinic facilities (eg, clinic equipment), communication between the clinic and patients (eg, telephone calls from patients or appointment letters), and patient care (eg, medication reconciliation and laboratory requisition).

In an improvement opportunity ticket, a staff member identified that the low seating in the patient waiting area was a fall risk and not diversified for varying body types. They posted a ticket, and the issue was discussed as a group. This staff member assumed ownership of the problem and placed an interior design request for taller chairs and bariatric options. The ticket was resolved when the waiting area was upgraded to include safer and more inclusive seating options for patients. Of 55 tickets submitted by staff as of June 2024, 45 have identified solutions, 4 are in process, and 6 have been placed in the parking lot. On average, the morning huddle spends about 5 to 10 minutes addressing tickets, but on occasion, more complex topics require additional time. The kudos board receives feedback from patients who express their gratitude, and serves as a space to celebrate awards received by staff members.

Implementing a VMB into daily huddles within the cardiology clinic led to increased staff engagement and ownership of challenges, as well as improved communication between frontline workers and leadership. VMBs have proven to be useful for annual staff performance evaluations because staff members who engaged in the board and volunteered to take accountability for ticket resolution could use those accomplishments in their assessments. Finally, VMBs made quality improvement and safety work accessible by normalizing frequent conversations. This empowered staff to engage in improvement projects and even led some members to enroll in formal Lean training.

The outpatient cardiology clinic VMB at the VAAAHS was identified as a best practice during a site visit by the Promising Practice Team in the Veterans Health Administration Office of Integrated Veteran Care. The outpatient cardiology clinic leadership team, including the authors of this article, was invited to present our visual management work as a main topic at the January 2024 Office of Integrated Veteran Care collaborative meeting.

Further Implementation

The SR program has collaborated with additional VAAAHS teams to implement VMBs. Forty-four physical VMBs and 20 virtual VMBs are currently in use throughout the VAAAHS. Virtual VMB content is similar to a physical board and can be modified by each team to meet its particular needs. Several virtual VMBs have been implemented at the VAAAHS and can achieve the same goals of staff teamwork, empowerment, and engagement. Each team can choose the format of the VMB that best fits their needs, which may be partially influenced by the team’s overall interaction style (on-site teams may function better with a physical VMB, and off-site teams may find a virtual VMB works best). VMBs have been implemented in various work areas, including laboratories, inpatient wards, subspecialty outpatient clinics, procedural areas, and the engineering department. In fiscal year 2024, 180 tickets were electronically submitted by teams across the VAAAHS, of which 170 identified solutions and were marked completed. Ticket counts may be underestimated since not all physical board tickets are reported in the electronic system. The SR program periodically attends morning huddles of various teams and obtains feedback on their VMBs, a practice that highlights its contribution to staff engagement, transparency, teamwork, and continuous improvement (Table). A goal of the SR program is to identify areas of the VAAAHS in which VMBs would add value to the team and implement them as necessary.

Discussion

VMBs are common in health care and are implemented to promote the core principlesof Lean thinking and HROs, including visual management and daily accountability. The goals of a visual management tool are to make problems visible and document their management. A VMB can serve as a focal point for team discussion and a physical space to track each problem through its initial identification, understanding of root causes, consideration of potential solutions, and recording of intervention results.

A VMB can foster a culture of safety, leadership commitment, and continuous process improvement when designed and implemented to reflect team needs. VMBs can empower staff members to share work concerns and openly promote engagement. As a central place for discussion between staff and leaders, VMBs can also foster teamwork and communication. The daily huddle provides a safe, productive working environment by ensuring that lines of communication are open among all team members, regardless of role or leadership designation.

Limitations

This article focused on the implementation of 1 type of visual management tool. It provides an in-depth discussion of the development, implementation, and experience with a VMB at multiple clinics of a single section in 1 health care system. These reported experiences may not represent other VA facilities. Perceptions of the impact and usefulness of the VMB were mostly anecdotal. Further evaluation of the VMB implementation experience and utility at other VA health care systems would provide additional insight into the optimal implementation of VMBs.

Conclusions

Through increased transparency, empowerment, and communication, VMBs are an important tool in the visual management tool belt for organizations committed to HROs and Lean management. Given the successful institution of VMBs at the VAAAHS, the description of our experience may aid other VA systems for the incorporation of visual management into the daily culture of their respective health care teams.

It is common practice to routinely measure postoperative hematocrit levels at US Department of Veterans Affairs (VA) hospitals for a wide range of elective general surgeries. While hematocrit measurement is a low-cost test, the high frequency with which these tests are performed may drastically increase overall costs.

Numerous studies have suggested that physicians overuse laboratory testing.^1-10 Kohli and colleagues recommended that the routine practice of obtaining postoperative hematocrit tests following elective gynecologic surgery be abandoned.¹ A similar recommendation was made by Olus and colleagues after studying uneventful, unplanned cesarean sections and by Wu and colleagues after investigating routine laboratory tests post total hip arthroplasty.^2,3

To our knowledge, a study assessing routine postoperative hematocrit testing in elective general surgery has not yet been conducted. Many laboratory tests ordered in the perioperative period are not indicated, including complete blood count (CBC), electrolytes, and coagulation studies.⁴ Based on the results of these studies, we expected that the routine measurement of postoperative hematocrit levels after elective general surgeries at VA medical centers would not be cost effective. A PubMed search for articles published from 1990 to 2023 using the search terms “hematocrit,” “hemoglobin,” “general,” “surgery,” “routine,” and “cost” or “cost-effectiveness,” suggests that the clinical usefulness of postoperative hematocrit testing has not been well studied in the general surgery setting. The purpose of this study was to determine the clinical utility and associated cost of measuring routine postoperative hematocrit levels in order to generate a guide as to when the practice is warranted following common elective general surgery.

Although gynecologic textbooks may describe recommendations of routine hematocrit checking after elective gynecologic operations, one has difficulty finding the same recommendations in general surgery textbooks.¹ However, it is common practice for surgical residents and attending surgeons to routinely order hematocrit on postoperative day-1 to ensure that the operation did not result in unsuspected anemia that then would need treatment (either with fluids or a blood transfusion). Many other surgeons rely on clinical factors such as tachycardia, oliguria, or hypotension to trigger a hematocrit (and other laboratory) tests. Our hypothesis is that the latter group has chosen the most cost-effective and prudent practice. One problem with checking the hematocrit routinely, as with any other screening test, is what to do with an abnormal result, assuming an asymptomatic patient? If the postoperative hematocrit is lower than expected given the estimated blood loss (EBL), what is one to do?

Methods

This retrospective case-control study conducted at the New Mexico VA Health Care System (NMVAHCS) in Albuquerque compared data for patients who received transfusion within 72 hours of elective surgeries vs patients who did not. Patients who underwent elective general surgery from January 2011 through December 2014 were included. An elective general surgery was defined as surgery performed following an outpatient preoperative anesthesia evaluation ≥ 30 days prior to operation. Patients who underwent emergency operations, and those with baseline anemia (preoperative hematocrit < 30%), and those transfused > 72 hours after their operation were excluded. The NMVAHCSInstitutional Review Board approved this study (No. 15-H184).

A detailed record review was conducted to collect data on demographics and other preoperative risk factors, including age, sex, body mass index (BMI), race and ethnicity, cardiac and pulmonary comorbidities, tobacco use, alcohol intake, diabetes, American Society of Anesthesiologists Physical Status Classification, metabolic equivalent of task, hematologic conditions, and renal disease.

For each procedure, we recorded the type of elective general surgery performed, the diagnosis/indication, pre- and postoperative hemoglobin/hematocrit, intraoperative EBL, length of operation, surgical wound class, length of hospital stay (LOS), intensive care unit (ICU) status, number of hematocrit tests, cardiovascular risk of operation (defined by anesthesia assessment), presence or absence of malignancy, preoperative platelet count, albumin level, preoperative prothrombin time/activated partial thromboplastin time (aPTT), international normalized ratio (INR), hemoglobin A_1c, and incidence of transfusion. Signs and symptoms of anemia were recorded as present if the postoperative vital signs suggested low intravascular volume (pulse > 120 beats/minute, systolic blood pressure < 90 mm Hg, or vasoactive medication requirement [per anesthesia postoperative note]) or if the patient reported or exhibited symptoms of dizziness or fatigue or evidence of clinically apparent bleeding (ie, hematoma formation). Laboratory charges for hematocrit tests and CBC at the NMAVAHCS were used to assess cost.¹¹

To stratify the transfusion risk, patients were distributed among 3 groups based on the following criteria: discharged home the same day as surgery; admitted but did not have postoperative hematocrit testing; and admitted and had postoperative hematocrit testing. We also stratified operations into low or high risk based on the risk for postoperative transfusion (Figure). Recognizing that the American College of Chest Physicians guidelines for perioperative management of antithrombotic therapy places bowel resection in a high-risk category, we designated a surgery as high risk when ≥ 2 patients in the transfusion group had that type of surgery over the 4 years of the study.¹² Otherwise, the operations were deemed low risk.

Statistical Analysis

Numeric analysis used t tests and Binary and categorical variables used Fisher exact tests. P value ≤ .05 was considered statistically significant. SAS software was used for all statistical analyses.

From 2011 through 2014, 1531 patients had elective general surgery at NMVAHCS. Twenty-two patients with preoperative anemia (hematocrit < 30%) and 1 patient who received a transfusion > 72 hours after the operation were excluded. Most elective operations (70%, n = 1075) were performed on an outpatient basis; none involved transfusion. Inguinal hernia repair was most common with 479 operations; 17 patients were treated inpatient of which 2 patients had routine postoperative hematocrit checks; (neither received transfusion). One patient with inguinal hernia surgery received transfusion without routine postoperative hematocrit monitoring.

Of 112 partial colon resections, 1 patient had a postoperative transfusion; and all but 3 received postoperative hematocrit monitoring. Nineteen patients undergoing partial colon resection had a clinical indication for postoperative hematocrit monitoring. None of the 5 patients with partial gastrectomy received a postoperative transfusion. Of 121 elective cholecystectomies, no patients had postoperative transfusion, whereas 34 had postoperative hematocrit monitoring; only 2 patients had a clinical reason for the hematocrit monitoring.

Of 430 elective inpatient operations, 12 received transfusions and 288 patients had ≥ 1 postoperative hematocrit test (67%). All hematocrit tests were requested by the attending surgeon, resident surgeon, or the surgical ICU team. Of the group that had postoperative hematocrit monitoring, there was an average of 4.4 postoperative hematocrit tests per patient (range, 1-44).

There were 12 transfusions for inpatients (2.8%), which is similar to the findings of a recent study of VA general surgery (2.3%).¹³ Five of the 12 patients received intraoperative transfusions while 7 were transfused within 72 hours postoperation. All but 1 patient receiving transfusion had EBL > 199 mL (range, 5-3000; mean, 950 mL; median, 500 mL) and/or signs or symptoms of anemia or other indications for measurement of the postoperative hematocrit. There were no statistically significant differences in patients’ age, sex, BMI, or race and ethnicity between groups receiving and not receiving transfusion (Table 1).

When comparing the transfusion vs the nontransfusion groups (after excluding those with clinical preoperative anemia) the risk factors for transfusion included: relatively low mean preoperative hematocrit (mean, 36.9% vs 42.7%, respectively; P = .003), low postoperative hematocrit (mean, 30.2% vs 37.1%, respectively; P < .001), high EBL (mean, 844 mL vs 109 mL, respectively; P = .005), large infusion of intraoperative fluids (mean, 4625 mL vs 2505 mL, respectively; P = .005), longer duration of operation (mean, 397 min vs 183 min, respectively; P < .001), and longer LOS (mean, 14.5 d vs 4.9 d, respectively; P < .001) (Table 2). Similarly, we found an increased risk for transfusion with high/intermediate cardiovascular risk (vs low), any wound not classified as clean, ICU stay, and postoperative symptoms of anemia.

We found no increased risk for transfusion with ethanol, tobacco, warfarin, or clopidogrel use; polycythemia; thrombocytopenia; preoperative INR; preoperative aPTT; preoperative albumin; Hemoglobin A_1c; or diabetes mellitus; or for operations performed for malignancy. Ten patients in the ICU received transfusion (5.8%) compared with 2 patients (0.8%) not admitted to the ICU.

Operations were deemed high risk when ≥ 2 of patients having that operation received transfusions within 72 hours of their operation. There were 15 abdominoperineal resections; 3 of these received transfusions (20%). There were 7 total abdominal colectomies; 3 of these received transfusions (43%). We therefore had 22 high-risk operations, 6 of which were transfused (27%).

Routine measurement of postoperative hematocrit levels after elective general surgery at NMVAHCS was not necessary. There were 12 transfusions for inpatients (2.8%), which is similar to the findings of a recent study of VA general surgery (2.3%).¹³ We found that routine postoperative hematocrit measurements to assess anemia had little or no effect on clinical decision-making or clinical outcomes.

According to our results, 88% of initial hematocrit tests after elective partial colectomies could have been eliminated; only 32 of 146 patients demonstrated a clinical reason for postoperative hematocrit testing. Similarly, 36 of 40 postcholecystectomy hematocrit tests (90%) could have been eliminated had the surgeons relied on clinical signs indicating possible postoperative anemia (none were transfused). Excluding patients with major intraoperative blood loss (> 300 mL), only 29 of 288 (10%) patients who had postoperative hematocrit tests had a clinical indication for a postoperative hematocrit test (ie, symptoms of anemia and/or active bleeding). One patient with inguinal hernia surgery who received transfusion was taking an anticoagulant and had a clinically indicated hematocrit test for a large hematoma that eventually required reoperation.

Our study found that routine hematocrit checks may actually increase the risk that a patient would receive an unnecessary transfusion. For instance, one elderly patient, after a right colectomy, had 6 hematocrit levels while on a heparin drip and received transfusion despite being asymptomatic. His lowest hematocrit level prior to transfusion was 23.7%. This patient had a total of 18 hematocrit tests. His EBL was 350 mL and his first postoperative HCT level was 33.1%. In another instance, a patient undergoing abdominoperineal resection had a transfusion on postoperative day 1, despite being hypertensive, with a hematocrit that ranged from 26% before transfusion to 31% after the transfusion. These 2 cases illustrate what has been shown in a recent study: A substantial number of patients with colorectal cancer receive unnecessary transfusions.¹⁴ On the other hand, one ileostomy closure patient had 33 hematocrit tests, yet his initial postoperative hematocrit was 37%, and he never received a transfusion. With low-risk surgeries, clinical judgment should dictate when a postoperative hematocrit level is needed. This strategy would have eliminated 206 unnecessary initial postoperative hematocrit tests (72%), could have decreased the number of unnecessary transfusions, and would have saved NMVAHCS about $1600 annually.

Abdominoperineal resections and total abdominal colectomies accounted for a high proportion of transfusions in our study. Inpatient elective operations can be risk stratified and have routine hematocrit tests ordered for patients at high risk. The probability of transfusion was greater in high-risk vs low-risk surgeries; 27% (6 of 22 patients) vs 2% (6 of 408 patients), respectively (P < .001). Since 14 of the 22 patients undergoing high-risk operation already had clinical reasons for a postoperative hematocrit test, we only need to add the remaining 8 patients with high-risk operations to the 74 who had a clinical reason for a hematocrit test and conclude that 82 of 430 patients (19%) had a clinical reason for a hematocrit test, either from signs or symptoms of blood loss or because they were in a high-risk group.

While our elective general surgery cases may not represent many general surgery programs in the US and VA health care systems, we can extrapolate cost savings using the same cost analyses outlined by Kohli and colleagues.¹ Assuming 1.9 million elective inpatient general surgeries per year in the United States with an average cost of $21 per CBC, the annual cost of universal postoperative hematocrit testing would be $40 million.^11,15 If postoperative hematocrit testing were 70% consistent with our findings, the annual cost for hematocrit tests on 51% of the inpatient general surgeries would be approximately $20.4 million. A reduction in routine hematocrit testing to 25% of all inpatient general surgeries (vs our finding that 19% were deemed necessary) results in an annual savings of $30 million. This conservative estimate could be even higher since there were 4.4 hematocrit tests per patient; therefore, we have about $132 million in savings.

Assuming 181,384 elective VA inpatient general surgeries each year, costing $7.14 per CBC (the NMVAHCS cost), the VA could save $1.3 million annually. If postoperative HCT testing were 70% consistent with our findings, the annual cost for hematocrit tests on 50.4% of inpatient general surgery operations would be about $653,000. A reduction in routine hematocrit testing to 25% of all inpatient general surgeries (vs our 19%) results in annual VA savings of $330,000. This conservative estimate could be even higher since there were on average 4.4 hematocrit levels per patient; therefore, we estimate that annual savings for the VA of about $1.45 million.

Limitations

The retrospective chart review nature of this study may have led to selection bias. Only a small number of patients received a transfusion, which may have skewed the data. This study population comes from a single VA medical center; this patient population may not be reflective of other VA medical centers or the US population as a whole. Given that NMVAHCS does not perform hepatic, esophageal, pancreas, or transplant operations, the potential savings to both the US and the VA may be overestimated, but this could be studied in the future by VA medical centers that perform more complex operations.

Conclusions

This study found that over a 4-year period routine postoperative hematocrit tests for patients undergoing elective general surgery at a VA medical center were not necessary. General surgeons routinely order various pre- and postoperative laboratory tests despite their limited utility. Reduction in unneeded routine tests could result in notable savings to the VA without compromising quality of care.

Only general surgery patients undergoing operations that carry a high risk for needing a blood transfusion should have a routine postoperative hematocrit testing. In our study population, the chance of an elective colectomy, cholecystectomy, or hernia patient needing a transfusion was rare. This strategy could eliminate a considerable number of unnecessary blood tests and would potentially yield significant savings.

It is common practice to routinely measure postoperative hematocrit levels at US Department of Veterans Affairs (VA) hospitals for a wide range of elective general surgeries. While hematocrit measurement is a low-cost test, the high frequency with which these tests are performed may drastically increase overall costs.

Numerous studies have suggested that physicians overuse laboratory testing.^1-10 Kohli and colleagues recommended that the routine practice of obtaining postoperative hematocrit tests following elective gynecologic surgery be abandoned.¹ A similar recommendation was made by Olus and colleagues after studying uneventful, unplanned cesarean sections and by Wu and colleagues after investigating routine laboratory tests post total hip arthroplasty.^2,3

To our knowledge, a study assessing routine postoperative hematocrit testing in elective general surgery has not yet been conducted. Many laboratory tests ordered in the perioperative period are not indicated, including complete blood count (CBC), electrolytes, and coagulation studies.⁴ Based on the results of these studies, we expected that the routine measurement of postoperative hematocrit levels after elective general surgeries at VA medical centers would not be cost effective. A PubMed search for articles published from 1990 to 2023 using the search terms “hematocrit,” “hemoglobin,” “general,” “surgery,” “routine,” and “cost” or “cost-effectiveness,” suggests that the clinical usefulness of postoperative hematocrit testing has not been well studied in the general surgery setting. The purpose of this study was to determine the clinical utility and associated cost of measuring routine postoperative hematocrit levels in order to generate a guide as to when the practice is warranted following common elective general surgery.

Although gynecologic textbooks may describe recommendations of routine hematocrit checking after elective gynecologic operations, one has difficulty finding the same recommendations in general surgery textbooks.¹ However, it is common practice for surgical residents and attending surgeons to routinely order hematocrit on postoperative day-1 to ensure that the operation did not result in unsuspected anemia that then would need treatment (either with fluids or a blood transfusion). Many other surgeons rely on clinical factors such as tachycardia, oliguria, or hypotension to trigger a hematocrit (and other laboratory) tests. Our hypothesis is that the latter group has chosen the most cost-effective and prudent practice. One problem with checking the hematocrit routinely, as with any other screening test, is what to do with an abnormal result, assuming an asymptomatic patient? If the postoperative hematocrit is lower than expected given the estimated blood loss (EBL), what is one to do?

Methods

This retrospective case-control study conducted at the New Mexico VA Health Care System (NMVAHCS) in Albuquerque compared data for patients who received transfusion within 72 hours of elective surgeries vs patients who did not. Patients who underwent elective general surgery from January 2011 through December 2014 were included. An elective general surgery was defined as surgery performed following an outpatient preoperative anesthesia evaluation ≥ 30 days prior to operation. Patients who underwent emergency operations, and those with baseline anemia (preoperative hematocrit < 30%), and those transfused > 72 hours after their operation were excluded. The NMVAHCSInstitutional Review Board approved this study (No. 15-H184).

A detailed record review was conducted to collect data on demographics and other preoperative risk factors, including age, sex, body mass index (BMI), race and ethnicity, cardiac and pulmonary comorbidities, tobacco use, alcohol intake, diabetes, American Society of Anesthesiologists Physical Status Classification, metabolic equivalent of task, hematologic conditions, and renal disease.

For each procedure, we recorded the type of elective general surgery performed, the diagnosis/indication, pre- and postoperative hemoglobin/hematocrit, intraoperative EBL, length of operation, surgical wound class, length of hospital stay (LOS), intensive care unit (ICU) status, number of hematocrit tests, cardiovascular risk of operation (defined by anesthesia assessment), presence or absence of malignancy, preoperative platelet count, albumin level, preoperative prothrombin time/activated partial thromboplastin time (aPTT), international normalized ratio (INR), hemoglobin A_1c, and incidence of transfusion. Signs and symptoms of anemia were recorded as present if the postoperative vital signs suggested low intravascular volume (pulse > 120 beats/minute, systolic blood pressure < 90 mm Hg, or vasoactive medication requirement [per anesthesia postoperative note]) or if the patient reported or exhibited symptoms of dizziness or fatigue or evidence of clinically apparent bleeding (ie, hematoma formation). Laboratory charges for hematocrit tests and CBC at the NMAVAHCS were used to assess cost.¹¹

To stratify the transfusion risk, patients were distributed among 3 groups based on the following criteria: discharged home the same day as surgery; admitted but did not have postoperative hematocrit testing; and admitted and had postoperative hematocrit testing. We also stratified operations into low or high risk based on the risk for postoperative transfusion (Figure). Recognizing that the American College of Chest Physicians guidelines for perioperative management of antithrombotic therapy places bowel resection in a high-risk category, we designated a surgery as high risk when ≥ 2 patients in the transfusion group had that type of surgery over the 4 years of the study.¹² Otherwise, the operations were deemed low risk.

Statistical Analysis

Numeric analysis used t tests and Binary and categorical variables used Fisher exact tests. P value ≤ .05 was considered statistically significant. SAS software was used for all statistical analyses.

From 2011 through 2014, 1531 patients had elective general surgery at NMVAHCS. Twenty-two patients with preoperative anemia (hematocrit < 30%) and 1 patient who received a transfusion > 72 hours after the operation were excluded. Most elective operations (70%, n = 1075) were performed on an outpatient basis; none involved transfusion. Inguinal hernia repair was most common with 479 operations; 17 patients were treated inpatient of which 2 patients had routine postoperative hematocrit checks; (neither received transfusion). One patient with inguinal hernia surgery received transfusion without routine postoperative hematocrit monitoring.

Of 112 partial colon resections, 1 patient had a postoperative transfusion; and all but 3 received postoperative hematocrit monitoring. Nineteen patients undergoing partial colon resection had a clinical indication for postoperative hematocrit monitoring. None of the 5 patients with partial gastrectomy received a postoperative transfusion. Of 121 elective cholecystectomies, no patients had postoperative transfusion, whereas 34 had postoperative hematocrit monitoring; only 2 patients had a clinical reason for the hematocrit monitoring.

Of 430 elective inpatient operations, 12 received transfusions and 288 patients had ≥ 1 postoperative hematocrit test (67%). All hematocrit tests were requested by the attending surgeon, resident surgeon, or the surgical ICU team. Of the group that had postoperative hematocrit monitoring, there was an average of 4.4 postoperative hematocrit tests per patient (range, 1-44).

There were 12 transfusions for inpatients (2.8%), which is similar to the findings of a recent study of VA general surgery (2.3%).¹³ Five of the 12 patients received intraoperative transfusions while 7 were transfused within 72 hours postoperation. All but 1 patient receiving transfusion had EBL > 199 mL (range, 5-3000; mean, 950 mL; median, 500 mL) and/or signs or symptoms of anemia or other indications for measurement of the postoperative hematocrit. There were no statistically significant differences in patients’ age, sex, BMI, or race and ethnicity between groups receiving and not receiving transfusion (Table 1).

When comparing the transfusion vs the nontransfusion groups (after excluding those with clinical preoperative anemia) the risk factors for transfusion included: relatively low mean preoperative hematocrit (mean, 36.9% vs 42.7%, respectively; P = .003), low postoperative hematocrit (mean, 30.2% vs 37.1%, respectively; P < .001), high EBL (mean, 844 mL vs 109 mL, respectively; P = .005), large infusion of intraoperative fluids (mean, 4625 mL vs 2505 mL, respectively; P = .005), longer duration of operation (mean, 397 min vs 183 min, respectively; P < .001), and longer LOS (mean, 14.5 d vs 4.9 d, respectively; P < .001) (Table 2). Similarly, we found an increased risk for transfusion with high/intermediate cardiovascular risk (vs low), any wound not classified as clean, ICU stay, and postoperative symptoms of anemia.

We found no increased risk for transfusion with ethanol, tobacco, warfarin, or clopidogrel use; polycythemia; thrombocytopenia; preoperative INR; preoperative aPTT; preoperative albumin; Hemoglobin A_1c; or diabetes mellitus; or for operations performed for malignancy. Ten patients in the ICU received transfusion (5.8%) compared with 2 patients (0.8%) not admitted to the ICU.

Operations were deemed high risk when ≥ 2 of patients having that operation received transfusions within 72 hours of their operation. There were 15 abdominoperineal resections; 3 of these received transfusions (20%). There were 7 total abdominal colectomies; 3 of these received transfusions (43%). We therefore had 22 high-risk operations, 6 of which were transfused (27%).

Routine measurement of postoperative hematocrit levels after elective general surgery at NMVAHCS was not necessary. There were 12 transfusions for inpatients (2.8%), which is similar to the findings of a recent study of VA general surgery (2.3%).¹³ We found that routine postoperative hematocrit measurements to assess anemia had little or no effect on clinical decision-making or clinical outcomes.

According to our results, 88% of initial hematocrit tests after elective partial colectomies could have been eliminated; only 32 of 146 patients demonstrated a clinical reason for postoperative hematocrit testing. Similarly, 36 of 40 postcholecystectomy hematocrit tests (90%) could have been eliminated had the surgeons relied on clinical signs indicating possible postoperative anemia (none were transfused). Excluding patients with major intraoperative blood loss (> 300 mL), only 29 of 288 (10%) patients who had postoperative hematocrit tests had a clinical indication for a postoperative hematocrit test (ie, symptoms of anemia and/or active bleeding). One patient with inguinal hernia surgery who received transfusion was taking an anticoagulant and had a clinically indicated hematocrit test for a large hematoma that eventually required reoperation.

Our study found that routine hematocrit checks may actually increase the risk that a patient would receive an unnecessary transfusion. For instance, one elderly patient, after a right colectomy, had 6 hematocrit levels while on a heparin drip and received transfusion despite being asymptomatic. His lowest hematocrit level prior to transfusion was 23.7%. This patient had a total of 18 hematocrit tests. His EBL was 350 mL and his first postoperative HCT level was 33.1%. In another instance, a patient undergoing abdominoperineal resection had a transfusion on postoperative day 1, despite being hypertensive, with a hematocrit that ranged from 26% before transfusion to 31% after the transfusion. These 2 cases illustrate what has been shown in a recent study: A substantial number of patients with colorectal cancer receive unnecessary transfusions.¹⁴ On the other hand, one ileostomy closure patient had 33 hematocrit tests, yet his initial postoperative hematocrit was 37%, and he never received a transfusion. With low-risk surgeries, clinical judgment should dictate when a postoperative hematocrit level is needed. This strategy would have eliminated 206 unnecessary initial postoperative hematocrit tests (72%), could have decreased the number of unnecessary transfusions, and would have saved NMVAHCS about $1600 annually.

Abdominoperineal resections and total abdominal colectomies accounted for a high proportion of transfusions in our study. Inpatient elective operations can be risk stratified and have routine hematocrit tests ordered for patients at high risk. The probability of transfusion was greater in high-risk vs low-risk surgeries; 27% (6 of 22 patients) vs 2% (6 of 408 patients), respectively (P < .001). Since 14 of the 22 patients undergoing high-risk operation already had clinical reasons for a postoperative hematocrit test, we only need to add the remaining 8 patients with high-risk operations to the 74 who had a clinical reason for a hematocrit test and conclude that 82 of 430 patients (19%) had a clinical reason for a hematocrit test, either from signs or symptoms of blood loss or because they were in a high-risk group.

While our elective general surgery cases may not represent many general surgery programs in the US and VA health care systems, we can extrapolate cost savings using the same cost analyses outlined by Kohli and colleagues.¹ Assuming 1.9 million elective inpatient general surgeries per year in the United States with an average cost of $21 per CBC, the annual cost of universal postoperative hematocrit testing would be $40 million.^11,15 If postoperative hematocrit testing were 70% consistent with our findings, the annual cost for hematocrit tests on 51% of the inpatient general surgeries would be approximately $20.4 million. A reduction in routine hematocrit testing to 25% of all inpatient general surgeries (vs our finding that 19% were deemed necessary) results in an annual savings of $30 million. This conservative estimate could be even higher since there were 4.4 hematocrit tests per patient; therefore, we have about $132 million in savings.

Assuming 181,384 elective VA inpatient general surgeries each year, costing $7.14 per CBC (the NMVAHCS cost), the VA could save $1.3 million annually. If postoperative HCT testing were 70% consistent with our findings, the annual cost for hematocrit tests on 50.4% of inpatient general surgery operations would be about $653,000. A reduction in routine hematocrit testing to 25% of all inpatient general surgeries (vs our 19%) results in annual VA savings of $330,000. This conservative estimate could be even higher since there were on average 4.4 hematocrit levels per patient; therefore, we estimate that annual savings for the VA of about $1.45 million.

Limitations

The retrospective chart review nature of this study may have led to selection bias. Only a small number of patients received a transfusion, which may have skewed the data. This study population comes from a single VA medical center; this patient population may not be reflective of other VA medical centers or the US population as a whole. Given that NMVAHCS does not perform hepatic, esophageal, pancreas, or transplant operations, the potential savings to both the US and the VA may be overestimated, but this could be studied in the future by VA medical centers that perform more complex operations.

Conclusions

This study found that over a 4-year period routine postoperative hematocrit tests for patients undergoing elective general surgery at a VA medical center were not necessary. General surgeons routinely order various pre- and postoperative laboratory tests despite their limited utility. Reduction in unneeded routine tests could result in notable savings to the VA without compromising quality of care.

Only general surgery patients undergoing operations that carry a high risk for needing a blood transfusion should have a routine postoperative hematocrit testing. In our study population, the chance of an elective colectomy, cholecystectomy, or hernia patient needing a transfusion was rare. This strategy could eliminate a considerable number of unnecessary blood tests and would potentially yield significant savings.

It is common practice to routinely measure postoperative hematocrit levels at US Department of Veterans Affairs (VA) hospitals for a wide range of elective general surgeries. While hematocrit measurement is a low-cost test, the high frequency with which these tests are performed may drastically increase overall costs.

Numerous studies have suggested that physicians overuse laboratory testing.^1-10 Kohli and colleagues recommended that the routine practice of obtaining postoperative hematocrit tests following elective gynecologic surgery be abandoned.¹ A similar recommendation was made by Olus and colleagues after studying uneventful, unplanned cesarean sections and by Wu and colleagues after investigating routine laboratory tests post total hip arthroplasty.^2,3

To our knowledge, a study assessing routine postoperative hematocrit testing in elective general surgery has not yet been conducted. Many laboratory tests ordered in the perioperative period are not indicated, including complete blood count (CBC), electrolytes, and coagulation studies.⁴ Based on the results of these studies, we expected that the routine measurement of postoperative hematocrit levels after elective general surgeries at VA medical centers would not be cost effective. A PubMed search for articles published from 1990 to 2023 using the search terms “hematocrit,” “hemoglobin,” “general,” “surgery,” “routine,” and “cost” or “cost-effectiveness,” suggests that the clinical usefulness of postoperative hematocrit testing has not been well studied in the general surgery setting. The purpose of this study was to determine the clinical utility and associated cost of measuring routine postoperative hematocrit levels in order to generate a guide as to when the practice is warranted following common elective general surgery.

Although gynecologic textbooks may describe recommendations of routine hematocrit checking after elective gynecologic operations, one has difficulty finding the same recommendations in general surgery textbooks.¹ However, it is common practice for surgical residents and attending surgeons to routinely order hematocrit on postoperative day-1 to ensure that the operation did not result in unsuspected anemia that then would need treatment (either with fluids or a blood transfusion). Many other surgeons rely on clinical factors such as tachycardia, oliguria, or hypotension to trigger a hematocrit (and other laboratory) tests. Our hypothesis is that the latter group has chosen the most cost-effective and prudent practice. One problem with checking the hematocrit routinely, as with any other screening test, is what to do with an abnormal result, assuming an asymptomatic patient? If the postoperative hematocrit is lower than expected given the estimated blood loss (EBL), what is one to do?

Methods

This retrospective case-control study conducted at the New Mexico VA Health Care System (NMVAHCS) in Albuquerque compared data for patients who received transfusion within 72 hours of elective surgeries vs patients who did not. Patients who underwent elective general surgery from January 2011 through December 2014 were included. An elective general surgery was defined as surgery performed following an outpatient preoperative anesthesia evaluation ≥ 30 days prior to operation. Patients who underwent emergency operations, and those with baseline anemia (preoperative hematocrit < 30%), and those transfused > 72 hours after their operation were excluded. The NMVAHCSInstitutional Review Board approved this study (No. 15-H184).

A detailed record review was conducted to collect data on demographics and other preoperative risk factors, including age, sex, body mass index (BMI), race and ethnicity, cardiac and pulmonary comorbidities, tobacco use, alcohol intake, diabetes, American Society of Anesthesiologists Physical Status Classification, metabolic equivalent of task, hematologic conditions, and renal disease.

For each procedure, we recorded the type of elective general surgery performed, the diagnosis/indication, pre- and postoperative hemoglobin/hematocrit, intraoperative EBL, length of operation, surgical wound class, length of hospital stay (LOS), intensive care unit (ICU) status, number of hematocrit tests, cardiovascular risk of operation (defined by anesthesia assessment), presence or absence of malignancy, preoperative platelet count, albumin level, preoperative prothrombin time/activated partial thromboplastin time (aPTT), international normalized ratio (INR), hemoglobin A_1c, and incidence of transfusion. Signs and symptoms of anemia were recorded as present if the postoperative vital signs suggested low intravascular volume (pulse > 120 beats/minute, systolic blood pressure < 90 mm Hg, or vasoactive medication requirement [per anesthesia postoperative note]) or if the patient reported or exhibited symptoms of dizziness or fatigue or evidence of clinically apparent bleeding (ie, hematoma formation). Laboratory charges for hematocrit tests and CBC at the NMAVAHCS were used to assess cost.¹¹

To stratify the transfusion risk, patients were distributed among 3 groups based on the following criteria: discharged home the same day as surgery; admitted but did not have postoperative hematocrit testing; and admitted and had postoperative hematocrit testing. We also stratified operations into low or high risk based on the risk for postoperative transfusion (Figure). Recognizing that the American College of Chest Physicians guidelines for perioperative management of antithrombotic therapy places bowel resection in a high-risk category, we designated a surgery as high risk when ≥ 2 patients in the transfusion group had that type of surgery over the 4 years of the study.¹² Otherwise, the operations were deemed low risk.

Statistical Analysis

Numeric analysis used t tests and Binary and categorical variables used Fisher exact tests. P value ≤ .05 was considered statistically significant. SAS software was used for all statistical analyses.

From 2011 through 2014, 1531 patients had elective general surgery at NMVAHCS. Twenty-two patients with preoperative anemia (hematocrit < 30%) and 1 patient who received a transfusion > 72 hours after the operation were excluded. Most elective operations (70%, n = 1075) were performed on an outpatient basis; none involved transfusion. Inguinal hernia repair was most common with 479 operations; 17 patients were treated inpatient of which 2 patients had routine postoperative hematocrit checks; (neither received transfusion). One patient with inguinal hernia surgery received transfusion without routine postoperative hematocrit monitoring.

Of 112 partial colon resections, 1 patient had a postoperative transfusion; and all but 3 received postoperative hematocrit monitoring. Nineteen patients undergoing partial colon resection had a clinical indication for postoperative hematocrit monitoring. None of the 5 patients with partial gastrectomy received a postoperative transfusion. Of 121 elective cholecystectomies, no patients had postoperative transfusion, whereas 34 had postoperative hematocrit monitoring; only 2 patients had a clinical reason for the hematocrit monitoring.

Of 430 elective inpatient operations, 12 received transfusions and 288 patients had ≥ 1 postoperative hematocrit test (67%). All hematocrit tests were requested by the attending surgeon, resident surgeon, or the surgical ICU team. Of the group that had postoperative hematocrit monitoring, there was an average of 4.4 postoperative hematocrit tests per patient (range, 1-44).

There were 12 transfusions for inpatients (2.8%), which is similar to the findings of a recent study of VA general surgery (2.3%).¹³ Five of the 12 patients received intraoperative transfusions while 7 were transfused within 72 hours postoperation. All but 1 patient receiving transfusion had EBL > 199 mL (range, 5-3000; mean, 950 mL; median, 500 mL) and/or signs or symptoms of anemia or other indications for measurement of the postoperative hematocrit. There were no statistically significant differences in patients’ age, sex, BMI, or race and ethnicity between groups receiving and not receiving transfusion (Table 1).

When comparing the transfusion vs the nontransfusion groups (after excluding those with clinical preoperative anemia) the risk factors for transfusion included: relatively low mean preoperative hematocrit (mean, 36.9% vs 42.7%, respectively; P = .003), low postoperative hematocrit (mean, 30.2% vs 37.1%, respectively; P < .001), high EBL (mean, 844 mL vs 109 mL, respectively; P = .005), large infusion of intraoperative fluids (mean, 4625 mL vs 2505 mL, respectively; P = .005), longer duration of operation (mean, 397 min vs 183 min, respectively; P < .001), and longer LOS (mean, 14.5 d vs 4.9 d, respectively; P < .001) (Table 2). Similarly, we found an increased risk for transfusion with high/intermediate cardiovascular risk (vs low), any wound not classified as clean, ICU stay, and postoperative symptoms of anemia.

We found no increased risk for transfusion with ethanol, tobacco, warfarin, or clopidogrel use; polycythemia; thrombocytopenia; preoperative INR; preoperative aPTT; preoperative albumin; Hemoglobin A_1c; or diabetes mellitus; or for operations performed for malignancy. Ten patients in the ICU received transfusion (5.8%) compared with 2 patients (0.8%) not admitted to the ICU.

Operations were deemed high risk when ≥ 2 of patients having that operation received transfusions within 72 hours of their operation. There were 15 abdominoperineal resections; 3 of these received transfusions (20%). There were 7 total abdominal colectomies; 3 of these received transfusions (43%). We therefore had 22 high-risk operations, 6 of which were transfused (27%).

Routine measurement of postoperative hematocrit levels after elective general surgery at NMVAHCS was not necessary. There were 12 transfusions for inpatients (2.8%), which is similar to the findings of a recent study of VA general surgery (2.3%).¹³ We found that routine postoperative hematocrit measurements to assess anemia had little or no effect on clinical decision-making or clinical outcomes.

According to our results, 88% of initial hematocrit tests after elective partial colectomies could have been eliminated; only 32 of 146 patients demonstrated a clinical reason for postoperative hematocrit testing. Similarly, 36 of 40 postcholecystectomy hematocrit tests (90%) could have been eliminated had the surgeons relied on clinical signs indicating possible postoperative anemia (none were transfused). Excluding patients with major intraoperative blood loss (> 300 mL), only 29 of 288 (10%) patients who had postoperative hematocrit tests had a clinical indication for a postoperative hematocrit test (ie, symptoms of anemia and/or active bleeding). One patient with inguinal hernia surgery who received transfusion was taking an anticoagulant and had a clinically indicated hematocrit test for a large hematoma that eventually required reoperation.

Our study found that routine hematocrit checks may actually increase the risk that a patient would receive an unnecessary transfusion. For instance, one elderly patient, after a right colectomy, had 6 hematocrit levels while on a heparin drip and received transfusion despite being asymptomatic. His lowest hematocrit level prior to transfusion was 23.7%. This patient had a total of 18 hematocrit tests. His EBL was 350 mL and his first postoperative HCT level was 33.1%. In another instance, a patient undergoing abdominoperineal resection had a transfusion on postoperative day 1, despite being hypertensive, with a hematocrit that ranged from 26% before transfusion to 31% after the transfusion. These 2 cases illustrate what has been shown in a recent study: A substantial number of patients with colorectal cancer receive unnecessary transfusions.¹⁴ On the other hand, one ileostomy closure patient had 33 hematocrit tests, yet his initial postoperative hematocrit was 37%, and he never received a transfusion. With low-risk surgeries, clinical judgment should dictate when a postoperative hematocrit level is needed. This strategy would have eliminated 206 unnecessary initial postoperative hematocrit tests (72%), could have decreased the number of unnecessary transfusions, and would have saved NMVAHCS about $1600 annually.

Abdominoperineal resections and total abdominal colectomies accounted for a high proportion of transfusions in our study. Inpatient elective operations can be risk stratified and have routine hematocrit tests ordered for patients at high risk. The probability of transfusion was greater in high-risk vs low-risk surgeries; 27% (6 of 22 patients) vs 2% (6 of 408 patients), respectively (P < .001). Since 14 of the 22 patients undergoing high-risk operation already had clinical reasons for a postoperative hematocrit test, we only need to add the remaining 8 patients with high-risk operations to the 74 who had a clinical reason for a hematocrit test and conclude that 82 of 430 patients (19%) had a clinical reason for a hematocrit test, either from signs or symptoms of blood loss or because they were in a high-risk group.

While our elective general surgery cases may not represent many general surgery programs in the US and VA health care systems, we can extrapolate cost savings using the same cost analyses outlined by Kohli and colleagues.¹ Assuming 1.9 million elective inpatient general surgeries per year in the United States with an average cost of $21 per CBC, the annual cost of universal postoperative hematocrit testing would be $40 million.^11,15 If postoperative hematocrit testing were 70% consistent with our findings, the annual cost for hematocrit tests on 51% of the inpatient general surgeries would be approximately $20.4 million. A reduction in routine hematocrit testing to 25% of all inpatient general surgeries (vs our finding that 19% were deemed necessary) results in an annual savings of $30 million. This conservative estimate could be even higher since there were 4.4 hematocrit tests per patient; therefore, we have about $132 million in savings.

Assuming 181,384 elective VA inpatient general surgeries each year, costing $7.14 per CBC (the NMVAHCS cost), the VA could save $1.3 million annually. If postoperative HCT testing were 70% consistent with our findings, the annual cost for hematocrit tests on 50.4% of inpatient general surgery operations would be about $653,000. A reduction in routine hematocrit testing to 25% of all inpatient general surgeries (vs our 19%) results in annual VA savings of $330,000. This conservative estimate could be even higher since there were on average 4.4 hematocrit levels per patient; therefore, we estimate that annual savings for the VA of about $1.45 million.

Limitations

The retrospective chart review nature of this study may have led to selection bias. Only a small number of patients received a transfusion, which may have skewed the data. This study population comes from a single VA medical center; this patient population may not be reflective of other VA medical centers or the US population as a whole. Given that NMVAHCS does not perform hepatic, esophageal, pancreas, or transplant operations, the potential savings to both the US and the VA may be overestimated, but this could be studied in the future by VA medical centers that perform more complex operations.

Conclusions

This study found that over a 4-year period routine postoperative hematocrit tests for patients undergoing elective general surgery at a VA medical center were not necessary. General surgeons routinely order various pre- and postoperative laboratory tests despite their limited utility. Reduction in unneeded routine tests could result in notable savings to the VA without compromising quality of care.

Only general surgery patients undergoing operations that carry a high risk for needing a blood transfusion should have a routine postoperative hematocrit testing. In our study population, the chance of an elective colectomy, cholecystectomy, or hernia patient needing a transfusion was rare. This strategy could eliminate a considerable number of unnecessary blood tests and would potentially yield significant savings.

The US Department of Veterans Affairs (VA) has partnered with academic medical centers and programs since 1946 to provide clinical training for physician residents. Ranking second in federal graduate medical education (GME) funding to the Centers for Medicare and Medicaid Services (CMS), the $850 million VA GME budget annually reimburses > 250 GME-sponsoring institutions (affiliates) of 8000 GME programs for the clinical training of 49,000 individual residents rotating through > 11,000 full-time equivalent (FTE) positions.¹ The VA also distributes $1.6 billion to VA facilities to offset the costs of conducting health professions education (HPE) (eg, facility infrastructure, salary support for VA instructors and preceptors, education office administration, and instructional equipment).² The VA financial and educational contributions account for payment of 11% of resident positions nationally and allow academic medical centers to be less reliant on CMS GME funding.^3,4 The VA contributions also provide opportunities for GME expansion,^1,5,6 educational innovations,^5,7 interprofessional and team-based care,^8,9 and quality and safety training.^10,11 The Table provides a comparison of CMS and VA GME reimbursability based on activity.

GME financing is complex, particularly the formulaic approach used by CMS, the details of which are often obscured in federal regulations. Due to this complexity and the $16 billion CMS GME budget, academic publications have focused on CMS GME financing while not fully explaining the VA GME policies and processes.^4,12-14 By comparison, the VA GME financing model is relatively straightforward and governed by different statues and VA regulations, yet sharing some of the same principles as CMS regulations. Given the challenges in CMS reimbursement to fully support the cost of resident education, as well as the educational opportunities at the VA, the VA designs its reimbursement model to assure that affiliates receive appropriate payments.^4,12,15 To ensure the continued success of VA GME partnerships, knowledge of VA GME financing has become increasingly important for designated institutional officers (DIOs) and residency program directors, particularly in light of recent investigations into oversight of the VA’s reimbursement to academic affiliates.^16-18 This report describes VA GME reimbursement and, where applicable, VA and CMS reimbursement policies are compared to highlight similarities, differences, and common principles.

VA AUTHORITY

While the VA’s primary mission is “to provide a complete hospital medical service for the medical care and treatment of veterans,”early VA leaders recognized the importance of affiliating with the nation’s academic institutions.¹⁹ In 1946, the VA Policy Memorandum Number 2 established a partnership between the VA and the academic medical community.²⁰ Additional legislation authorized specific agreements with academic affiliates for the central administration of salary and benefits for residents rotating at VA facilities. This process, known as disbursement, is an alternative payroll mechanism whereby the VA reimburses the academic affiliate for resident salary and benefits and the affiliate acts as the disbursing agent, issuing paychecks to residents.^21,22

Resident FUNDING

By policy, with rare exceptions, the VA does not sponsor residency programs due to the challenges of providing an appropriate patient mix of age, sex, and medical conditions to meet accreditation standards.⁴ Nearly all VA reimbursements are for residents in affiliate-sponsored programs, while just 1% pays for residents in legacy, VA-sponsored residency programs at 2 VA facilities. The VA budget for resident (including fellows) salary and benefits is managed by the VA Office of Academic Affiliations (OAA), the national VA office responsible for oversight, policy, and funding of VA HPE programs.

Resident Salaries and Benefits

VA funding of resident salary and benefits are analogous with CMS direct GME (DGME), which is designed to cover resident salary and benefits costs.^4,14,23 CMS DGME payments depend on a hospital’s volume of CMS inpatients and are based on a statutory formula, which uses the hospital’s resident FTE positions, the per-resident amount, and Medicare’s share of inpatient beds (Medicare patient load) to determine payments.¹² The per-resident amount is set by statute, varies geographically, and is calculated by dividing the hospital’s allowable costs of GME (percentage of CMS inpatient days) divided by the number of residents.^12,24

By comparison, the VA GME payment reimburses for each FTE based on the salary and benefits rate set by the academic affiliate. Reimbursement is calculated based on resident time spent at the VA multiplied by a daily salary rate. The daily salary rate is determined by dividing the resident’s total compensation (salary and benefits) by the number of calendar days in an academic year. Resident time spent at the VA facility is determined by obtaining rotation schedules provided by the academic affiliate and verifying resident clinical and educational activity during scheduled rotations.

Indirect Medical Education Funding

In addition to resident salary and benefits, funds to offset the cost of conducting HPE are provided to VA facilities. These funds are intended to improve and maintain necessary infrastructure for all HPE programs not just GME, including education office administration needs, teaching costs (ie, a portion of VA preceptors salary), and instructional equipment.

The Veterans Equitable Resource Allocation (VERA) is a national budgeting process for VA medical facilities that funds facility operational needs such as staff salary and benefits, infrastructure, and equipment.² The education portion of the VERA, the VERA Education Support Component (VESC), is not managed by the OAA, but rather is distributed through the VERA model to the general budget of VA facilities hosting HPE (Figure). VESC funding in the VA budget is based on labor mapping of physician time spent in education; other labor mapping categories include clinical care, research, and administration. VA facility VESC funding is calculated based on the number of paid health profession trainees (HPTs) from all professions, apportioned according to the number of FTEs for physician residents and VA-paid HPTs in other disciplines. In fiscal year 2024, VA facilities received $115,812 for each physician resident FTE position and $84,906 for each VA-paid, non-GME FTE position.

The VESC is like CMS's indirect GME funding, termed Indirect Medical Education (IME), an additional payment for each Medicare patient discharged reflecting teaching hospitals’ higher patient care costs relative to nonteaching hospitals. Described elsewhere, IME is calculated using a resident-to-bed ratio and a multiplier, which is set by statute.^4,25 While IME can be used for reimbursement for some resident clinical and educational activities(eg, research), VA VESC funds cannot be used for such activities and are part of the general facility budget and appropriated per the discretion of the medical facility director.

ESTABLISHING GME PARTNERSHIPS

An affiliation agreement establishes the administrative and legal requirements for educational relationships with academic affiliates and includes standards for conducting HPE, responsibilities for accreditation standards, program leadership, faculty, resources, supervision, academic policies, and procedures. The VA uses standardized affiliation agreement templates that have been vetted with accrediting bodies and the VA Office of General Counsel.

A disbursement agreement authorizes the VA to reimburse affiliates for resident salary and benefits for VA clinical and educational activities. The disbursement agreement details the fiscal arrangements (eg, payment in advance vs arrears, salary, and benefit rates, leave) for the reimbursement payments. Veterans Health Administration (VHA) Directive 1400.05 provides the policy and procedures for calculating reimbursement for HPT educational activities.²⁶

The VA facility designated education officer (DEO) oversees all HPE programs and coordinates the affiliation and disbursement agreement processes.²⁷ The DEO, affiliate DIO, residency program director, and VA residency site director determine the physician resident FTE positions assigned to a VA facility based on educational objectives and availability of educational resources at the VA facility, such as patient care opportunities, faculty supervisors, space, and equipment. The VA facility requests for resident FTE positions are submitted to the OAA by the facility DEO.

Once GME FTE positions are approved by the OAA, VA facilities work with their academic affiliate to submit the physician resident salary and benefit rate. Affiliate DIOs attest to the accuracy of the salary rate schedule and the local DEO submits the budget request to the OAA. Upon approval, the funds are transferred to the VA facility each fiscal year, which begins October 1. DEOs report quarterly to the OAA both budget needs and excesses based on variations in the approved FTEs due to additional VA rotations, physician resident attrition, or reassignment.

Resident Position Allocation

VA GME financing provides flexibility through periodic needs assessments and expansion initiatives. In August and December, DEOs collaborate with an academic affiliate to submit reports to the OAA confirming their projected GME needs for the next academic year. Additional positions requests are reviewed by the OAA; funding depends on budget and the educational justification. The OAA periodically issues GME expansion requests for proposal, which typically arise from legislation to address specific VA workforce needs. The VA facility DEO and affiliate GME leaders collaborate to apply for additional positions. For example, a VA GME expansion under the Veterans Access, Choice, and Accountability Act of 2014 added 1500 GME positions in 8 years for critically needed specialties and in rural and underserved areas.⁵ The Maintaining Internal Systems and Strengthening Outside Networks (MISSION) Act of 2018 authorized a pilot program for VA to fund residents at non-VA facilities with priority for Indian Health Services, Tribes and Tribal Organizations, Federally Qualified Health Centers, and US Department of Defense facilities to provide access to veterans in underserved areas.⁶

The VA GME financing system has flexibility to meet local needs for additional resident positions and to address broader VA workforce gaps through targeted expansion. Generally, CMS does not fund positions to address workforce needs, place residents in specific geographic areas, or require the training of certain types of residents.⁴ However, the Consolidated Appropriations Act of 2021 has provided the opportunity to address rural workforce needs.²⁸

Reimbursement

The VA provides reimbursement for clinical and educational activities performed in VA facilities for the benefit of veterans as well as research, didactics, meetings and conferences, annual and sick leave, and orientation. The VA also may provide reimbursement for educational activities that occur off VA grounds (eg, the VA proportional share of a residency program’s didactic sessions). The VA does not reimburse for affiliate clinical duties or administrative costs, although a national policy allows VA facilities to reimburse affiliates for some GME overhead costs.²⁹

CMS similarly reimburses for residency training time spent in patient care activities as well as orientation activities, didactics, leave, and, in some cases, research.^4,30,31 CMS makes payments to hospitals, which may include sponsoring institutions and Medicare-eligible participating training sites.^4,30,31 For both the VA and CMS, residents may not be counted twice for reimbursement by 2 federal agencies; in other words, a resident may not count for > 1 FTE.^4,30-32

GME Oversight

VA GME funding came under significant scrutiny. At a 2016 House Veterans Affairs Committee hearing, Representative Phil Roe, MD (R-Tennessee), noted that no process existed at many VA facilities for “determining trainee presence” and that many VA medical centers had “difficulty tracking resident rotations”¹⁶ A VA Office of the Inspector General investigation recommended that the VA implement policies and procedures to improve oversight to “ensure residents are fully participating in educational activities” and that the VA is “paying the correct amount” to the affiliate.¹⁷ A 2020 General Accountability Office report outlined unclear policy guidance, incomplete tracking of resident activities, and improper fiscal processes for reimbursement and reconciliation of affiliate invoices.¹⁸

In response, the OAA created an oversight and compliance unit, revised VHA Directive 1400.05 (the policy for disbursement), and improved resident tracking procedures.²⁶ The standard operating procedure that accompanied VHA Directive 1400.05 provides detailed information for the DEO and VA facility staff for tracking resident clinical and educational activities. FTE counts are essential to both VA and CMS for accurate reimbursement. The eAppendix and the Table provide a guide to reimbursable activities in the VA for the calculation of reimbursement, with a comparison to CMS.^33,34 The OAA in cooperation with other VA staff and officers periodically conducts audits to assess compliance with disbursement policy and affiliate reimbursement accuracy.

In the VA, resident activities are captured on the VA Educational Activity Record, a standardized spreadsheet to track activities and calculate reimbursement. Each VA facility hosting resident physicians manually records resident activity by the half-day. This process is labor intensive, involving both VA and affiliate staff to accurately reconcile payments. To address the workload demands, the OAA is developing an online tool that will automate aspects of the tracking process. Also, to ensure adequate staffing, the OAA is in the process of implementing an office optimization project, providing standardized position descriptions, an organizational chart, and staffing levels for DEO offices in VA facilities.

This report describes the key policies and principles of VA GME financing, highlighting the essential similarities and differences between VA and CMS. Neither the VA nor CMS regulations allow for reimbursement for > 1 FTE position per resident, a principle that underpins the assignment of resident rotations and federal funding for GME and are similar with respect to reimbursement for patient care activities, didactics, research, orientation, and scholarly activity. While reimbursable activities in the VA require physical presence and care of veteran patients, CMS also limits reimbursement to resident activities in the hospital and approved other settings if the hospital is paying for resident salary and benefits in these settings. The VA provides some flexibility for offsite activities including didactics and, in specific circumstances, remote care of veteran patients (eg, teleradiology).

The VA and CMS use different GME financing models. For example, the CMS calculations for resident FTEs are complex, whereas VA calculations reimburse the salary and benefits as set by the academic affiliate. The VA process accounts for local variation in salary rates, whereas the per-resident amount set by CMS varies regionally and does not fully account for differences in the cost of living.²⁴ Because all patients in VA facilities are veterans, VA calculations for reimbursement do not involve ratios of beds like the CMS calculations to determine a proportional share of reimbursement. The VA GME expansion tends to be more directed to VA health workforce needs than CMS, specifying the types of programs and geographic locations to address these needs.

The VA regularly reevaluates how affiliates are reimbursed for VA resident activity, balancing compliance with VA policies and the workload for VA and its affiliates. The VA obtains input from key stakeholders including DEOs, DIOs, and professional organizations such as the Association of American Medical Colleges and the Accreditation Council for Graduate Medical Education.^35,36

Looking ahead, the VA is developing an online tool to improve the accuracy of affiliate reimbursement. The VA will also implement a standardized staffing model, organizational structure, and position descriptions for DEO offices. These initiatives will help reduce the burden of tracking and verifying resident activity and continue to support the 77-year partnership between VA and its affiliated institutions.

The US Department of Veterans Affairs (VA) has partnered with academic medical centers and programs since 1946 to provide clinical training for physician residents. Ranking second in federal graduate medical education (GME) funding to the Centers for Medicare and Medicaid Services (CMS), the $850 million VA GME budget annually reimburses > 250 GME-sponsoring institutions (affiliates) of 8000 GME programs for the clinical training of 49,000 individual residents rotating through > 11,000 full-time equivalent (FTE) positions.¹ The VA also distributes $1.6 billion to VA facilities to offset the costs of conducting health professions education (HPE) (eg, facility infrastructure, salary support for VA instructors and preceptors, education office administration, and instructional equipment).² The VA financial and educational contributions account for payment of 11% of resident positions nationally and allow academic medical centers to be less reliant on CMS GME funding.^3,4 The VA contributions also provide opportunities for GME expansion,^1,5,6 educational innovations,^5,7 interprofessional and team-based care,^8,9 and quality and safety training.^10,11 The Table provides a comparison of CMS and VA GME reimbursability based on activity.

GME financing is complex, particularly the formulaic approach used by CMS, the details of which are often obscured in federal regulations. Due to this complexity and the $16 billion CMS GME budget, academic publications have focused on CMS GME financing while not fully explaining the VA GME policies and processes.^4,12-14 By comparison, the VA GME financing model is relatively straightforward and governed by different statues and VA regulations, yet sharing some of the same principles as CMS regulations. Given the challenges in CMS reimbursement to fully support the cost of resident education, as well as the educational opportunities at the VA, the VA designs its reimbursement model to assure that affiliates receive appropriate payments.^4,12,15 To ensure the continued success of VA GME partnerships, knowledge of VA GME financing has become increasingly important for designated institutional officers (DIOs) and residency program directors, particularly in light of recent investigations into oversight of the VA’s reimbursement to academic affiliates.^16-18 This report describes VA GME reimbursement and, where applicable, VA and CMS reimbursement policies are compared to highlight similarities, differences, and common principles.

VA AUTHORITY

While the VA’s primary mission is “to provide a complete hospital medical service for the medical care and treatment of veterans,”early VA leaders recognized the importance of affiliating with the nation’s academic institutions.¹⁹ In 1946, the VA Policy Memorandum Number 2 established a partnership between the VA and the academic medical community.²⁰ Additional legislation authorized specific agreements with academic affiliates for the central administration of salary and benefits for residents rotating at VA facilities. This process, known as disbursement, is an alternative payroll mechanism whereby the VA reimburses the academic affiliate for resident salary and benefits and the affiliate acts as the disbursing agent, issuing paychecks to residents.^21,22

Resident FUNDING

By policy, with rare exceptions, the VA does not sponsor residency programs due to the challenges of providing an appropriate patient mix of age, sex, and medical conditions to meet accreditation standards.⁴ Nearly all VA reimbursements are for residents in affiliate-sponsored programs, while just 1% pays for residents in legacy, VA-sponsored residency programs at 2 VA facilities. The VA budget for resident (including fellows) salary and benefits is managed by the VA Office of Academic Affiliations (OAA), the national VA office responsible for oversight, policy, and funding of VA HPE programs.

Resident Salaries and Benefits

VA funding of resident salary and benefits are analogous with CMS direct GME (DGME), which is designed to cover resident salary and benefits costs.^4,14,23 CMS DGME payments depend on a hospital’s volume of CMS inpatients and are based on a statutory formula, which uses the hospital’s resident FTE positions, the per-resident amount, and Medicare’s share of inpatient beds (Medicare patient load) to determine payments.¹² The per-resident amount is set by statute, varies geographically, and is calculated by dividing the hospital’s allowable costs of GME (percentage of CMS inpatient days) divided by the number of residents.^12,24

By comparison, the VA GME payment reimburses for each FTE based on the salary and benefits rate set by the academic affiliate. Reimbursement is calculated based on resident time spent at the VA multiplied by a daily salary rate. The daily salary rate is determined by dividing the resident’s total compensation (salary and benefits) by the number of calendar days in an academic year. Resident time spent at the VA facility is determined by obtaining rotation schedules provided by the academic affiliate and verifying resident clinical and educational activity during scheduled rotations.

Indirect Medical Education Funding

In addition to resident salary and benefits, funds to offset the cost of conducting HPE are provided to VA facilities. These funds are intended to improve and maintain necessary infrastructure for all HPE programs not just GME, including education office administration needs, teaching costs (ie, a portion of VA preceptors salary), and instructional equipment.

The Veterans Equitable Resource Allocation (VERA) is a national budgeting process for VA medical facilities that funds facility operational needs such as staff salary and benefits, infrastructure, and equipment.² The education portion of the VERA, the VERA Education Support Component (VESC), is not managed by the OAA, but rather is distributed through the VERA model to the general budget of VA facilities hosting HPE (Figure). VESC funding in the VA budget is based on labor mapping of physician time spent in education; other labor mapping categories include clinical care, research, and administration. VA facility VESC funding is calculated based on the number of paid health profession trainees (HPTs) from all professions, apportioned according to the number of FTEs for physician residents and VA-paid HPTs in other disciplines. In fiscal year 2024, VA facilities received $115,812 for each physician resident FTE position and $84,906 for each VA-paid, non-GME FTE position.

The VESC is like CMS's indirect GME funding, termed Indirect Medical Education (IME), an additional payment for each Medicare patient discharged reflecting teaching hospitals’ higher patient care costs relative to nonteaching hospitals. Described elsewhere, IME is calculated using a resident-to-bed ratio and a multiplier, which is set by statute.^4,25 While IME can be used for reimbursement for some resident clinical and educational activities(eg, research), VA VESC funds cannot be used for such activities and are part of the general facility budget and appropriated per the discretion of the medical facility director.

ESTABLISHING GME PARTNERSHIPS

An affiliation agreement establishes the administrative and legal requirements for educational relationships with academic affiliates and includes standards for conducting HPE, responsibilities for accreditation standards, program leadership, faculty, resources, supervision, academic policies, and procedures. The VA uses standardized affiliation agreement templates that have been vetted with accrediting bodies and the VA Office of General Counsel.

A disbursement agreement authorizes the VA to reimburse affiliates for resident salary and benefits for VA clinical and educational activities. The disbursement agreement details the fiscal arrangements (eg, payment in advance vs arrears, salary, and benefit rates, leave) for the reimbursement payments. Veterans Health Administration (VHA) Directive 1400.05 provides the policy and procedures for calculating reimbursement for HPT educational activities.²⁶

The VA facility designated education officer (DEO) oversees all HPE programs and coordinates the affiliation and disbursement agreement processes.²⁷ The DEO, affiliate DIO, residency program director, and VA residency site director determine the physician resident FTE positions assigned to a VA facility based on educational objectives and availability of educational resources at the VA facility, such as patient care opportunities, faculty supervisors, space, and equipment. The VA facility requests for resident FTE positions are submitted to the OAA by the facility DEO.

Once GME FTE positions are approved by the OAA, VA facilities work with their academic affiliate to submit the physician resident salary and benefit rate. Affiliate DIOs attest to the accuracy of the salary rate schedule and the local DEO submits the budget request to the OAA. Upon approval, the funds are transferred to the VA facility each fiscal year, which begins October 1. DEOs report quarterly to the OAA both budget needs and excesses based on variations in the approved FTEs due to additional VA rotations, physician resident attrition, or reassignment.

Resident Position Allocation

VA GME financing provides flexibility through periodic needs assessments and expansion initiatives. In August and December, DEOs collaborate with an academic affiliate to submit reports to the OAA confirming their projected GME needs for the next academic year. Additional positions requests are reviewed by the OAA; funding depends on budget and the educational justification. The OAA periodically issues GME expansion requests for proposal, which typically arise from legislation to address specific VA workforce needs. The VA facility DEO and affiliate GME leaders collaborate to apply for additional positions. For example, a VA GME expansion under the Veterans Access, Choice, and Accountability Act of 2014 added 1500 GME positions in 8 years for critically needed specialties and in rural and underserved areas.⁵ The Maintaining Internal Systems and Strengthening Outside Networks (MISSION) Act of 2018 authorized a pilot program for VA to fund residents at non-VA facilities with priority for Indian Health Services, Tribes and Tribal Organizations, Federally Qualified Health Centers, and US Department of Defense facilities to provide access to veterans in underserved areas.⁶

The VA GME financing system has flexibility to meet local needs for additional resident positions and to address broader VA workforce gaps through targeted expansion. Generally, CMS does not fund positions to address workforce needs, place residents in specific geographic areas, or require the training of certain types of residents.⁴ However, the Consolidated Appropriations Act of 2021 has provided the opportunity to address rural workforce needs.²⁸

Reimbursement

The VA provides reimbursement for clinical and educational activities performed in VA facilities for the benefit of veterans as well as research, didactics, meetings and conferences, annual and sick leave, and orientation. The VA also may provide reimbursement for educational activities that occur off VA grounds (eg, the VA proportional share of a residency program’s didactic sessions). The VA does not reimburse for affiliate clinical duties or administrative costs, although a national policy allows VA facilities to reimburse affiliates for some GME overhead costs.²⁹

CMS similarly reimburses for residency training time spent in patient care activities as well as orientation activities, didactics, leave, and, in some cases, research.^4,30,31 CMS makes payments to hospitals, which may include sponsoring institutions and Medicare-eligible participating training sites.^4,30,31 For both the VA and CMS, residents may not be counted twice for reimbursement by 2 federal agencies; in other words, a resident may not count for > 1 FTE.^4,30-32

GME Oversight

VA GME funding came under significant scrutiny. At a 2016 House Veterans Affairs Committee hearing, Representative Phil Roe, MD (R-Tennessee), noted that no process existed at many VA facilities for “determining trainee presence” and that many VA medical centers had “difficulty tracking resident rotations”¹⁶ A VA Office of the Inspector General investigation recommended that the VA implement policies and procedures to improve oversight to “ensure residents are fully participating in educational activities” and that the VA is “paying the correct amount” to the affiliate.¹⁷ A 2020 General Accountability Office report outlined unclear policy guidance, incomplete tracking of resident activities, and improper fiscal processes for reimbursement and reconciliation of affiliate invoices.¹⁸

In response, the OAA created an oversight and compliance unit, revised VHA Directive 1400.05 (the policy for disbursement), and improved resident tracking procedures.²⁶ The standard operating procedure that accompanied VHA Directive 1400.05 provides detailed information for the DEO and VA facility staff for tracking resident clinical and educational activities. FTE counts are essential to both VA and CMS for accurate reimbursement. The eAppendix and the Table provide a guide to reimbursable activities in the VA for the calculation of reimbursement, with a comparison to CMS.^33,34 The OAA in cooperation with other VA staff and officers periodically conducts audits to assess compliance with disbursement policy and affiliate reimbursement accuracy.

In the VA, resident activities are captured on the VA Educational Activity Record, a standardized spreadsheet to track activities and calculate reimbursement. Each VA facility hosting resident physicians manually records resident activity by the half-day. This process is labor intensive, involving both VA and affiliate staff to accurately reconcile payments. To address the workload demands, the OAA is developing an online tool that will automate aspects of the tracking process. Also, to ensure adequate staffing, the OAA is in the process of implementing an office optimization project, providing standardized position descriptions, an organizational chart, and staffing levels for DEO offices in VA facilities.

This report describes the key policies and principles of VA GME financing, highlighting the essential similarities and differences between VA and CMS. Neither the VA nor CMS regulations allow for reimbursement for > 1 FTE position per resident, a principle that underpins the assignment of resident rotations and federal funding for GME and are similar with respect to reimbursement for patient care activities, didactics, research, orientation, and scholarly activity. While reimbursable activities in the VA require physical presence and care of veteran patients, CMS also limits reimbursement to resident activities in the hospital and approved other settings if the hospital is paying for resident salary and benefits in these settings. The VA provides some flexibility for offsite activities including didactics and, in specific circumstances, remote care of veteran patients (eg, teleradiology).

The VA and CMS use different GME financing models. For example, the CMS calculations for resident FTEs are complex, whereas VA calculations reimburse the salary and benefits as set by the academic affiliate. The VA process accounts for local variation in salary rates, whereas the per-resident amount set by CMS varies regionally and does not fully account for differences in the cost of living.²⁴ Because all patients in VA facilities are veterans, VA calculations for reimbursement do not involve ratios of beds like the CMS calculations to determine a proportional share of reimbursement. The VA GME expansion tends to be more directed to VA health workforce needs than CMS, specifying the types of programs and geographic locations to address these needs.

The VA regularly reevaluates how affiliates are reimbursed for VA resident activity, balancing compliance with VA policies and the workload for VA and its affiliates. The VA obtains input from key stakeholders including DEOs, DIOs, and professional organizations such as the Association of American Medical Colleges and the Accreditation Council for Graduate Medical Education.^35,36

Looking ahead, the VA is developing an online tool to improve the accuracy of affiliate reimbursement. The VA will also implement a standardized staffing model, organizational structure, and position descriptions for DEO offices. These initiatives will help reduce the burden of tracking and verifying resident activity and continue to support the 77-year partnership between VA and its affiliated institutions.

The US Department of Veterans Affairs (VA) has partnered with academic medical centers and programs since 1946 to provide clinical training for physician residents. Ranking second in federal graduate medical education (GME) funding to the Centers for Medicare and Medicaid Services (CMS), the $850 million VA GME budget annually reimburses > 250 GME-sponsoring institutions (affiliates) of 8000 GME programs for the clinical training of 49,000 individual residents rotating through > 11,000 full-time equivalent (FTE) positions.¹ The VA also distributes $1.6 billion to VA facilities to offset the costs of conducting health professions education (HPE) (eg, facility infrastructure, salary support for VA instructors and preceptors, education office administration, and instructional equipment).² The VA financial and educational contributions account for payment of 11% of resident positions nationally and allow academic medical centers to be less reliant on CMS GME funding.^3,4 The VA contributions also provide opportunities for GME expansion,^1,5,6 educational innovations,^5,7 interprofessional and team-based care,^8,9 and quality and safety training.^10,11 The Table provides a comparison of CMS and VA GME reimbursability based on activity.

GME financing is complex, particularly the formulaic approach used by CMS, the details of which are often obscured in federal regulations. Due to this complexity and the $16 billion CMS GME budget, academic publications have focused on CMS GME financing while not fully explaining the VA GME policies and processes.^4,12-14 By comparison, the VA GME financing model is relatively straightforward and governed by different statues and VA regulations, yet sharing some of the same principles as CMS regulations. Given the challenges in CMS reimbursement to fully support the cost of resident education, as well as the educational opportunities at the VA, the VA designs its reimbursement model to assure that affiliates receive appropriate payments.^4,12,15 To ensure the continued success of VA GME partnerships, knowledge of VA GME financing has become increasingly important for designated institutional officers (DIOs) and residency program directors, particularly in light of recent investigations into oversight of the VA’s reimbursement to academic affiliates.^16-18 This report describes VA GME reimbursement and, where applicable, VA and CMS reimbursement policies are compared to highlight similarities, differences, and common principles.

VA AUTHORITY

While the VA’s primary mission is “to provide a complete hospital medical service for the medical care and treatment of veterans,”early VA leaders recognized the importance of affiliating with the nation’s academic institutions.¹⁹ In 1946, the VA Policy Memorandum Number 2 established a partnership between the VA and the academic medical community.²⁰ Additional legislation authorized specific agreements with academic affiliates for the central administration of salary and benefits for residents rotating at VA facilities. This process, known as disbursement, is an alternative payroll mechanism whereby the VA reimburses the academic affiliate for resident salary and benefits and the affiliate acts as the disbursing agent, issuing paychecks to residents.^21,22

Resident FUNDING

By policy, with rare exceptions, the VA does not sponsor residency programs due to the challenges of providing an appropriate patient mix of age, sex, and medical conditions to meet accreditation standards.⁴ Nearly all VA reimbursements are for residents in affiliate-sponsored programs, while just 1% pays for residents in legacy, VA-sponsored residency programs at 2 VA facilities. The VA budget for resident (including fellows) salary and benefits is managed by the VA Office of Academic Affiliations (OAA), the national VA office responsible for oversight, policy, and funding of VA HPE programs.

Resident Salaries and Benefits

VA funding of resident salary and benefits are analogous with CMS direct GME (DGME), which is designed to cover resident salary and benefits costs.^4,14,23 CMS DGME payments depend on a hospital’s volume of CMS inpatients and are based on a statutory formula, which uses the hospital’s resident FTE positions, the per-resident amount, and Medicare’s share of inpatient beds (Medicare patient load) to determine payments.¹² The per-resident amount is set by statute, varies geographically, and is calculated by dividing the hospital’s allowable costs of GME (percentage of CMS inpatient days) divided by the number of residents.^12,24

By comparison, the VA GME payment reimburses for each FTE based on the salary and benefits rate set by the academic affiliate. Reimbursement is calculated based on resident time spent at the VA multiplied by a daily salary rate. The daily salary rate is determined by dividing the resident’s total compensation (salary and benefits) by the number of calendar days in an academic year. Resident time spent at the VA facility is determined by obtaining rotation schedules provided by the academic affiliate and verifying resident clinical and educational activity during scheduled rotations.

Indirect Medical Education Funding

In addition to resident salary and benefits, funds to offset the cost of conducting HPE are provided to VA facilities. These funds are intended to improve and maintain necessary infrastructure for all HPE programs not just GME, including education office administration needs, teaching costs (ie, a portion of VA preceptors salary), and instructional equipment.

The Veterans Equitable Resource Allocation (VERA) is a national budgeting process for VA medical facilities that funds facility operational needs such as staff salary and benefits, infrastructure, and equipment.² The education portion of the VERA, the VERA Education Support Component (VESC), is not managed by the OAA, but rather is distributed through the VERA model to the general budget of VA facilities hosting HPE (Figure). VESC funding in the VA budget is based on labor mapping of physician time spent in education; other labor mapping categories include clinical care, research, and administration. VA facility VESC funding is calculated based on the number of paid health profession trainees (HPTs) from all professions, apportioned according to the number of FTEs for physician residents and VA-paid HPTs in other disciplines. In fiscal year 2024, VA facilities received $115,812 for each physician resident FTE position and $84,906 for each VA-paid, non-GME FTE position.

The VESC is like CMS's indirect GME funding, termed Indirect Medical Education (IME), an additional payment for each Medicare patient discharged reflecting teaching hospitals’ higher patient care costs relative to nonteaching hospitals. Described elsewhere, IME is calculated using a resident-to-bed ratio and a multiplier, which is set by statute.^4,25 While IME can be used for reimbursement for some resident clinical and educational activities(eg, research), VA VESC funds cannot be used for such activities and are part of the general facility budget and appropriated per the discretion of the medical facility director.

ESTABLISHING GME PARTNERSHIPS

An affiliation agreement establishes the administrative and legal requirements for educational relationships with academic affiliates and includes standards for conducting HPE, responsibilities for accreditation standards, program leadership, faculty, resources, supervision, academic policies, and procedures. The VA uses standardized affiliation agreement templates that have been vetted with accrediting bodies and the VA Office of General Counsel.

A disbursement agreement authorizes the VA to reimburse affiliates for resident salary and benefits for VA clinical and educational activities. The disbursement agreement details the fiscal arrangements (eg, payment in advance vs arrears, salary, and benefit rates, leave) for the reimbursement payments. Veterans Health Administration (VHA) Directive 1400.05 provides the policy and procedures for calculating reimbursement for HPT educational activities.²⁶

The VA facility designated education officer (DEO) oversees all HPE programs and coordinates the affiliation and disbursement agreement processes.²⁷ The DEO, affiliate DIO, residency program director, and VA residency site director determine the physician resident FTE positions assigned to a VA facility based on educational objectives and availability of educational resources at the VA facility, such as patient care opportunities, faculty supervisors, space, and equipment. The VA facility requests for resident FTE positions are submitted to the OAA by the facility DEO.

Once GME FTE positions are approved by the OAA, VA facilities work with their academic affiliate to submit the physician resident salary and benefit rate. Affiliate DIOs attest to the accuracy of the salary rate schedule and the local DEO submits the budget request to the OAA. Upon approval, the funds are transferred to the VA facility each fiscal year, which begins October 1. DEOs report quarterly to the OAA both budget needs and excesses based on variations in the approved FTEs due to additional VA rotations, physician resident attrition, or reassignment.

Resident Position Allocation

VA GME financing provides flexibility through periodic needs assessments and expansion initiatives. In August and December, DEOs collaborate with an academic affiliate to submit reports to the OAA confirming their projected GME needs for the next academic year. Additional positions requests are reviewed by the OAA; funding depends on budget and the educational justification. The OAA periodically issues GME expansion requests for proposal, which typically arise from legislation to address specific VA workforce needs. The VA facility DEO and affiliate GME leaders collaborate to apply for additional positions. For example, a VA GME expansion under the Veterans Access, Choice, and Accountability Act of 2014 added 1500 GME positions in 8 years for critically needed specialties and in rural and underserved areas.⁵ The Maintaining Internal Systems and Strengthening Outside Networks (MISSION) Act of 2018 authorized a pilot program for VA to fund residents at non-VA facilities with priority for Indian Health Services, Tribes and Tribal Organizations, Federally Qualified Health Centers, and US Department of Defense facilities to provide access to veterans in underserved areas.⁶

The VA GME financing system has flexibility to meet local needs for additional resident positions and to address broader VA workforce gaps through targeted expansion. Generally, CMS does not fund positions to address workforce needs, place residents in specific geographic areas, or require the training of certain types of residents.⁴ However, the Consolidated Appropriations Act of 2021 has provided the opportunity to address rural workforce needs.²⁸

Reimbursement

The VA provides reimbursement for clinical and educational activities performed in VA facilities for the benefit of veterans as well as research, didactics, meetings and conferences, annual and sick leave, and orientation. The VA also may provide reimbursement for educational activities that occur off VA grounds (eg, the VA proportional share of a residency program’s didactic sessions). The VA does not reimburse for affiliate clinical duties or administrative costs, although a national policy allows VA facilities to reimburse affiliates for some GME overhead costs.²⁹

CMS similarly reimburses for residency training time spent in patient care activities as well as orientation activities, didactics, leave, and, in some cases, research.^4,30,31 CMS makes payments to hospitals, which may include sponsoring institutions and Medicare-eligible participating training sites.^4,30,31 For both the VA and CMS, residents may not be counted twice for reimbursement by 2 federal agencies; in other words, a resident may not count for > 1 FTE.^4,30-32

GME Oversight

VA GME funding came under significant scrutiny. At a 2016 House Veterans Affairs Committee hearing, Representative Phil Roe, MD (R-Tennessee), noted that no process existed at many VA facilities for “determining trainee presence” and that many VA medical centers had “difficulty tracking resident rotations”¹⁶ A VA Office of the Inspector General investigation recommended that the VA implement policies and procedures to improve oversight to “ensure residents are fully participating in educational activities” and that the VA is “paying the correct amount” to the affiliate.¹⁷ A 2020 General Accountability Office report outlined unclear policy guidance, incomplete tracking of resident activities, and improper fiscal processes for reimbursement and reconciliation of affiliate invoices.¹⁸

In response, the OAA created an oversight and compliance unit, revised VHA Directive 1400.05 (the policy for disbursement), and improved resident tracking procedures.²⁶ The standard operating procedure that accompanied VHA Directive 1400.05 provides detailed information for the DEO and VA facility staff for tracking resident clinical and educational activities. FTE counts are essential to both VA and CMS for accurate reimbursement. The eAppendix and the Table provide a guide to reimbursable activities in the VA for the calculation of reimbursement, with a comparison to CMS.^33,34 The OAA in cooperation with other VA staff and officers periodically conducts audits to assess compliance with disbursement policy and affiliate reimbursement accuracy.

In the VA, resident activities are captured on the VA Educational Activity Record, a standardized spreadsheet to track activities and calculate reimbursement. Each VA facility hosting resident physicians manually records resident activity by the half-day. This process is labor intensive, involving both VA and affiliate staff to accurately reconcile payments. To address the workload demands, the OAA is developing an online tool that will automate aspects of the tracking process. Also, to ensure adequate staffing, the OAA is in the process of implementing an office optimization project, providing standardized position descriptions, an organizational chart, and staffing levels for DEO offices in VA facilities.

This report describes the key policies and principles of VA GME financing, highlighting the essential similarities and differences between VA and CMS. Neither the VA nor CMS regulations allow for reimbursement for > 1 FTE position per resident, a principle that underpins the assignment of resident rotations and federal funding for GME and are similar with respect to reimbursement for patient care activities, didactics, research, orientation, and scholarly activity. While reimbursable activities in the VA require physical presence and care of veteran patients, CMS also limits reimbursement to resident activities in the hospital and approved other settings if the hospital is paying for resident salary and benefits in these settings. The VA provides some flexibility for offsite activities including didactics and, in specific circumstances, remote care of veteran patients (eg, teleradiology).

The VA and CMS use different GME financing models. For example, the CMS calculations for resident FTEs are complex, whereas VA calculations reimburse the salary and benefits as set by the academic affiliate. The VA process accounts for local variation in salary rates, whereas the per-resident amount set by CMS varies regionally and does not fully account for differences in the cost of living.²⁴ Because all patients in VA facilities are veterans, VA calculations for reimbursement do not involve ratios of beds like the CMS calculations to determine a proportional share of reimbursement. The VA GME expansion tends to be more directed to VA health workforce needs than CMS, specifying the types of programs and geographic locations to address these needs.

The VA regularly reevaluates how affiliates are reimbursed for VA resident activity, balancing compliance with VA policies and the workload for VA and its affiliates. The VA obtains input from key stakeholders including DEOs, DIOs, and professional organizations such as the Association of American Medical Colleges and the Accreditation Council for Graduate Medical Education.^35,36

Looking ahead, the VA is developing an online tool to improve the accuracy of affiliate reimbursement. The VA will also implement a standardized staffing model, organizational structure, and position descriptions for DEO offices. These initiatives will help reduce the burden of tracking and verifying resident activity and continue to support the 77-year partnership between VA and its affiliated institutions.

The hospital is altogether the most complex human organization ever devised. Peter Drucker ¹

The ever-changing landscape of today’s increasingly complex health care system depends on implementing multifaceted, team-based methods of care delivery to provide safe, effective patient care.²Critical to establishing and sustaining exceptionally safe, effective patient care is open, transparent communication among members of interprofessional teams with senior leaders.³ However, current evidence shows thatpoor communication among interprofessional health care teams and leadership is commonplace and a significant contributing factor to inefficiencies, medical errors, and poor outcomes.⁴ One strategy for improving communication is through the implementation of leader rounding for high reliability. The concept of high reliability pertains to organizations that operate in high-risk environments for prolonged periods without serious adverse events or catastrophic failures.⁵ The overarching goal of implementation is to ensure that efficient communication exists among members of the health care team, which is essential for providing safe, quality patient care.

We describe the importance of leader rounding for high reliability as an approach to improving patient safety.Based on a review of the literature, our experiences, and lessons learned, we offer recommendations for how health care organizations on the journey to high reliability can improve patient safety.

Rounding in health care is not new. In fact, rounding has been a strong principal practice globally for more than 2 decades.⁶ During this time, varied rounding approaches have emerged, oftentimes focused on areas of interest, such as patient care, environmental services, facilities management, and discharge planning.^4,7 Variations also might involve the location of the rounds, such as a patient’s bedside, unit hallways, and conference rooms as well as the naming of rounds, such as interdisciplinary/multidisciplinary, teaching, and walkrounds.^7-10

A different type of rounding that is characteristic of high reliability organizations (HROs) is leader rounding for high reliability. The Veterans Health Administration (VHA) formally launched its journey to becoming an enterprise HRO in February 2019, using 3 cohorts. At the Veterans Affairs Bedford Healthcare System (VABHS) in Massachusetts, the journey commenced in 2021 as part of the third cohort. Leader rounding for high reliability is one of VHAs 4 HRO foundational practices for achieving a culture of safety (Figure 1).¹¹

Leader rounding for high reliability includes regularly scheduled, structured visits, with interdisciplinary teams to discuss high reliability, safety, and improvement efforts.The specific aim of these particular rounds is for senior leaders to be visible where teams are located and learn from staff (especially those on the frontlines of care) about day-to-day challenges that may contribute to patient harm.^12,13 Leader rounding for high reliability is also an important approach to improving leadership visibility across the organization, demonstrating a commitment to high reliability, and building trust and relationships with staff through open and honest dialogue. It is also an important approach to increasing leadership understanding of operational, clinical, nonclinical, patient experience issues, and concern related to safety.¹¹ This opportunity enables leaders to provide and receive real-time feedback from staff.^9,11 This experience also gives leaders an opportunity to reinforce the VHA’s 3 pillars, 5 principles, and 7 values related to high reliability (Figure 2)¹⁴ as well as to recognize behaviors that support a culture of safety.¹⁵

In preparation for implementing a leader rounding for high reliability process at the VABHS, we conducted an extensive literature review for peer-reviewed publications published between January 2015 and September 2022 regarding how other organizations implemented leader rounding. This search found a dearth of evidence as it specifically relates to leader rounding for high reliability. This motivated us to create a process for developing and implementing leader rounding for high reliability in pursuit of improving patient safety. With this objective in mind, we created and piloted a process in the fall of 2023. The first 3 months were focused on the medical center director rounding with other members of the executive leadership team to assess the feasibility and acceptability of the process. In December 2023, members of the executive leadership team began conducting leader rounding for high reliability separately. The following steps are based on the lessons we have gleaned from evolving evidence, our experiences, and developing and implementing an approach to leader rounding for high reliability.

ESTABLISH A PROCESS

Leader rounding for high reliability is performed by health care organization executive leadership, directors, managers, and supervisors. When properly conducted, increased levels of teamwork and more effective bidirectional communication take place, resulting in a united team motivated to improve patient safety.^16,17 Important early steps for implementing leader rounding for high reliability include establishing a process and getting leadership buy-in.Purposeful attention to planning is critical as is understanding the organizational factors that might deter success.Establishing a process should consider facilitators and barriers to implementation, which can include high vs low leadership turnover, structured vs unstructured rounding, and time for rounding vs competing demands.^18,19 We have learned thateffective planning is important for ensuring that leadership teams are well prepared and ambitious about leader rounding for high reliability.

Leader rounding for high reliability involves brief 10-to-15-minute interactions with interdisciplinary teams, including frontline staff. For health care organizations beginning to implement this approach, having scripts or checklists accessible might be of help. If possible, the rounds should be scheduled in advance. This helps to avoid rounding in areas at their busiest times. When possible, leader rounding for high reliability should occur as planned. Canceling rounds sends the message that leader rounding for high reliability and the valuable interactions they support are a low priority. When conflicts arise, another leader should be sent to participate. Developing a list of questions in advance helps to underscore key messages to be shared as well as reinforce principles, practices, behaviors, and attitudes related to high reliability (Appendix 1).¹¹

Finally, closing the loop is critical to the leader rounding process and to improve bidirectional communication. Closed-loop communication, following up on and/or closing out an area of discussion, not only promotes a shared understanding of information but has been found to improve patient safety.¹⁹ Effective leader rounding for high reliability includes summarizing issues and opportunities, deciding on a date for resolution for open action items, and identifying who is responsible for taking action. Senior leaders are not responsible for resolving all issues. If a team or manager of a work area can solve any issues identified, this should be encouraged and supported so accountability is maintained at the most appropriate level of the organization.

Instrumental to leader rounding for high reliability is establishing a cadence for when leaders will visit work areas.¹⁴ The most critical strategy, especially in times of change, is consistency in rounding.¹¹ At the start of implementation, we decided on a biweekly cadence. Initially leaders visited areas of the organization within their respective reporting structure. Once this was established, leaders periodically round in areas outside their scope of responsibility. This affords leaders the opportunity to observe other areas of the organization. As noted, it is important for leaders to be flexible with the rounding process especially in areas where direct patient care is being provided.

Tracking

Developing a tracking tool also is important for an effective leader rounding process. This tool is used to document issues and concerns identified during the rounding process, assign accountability, track the status of items, and close the loop when completed. One of the most commonly reported hurdles to staff sharing information to promote a culture of safety is the lack of feedback on what actions were taken to address the concern or issue raised with leadership. Closed-loop communication is critical for keeping staff continually engaged in efforts to promote a culture of safety.²⁰ We have found that a tracking tool helps to ensure that closed-loop communication takes place.

Various platforms can be used for tracking items and providing follow-up, including paper worksheets, spreadsheets, databases, or third party software (eg, SharePoint, TruthPoint Rounds, GetWell Rounds). The tracking tool should have a standardized approach for prioritizing issues.

Measuring Impact

Measuring the impact is a critical step to determine the overall effectiveness of leader rounding for high reliability. It can be as simple as requesting candid feedback from frontline staff, supervisors, managers, and service chiefs. For example, 4 months into the implementation process, the VABHS administered a brief staff survey on the overall process, perceived benefits, and challenges experienced (Appendix 2). Potential measures include the counts of leaders rounding, total rounds, rounds cancelled, and staff members actively participating in rounds. Outcomes that can be measured include issues identified, addressed, elevated, and remaining open; number of extended workdays due to rounds; staff staying overtime; and delays in patient care activities.²³ Other measures to consider are the effects of rounding on staff as well as patient/family satisfaction, increase in the number of errors and near-miss events reported per month in a health care organizations’ patient safety reporting system, and increased engagement of staff members in continuous process improvement activities. Since the inception of leader rounding for high reliability, the VABHS has seen a slight increase in the number of events entered in the patient safety reporting system. Other factors that may have contributed to this change, including encouragement of reporting at safety forums, and tiered safety huddles.

DISCUSSION

This initiative involved the development and implementation of a leader rounding for high reliability process at the VABHS with the overarching goal of ensuring efficient communication exists among members of the health care team for delivering safe, quality patient care. The initiative was well received by staff from senior leadership to frontline personnel and promoted significant interest in efforts to improve safety across the health care system.

The pilot phase permitted us to examine the feasibility and acceptability of the process to leadership as well as frontline staff. The insight gained and lessons learned through the implementation process helped us make revisions where needed and develop the tools to ensure success. In the second phase of implementation, which commenced in December 2023, each executive leadership team member began leader rounding for high reliability with their respective department service chiefs. Throughout this phase, feedback will be sought on the overall process, perceived benefits, and challenges experienced to make improvements or changes as needed. We also will continue to monitor the number of events entered in the patient safety reporting system. Future efforts will focus on developing a robust program of evaluation to explore the impact of the program on patient/family satisfaction as well as safety outcomes.

Limitations

Developing and implementing a process for leader rounding for high reliability was undertaken to support the VABHS and VHA journey to high reliability. Other health care organizations and integrated systems might identify different processes for improving patient safety and to support their journey to becoming an HRO.

CONCLUSIONS

The importance of leader rounding for high reliability to improve patient safety cannot be emphasized enough in a time where health care systems have become increasingly complex. Health care is a complex adaptive system that requires effective, bidirectional communication and collaboration among all disciplines. One of the most useful, evidence-based strategies for promoting this communication and collaboration to improve a culture of safety is leader rounding for high reliability.

The hospital is altogether the most complex human organization ever devised. Peter Drucker ¹

The ever-changing landscape of today’s increasingly complex health care system depends on implementing multifaceted, team-based methods of care delivery to provide safe, effective patient care.²Critical to establishing and sustaining exceptionally safe, effective patient care is open, transparent communication among members of interprofessional teams with senior leaders.³ However, current evidence shows thatpoor communication among interprofessional health care teams and leadership is commonplace and a significant contributing factor to inefficiencies, medical errors, and poor outcomes.⁴ One strategy for improving communication is through the implementation of leader rounding for high reliability. The concept of high reliability pertains to organizations that operate in high-risk environments for prolonged periods without serious adverse events or catastrophic failures.⁵ The overarching goal of implementation is to ensure that efficient communication exists among members of the health care team, which is essential for providing safe, quality patient care.

We describe the importance of leader rounding for high reliability as an approach to improving patient safety.Based on a review of the literature, our experiences, and lessons learned, we offer recommendations for how health care organizations on the journey to high reliability can improve patient safety.

Rounding in health care is not new. In fact, rounding has been a strong principal practice globally for more than 2 decades.⁶ During this time, varied rounding approaches have emerged, oftentimes focused on areas of interest, such as patient care, environmental services, facilities management, and discharge planning.^4,7 Variations also might involve the location of the rounds, such as a patient’s bedside, unit hallways, and conference rooms as well as the naming of rounds, such as interdisciplinary/multidisciplinary, teaching, and walkrounds.^7-10

A different type of rounding that is characteristic of high reliability organizations (HROs) is leader rounding for high reliability. The Veterans Health Administration (VHA) formally launched its journey to becoming an enterprise HRO in February 2019, using 3 cohorts. At the Veterans Affairs Bedford Healthcare System (VABHS) in Massachusetts, the journey commenced in 2021 as part of the third cohort. Leader rounding for high reliability is one of VHAs 4 HRO foundational practices for achieving a culture of safety (Figure 1).¹¹

Leader rounding for high reliability includes regularly scheduled, structured visits, with interdisciplinary teams to discuss high reliability, safety, and improvement efforts.The specific aim of these particular rounds is for senior leaders to be visible where teams are located and learn from staff (especially those on the frontlines of care) about day-to-day challenges that may contribute to patient harm.^12,13 Leader rounding for high reliability is also an important approach to improving leadership visibility across the organization, demonstrating a commitment to high reliability, and building trust and relationships with staff through open and honest dialogue. It is also an important approach to increasing leadership understanding of operational, clinical, nonclinical, patient experience issues, and concern related to safety.¹¹ This opportunity enables leaders to provide and receive real-time feedback from staff.^9,11 This experience also gives leaders an opportunity to reinforce the VHA’s 3 pillars, 5 principles, and 7 values related to high reliability (Figure 2)¹⁴ as well as to recognize behaviors that support a culture of safety.¹⁵

In preparation for implementing a leader rounding for high reliability process at the VABHS, we conducted an extensive literature review for peer-reviewed publications published between January 2015 and September 2022 regarding how other organizations implemented leader rounding. This search found a dearth of evidence as it specifically relates to leader rounding for high reliability. This motivated us to create a process for developing and implementing leader rounding for high reliability in pursuit of improving patient safety. With this objective in mind, we created and piloted a process in the fall of 2023. The first 3 months were focused on the medical center director rounding with other members of the executive leadership team to assess the feasibility and acceptability of the process. In December 2023, members of the executive leadership team began conducting leader rounding for high reliability separately. The following steps are based on the lessons we have gleaned from evolving evidence, our experiences, and developing and implementing an approach to leader rounding for high reliability.

ESTABLISH A PROCESS

Leader rounding for high reliability is performed by health care organization executive leadership, directors, managers, and supervisors. When properly conducted, increased levels of teamwork and more effective bidirectional communication take place, resulting in a united team motivated to improve patient safety.^16,17 Important early steps for implementing leader rounding for high reliability include establishing a process and getting leadership buy-in.Purposeful attention to planning is critical as is understanding the organizational factors that might deter success.Establishing a process should consider facilitators and barriers to implementation, which can include high vs low leadership turnover, structured vs unstructured rounding, and time for rounding vs competing demands.^18,19 We have learned thateffective planning is important for ensuring that leadership teams are well prepared and ambitious about leader rounding for high reliability.

Leader rounding for high reliability involves brief 10-to-15-minute interactions with interdisciplinary teams, including frontline staff. For health care organizations beginning to implement this approach, having scripts or checklists accessible might be of help. If possible, the rounds should be scheduled in advance. This helps to avoid rounding in areas at their busiest times. When possible, leader rounding for high reliability should occur as planned. Canceling rounds sends the message that leader rounding for high reliability and the valuable interactions they support are a low priority. When conflicts arise, another leader should be sent to participate. Developing a list of questions in advance helps to underscore key messages to be shared as well as reinforce principles, practices, behaviors, and attitudes related to high reliability (Appendix 1).¹¹

Finally, closing the loop is critical to the leader rounding process and to improve bidirectional communication. Closed-loop communication, following up on and/or closing out an area of discussion, not only promotes a shared understanding of information but has been found to improve patient safety.¹⁹ Effective leader rounding for high reliability includes summarizing issues and opportunities, deciding on a date for resolution for open action items, and identifying who is responsible for taking action. Senior leaders are not responsible for resolving all issues. If a team or manager of a work area can solve any issues identified, this should be encouraged and supported so accountability is maintained at the most appropriate level of the organization.

Instrumental to leader rounding for high reliability is establishing a cadence for when leaders will visit work areas.¹⁴ The most critical strategy, especially in times of change, is consistency in rounding.¹¹ At the start of implementation, we decided on a biweekly cadence. Initially leaders visited areas of the organization within their respective reporting structure. Once this was established, leaders periodically round in areas outside their scope of responsibility. This affords leaders the opportunity to observe other areas of the organization. As noted, it is important for leaders to be flexible with the rounding process especially in areas where direct patient care is being provided.

Tracking

Developing a tracking tool also is important for an effective leader rounding process. This tool is used to document issues and concerns identified during the rounding process, assign accountability, track the status of items, and close the loop when completed. One of the most commonly reported hurdles to staff sharing information to promote a culture of safety is the lack of feedback on what actions were taken to address the concern or issue raised with leadership. Closed-loop communication is critical for keeping staff continually engaged in efforts to promote a culture of safety.²⁰ We have found that a tracking tool helps to ensure that closed-loop communication takes place.

Various platforms can be used for tracking items and providing follow-up, including paper worksheets, spreadsheets, databases, or third party software (eg, SharePoint, TruthPoint Rounds, GetWell Rounds). The tracking tool should have a standardized approach for prioritizing issues.

Measuring Impact

Measuring the impact is a critical step to determine the overall effectiveness of leader rounding for high reliability. It can be as simple as requesting candid feedback from frontline staff, supervisors, managers, and service chiefs. For example, 4 months into the implementation process, the VABHS administered a brief staff survey on the overall process, perceived benefits, and challenges experienced (Appendix 2). Potential measures include the counts of leaders rounding, total rounds, rounds cancelled, and staff members actively participating in rounds. Outcomes that can be measured include issues identified, addressed, elevated, and remaining open; number of extended workdays due to rounds; staff staying overtime; and delays in patient care activities.²³ Other measures to consider are the effects of rounding on staff as well as patient/family satisfaction, increase in the number of errors and near-miss events reported per month in a health care organizations’ patient safety reporting system, and increased engagement of staff members in continuous process improvement activities. Since the inception of leader rounding for high reliability, the VABHS has seen a slight increase in the number of events entered in the patient safety reporting system. Other factors that may have contributed to this change, including encouragement of reporting at safety forums, and tiered safety huddles.

DISCUSSION

This initiative involved the development and implementation of a leader rounding for high reliability process at the VABHS with the overarching goal of ensuring efficient communication exists among members of the health care team for delivering safe, quality patient care. The initiative was well received by staff from senior leadership to frontline personnel and promoted significant interest in efforts to improve safety across the health care system.

The pilot phase permitted us to examine the feasibility and acceptability of the process to leadership as well as frontline staff. The insight gained and lessons learned through the implementation process helped us make revisions where needed and develop the tools to ensure success. In the second phase of implementation, which commenced in December 2023, each executive leadership team member began leader rounding for high reliability with their respective department service chiefs. Throughout this phase, feedback will be sought on the overall process, perceived benefits, and challenges experienced to make improvements or changes as needed. We also will continue to monitor the number of events entered in the patient safety reporting system. Future efforts will focus on developing a robust program of evaluation to explore the impact of the program on patient/family satisfaction as well as safety outcomes.

Limitations

Developing and implementing a process for leader rounding for high reliability was undertaken to support the VABHS and VHA journey to high reliability. Other health care organizations and integrated systems might identify different processes for improving patient safety and to support their journey to becoming an HRO.

CONCLUSIONS

The importance of leader rounding for high reliability to improve patient safety cannot be emphasized enough in a time where health care systems have become increasingly complex. Health care is a complex adaptive system that requires effective, bidirectional communication and collaboration among all disciplines. One of the most useful, evidence-based strategies for promoting this communication and collaboration to improve a culture of safety is leader rounding for high reliability.

The hospital is altogether the most complex human organization ever devised. Peter Drucker ¹

The ever-changing landscape of today’s increasingly complex health care system depends on implementing multifaceted, team-based methods of care delivery to provide safe, effective patient care.²Critical to establishing and sustaining exceptionally safe, effective patient care is open, transparent communication among members of interprofessional teams with senior leaders.³ However, current evidence shows thatpoor communication among interprofessional health care teams and leadership is commonplace and a significant contributing factor to inefficiencies, medical errors, and poor outcomes.⁴ One strategy for improving communication is through the implementation of leader rounding for high reliability. The concept of high reliability pertains to organizations that operate in high-risk environments for prolonged periods without serious adverse events or catastrophic failures.⁵ The overarching goal of implementation is to ensure that efficient communication exists among members of the health care team, which is essential for providing safe, quality patient care.

We describe the importance of leader rounding for high reliability as an approach to improving patient safety.Based on a review of the literature, our experiences, and lessons learned, we offer recommendations for how health care organizations on the journey to high reliability can improve patient safety.

Rounding in health care is not new. In fact, rounding has been a strong principal practice globally for more than 2 decades.⁶ During this time, varied rounding approaches have emerged, oftentimes focused on areas of interest, such as patient care, environmental services, facilities management, and discharge planning.^4,7 Variations also might involve the location of the rounds, such as a patient’s bedside, unit hallways, and conference rooms as well as the naming of rounds, such as interdisciplinary/multidisciplinary, teaching, and walkrounds.^7-10

A different type of rounding that is characteristic of high reliability organizations (HROs) is leader rounding for high reliability. The Veterans Health Administration (VHA) formally launched its journey to becoming an enterprise HRO in February 2019, using 3 cohorts. At the Veterans Affairs Bedford Healthcare System (VABHS) in Massachusetts, the journey commenced in 2021 as part of the third cohort. Leader rounding for high reliability is one of VHAs 4 HRO foundational practices for achieving a culture of safety (Figure 1).¹¹

Leader rounding for high reliability includes regularly scheduled, structured visits, with interdisciplinary teams to discuss high reliability, safety, and improvement efforts.The specific aim of these particular rounds is for senior leaders to be visible where teams are located and learn from staff (especially those on the frontlines of care) about day-to-day challenges that may contribute to patient harm.^12,13 Leader rounding for high reliability is also an important approach to improving leadership visibility across the organization, demonstrating a commitment to high reliability, and building trust and relationships with staff through open and honest dialogue. It is also an important approach to increasing leadership understanding of operational, clinical, nonclinical, patient experience issues, and concern related to safety.¹¹ This opportunity enables leaders to provide and receive real-time feedback from staff.^9,11 This experience also gives leaders an opportunity to reinforce the VHA’s 3 pillars, 5 principles, and 7 values related to high reliability (Figure 2)¹⁴ as well as to recognize behaviors that support a culture of safety.¹⁵

In preparation for implementing a leader rounding for high reliability process at the VABHS, we conducted an extensive literature review for peer-reviewed publications published between January 2015 and September 2022 regarding how other organizations implemented leader rounding. This search found a dearth of evidence as it specifically relates to leader rounding for high reliability. This motivated us to create a process for developing and implementing leader rounding for high reliability in pursuit of improving patient safety. With this objective in mind, we created and piloted a process in the fall of 2023. The first 3 months were focused on the medical center director rounding with other members of the executive leadership team to assess the feasibility and acceptability of the process. In December 2023, members of the executive leadership team began conducting leader rounding for high reliability separately. The following steps are based on the lessons we have gleaned from evolving evidence, our experiences, and developing and implementing an approach to leader rounding for high reliability.

ESTABLISH A PROCESS

Leader rounding for high reliability is performed by health care organization executive leadership, directors, managers, and supervisors. When properly conducted, increased levels of teamwork and more effective bidirectional communication take place, resulting in a united team motivated to improve patient safety.^16,17 Important early steps for implementing leader rounding for high reliability include establishing a process and getting leadership buy-in.Purposeful attention to planning is critical as is understanding the organizational factors that might deter success.Establishing a process should consider facilitators and barriers to implementation, which can include high vs low leadership turnover, structured vs unstructured rounding, and time for rounding vs competing demands.^18,19 We have learned thateffective planning is important for ensuring that leadership teams are well prepared and ambitious about leader rounding for high reliability.

Leader rounding for high reliability involves brief 10-to-15-minute interactions with interdisciplinary teams, including frontline staff. For health care organizations beginning to implement this approach, having scripts or checklists accessible might be of help. If possible, the rounds should be scheduled in advance. This helps to avoid rounding in areas at their busiest times. When possible, leader rounding for high reliability should occur as planned. Canceling rounds sends the message that leader rounding for high reliability and the valuable interactions they support are a low priority. When conflicts arise, another leader should be sent to participate. Developing a list of questions in advance helps to underscore key messages to be shared as well as reinforce principles, practices, behaviors, and attitudes related to high reliability (Appendix 1).¹¹

Finally, closing the loop is critical to the leader rounding process and to improve bidirectional communication. Closed-loop communication, following up on and/or closing out an area of discussion, not only promotes a shared understanding of information but has been found to improve patient safety.¹⁹ Effective leader rounding for high reliability includes summarizing issues and opportunities, deciding on a date for resolution for open action items, and identifying who is responsible for taking action. Senior leaders are not responsible for resolving all issues. If a team or manager of a work area can solve any issues identified, this should be encouraged and supported so accountability is maintained at the most appropriate level of the organization.

Instrumental to leader rounding for high reliability is establishing a cadence for when leaders will visit work areas.¹⁴ The most critical strategy, especially in times of change, is consistency in rounding.¹¹ At the start of implementation, we decided on a biweekly cadence. Initially leaders visited areas of the organization within their respective reporting structure. Once this was established, leaders periodically round in areas outside their scope of responsibility. This affords leaders the opportunity to observe other areas of the organization. As noted, it is important for leaders to be flexible with the rounding process especially in areas where direct patient care is being provided.

Tracking

Developing a tracking tool also is important for an effective leader rounding process. This tool is used to document issues and concerns identified during the rounding process, assign accountability, track the status of items, and close the loop when completed. One of the most commonly reported hurdles to staff sharing information to promote a culture of safety is the lack of feedback on what actions were taken to address the concern or issue raised with leadership. Closed-loop communication is critical for keeping staff continually engaged in efforts to promote a culture of safety.²⁰ We have found that a tracking tool helps to ensure that closed-loop communication takes place.

Various platforms can be used for tracking items and providing follow-up, including paper worksheets, spreadsheets, databases, or third party software (eg, SharePoint, TruthPoint Rounds, GetWell Rounds). The tracking tool should have a standardized approach for prioritizing issues.

Measuring Impact

Measuring the impact is a critical step to determine the overall effectiveness of leader rounding for high reliability. It can be as simple as requesting candid feedback from frontline staff, supervisors, managers, and service chiefs. For example, 4 months into the implementation process, the VABHS administered a brief staff survey on the overall process, perceived benefits, and challenges experienced (Appendix 2). Potential measures include the counts of leaders rounding, total rounds, rounds cancelled, and staff members actively participating in rounds. Outcomes that can be measured include issues identified, addressed, elevated, and remaining open; number of extended workdays due to rounds; staff staying overtime; and delays in patient care activities.²³ Other measures to consider are the effects of rounding on staff as well as patient/family satisfaction, increase in the number of errors and near-miss events reported per month in a health care organizations’ patient safety reporting system, and increased engagement of staff members in continuous process improvement activities. Since the inception of leader rounding for high reliability, the VABHS has seen a slight increase in the number of events entered in the patient safety reporting system. Other factors that may have contributed to this change, including encouragement of reporting at safety forums, and tiered safety huddles.

DISCUSSION

This initiative involved the development and implementation of a leader rounding for high reliability process at the VABHS with the overarching goal of ensuring efficient communication exists among members of the health care team for delivering safe, quality patient care. The initiative was well received by staff from senior leadership to frontline personnel and promoted significant interest in efforts to improve safety across the health care system.

The pilot phase permitted us to examine the feasibility and acceptability of the process to leadership as well as frontline staff. The insight gained and lessons learned through the implementation process helped us make revisions where needed and develop the tools to ensure success. In the second phase of implementation, which commenced in December 2023, each executive leadership team member began leader rounding for high reliability with their respective department service chiefs. Throughout this phase, feedback will be sought on the overall process, perceived benefits, and challenges experienced to make improvements or changes as needed. We also will continue to monitor the number of events entered in the patient safety reporting system. Future efforts will focus on developing a robust program of evaluation to explore the impact of the program on patient/family satisfaction as well as safety outcomes.

Limitations

Developing and implementing a process for leader rounding for high reliability was undertaken to support the VABHS and VHA journey to high reliability. Other health care organizations and integrated systems might identify different processes for improving patient safety and to support their journey to becoming an HRO.

CONCLUSIONS

The importance of leader rounding for high reliability to improve patient safety cannot be emphasized enough in a time where health care systems have become increasingly complex. Health care is a complex adaptive system that requires effective, bidirectional communication and collaboration among all disciplines. One of the most useful, evidence-based strategies for promoting this communication and collaboration to improve a culture of safety is leader rounding for high reliability.

The Central Texas Veteran’s Health Care System (CTVHCS) in Temple, Texas, is a 189-bed teaching hospital. CTVHCS opened the Center for Innovation and Learning (CIL) in 2022. The CIL has about 279 m² of simulation space that includes high- and low-fidelity simulation equipment and multiple laboratories, which can be used to simulate inpatient and outpatient settings. The CIL high-fidelity manikins and environment allow learners to be immersed in the simulation for maximum realism. Computer and video systems provide clear viewing of training, which allows for more in-depth debriefing and learning. CIL simulation training is used by CTVHCS staff, medical residents, and medical and physician assistant students.

The utility of technology in medical education is rapidly evolving. As noted in many studies, simulation creates an environment that can imitate real patients in the format of a lifelike manikin, anatomic regions stations, clinical tasks, and many real-life circumstances.¹ Task trainers for procedure simulation have been widely used and studied. A 2020 study noted that simulation training is effective for developing procedural skills in surgery and prevents the decay of surgical skills.²

In reviewing health care education curriculums, we noted that most of the rapid response situations are learned through active patient experiences. Rapid responses are managed by the intensive care unit and primary care teams during the day but at night are run primarily by the postgraduate year 2 (PGY2) night resident and intern. Knowing these logistics and current studies, we decided to build a rapid response simulation curriculum to improve preparedness for PGY1 residents, medical students, and physician assistant students.

Curriculum Planning

Planning the simulation curriculum began with the CTVHCS internal medicine chief resident and registered nurse (RN) educator. CTVHCS data were reviewed to identify the 3 most common rapid response calls from the past 3 years; research on the most common systems affected by rapid responses also was evaluated.

A 2019 study by Lyons and colleagues evaluated 402,023 rapid response activations across 360 hospitals and found that respiratory scenarios made up 38% and cardiac scenarios made up 37%.³ In addition, the CTVHCS has limited support in stroke neurology. Therefore, the internal medicine chief resident and RN educator decided to run 3 evolving rapid response scenarios per session that included cardiac, respiratory, and neurological scenarios. Capabilities and limitations of different high-fidelity manikins were discussed to identify and use the most appropriate simulator for each situation. Objectives that met both general medicine and site-specific education were discussed, and the program was formulated.

Program Description

Nightmare on CIL Street is a simulation-based program designed for new internal medicine residents and students to encounter difficult situations (late at night, on call, or when resources are limited; ie, weekends/holidays) in a controlled simulation environment. During the simulation, learners will be unable to transfer the patient and no additional help is available. Each learner must determine a differential diagnosis and make appropriate medical interventions with only the assistance of a nurse. Scenarios are derived from common rapid response team calls and low-volume/high-impact situations where clinical decisions must be made quickly to ensure the best patient outcomes. High-fidelity manikins that have abilities to respond to questions, simulate breathing, reproduce pathological heart and breath sounds and more are used to create a realistic patient environment.

This program aligns with 2 national Veterans Health Administration priorities: (1) connect veterans to the soonest and best care; and (2) accelerate the Veterans Health Administration journey to be a high-reliability organization (sensitivity to operations, preoccupation with failure, commitment to resilience, and deference to expertise). Nightmare on CIL Street has 3 clinical episodes: 2 cardiac (A Tell-Tale Heart), respiratory (Don’t Breathe), and neurologic (Brain Scan). Additional clinical episodes will be added based on learner feedback and assessed need.

Each simulation event encompassed all 3 episodes that an individual or a team of 2 learners rotate through in a round-robin fashion. The overarching theme for each episode was a rapid response team call with minimal resources that the learner would have to provide care and stabilization. A literature search for rapid response team training programs found few results, but the literature assisted with providing a foundation for Nightmare on CIL Street.^4,5 The goal was to completely envelop the learners in a nightmare scenario that required a solution.

After the safety brief and predata collection, learners received a phone call with minimal information about a patient in need of care. The learners responded to the requested area and provided treatment to the emergency over 25 minutes with the bedside nurse (who is an embedded participant). At the conclusion of the scenario, a physician subject matter expert who has been observing, provided a personalized 10-minute debriefing to the learner, which presented specific learning points and opportunities for the learner’s educational development. After the debriefing, learners returned to a conference room and awaited the next call. After all learners completed the 3 episodes, a group debriefing was conducted using the gather, analyze, summarize debriefing framework. The debriefing begins with an open-ended forum for learners to express their thoughts. Then, each scenario is discussed and broken down by key learning objectives. Starting with cardiac and ending with neurology, the logistics of the cases are discussed based on the trajectory of the learners during the scenarios. Each objective is discussed, and learners are allowed to ask questions before moving to the next scenario. After the debriefing, postevent data were gathered.

Objectives

The program objective was to educate residents and students on common rapid response scenarios. We devised each scenario as an evolving simulation where various interventions would improve or worsen vital signs and symptoms. Each scenario had an end goal: cardioversion (cardiac), intubation (respiratory), and transfer (neurologic). Objectives were tailored to the trainees present during the specific simulation (Table).

IMPLEMENTATION

The initial run of the simulation curriculum was implemented on February 22, 2023, and ended on May 17, 2023, with 5 events. Participants included internal medicine PGY1 residents, third-year medical students, and fourth-year physician assistant students. Internal medicine residents ran each scenario with a subject matter expert monitoring; the undergraduate medical trainees partnered with another student. Students were pulled from their ward rotations to attend the simulation, and residents were pulled from electives and wards. Each trainee was able to experience each planned scenario. They were then briefed, participated in each scenario, and ended with a debriefing, discussing each case in detail. Two subject matter experts were always available, and occasionally 4 were present to provide additional knowledge transfer to learners. These included board-certified physicians in internal medicine and pulmonary critical care. Most scenarios were conducted on Wednesday afternoon or Thursday.

The CIL provided 6 staff minimum for every event. The staff controlled the manikins and acted as embedded players for the learners to interact and work with at the bedside. Every embedded RN was provided the same script: They were a new nurse just off orientation and did not know what to do. In addition, they were instructed that no matter who the learner wanted to call/page, that person or service was not answering or unavailable. This forced learners to respond and treat the simulated patient on their own.

Survey Responses

To evaluate the effect of this program on medical education, we administered surveys to the trainees before and after the simulation (Appendix). All questions were evaluated on a 10-point Likert scale (1, minimal comfort; 10, maximum comfort). The postsurvey added an additional Likert scale question and an open-ended question.

Sixteen trainees underwent the simulation curriculum during the 2022 to 2023 academic year, 9 internal medicine PGY1 residents, 4 medical students, and 3 physician assistant students. Postsimulation surveys indicated a mean 2.2 point increase in comfort compared with the presimulation surveys across all questions and participants.

DISCUSSION

The simulation curriculum proved to be successful for all parties, including trainees, medical educators, and simulation staff. Trainees expressed gratitude for the teaching ability of the simulation and the challenge of confronting an evolving scenario. Students also stated that the simulation allowed them to identify knowledge weaknesses.

Medical technology is rapidly advancing. A study evaluating high-fidelity medical simulations between 1969 and 2003 found that they are educationally effective and complement other medical education modalities.⁶ It is also noted that care provided by junior physicians with a lack of prior exposure to emergencies and unusual clinical syndromes can lead to more adverse effects.⁷ Simulation curriculums can be used to educate junior physicians as well as trainees on a multitude of medical emergencies, teach systematic approaches to medical scenarios, and increase exposure to unfamiliar experiences.

The goals of this article are to share program details and encourage other training programs with similar capabilities to incorporate simulation into medical education. Using pre- and postsimulation surveys, there was a concrete improvement in the value obtained by participating in this simulation. The Nightmare on CIL Street learners experienced a mean 2.2 point improvement from presimulation survey to postsimulation survey. Some notable improvements were the feelings of preparedness for rapid response situations and developing a systematic approach. As the students who participated in our Nightmare on CIL Street simulation were early in training, we believe the improvement in preparation and developing a systematic approach can be key to their success in their practical environments.

From a site-specific standpoint, improvement in confidence working through cardiac, respiratory, and neurological emergencies will be very useful. The anesthesiology service intubates during respiratory failures and there is no stroke neurologist available at the CTVHCS hospital. Giving trainees experience in these conditions may allow them to better understand their role in coordination during these times and potentially improve patient outcomes. A follow-up questionnaire administered a year after this simulation may be useful in ascertaining the usefulness of the simulation and what items may have been approached differently. We encourage other institutions to build in aspects of their site-specific challenges to improve trainee awareness in approaches to critical scenarios.

Challenges

The greatest challenge for Nightmare on CIL Street was the ability to pull internal medicine residents from their clinical duties to participate in the simulation. As there are many moving parts to their clinical scheduling, residents do not always have sufficient coverage to participate in training. There were also instances where residents needed to cover for another resident preventing them from attending the simulation. In the future, this program will schedule residents months in advance and will have the simulation training built into their rotations.

Medical and physician assistant students were pulled from their ward rotations as well. They rotate on a 2-to-4-week basis and often had already experienced the simulation the week prior, leaving out students for the following week. With more longitudinal planning, students can be pulled on a rotating monthly basis to maximize their participation. Another challenge was deciding whether residents should partner or experience the simulation on their own. After some feedback, it was noted that residents preferred to experience the simulation on their own as this improves their learning value. With the limited resources available, only rotating 3 residents on a scenario limits the number of trainees who can be reached with the program. Running this program throughout an academic year can help to reach more trainees.

CONCLUSIONS

Educating trainees on rapid response scenarios by using a simulation curriculum provides many benefits. Our trainees reported improvement in addressing cardiac, respiratory, and neurological rapid response scenarios after experiencing the simulation. They felt better prepared and had developed a better systematic approach for the future.

Acknowledgments

The authors thank Pawan Sikka, MD, George Martinez, MD and Braden Anderson, MD for participating as physician experts and educating our students. We thank Naomi Devers; Dinetra Jones; Stephanie Garrett; Sara Holton; Evelina Bartnick; Tanelle Smith; Michael Lomax; Shaun Kelemen for their participation as nurses, assistants, and simulation technology experts.

The Central Texas Veteran’s Health Care System (CTVHCS) in Temple, Texas, is a 189-bed teaching hospital. CTVHCS opened the Center for Innovation and Learning (CIL) in 2022. The CIL has about 279 m² of simulation space that includes high- and low-fidelity simulation equipment and multiple laboratories, which can be used to simulate inpatient and outpatient settings. The CIL high-fidelity manikins and environment allow learners to be immersed in the simulation for maximum realism. Computer and video systems provide clear viewing of training, which allows for more in-depth debriefing and learning. CIL simulation training is used by CTVHCS staff, medical residents, and medical and physician assistant students.

The utility of technology in medical education is rapidly evolving. As noted in many studies, simulation creates an environment that can imitate real patients in the format of a lifelike manikin, anatomic regions stations, clinical tasks, and many real-life circumstances.¹ Task trainers for procedure simulation have been widely used and studied. A 2020 study noted that simulation training is effective for developing procedural skills in surgery and prevents the decay of surgical skills.²

In reviewing health care education curriculums, we noted that most of the rapid response situations are learned through active patient experiences. Rapid responses are managed by the intensive care unit and primary care teams during the day but at night are run primarily by the postgraduate year 2 (PGY2) night resident and intern. Knowing these logistics and current studies, we decided to build a rapid response simulation curriculum to improve preparedness for PGY1 residents, medical students, and physician assistant students.

Curriculum Planning

Planning the simulation curriculum began with the CTVHCS internal medicine chief resident and registered nurse (RN) educator. CTVHCS data were reviewed to identify the 3 most common rapid response calls from the past 3 years; research on the most common systems affected by rapid responses also was evaluated.

A 2019 study by Lyons and colleagues evaluated 402,023 rapid response activations across 360 hospitals and found that respiratory scenarios made up 38% and cardiac scenarios made up 37%.³ In addition, the CTVHCS has limited support in stroke neurology. Therefore, the internal medicine chief resident and RN educator decided to run 3 evolving rapid response scenarios per session that included cardiac, respiratory, and neurological scenarios. Capabilities and limitations of different high-fidelity manikins were discussed to identify and use the most appropriate simulator for each situation. Objectives that met both general medicine and site-specific education were discussed, and the program was formulated.

Program Description

Nightmare on CIL Street is a simulation-based program designed for new internal medicine residents and students to encounter difficult situations (late at night, on call, or when resources are limited; ie, weekends/holidays) in a controlled simulation environment. During the simulation, learners will be unable to transfer the patient and no additional help is available. Each learner must determine a differential diagnosis and make appropriate medical interventions with only the assistance of a nurse. Scenarios are derived from common rapid response team calls and low-volume/high-impact situations where clinical decisions must be made quickly to ensure the best patient outcomes. High-fidelity manikins that have abilities to respond to questions, simulate breathing, reproduce pathological heart and breath sounds and more are used to create a realistic patient environment.

This program aligns with 2 national Veterans Health Administration priorities: (1) connect veterans to the soonest and best care; and (2) accelerate the Veterans Health Administration journey to be a high-reliability organization (sensitivity to operations, preoccupation with failure, commitment to resilience, and deference to expertise). Nightmare on CIL Street has 3 clinical episodes: 2 cardiac (A Tell-Tale Heart), respiratory (Don’t Breathe), and neurologic (Brain Scan). Additional clinical episodes will be added based on learner feedback and assessed need.

Each simulation event encompassed all 3 episodes that an individual or a team of 2 learners rotate through in a round-robin fashion. The overarching theme for each episode was a rapid response team call with minimal resources that the learner would have to provide care and stabilization. A literature search for rapid response team training programs found few results, but the literature assisted with providing a foundation for Nightmare on CIL Street.^4,5 The goal was to completely envelop the learners in a nightmare scenario that required a solution.

After the safety brief and predata collection, learners received a phone call with minimal information about a patient in need of care. The learners responded to the requested area and provided treatment to the emergency over 25 minutes with the bedside nurse (who is an embedded participant). At the conclusion of the scenario, a physician subject matter expert who has been observing, provided a personalized 10-minute debriefing to the learner, which presented specific learning points and opportunities for the learner’s educational development. After the debriefing, learners returned to a conference room and awaited the next call. After all learners completed the 3 episodes, a group debriefing was conducted using the gather, analyze, summarize debriefing framework. The debriefing begins with an open-ended forum for learners to express their thoughts. Then, each scenario is discussed and broken down by key learning objectives. Starting with cardiac and ending with neurology, the logistics of the cases are discussed based on the trajectory of the learners during the scenarios. Each objective is discussed, and learners are allowed to ask questions before moving to the next scenario. After the debriefing, postevent data were gathered.

Objectives

The program objective was to educate residents and students on common rapid response scenarios. We devised each scenario as an evolving simulation where various interventions would improve or worsen vital signs and symptoms. Each scenario had an end goal: cardioversion (cardiac), intubation (respiratory), and transfer (neurologic). Objectives were tailored to the trainees present during the specific simulation (Table).

IMPLEMENTATION

The initial run of the simulation curriculum was implemented on February 22, 2023, and ended on May 17, 2023, with 5 events. Participants included internal medicine PGY1 residents, third-year medical students, and fourth-year physician assistant students. Internal medicine residents ran each scenario with a subject matter expert monitoring; the undergraduate medical trainees partnered with another student. Students were pulled from their ward rotations to attend the simulation, and residents were pulled from electives and wards. Each trainee was able to experience each planned scenario. They were then briefed, participated in each scenario, and ended with a debriefing, discussing each case in detail. Two subject matter experts were always available, and occasionally 4 were present to provide additional knowledge transfer to learners. These included board-certified physicians in internal medicine and pulmonary critical care. Most scenarios were conducted on Wednesday afternoon or Thursday.

The CIL provided 6 staff minimum for every event. The staff controlled the manikins and acted as embedded players for the learners to interact and work with at the bedside. Every embedded RN was provided the same script: They were a new nurse just off orientation and did not know what to do. In addition, they were instructed that no matter who the learner wanted to call/page, that person or service was not answering or unavailable. This forced learners to respond and treat the simulated patient on their own.

Survey Responses

To evaluate the effect of this program on medical education, we administered surveys to the trainees before and after the simulation (Appendix). All questions were evaluated on a 10-point Likert scale (1, minimal comfort; 10, maximum comfort). The postsurvey added an additional Likert scale question and an open-ended question.

Sixteen trainees underwent the simulation curriculum during the 2022 to 2023 academic year, 9 internal medicine PGY1 residents, 4 medical students, and 3 physician assistant students. Postsimulation surveys indicated a mean 2.2 point increase in comfort compared with the presimulation surveys across all questions and participants.

DISCUSSION

The simulation curriculum proved to be successful for all parties, including trainees, medical educators, and simulation staff. Trainees expressed gratitude for the teaching ability of the simulation and the challenge of confronting an evolving scenario. Students also stated that the simulation allowed them to identify knowledge weaknesses.

Medical technology is rapidly advancing. A study evaluating high-fidelity medical simulations between 1969 and 2003 found that they are educationally effective and complement other medical education modalities.⁶ It is also noted that care provided by junior physicians with a lack of prior exposure to emergencies and unusual clinical syndromes can lead to more adverse effects.⁷ Simulation curriculums can be used to educate junior physicians as well as trainees on a multitude of medical emergencies, teach systematic approaches to medical scenarios, and increase exposure to unfamiliar experiences.

The goals of this article are to share program details and encourage other training programs with similar capabilities to incorporate simulation into medical education. Using pre- and postsimulation surveys, there was a concrete improvement in the value obtained by participating in this simulation. The Nightmare on CIL Street learners experienced a mean 2.2 point improvement from presimulation survey to postsimulation survey. Some notable improvements were the feelings of preparedness for rapid response situations and developing a systematic approach. As the students who participated in our Nightmare on CIL Street simulation were early in training, we believe the improvement in preparation and developing a systematic approach can be key to their success in their practical environments.

From a site-specific standpoint, improvement in confidence working through cardiac, respiratory, and neurological emergencies will be very useful. The anesthesiology service intubates during respiratory failures and there is no stroke neurologist available at the CTVHCS hospital. Giving trainees experience in these conditions may allow them to better understand their role in coordination during these times and potentially improve patient outcomes. A follow-up questionnaire administered a year after this simulation may be useful in ascertaining the usefulness of the simulation and what items may have been approached differently. We encourage other institutions to build in aspects of their site-specific challenges to improve trainee awareness in approaches to critical scenarios.

Challenges

The greatest challenge for Nightmare on CIL Street was the ability to pull internal medicine residents from their clinical duties to participate in the simulation. As there are many moving parts to their clinical scheduling, residents do not always have sufficient coverage to participate in training. There were also instances where residents needed to cover for another resident preventing them from attending the simulation. In the future, this program will schedule residents months in advance and will have the simulation training built into their rotations.

Medical and physician assistant students were pulled from their ward rotations as well. They rotate on a 2-to-4-week basis and often had already experienced the simulation the week prior, leaving out students for the following week. With more longitudinal planning, students can be pulled on a rotating monthly basis to maximize their participation. Another challenge was deciding whether residents should partner or experience the simulation on their own. After some feedback, it was noted that residents preferred to experience the simulation on their own as this improves their learning value. With the limited resources available, only rotating 3 residents on a scenario limits the number of trainees who can be reached with the program. Running this program throughout an academic year can help to reach more trainees.

CONCLUSIONS

Educating trainees on rapid response scenarios by using a simulation curriculum provides many benefits. Our trainees reported improvement in addressing cardiac, respiratory, and neurological rapid response scenarios after experiencing the simulation. They felt better prepared and had developed a better systematic approach for the future.

Acknowledgments

The authors thank Pawan Sikka, MD, George Martinez, MD and Braden Anderson, MD for participating as physician experts and educating our students. We thank Naomi Devers; Dinetra Jones; Stephanie Garrett; Sara Holton; Evelina Bartnick; Tanelle Smith; Michael Lomax; Shaun Kelemen for their participation as nurses, assistants, and simulation technology experts.

The Central Texas Veteran’s Health Care System (CTVHCS) in Temple, Texas, is a 189-bed teaching hospital. CTVHCS opened the Center for Innovation and Learning (CIL) in 2022. The CIL has about 279 m² of simulation space that includes high- and low-fidelity simulation equipment and multiple laboratories, which can be used to simulate inpatient and outpatient settings. The CIL high-fidelity manikins and environment allow learners to be immersed in the simulation for maximum realism. Computer and video systems provide clear viewing of training, which allows for more in-depth debriefing and learning. CIL simulation training is used by CTVHCS staff, medical residents, and medical and physician assistant students.

The utility of technology in medical education is rapidly evolving. As noted in many studies, simulation creates an environment that can imitate real patients in the format of a lifelike manikin, anatomic regions stations, clinical tasks, and many real-life circumstances.¹ Task trainers for procedure simulation have been widely used and studied. A 2020 study noted that simulation training is effective for developing procedural skills in surgery and prevents the decay of surgical skills.²

In reviewing health care education curriculums, we noted that most of the rapid response situations are learned through active patient experiences. Rapid responses are managed by the intensive care unit and primary care teams during the day but at night are run primarily by the postgraduate year 2 (PGY2) night resident and intern. Knowing these logistics and current studies, we decided to build a rapid response simulation curriculum to improve preparedness for PGY1 residents, medical students, and physician assistant students.

Curriculum Planning

Planning the simulation curriculum began with the CTVHCS internal medicine chief resident and registered nurse (RN) educator. CTVHCS data were reviewed to identify the 3 most common rapid response calls from the past 3 years; research on the most common systems affected by rapid responses also was evaluated.

A 2019 study by Lyons and colleagues evaluated 402,023 rapid response activations across 360 hospitals and found that respiratory scenarios made up 38% and cardiac scenarios made up 37%.³ In addition, the CTVHCS has limited support in stroke neurology. Therefore, the internal medicine chief resident and RN educator decided to run 3 evolving rapid response scenarios per session that included cardiac, respiratory, and neurological scenarios. Capabilities and limitations of different high-fidelity manikins were discussed to identify and use the most appropriate simulator for each situation. Objectives that met both general medicine and site-specific education were discussed, and the program was formulated.

Program Description

Nightmare on CIL Street is a simulation-based program designed for new internal medicine residents and students to encounter difficult situations (late at night, on call, or when resources are limited; ie, weekends/holidays) in a controlled simulation environment. During the simulation, learners will be unable to transfer the patient and no additional help is available. Each learner must determine a differential diagnosis and make appropriate medical interventions with only the assistance of a nurse. Scenarios are derived from common rapid response team calls and low-volume/high-impact situations where clinical decisions must be made quickly to ensure the best patient outcomes. High-fidelity manikins that have abilities to respond to questions, simulate breathing, reproduce pathological heart and breath sounds and more are used to create a realistic patient environment.

This program aligns with 2 national Veterans Health Administration priorities: (1) connect veterans to the soonest and best care; and (2) accelerate the Veterans Health Administration journey to be a high-reliability organization (sensitivity to operations, preoccupation with failure, commitment to resilience, and deference to expertise). Nightmare on CIL Street has 3 clinical episodes: 2 cardiac (A Tell-Tale Heart), respiratory (Don’t Breathe), and neurologic (Brain Scan). Additional clinical episodes will be added based on learner feedback and assessed need.

Each simulation event encompassed all 3 episodes that an individual or a team of 2 learners rotate through in a round-robin fashion. The overarching theme for each episode was a rapid response team call with minimal resources that the learner would have to provide care and stabilization. A literature search for rapid response team training programs found few results, but the literature assisted with providing a foundation for Nightmare on CIL Street.^4,5 The goal was to completely envelop the learners in a nightmare scenario that required a solution.

After the safety brief and predata collection, learners received a phone call with minimal information about a patient in need of care. The learners responded to the requested area and provided treatment to the emergency over 25 minutes with the bedside nurse (who is an embedded participant). At the conclusion of the scenario, a physician subject matter expert who has been observing, provided a personalized 10-minute debriefing to the learner, which presented specific learning points and opportunities for the learner’s educational development. After the debriefing, learners returned to a conference room and awaited the next call. After all learners completed the 3 episodes, a group debriefing was conducted using the gather, analyze, summarize debriefing framework. The debriefing begins with an open-ended forum for learners to express their thoughts. Then, each scenario is discussed and broken down by key learning objectives. Starting with cardiac and ending with neurology, the logistics of the cases are discussed based on the trajectory of the learners during the scenarios. Each objective is discussed, and learners are allowed to ask questions before moving to the next scenario. After the debriefing, postevent data were gathered.

Objectives

The program objective was to educate residents and students on common rapid response scenarios. We devised each scenario as an evolving simulation where various interventions would improve or worsen vital signs and symptoms. Each scenario had an end goal: cardioversion (cardiac), intubation (respiratory), and transfer (neurologic). Objectives were tailored to the trainees present during the specific simulation (Table).

IMPLEMENTATION

The initial run of the simulation curriculum was implemented on February 22, 2023, and ended on May 17, 2023, with 5 events. Participants included internal medicine PGY1 residents, third-year medical students, and fourth-year physician assistant students. Internal medicine residents ran each scenario with a subject matter expert monitoring; the undergraduate medical trainees partnered with another student. Students were pulled from their ward rotations to attend the simulation, and residents were pulled from electives and wards. Each trainee was able to experience each planned scenario. They were then briefed, participated in each scenario, and ended with a debriefing, discussing each case in detail. Two subject matter experts were always available, and occasionally 4 were present to provide additional knowledge transfer to learners. These included board-certified physicians in internal medicine and pulmonary critical care. Most scenarios were conducted on Wednesday afternoon or Thursday.

The CIL provided 6 staff minimum for every event. The staff controlled the manikins and acted as embedded players for the learners to interact and work with at the bedside. Every embedded RN was provided the same script: They were a new nurse just off orientation and did not know what to do. In addition, they were instructed that no matter who the learner wanted to call/page, that person or service was not answering or unavailable. This forced learners to respond and treat the simulated patient on their own.

Survey Responses

To evaluate the effect of this program on medical education, we administered surveys to the trainees before and after the simulation (Appendix). All questions were evaluated on a 10-point Likert scale (1, minimal comfort; 10, maximum comfort). The postsurvey added an additional Likert scale question and an open-ended question.

Sixteen trainees underwent the simulation curriculum during the 2022 to 2023 academic year, 9 internal medicine PGY1 residents, 4 medical students, and 3 physician assistant students. Postsimulation surveys indicated a mean 2.2 point increase in comfort compared with the presimulation surveys across all questions and participants.

DISCUSSION

The simulation curriculum proved to be successful for all parties, including trainees, medical educators, and simulation staff. Trainees expressed gratitude for the teaching ability of the simulation and the challenge of confronting an evolving scenario. Students also stated that the simulation allowed them to identify knowledge weaknesses.

Medical technology is rapidly advancing. A study evaluating high-fidelity medical simulations between 1969 and 2003 found that they are educationally effective and complement other medical education modalities.⁶ It is also noted that care provided by junior physicians with a lack of prior exposure to emergencies and unusual clinical syndromes can lead to more adverse effects.⁷ Simulation curriculums can be used to educate junior physicians as well as trainees on a multitude of medical emergencies, teach systematic approaches to medical scenarios, and increase exposure to unfamiliar experiences.

The goals of this article are to share program details and encourage other training programs with similar capabilities to incorporate simulation into medical education. Using pre- and postsimulation surveys, there was a concrete improvement in the value obtained by participating in this simulation. The Nightmare on CIL Street learners experienced a mean 2.2 point improvement from presimulation survey to postsimulation survey. Some notable improvements were the feelings of preparedness for rapid response situations and developing a systematic approach. As the students who participated in our Nightmare on CIL Street simulation were early in training, we believe the improvement in preparation and developing a systematic approach can be key to their success in their practical environments.

From a site-specific standpoint, improvement in confidence working through cardiac, respiratory, and neurological emergencies will be very useful. The anesthesiology service intubates during respiratory failures and there is no stroke neurologist available at the CTVHCS hospital. Giving trainees experience in these conditions may allow them to better understand their role in coordination during these times and potentially improve patient outcomes. A follow-up questionnaire administered a year after this simulation may be useful in ascertaining the usefulness of the simulation and what items may have been approached differently. We encourage other institutions to build in aspects of their site-specific challenges to improve trainee awareness in approaches to critical scenarios.

Challenges

The greatest challenge for Nightmare on CIL Street was the ability to pull internal medicine residents from their clinical duties to participate in the simulation. As there are many moving parts to their clinical scheduling, residents do not always have sufficient coverage to participate in training. There were also instances where residents needed to cover for another resident preventing them from attending the simulation. In the future, this program will schedule residents months in advance and will have the simulation training built into their rotations.

Medical and physician assistant students were pulled from their ward rotations as well. They rotate on a 2-to-4-week basis and often had already experienced the simulation the week prior, leaving out students for the following week. With more longitudinal planning, students can be pulled on a rotating monthly basis to maximize their participation. Another challenge was deciding whether residents should partner or experience the simulation on their own. After some feedback, it was noted that residents preferred to experience the simulation on their own as this improves their learning value. With the limited resources available, only rotating 3 residents on a scenario limits the number of trainees who can be reached with the program. Running this program throughout an academic year can help to reach more trainees.

CONCLUSIONS

Educating trainees on rapid response scenarios by using a simulation curriculum provides many benefits. Our trainees reported improvement in addressing cardiac, respiratory, and neurological rapid response scenarios after experiencing the simulation. They felt better prepared and had developed a better systematic approach for the future.

Acknowledgments

The authors thank Pawan Sikka, MD, George Martinez, MD and Braden Anderson, MD for participating as physician experts and educating our students. We thank Naomi Devers; Dinetra Jones; Stephanie Garrett; Sara Holton; Evelina Bartnick; Tanelle Smith; Michael Lomax; Shaun Kelemen for their participation as nurses, assistants, and simulation technology experts.

Patients planning plastic surgery traditionally were instructed to stop anticoagulants and antiplatelet medications during the perioperative period to avoid bleeding, which could result in flap loss, pain, skin necrosis, and blood transfusions. In the veteran patient population, anticoagulants are prescribed for the prevention of limb- and life-threatening embolic and thrombotic events.^1-3 As of June 2021, > 332,000 veterans were prescribed direct oral anticoagulants.¹

In 2015, the Malcom Randall Veterans Affairs Medical Center (MRVAMC) in Gainesville, Florida, Plastic Surgery Service began instructing patients planning elective hand surgery to continue their prescription anticoagulants and antiplatelets during the perioperative period. This decision was prompted by a patient who needed carpal tunnel release surgery and was prescribed coumadin for repeated thrombosis of his dialysis grafts. Hand surgery literature at the time suggested allowing patients to continue their anticoagulants and antiplatelets through the perioperative period to avoid life- and limb-threatening events and wide fluctuations in blood anticoagulant levels.^4-6 The MRVAMC Plastic Surgery Service chose to accept the risk of perioperative bleeding after shared decision making with the patients rather than risk a cardiac stent obstruction, pulmonary embolism, or embolic stroke in the at-risk patients.

The objective of this study was to determine the postoperative bleeding complication rate over a 7.5-year period in the veteran patients who did not interrupt their prescription blood thinners. This would assist the MRVAMC Plastic Surgery Service with providing data-driven informed consent and determine whether this protocol should continue.

Methods

The North Florida/South Georgia Veterans Health System Research Committee and the University of Florida Institutional Review Board approved a retrospective chart review of elective hand cases performed by the MRVAMC Plastic Surgery Service from January 1, 2015, through June 30, 2022. Elective hand cases were identified based on the operation description and included nerve decompressions, tendon releases, trapeziectomy, small-joint fusion, neurectomy, elective amputations, and benign neoplasm removals (Table). Hand surgery included cubital tunnel releases (decompression of the ulnar nerve at the level of the elbow) because hand surgery fellowships, hand surgery training, and hand surgery practices traditionally include a high volume of cubital tunnel releases. We wanted this study to have real-world applications.

Patients’ histories and physicals were reviewed for prescription antithrombotics and for instructions not to interrupt these medications. Postoperative notes were reviewed for 30 days for evidence of postoperative bleeding complications.

The following prescription anticoagulants were included in the study: dabigatran, rivaroxaban, warfarin, edoxaban, and apixaban. In addition, the following prescription antiplatelets were included in the study: clopidogrel, aspirin/dipyridamole, prasugrel, cilostazol, and ticagrelor. Indications for the medications included a history of thromboembolic events, cardiac stents, cerebrovascular disease, atrial fibrillation, hypercoagulable states, and mechanical valves. Over-the-counter antiplatelet medications, such as aspirin and ibuprofen, were not included as a standalone medication for accuracy because patients taking those medications may not be captured in the electronic health record review.

Results

One hundred seventy-eight patients were identified for maintaining prescription blood thinners during their elective hand surgery. There was 1 major complication (0.6%) and 4 minor bleeding complications (2.2%). The major complication occurred when a patient had to return to surgery from the recovery room for emergent control of bleeding. The surgery was for an in situ cubital tunnel release. The patient, aged 48 years, was taking clopidogrel and aspirin and had a personal and family history of cardiovascular disease. The bleeding was controlled with bipolar cautery and Floseal, a topical haemostatic matrix made of bovine gelatin and human thrombin. The minor bleeding complications were treated in the clinic with compression, wound care, or expedited follow-up for reassurance. These included an in situ cubital tunnel release for a patient taking warfarin and aspirin, a digital inclusion cyst for a patient taking apixaban, an endoscopic carpal tunnel for a patient taking aspirin and clopidogrel, and an open carpal tunnel and ulnar tunnel release for a patient taking aspirin and clopidogrel. There were no thrombotic events during the study.

Discussion

Higher utilization of anticoagulation has been evidenced by a 30% increase in Medicare claims and a 277% increase in Medicaid anticoagulation claims between 2014 and 2019, driven by more prescriptions for direct oral anticoagulants such as apixaban and rivaroxaban.⁷ The MRVAMC Plastic Surgery Service began a protocol for managing perioperative anticoagulation in 2015 to avoid the risk of perioperative thrombotic events in veteran patients. Patients who choose elective hand surgery were instructed to continue their prescription blood thinners. Exceptions to this protocol were patients scheduled for a partial fasciectomy (for Dupuytren contracture) or cubital tunnel release with anterior ulnar nerve transposition. A hematoma would increase the risk for skin necrosis in the patients receiving a fasciectomy, resulting from the thin skin flaps and meticulous dissection to identify and protect the digital nerves. Worsening nerve dysfunction could result from hematoma compression and scarring in the ulnar nerve cases. If the risk of holding the blood thinner was felt to be unreasonably high, based on recommendations from the patients’ cardiologist or primary care doctor, we offered an in situ cubital tunnel release for the ulnar nerve patients.

Concerns regarding interrupting chronic anticoagulation involve the increased risk of thromboembolism and the theoretical risk of a rebound hypercoagulable effect.⁸ Patients prescribed warfarin have been found to unintentionally discontinue this medication after outpatient surgery at more than 1.5 times the rate of the general population.⁹

A systematic review of 9 published studies looking specifically at elective hand and wrist surgeries demonstrated no significant increase in perioperative bleeding risk with the continuation of anticoagulation and antiplatelet medications.¹⁰ Sardenberg and colleagues reviewed 7 studies in which 410 hand and wrist surgeries were performed in patients prescribed warfarin or aspirin and clopidogrel. These patients had a 0.7% serious complication rate, requiring surgical treatment only in patients having complex wrist surgeries (wrist arthrodesis with tenosynovectomy, resection of the distal ulna with tenosynovectomy and tendon transfer, and proximal row carpectomy).¹¹ Bogunovic and colleagues compared 50 hand and wrist patients who were on uninterrupted warfarin with those who were not. They required patients to have an international normalized ratio (INR) < 3.5, but 1 patient required a return to the operating room for a bleeding complication due to an INR of 5.4 on postoperative day 4. They caution vigilant monitoring of INR.¹²

These and our study are consistent with other disciplines, such as facial plastic surgery, dermatology, and ophthalmology, which do not support routine suspension of anticoagulants.^13-16 A review of 30 cutaneous surgery studies involving > 14,000 patients recommended meticulous hemostasis over cessation of blood thinners.¹⁵ The University of Massachusetts Dermatology Clinic found a 40 times higher rate of bleeding complications in patients on clopidogrel and warfarin but still recommended continuation of these medications to avoid thrombotic events.¹⁶

Limitations

This study is a retrospective chart review and limited by what is already documented in the electronic health record. We can verify that the patients were given instructions to continue their medications up to the day of surgery but cannot be certain whether the instructions were followed. No control group was told to hold their anticoagulants for the same surgery. Once we decided on a protocol, we applied it to all patients. The study approval was for the specific time frame when the protocol was in place.

Our study was designed for elective hand cases because those surgeries can be anticipated, predicted, and patients can be given instructions during the preoperative appointments. We did incidentally find several nonelective hand cases (traumas, infections, and cancers) during the review of patients taking prescription blood thinners that had to be expedited to the operating room. Based on morbidity data during that time period, there were no additional postoperative hand surgery bleeding complications that had to return to the operating room. Future studies are indicated, but we believe our protocol can be applied to urgent and emergent hand surgeries as well as elective cases.

Conclusions

Our study supports continuing prescription anticoagulant and antiplatelet medications during the perioperative period for elective hand surgery. We found this is a safe practice in our veteran population with an acceptably low local bleeding complication rate.

Acknowledgments

This manuscript is the result of work supported with the resources and the use of facilities at the North Florida/South Georgia Veterans Health System in Gainesville, Florida.

Patients planning plastic surgery traditionally were instructed to stop anticoagulants and antiplatelet medications during the perioperative period to avoid bleeding, which could result in flap loss, pain, skin necrosis, and blood transfusions. In the veteran patient population, anticoagulants are prescribed for the prevention of limb- and life-threatening embolic and thrombotic events.^1-3 As of June 2021, > 332,000 veterans were prescribed direct oral anticoagulants.¹

In 2015, the Malcom Randall Veterans Affairs Medical Center (MRVAMC) in Gainesville, Florida, Plastic Surgery Service began instructing patients planning elective hand surgery to continue their prescription anticoagulants and antiplatelets during the perioperative period. This decision was prompted by a patient who needed carpal tunnel release surgery and was prescribed coumadin for repeated thrombosis of his dialysis grafts. Hand surgery literature at the time suggested allowing patients to continue their anticoagulants and antiplatelets through the perioperative period to avoid life- and limb-threatening events and wide fluctuations in blood anticoagulant levels.^4-6 The MRVAMC Plastic Surgery Service chose to accept the risk of perioperative bleeding after shared decision making with the patients rather than risk a cardiac stent obstruction, pulmonary embolism, or embolic stroke in the at-risk patients.

The objective of this study was to determine the postoperative bleeding complication rate over a 7.5-year period in the veteran patients who did not interrupt their prescription blood thinners. This would assist the MRVAMC Plastic Surgery Service with providing data-driven informed consent and determine whether this protocol should continue.

Methods

The North Florida/South Georgia Veterans Health System Research Committee and the University of Florida Institutional Review Board approved a retrospective chart review of elective hand cases performed by the MRVAMC Plastic Surgery Service from January 1, 2015, through June 30, 2022. Elective hand cases were identified based on the operation description and included nerve decompressions, tendon releases, trapeziectomy, small-joint fusion, neurectomy, elective amputations, and benign neoplasm removals (Table). Hand surgery included cubital tunnel releases (decompression of the ulnar nerve at the level of the elbow) because hand surgery fellowships, hand surgery training, and hand surgery practices traditionally include a high volume of cubital tunnel releases. We wanted this study to have real-world applications.

Patients’ histories and physicals were reviewed for prescription antithrombotics and for instructions not to interrupt these medications. Postoperative notes were reviewed for 30 days for evidence of postoperative bleeding complications.

The following prescription anticoagulants were included in the study: dabigatran, rivaroxaban, warfarin, edoxaban, and apixaban. In addition, the following prescription antiplatelets were included in the study: clopidogrel, aspirin/dipyridamole, prasugrel, cilostazol, and ticagrelor. Indications for the medications included a history of thromboembolic events, cardiac stents, cerebrovascular disease, atrial fibrillation, hypercoagulable states, and mechanical valves. Over-the-counter antiplatelet medications, such as aspirin and ibuprofen, were not included as a standalone medication for accuracy because patients taking those medications may not be captured in the electronic health record review.

Results

One hundred seventy-eight patients were identified for maintaining prescription blood thinners during their elective hand surgery. There was 1 major complication (0.6%) and 4 minor bleeding complications (2.2%). The major complication occurred when a patient had to return to surgery from the recovery room for emergent control of bleeding. The surgery was for an in situ cubital tunnel release. The patient, aged 48 years, was taking clopidogrel and aspirin and had a personal and family history of cardiovascular disease. The bleeding was controlled with bipolar cautery and Floseal, a topical haemostatic matrix made of bovine gelatin and human thrombin. The minor bleeding complications were treated in the clinic with compression, wound care, or expedited follow-up for reassurance. These included an in situ cubital tunnel release for a patient taking warfarin and aspirin, a digital inclusion cyst for a patient taking apixaban, an endoscopic carpal tunnel for a patient taking aspirin and clopidogrel, and an open carpal tunnel and ulnar tunnel release for a patient taking aspirin and clopidogrel. There were no thrombotic events during the study.

Discussion

Higher utilization of anticoagulation has been evidenced by a 30% increase in Medicare claims and a 277% increase in Medicaid anticoagulation claims between 2014 and 2019, driven by more prescriptions for direct oral anticoagulants such as apixaban and rivaroxaban.⁷ The MRVAMC Plastic Surgery Service began a protocol for managing perioperative anticoagulation in 2015 to avoid the risk of perioperative thrombotic events in veteran patients. Patients who choose elective hand surgery were instructed to continue their prescription blood thinners. Exceptions to this protocol were patients scheduled for a partial fasciectomy (for Dupuytren contracture) or cubital tunnel release with anterior ulnar nerve transposition. A hematoma would increase the risk for skin necrosis in the patients receiving a fasciectomy, resulting from the thin skin flaps and meticulous dissection to identify and protect the digital nerves. Worsening nerve dysfunction could result from hematoma compression and scarring in the ulnar nerve cases. If the risk of holding the blood thinner was felt to be unreasonably high, based on recommendations from the patients’ cardiologist or primary care doctor, we offered an in situ cubital tunnel release for the ulnar nerve patients.

Concerns regarding interrupting chronic anticoagulation involve the increased risk of thromboembolism and the theoretical risk of a rebound hypercoagulable effect.⁸ Patients prescribed warfarin have been found to unintentionally discontinue this medication after outpatient surgery at more than 1.5 times the rate of the general population.⁹

A systematic review of 9 published studies looking specifically at elective hand and wrist surgeries demonstrated no significant increase in perioperative bleeding risk with the continuation of anticoagulation and antiplatelet medications.¹⁰ Sardenberg and colleagues reviewed 7 studies in which 410 hand and wrist surgeries were performed in patients prescribed warfarin or aspirin and clopidogrel. These patients had a 0.7% serious complication rate, requiring surgical treatment only in patients having complex wrist surgeries (wrist arthrodesis with tenosynovectomy, resection of the distal ulna with tenosynovectomy and tendon transfer, and proximal row carpectomy).¹¹ Bogunovic and colleagues compared 50 hand and wrist patients who were on uninterrupted warfarin with those who were not. They required patients to have an international normalized ratio (INR) < 3.5, but 1 patient required a return to the operating room for a bleeding complication due to an INR of 5.4 on postoperative day 4. They caution vigilant monitoring of INR.¹²

These and our study are consistent with other disciplines, such as facial plastic surgery, dermatology, and ophthalmology, which do not support routine suspension of anticoagulants.^13-16 A review of 30 cutaneous surgery studies involving > 14,000 patients recommended meticulous hemostasis over cessation of blood thinners.¹⁵ The University of Massachusetts Dermatology Clinic found a 40 times higher rate of bleeding complications in patients on clopidogrel and warfarin but still recommended continuation of these medications to avoid thrombotic events.¹⁶

Limitations

This study is a retrospective chart review and limited by what is already documented in the electronic health record. We can verify that the patients were given instructions to continue their medications up to the day of surgery but cannot be certain whether the instructions were followed. No control group was told to hold their anticoagulants for the same surgery. Once we decided on a protocol, we applied it to all patients. The study approval was for the specific time frame when the protocol was in place.

Our study was designed for elective hand cases because those surgeries can be anticipated, predicted, and patients can be given instructions during the preoperative appointments. We did incidentally find several nonelective hand cases (traumas, infections, and cancers) during the review of patients taking prescription blood thinners that had to be expedited to the operating room. Based on morbidity data during that time period, there were no additional postoperative hand surgery bleeding complications that had to return to the operating room. Future studies are indicated, but we believe our protocol can be applied to urgent and emergent hand surgeries as well as elective cases.

Conclusions

Our study supports continuing prescription anticoagulant and antiplatelet medications during the perioperative period for elective hand surgery. We found this is a safe practice in our veteran population with an acceptably low local bleeding complication rate.

Acknowledgments

This manuscript is the result of work supported with the resources and the use of facilities at the North Florida/South Georgia Veterans Health System in Gainesville, Florida.

Patients planning plastic surgery traditionally were instructed to stop anticoagulants and antiplatelet medications during the perioperative period to avoid bleeding, which could result in flap loss, pain, skin necrosis, and blood transfusions. In the veteran patient population, anticoagulants are prescribed for the prevention of limb- and life-threatening embolic and thrombotic events.^1-3 As of June 2021, > 332,000 veterans were prescribed direct oral anticoagulants.¹

In 2015, the Malcom Randall Veterans Affairs Medical Center (MRVAMC) in Gainesville, Florida, Plastic Surgery Service began instructing patients planning elective hand surgery to continue their prescription anticoagulants and antiplatelets during the perioperative period. This decision was prompted by a patient who needed carpal tunnel release surgery and was prescribed coumadin for repeated thrombosis of his dialysis grafts. Hand surgery literature at the time suggested allowing patients to continue their anticoagulants and antiplatelets through the perioperative period to avoid life- and limb-threatening events and wide fluctuations in blood anticoagulant levels.^4-6 The MRVAMC Plastic Surgery Service chose to accept the risk of perioperative bleeding after shared decision making with the patients rather than risk a cardiac stent obstruction, pulmonary embolism, or embolic stroke in the at-risk patients.

The objective of this study was to determine the postoperative bleeding complication rate over a 7.5-year period in the veteran patients who did not interrupt their prescription blood thinners. This would assist the MRVAMC Plastic Surgery Service with providing data-driven informed consent and determine whether this protocol should continue.

Methods

The North Florida/South Georgia Veterans Health System Research Committee and the University of Florida Institutional Review Board approved a retrospective chart review of elective hand cases performed by the MRVAMC Plastic Surgery Service from January 1, 2015, through June 30, 2022. Elective hand cases were identified based on the operation description and included nerve decompressions, tendon releases, trapeziectomy, small-joint fusion, neurectomy, elective amputations, and benign neoplasm removals (Table). Hand surgery included cubital tunnel releases (decompression of the ulnar nerve at the level of the elbow) because hand surgery fellowships, hand surgery training, and hand surgery practices traditionally include a high volume of cubital tunnel releases. We wanted this study to have real-world applications.

Patients’ histories and physicals were reviewed for prescription antithrombotics and for instructions not to interrupt these medications. Postoperative notes were reviewed for 30 days for evidence of postoperative bleeding complications.

The following prescription anticoagulants were included in the study: dabigatran, rivaroxaban, warfarin, edoxaban, and apixaban. In addition, the following prescription antiplatelets were included in the study: clopidogrel, aspirin/dipyridamole, prasugrel, cilostazol, and ticagrelor. Indications for the medications included a history of thromboembolic events, cardiac stents, cerebrovascular disease, atrial fibrillation, hypercoagulable states, and mechanical valves. Over-the-counter antiplatelet medications, such as aspirin and ibuprofen, were not included as a standalone medication for accuracy because patients taking those medications may not be captured in the electronic health record review.

Results

One hundred seventy-eight patients were identified for maintaining prescription blood thinners during their elective hand surgery. There was 1 major complication (0.6%) and 4 minor bleeding complications (2.2%). The major complication occurred when a patient had to return to surgery from the recovery room for emergent control of bleeding. The surgery was for an in situ cubital tunnel release. The patient, aged 48 years, was taking clopidogrel and aspirin and had a personal and family history of cardiovascular disease. The bleeding was controlled with bipolar cautery and Floseal, a topical haemostatic matrix made of bovine gelatin and human thrombin. The minor bleeding complications were treated in the clinic with compression, wound care, or expedited follow-up for reassurance. These included an in situ cubital tunnel release for a patient taking warfarin and aspirin, a digital inclusion cyst for a patient taking apixaban, an endoscopic carpal tunnel for a patient taking aspirin and clopidogrel, and an open carpal tunnel and ulnar tunnel release for a patient taking aspirin and clopidogrel. There were no thrombotic events during the study.

Discussion

Higher utilization of anticoagulation has been evidenced by a 30% increase in Medicare claims and a 277% increase in Medicaid anticoagulation claims between 2014 and 2019, driven by more prescriptions for direct oral anticoagulants such as apixaban and rivaroxaban.⁷ The MRVAMC Plastic Surgery Service began a protocol for managing perioperative anticoagulation in 2015 to avoid the risk of perioperative thrombotic events in veteran patients. Patients who choose elective hand surgery were instructed to continue their prescription blood thinners. Exceptions to this protocol were patients scheduled for a partial fasciectomy (for Dupuytren contracture) or cubital tunnel release with anterior ulnar nerve transposition. A hematoma would increase the risk for skin necrosis in the patients receiving a fasciectomy, resulting from the thin skin flaps and meticulous dissection to identify and protect the digital nerves. Worsening nerve dysfunction could result from hematoma compression and scarring in the ulnar nerve cases. If the risk of holding the blood thinner was felt to be unreasonably high, based on recommendations from the patients’ cardiologist or primary care doctor, we offered an in situ cubital tunnel release for the ulnar nerve patients.

Concerns regarding interrupting chronic anticoagulation involve the increased risk of thromboembolism and the theoretical risk of a rebound hypercoagulable effect.⁸ Patients prescribed warfarin have been found to unintentionally discontinue this medication after outpatient surgery at more than 1.5 times the rate of the general population.⁹

A systematic review of 9 published studies looking specifically at elective hand and wrist surgeries demonstrated no significant increase in perioperative bleeding risk with the continuation of anticoagulation and antiplatelet medications.¹⁰ Sardenberg and colleagues reviewed 7 studies in which 410 hand and wrist surgeries were performed in patients prescribed warfarin or aspirin and clopidogrel. These patients had a 0.7% serious complication rate, requiring surgical treatment only in patients having complex wrist surgeries (wrist arthrodesis with tenosynovectomy, resection of the distal ulna with tenosynovectomy and tendon transfer, and proximal row carpectomy).¹¹ Bogunovic and colleagues compared 50 hand and wrist patients who were on uninterrupted warfarin with those who were not. They required patients to have an international normalized ratio (INR) < 3.5, but 1 patient required a return to the operating room for a bleeding complication due to an INR of 5.4 on postoperative day 4. They caution vigilant monitoring of INR.¹²

These and our study are consistent with other disciplines, such as facial plastic surgery, dermatology, and ophthalmology, which do not support routine suspension of anticoagulants.^13-16 A review of 30 cutaneous surgery studies involving > 14,000 patients recommended meticulous hemostasis over cessation of blood thinners.¹⁵ The University of Massachusetts Dermatology Clinic found a 40 times higher rate of bleeding complications in patients on clopidogrel and warfarin but still recommended continuation of these medications to avoid thrombotic events.¹⁶

Limitations

This study is a retrospective chart review and limited by what is already documented in the electronic health record. We can verify that the patients were given instructions to continue their medications up to the day of surgery but cannot be certain whether the instructions were followed. No control group was told to hold their anticoagulants for the same surgery. Once we decided on a protocol, we applied it to all patients. The study approval was for the specific time frame when the protocol was in place.

Our study was designed for elective hand cases because those surgeries can be anticipated, predicted, and patients can be given instructions during the preoperative appointments. We did incidentally find several nonelective hand cases (traumas, infections, and cancers) during the review of patients taking prescription blood thinners that had to be expedited to the operating room. Based on morbidity data during that time period, there were no additional postoperative hand surgery bleeding complications that had to return to the operating room. Future studies are indicated, but we believe our protocol can be applied to urgent and emergent hand surgeries as well as elective cases.

Conclusions

Our study supports continuing prescription anticoagulant and antiplatelet medications during the perioperative period for elective hand surgery. We found this is a safe practice in our veteran population with an acceptably low local bleeding complication rate.

Acknowledgments

This manuscript is the result of work supported with the resources and the use of facilities at the North Florida/South Georgia Veterans Health System in Gainesville, Florida.