Professional Documents
Culture Documents
• Background
• VA NCPS MTT Program
• OR Briefing/Debriefing Project
• Evaluation
• Results
• Summary
2
Military Health System – Learning Action Network (LAN) 09 JAN 2008
Lessons learned
• Implementation
• Tools
• Physician engagement
• Barriers
• Critical success factors
• Measurement
• Spread and sustainment
3
Military Health System – Learning Action Network (LAN) 09 JAN 2008
History of VA NCPS MTT program
5
Military Health System – Learning Action Network (LAN) 09 JAN 2008
Facility commitment
• Plan and prepare for the LS
• Organize a multidisciplinary IT
• Close OR to elective procedures on day of LS
• Implement MTT project involving B/DB for a
minimum of 1y following the LS
• Participate in quarterly follow-up interviews with
NCPS support for a minimum of 1y
• Administer the Safety Attitudes Questionnaire in
staff meetings to LS attendees 1y follow the LS
6
Military Health System – Learning Action Network (LAN) 09 JAN 2008
Preparation and planning
9
Military Health System – Learning Action Network (LAN) 09 JAN 2008
Description of B/DB
• Preoperative Briefing
– Conducted in the OR
– Immediately prior to the procedure
– With all surgical team members present
• Postoperative Debriefing
– conducted in the OR
– near the conclusion of the procedure
– all team members present
10
Military Health System – Learning Action Network (LAN) 09 JAN 2008
Implementation of Preoperative Briefing
• Who (introductions)?
– All surgical team members present
• Where?
– In the OR suite
• When?
– Prior to the induction of anesthesia
• How?
– Checklist- specialty specific briefing guide
• What (shared mental model)?
– Roles/responsibilities, situation awareness, workload, task assistance
– Resources (instrumentation, implants, blood products, imaging,
pathology specimens, personnel)
– “Stop the line”
11
Military Health System – Learning Action Network (LAN) 09 JAN 2008
Implementation of Postoperative Debriefing
• Who?
– All surgical team members
• Where?
– In the OR suite
• When?
– During surgical wound closure
– After all counts have been recorded as correct
• How?
– Checklist
– Respecting the anesthesia provider who is monitoring the patient, the
surgical team closing the wound, and the circulator performing multiple
tasks
• What?
– Roles/responsibilities, situation awareness, workload, task assistance
– Resources (instrumentation, implants, blood products, imaging,
pathology specimens, personnel)
– Went well? Didn’t go well? Lessons learned from this procedure?
12
Military Health System – Learning Action Network (LAN) 09 JAN 2008
Potential gains of B/DB
• QUALITY
– Improve performance measures (infection prevention)
• SAFETY
– Avoid undesirable events in the OR
– Fatigue management
• EFFICIENCY
– Reduce frequency of staff members leaving the room for instruments,
equipment, and other items
– Streamline surgical instrument and equipment processing
• TEAMWORK
– Promote situational learning and teaching
– Improve communication
• SATISFACTION
– Improve morale and job satisfaction in OR
13
Military Health System – Learning Action Network (LAN) 09 JAN 2008
Evaluation
• B/DB Project by facility
– Process
– Outcome
• MTT Program by NCPS (Kirkpatrick)
– REACTION
– LEARNING
– BEHAVIORAL CHANGE
– ORGANIZATIONAL IMPACT
14
Military Health System – Learning Action Network (LAN) 09 JAN 2008
B/DB project evaluation by facility
• Measure, Target, Date
• Process
– % of Surgical Service procedures with a briefing and
debriefing (50%, 4m)
• Outcome
– SIP-1 (10% increase, 6m)
– On time start - 1st case of day (20% increase, 4m)
– Beta blocker admin (25% increase, 4m)
– Glycemic control (50% increase, 4m)
– Temperature control (50% increase, 4m)
– # "WAITING TIME EVENTS" per procedure (< 2, 4m)
15
Military Health System – Learning Action Network (LAN) 09 JAN 2008
Waiting Time Events
• Instruments
• Equipment
• Radiology
• Laboratory
• Personnel
• Blood
• Medication
• Fluids
16
Military Health System – Learning Action Network (LAN) 09 JAN 2008
MTT program evaluation by NCPS
• LS assessment by participants
• Safety Attitudes Questionnaire (SAQ)
before LS and 12+m after LS
• Quarterly semi-structured interview
• NSQIP (National Surgical Quality
Improvement Program)
• All Employee Survey (AES) Job
Satisfaction Index
17
Military Health System – Learning Action Network (LAN) 09 JAN 2008
Results
• 500 providers at 10
VAMCs underwent
MTT from 0806-
1206
• They have now
completed 1y
follow-up
18
Military Health System – Learning Action Network (LAN) 09 JAN 2008
Reaction
• How did participants react to the training?
• Measured with participant LS questionnaire
Objective Questions given at the end of the learning session % reporting objective met completely or mostly
19
Military Health System – Learning Action Network (LAN) 09 JAN 2008
Learning
• Has the training resulted in an increase in knowledge,
skills, or attitudes?
• Measured with SAQ
– Administered before LS and 12+m after LS
– Snapshot of safety culture thru surveys of frontline
worker perceptions
– Aviation-derived tool that has been validated
– Allows organizations to determine provider attitudes,
compare themselves to other organizations, prompt
interventions, and measure effectiveness of interventions
– Assesses provider attitude of 6 factors- teamwork
climate, safety climate, job satisfaction, stress
recognition, perceptions of management, working
conditions
20
Military Health System – Learning Action Network (LAN) 09 JAN 2008
Teamwork Climate
21
Military Health System – Learning Action Network (LAN) 09 JAN 2008
Safety Climate
23
Military Health System – Learning Action Network (LAN) 09 JAN 2008
Stress Recognition
26
Military Health System – Learning Action Network (LAN) 09 JAN 2008
Safety Assessment Questionnaire
Perceptions of Management
Scale Score
28
Military Health System – Learning Action Network (LAN) 09 JAN 2008
Quality
• Improved measures (5)
– Antibiotic prophylaxis
– Also reported for other infection measures
(normothermia, hair removal), use of beta blockers in
cardiac patients, and VTE prophylaxis
• Assisted with compliance in Insuring Correct
Surgery, Resident Supervision, and Medication
Reconciliation
• Specific process improvement accomplished for
blood availability, equipment availability, and
patient positioning
29
Military Health System – Learning Action Network (LAN) 09 JAN 2008
Safety
• Wrong site surgery avoided because of the
preoperative briefing (2)
• Problem detected at preoperative briefing (4)
– 2 cases cancelled due medical contraindications
– 2 cases where lack of equipment detected
• Change in care
– patient brought to OR for cholecystectomy
– nurse noted discolored limb during briefing
– further assessment confirmed pulseless extremity
– required emergent treatment
30
Military Health System – Learning Action Network (LAN) 09 JAN 2008
Efficiency
• All 9 sites reported improvements
– Improved first case on time start (7)
– Decreased # waiting time events (4)
– Decreased length of surgical procedures (2)
• No site reported an increase in the length
of surgical procedures with the
implementation of briefings/debriefings
• Efficiency improvements attributed to
revision of instrument packs (3)
31
Military Health System – Learning Action Network (LAN) 09 JAN 2008
Teamwork
32
Military Health System – Learning Action Network (LAN) 09 JAN 2008
Organizational impact
• Has the training affected process or outcome
such as increased production, improved
quality, reduced adverse events, decreased
costs, or return on investment?
• Measured with NSQIP and AEP
• NSQIP
– Risk-adjusted morbidity and mortality rates for
major noncardiac surgery
• AEP Job satisfaction index
– 9 questions answered on 5 point Likert scale
– Able to drilldown to work group and profession
33
Military Health System – Learning Action Network (LAN) 09 JAN 2008
Lessons learned
• Implementation
• Tools
• Physician engagement
• Barriers
• Critical success factors
• Measurement
• Spread and sustainment
34
Military Health System – Learning Action Network (LAN) 09 JAN 2008
Summary
• Introduction
• Background
• VA NCPS MTT Program
• OR Briefing/Debriefing Project
• Evaluation
• Results
35
Military Health System – Learning Action Network (LAN) 09 JAN 2008