Abstract
Ventilator associated pneumonia (VAP) is defined by the American College of Surgeons Trauma Quality Improvement Program (ACS TQIP) using laboratory findings, pathophysiologic signs/symptoms, and imaging criteria. However, many critically ill trauma patients meet the non-specific laboratory and sign/symptom thresholds for VAP, so the TQIP designation of VAP depends heavily upon imaging evidence. We hypothesized that physician opinions widely vary regarding chest radiograph findings significant for VAP.
The TQIP Spring 2021 Benchmark Report (BR) was used to identify 14 patients with VAP at an academic Level 1 Trauma Center. Critically ill trauma patients (n = 7) who spent at least four days intubated and met TQIP's laboratory and sign/symptom thresholds for VAP but did not appear as VAPs on the BR comprised the control group. For each deidentified patient, four successive chest radiographic images were compiled and arranged chronologically. Cases and controls were randomly arranged in digital format. Blinded physicians (n = 27) were asked to identify patients with VAP based solely on imaging evidence.
Radiographic evidence of VAP was highly subjective (Krippendorff α = 0.134). Among physicians of the same job description, inter-rater reliability remained low (α = 0.137 for trauma attending physicians; α = 0.141 for trauma fellows; α = 0.271 for radiologists). When majority judgment was compared to the TQIP BR, there was disagreement between the two tests (Cohen κ =
0.071; sensitivity, 64.3%; specificity, 28.6%).
Current definitions of VAP rely on subjective imaging interpretation and ignore the reality that there are numerous explanations for opacities on CXR. The inconsistency of physicians' imaging interpretation and protean physiologic findings for VAP in trauma patients should preclude the current definition of VAP from being used as a quality improvement metric in TQIP.
