Tag Archives: scoring

Performance Improvement

NFTI: A Nifty Tool To Replace The Cribari Grid?

Leave a comment

This two-part post will examine trauma activation triage tools. The type of triage I am discussing is not prehospital triage. In this case, it involves ensuring that a trauma activation occurs appropriately and that the trauma resuscitation team evaluates the right patients.

The Cribari grid was the mainstay for years, using a high ISS score as a surrogate for appropriate triage. But it has shortcomings. The most important one is that it relies solely on the Injury Severity Score (ISS) to determine whether a type of mistriage occurred.  As you know, the ISS is usually calculated after discharge, so it can only be applied after the fact.

A few years ago, the Baylor University in Dallas group developed an alternate method of determining who needed a full trauma team activation. They chose resource utilization as their surrogate to select these cases. They reviewed 2.5 years of their registry data (Level I center).  After several iterations, they settled on six “need for trauma intervention” (NFTI) criteria:

  • blood transfusion within 4 hours of arrival
  • discharge from ED to OR within 90 minutes of arrival
  • discharge from ED to interventional radiology (IR)
  • discharge from ED to ICU AND ICU length of stay at least 3 days
  • require mechanical ventilation during the first 3 days, excluding anesthesia
  • death within 60 hours of arrival

Patients who had at least one NFTI criterion were considered candidates for full trauma activation, and those who met none were not. Here are the factoids for this study:

  • There were a total of 2260 full trauma activations and 2348 partial activations during the study period (a little over 900 per year for each level)
  • Roughly 2/3 of full activations were NFTI +, and 1/3 were NFTI –
  • For partial activations, 1/4 were NFTI + and 3/4 were NFTI –
  • Only 13 of 561 deaths were NFTI – and all had DNR orders in place

The authors concluded that NFTI assesses anatomy and physiology using only measures of early resource utilization. They believed that it self-adjusts for age, frailty, and comorbidities, and that it is a simple and effective tool for identifying major trauma patients.

Bottom line: NFTI has become a valuable adjunct to the Cribari grid. Both decrease the number of charts that must be manually reviewed to identify true undertriage. Cribari does this by using ISS as a surrogate for the need for the trauma team; NFTI does it using key resource utilization. Combining the two can further reduce chart reviews, saving a significant amount of PI analysis time.

In my next post, I’ll review a problematic subset of inappropriately triaged patients whom I refer to as “ultimate overtriage.” These are patients for whom the trauma team may not have been needed. And I’ll show you how these may be labeled as “anti-NFTI” patients.

Reference: Asking a Better Question: Development and Evaluation of the Need For Trauma Intervention (NFTI) Metric as a Novel Indicator of Major Trauma. J Trauma Nursing 24(3):150-157, 2017.

Performance Improvement

NFTI: A Nifty Tool To Replace The Cribari Grid?

Leave a comment

In my last post, I reviewed using the Cribari grid to evaluate over- and under-triage at your trauma center.  This technique has been a mainstay for over a decade, but it has shortcomings. The most important one is that it relies only on the Injury Severity Score (ISS) to judge whether some type of mistriage occurred.  As you know, the ISS is usually calculated after discharge, so it can only be applied after the fact.

A few years ago, the Baylor University in Dallas group sought to develop an alternate method of determining who needed a full trauma team activation. They chose resource utilization as their surrogate to select these cases. They reviewed 2.5 years of their registry data (Level I center).  After several iterations, they settled on six “need for trauma intervention” (NFTI) criteria:

  • blood transfusion within 4 hours of arrival
  • discharge from ED to OR within 90 minutes of arrival
  • discharge from ED to interventional radiology (IR)
  • discharge from ED to ICU AND ICU length of stay at least 3 days
  • require mechanical ventilation during the first 3 days, excluding anesthesia
  • death within 60 hours of arrival

Patients who had at least one NFTI criterion were considered candidates for full trauma activation, and those who met none were not. Here are the factoids for this study:

  • There were a total of 2260 full trauma activations and 2348 partial activations during the study period (a little over 900 per year for each level)
  • Roughly 2/3 of full activations were NFTI +, and 1/3 were NFTI –
  • For partial activations, 1/4 were NFTI + and 3/4 were NFTI –
  • Only 13 of 561 deaths were NFTI – and all had DNR orders in place

The authors concluded that NFTI assesses anatomy and physiology using only measures of early resource utilization. They believe that it self-adjusts for age, frailty, and comorbidities, and that it is a simple and effective tool for identifying major trauma patients.

Bottom line: This is an elegant attempt to improve upon the simple (yet admittedly flawed) Cribari matrix method for assessment of major trauma patient triage. It was thoughtfully designed and evaluated at this one center. The authors recognize that it is based on retrospective data, but so is the Cribari technique. 

I believe that NFTI can be used as an adjunct to Cribari. The matrix identifies gross under- and over-triage using ISS as a surrogate for trauma activation criteria. Normally, the trauma program then needs to review the outliers to see if mistriage actually occurred. It is basically a “first pass” that seeks to over-identify potential problem patients.

NFTI uses the need for resource utilization as a surrogate. I recommend that it be applied to the Cribari outliers, and then the remaining few charts can be analyzed to see if your trauma activation criteria were met. Combining both techniques can dramatically reduce the workload for reviewing undertriage cases.

Reference: Asking a Better Question: Development and Evaluation of the Need For Trauma Intervention (NFTI) Metric as a Novel Indicator of Major Trauma. J Trauma Nursing 24(3):150-157, 2017.

Trauma Center

Nonsurgical Admissions And The Nelson Score

Leave a comment

All trauma centers admit some of their patients to nonsurgical services. This usually occurs when patients have medical comorbidities that overshadow their injuries. Unfortunately, the decision-making that goes into balancing the medical versus trauma issues is not always straightforward. The fear is that if trauma patients are inappropriately placed on a nonsurgical service, mortality and morbidity may be higher because their injuries may not receive adequate attention.

To take some of the variability out of the decision-making process for admitting service, two surgical groups on Long Island created a scoring system that incorporated several parameters described in the ACS Optimal Resource Document (Orange book). Some additional parameters were also included that the authors believed were relevant to the choice of admitting service. Here’s the final list:

The paper’s first author was a nurse, Laura Nelson, and hence this has come to be known as the Nelson Score. Patients with a score of 6 or 7 were considered definitely appropriate for nonsurgical admission. Scores of 4 or 5 were subject to more in-depth review, and those with a score of 3 or less were considered definitely appropriate for trauma service admission. There is no mention of what to do with a score of 6 in the original paper, but I presume it should be almost a slam dunk for considering nonsurgical admission.

The authors evaluated this system’s utility over a two year period. They found that using it placed more patients on the trauma service (nonsurgical admissions decreased from a peak of 28% to somewhere around 10%). They also examined morbidity and mortality statistics between the two types of admissions and found no significant differences.

The concept was further tested by the trauma group at UCHealth in Colorado Springs. They performed a retrospective review of four years of data that included over 2,000 patients. Patients were older (mean 79 years) and nearly all had blunt mechanism. Mean ISS was 9 and the nonsurgical admission rate was 19%. Patients with a Nelson score of 6 or 7 were even older and had more comorbidities.

Regression analysis did not identify admitting service as a predictor of mortality. The authors concluded that using this score is a safe way to objectively identify patients who would benefit from nonsurgical admission.

Bottom line: I have visited a number of hospitals that successfully use the Nelson score to assist with admission service decision-making while the patient is still in the emergency department. The only gray zone is the score of 4 or 5. Each program will need to determine their own cut point so they can make the service decision more objectively.

Trauma programs can also use this tool to expedite PI review of patients who have already been admitted to a nonsurgical service to check appropriateness. If the score is less than 6 further scrutiny is needed to determine if a consult from or transfer to trauma should be recommended.

References:

  1. Nonsurgical Admissions With Traumatic Injury: Medical Patients Are Trauma Patients Too. Journal of Trauma Nursing, 25 (3), 192-195, 2018.
  2. Evaluation of the Nelson criteria as an indicator for nonsurgical admission in trauma patients. Am Surg, 88(7), 1537-1540, 2022.
Trauma Center

Nonsurgical Admissions And The Nelson Score

Leave a comment

All trauma centers admit some of their patients to nonsurgical services. This usually occurs when patients have medical comorbidities that overshadow their injuries. Unfortunately, the decision-making that goes into balancing the medical versus trauma issues is not always straightforward. The fear is that if trauma patients are inappropriately placed on a nonsurgical service, mortality and morbidity may be higher because their injuries may not receive adequate attention.

To take some of the variability out of the decision-making process for admitting service, two surgical groups on Long Island created a scoring system that incorporated several parameters described in the ACS Optimal Resource Document (Orange book). Some additional parameters were also included that the authors believed were relevant to the choice of admitting service. Here’s the final list:

The first author on the paper was a nurse, Laura Nelson, and hence this has come to be known as the Nelson Score. Patients with a score score of 7 were considered definitely appropriate for nonsurgical admission. Scores of 4 or 5 were subject to more in-depth review, and those with a score of 3 or less were considered definitely appropriate for trauma service admission. There is no mention of what to do with a score of 6 in the original paper, but I presume it should be almost a slam dunk for considering nonsurgical admission.

The authors evaluated this system’s utility over a two year period. They found that using it placed more patients on the trauma service (nonsurgical admissions decreased from a peak of 28% to somewhere around 10%). They also examined morbidity and mortality statistics between the two types of admissions, and found no significant differences.

The concept was further tested by the trauma group at UCHealth in Colorado Springs. They performed a retrospective review of four years of data that included over 2,000 patients. Patients were older (mean 79 years) and nearly all had blunt mechanism. Mean ISS was 9 and the nonsurgical admission rate was 19%. Patients with a Nelson score of 6 or 7 were even older and had more comorbidities.

Regression analysis did not identify admitting service as a predictor of mortality. The authors concluded that using this score is a safe way to objectively identify patients who would benefit from nonsurgical admission.

Bottom line: I have visited a number of hospitals that successfully use the Nelson score to assist with admission service decision-making while the patient is still in the emergency department. The only gray zone is the score of 4 or 5. Each program will need to determine their own cut point so they can make the service decision more objectively.

Trauma programs can also use this tool to expedite PI review of patients who have already been admitted to a nonsurgical service to check appropriateness. If the score is less than 6 further scrutiny is needed to determine if a consult from or transfer to trauma should be recommended.

References:

  1. Nonsurgical Admissions With Traumatic Injury: Medical Patients Are Trauma Patients Too. Journal of Trauma Nursing, 25 (3), 192-195, 2018.
  2. Evaluation of the Nelson criteria as an indicator for nonsurgical admission in trauma patients. Am Surg, 88(7), 1537-1540, 2022.
Performance Improvement

NFTI Scoring Revisited – Not Just For Triage Calculations?

Leave a comment

Earlier this week, I wrote about a new tool for monitoring over- and under-triage for trauma programs. In place of using ISS as the metric for triggering review, the Need For Trauma Intervention (NFTI) is based on resource utilization during the initial portion of the hospital stay.

The original study was performed at a single Level I trauma center in Dallas. The authors then rolled it out as a multicenter study to test its overall reliability. However, the authors changed the focus in this work. The original paper focused on the development of a new tool to improve upon the evaluation of proper decisions to activate the trauma team. The authors have now extrapolated that their system predicts when a patient’s physiologic reserve is depleted. In turn, this should be the indicator that a trauma activation is needed.

The authors performed a convenience sample of 38 trauma centers around the US. Of these, 25 were adult only, 3, pediatric only, and 10 were combined adult/peds centers. Two years of data were collected from each. Injury severity score (ISS) and revised trauma score (RTS) were calculated for all patients. Outcomes analyzed were discharge location (home vs ongoing care), complications, and length of stay.

A complicated statistical model was adopted that evaluated the associations between higher ISS (> 15), lower RTS (< 7.84) and any positive NFTI factor. To refresh your memory, here’s the list of NFTI factors:

  • blood transfusion within 4 hours of arrival
  • discharge from ED to OR within 90 minutes of arrival
  • discharge from ED to interventional radiology (IR)
  • discharge from ED to ICU AND ICU length of stay at least 3 days
  • require mechanical ventilation during the first 3 days, excluding anesthesia
  • death within 60 hours of arrival

Here are the factoids regarding the new study:

  • Nearly 90,000 patient encounters were submitted over a 2 year period
  • The risk of experiencing a complication increased by 9x if NFTI+, 6x for ISS>15, and 5x for RTS<7.84
  • Odds of discharge to a continuing care facility was about 2.5x more likely if any of the three thresholds were met
  • Length of stay was significantly better predicted by NFTI

The authors conclude that NFTI was a better indicator of major trauma when compared to ISS and RTS. They claim that it is the best single definition because the model fit is better and that it has stronger associations with complications, discharge location, and length of stay.

Bottom line: Hmm, I’m not so sure. It’s a great idea and does allow us to drill down on those patients most in need of high-level trauma center resources. The authors admit that each tool (ISS, RTS, and NFTI) identifies some important patients that the others do not. It just seems that more of them tend to be identified by NFTI.

I always worry when complicated statistical models are needed to show these differences. This is a complex concept, so more sophisticated models may indeed be needed by virtue of the data that needs to be analyzed. Overtriage can be easily identified in many cases when NFTI- patients trigger a full trauma activation. Obvious undertriage occurs in NFTI+ patients with no activation.

But NFTI still does not obviate the need to search harder for undertriage. What about the case of a stab to the chest in the “box” region, who does not end up with a cardiac injury or hemo/pneumothorax? They would be NFTI- but mechanism positive.

How do we learn from NFTI+ patients who did not have a trauma activation. Just like using the Cribari grid, we must look at each individual chart and ask two questions:

  1. Did this patient meet any of our highest level activation criteria? If so, it is frank undertriage.
  2. If not, do we need a new criterion to catch this in the future?

So NFTI is a somewhat improved version of the Cribari grid. Sure, it can predict complications better, as well as length of stay (which may be related). But not discharge location, as claimed. As for being an indicator of depleted patient reserve, I think that’s just speculation at this point. Both tools can be used to automatically generate data for review from the trauma registry. And both will have some false negatives and positives.

My recommendation: This paper provides an academic argument that NFTI is somewhat better than the Cribari method. Now it’s time to get practical. Some enterprising trauma centers need to do a study where they use both systems side by side. How many charts for review are generated by each? How many false negatives and positives are there? How much work (abstractor / registrar time) is needed to analyze and act on the results? This is the only way we can answer the question of which one is better in the real world.

Reference: Rethinking the definition of major trauma: The Need For Trauma Intervention outperforms Injury Severity Score and Revised Trauma Score in 38 adult and pediatric trauma centers. J Trauma publish ahead of print, 2019.