Tag Archives: overtriage

NFTI And STAT: Can They Replace The Cribari Grid?

May 10, 2024 The Trauma Pro Leave a comment

In my last post, I reviewed using the Cribari grid to evaluate over- and under-triage at your trauma center. This technique has been a mainstay for nearly two decades but has shortcomings. The most important one is that it relies only on the Injury Severity Score (ISS) to judge whether some type of mistriage occurred. The ISS is usually calculated after discharge, so it can only be applied after the fact. And its correlation with outcomes varies.

What is NFTI, Exactly?

Five years ago, the Baylor University in Dallas group sought to develop an alternate method of determining who needed a full trauma team activation. They chose resource utilization as their surrogate to select these cases. They reviewed 2.5 years of their registry data (Level I center). After several iterations, they settled on six “need for trauma intervention” (NFTI) criteria:

blood transfusion within 4 hours of arrival
discharge from ED to OR within 90 minutes of arrival
discharge from ED to interventional radiology (IR)
discharge from ED to ICU AND ICU length of stay at least three days
require mechanical ventilation during the first three days, excluding anesthesia
death within 60 hours of arrival

Patients who had at least one NFTI criterion were considered candidates for full trauma activation, and if an activation did not occur, the encounter would be regarded as undertriage. On the flip side, if no NFTI criteria were present and an activation did occur, it would be overtriage.

The First NFTI Paper

In their first published paper, the Baylor group analyzed nearly 5,000 trauma activations, split roughly in half for full versus partial trauma activations. Two-thirds of the full activations met at least one NFTI criterion. This means that about a third might be considered overtriage since they did not require one of the critical resources or die within 60 hours of arrival. And looking at the partial activations, fully 75% did not meet any NFTI criteria. There were 561 deaths in the overall group (12%). Of those, only 13 did not meet any NFTI criteria, but every one had a DNR order in place.

Now let’s translate all this into under- and overtriage numbers:

Undertriage: 22% (partial activations that were NFTI +)
Overtriage: 58% (any level of activation in a NFTI – patient)

The authors concluded that NFTI assesses anatomy and physiology using only measures of early resource utilization. They believe that it self-adjusts for age, frailty, and comorbidities and is a simple and effective tool for identifying major trauma patients.

But is it better for evaluating over- and undertriage than the Cribari grid? I’ve had several people tell me that it is. But if you look at the numbers above, overtriage is in the usual range, and undertriage is higher than the usual raw Cribari numbers. Even the authors suggest that it might be used to determine if the patient needed a trauma activation. Up to this point, NFTI is interesting, but not better than Cribari on its own.

The following year, these authors published a paper that further refined their concept. They rolled NFTI into something called the Standardized Triage Assessment Tool (STAT). Basically, the Cribari matrix is applied to the trauma activation data as usual. The fallouts (over- and undertriage groups) are then tested against the NFTI criteria. Cribari undertriage patients who were NFTI negative were now considered appropriate triage, as were Cribari overtriage who were NFTI positive. NFTI was basically used to do another level of screening on the outliers before resorting to individual chart review.

Once again, let’s look at over- and undertriage experience in the paper:

Undertriage: 9.1% undertriage (Cribari) reduced to 3.3% by adding STAT
Overtriage: 50% overtriage (Cribari) reduced to 31% by adding STAT

The authors concluded that adding STAT to the review process tightens up the numbers, reducing the number of charts that need to be reviewed individually. It also standardizes comparisons between hospitals that use STAT. This may be helpful for future triage-related research.

What Does It All Mean?

The Cribari grid has been around a long time, and people are both comfortable and facile using it. But it does tend to overestimate undertriage. In my experience, the raw Cribari undertriage rate is usually 12-22%. Individual chart analysis reduces this by about 10%. Overtriage rates are anywhere from 40% to 90%, and most centers do not review those charts because they don’t care much about reducing it.

Applying NFTI criteria to the over- and undertriage fallouts from Cribari makes sense. It appears to appropriately reduce both rates significantly. Undertriage remains the most significant factor to monitor. If you choose to adopt the use of the STAT technique, consider manually reviewing the undertriage charts that are being reclassified as appropriate for a few cycles. This should help confirm that STAT is really working for you.

One last thing. Using Cribari or NFTI or STAT does not absolve you of having good triage criteria for trauma activations. It is not possible to know a patient’s ISS or NFTI status as they are rolling through the door. The quality of your activation criteria are the first screen to try to ensure appropriate triage. If you keep finding undertriage events occurring, first look at your criteria. If those seem to be fine, then it’s time to scrutinize the people applying them!

Helpful Tools

The authors of the STAT paper provided some Excel spreadsheets to help add the Cribari matrix, NFTI, or STAT to your registry. Note that this only works for TraumaBase! If you use a different registry, contact your vendor for assistance.

The spreadsheets consist of three tabs/pages. On the first, enter the specific field names from your TraumaBase implementation. This fills in the code on the second tab which will be added to TraumaBase. The third tab gives explicit directions on how to add the feature to your registry.

Here are the downloadable file links provided by the authors:

References:

Asking a Better Question: Development and Evaluation of the Need For Trauma Intervention (NFTI) Metric as a Novel Indicator of Major Trauma. J Trauma Nursing 24(3):150-157, 2017.
Avoiding Cribari gridlock: The standardized triage assessment tool improves the accuracy of the Cribari matrix method in identifying potential overtriage and undertriage. J Trauma Acute Care Surg. 2018 May;84(5):718-726.

Performance Improvement

Undertriage And Overtriage: The Cribari Grid

May 7, 2024 The Trauma Pro Leave a comment

Any trauma performance improvement professional understands the importance of undertriage and overtriage. Overtriage occurs when a patient who does not meet trauma activation criteria gets one anyway. And undertriage is the converse, where no activation is called despite criteria being met. As you may expect, the latter is much more dangerous for the patient.

I frequently get questions on the “Cribari Grid” or “Cribari Method” for calculating these numbers. Dr. Chris Cribari was a previous chair of the Verification Review Committee of the ACS Committee on Trauma. He developed a table-format grid that provides a simplified method for calculating these numbers.

But remember, the gold standard for calculating over- and undertriage is examining each admission to see if they actually met any of your trauma activation triage criteria. The Cribari method is designed for those programs that do not or cannot check these on every admission. And since most programs have too many trauma admissions to verify every single one, the grid technique can be very helpful. It is a surrogate for chart review that helps reduce the workload to identify patients with higher ISS that might have benefited from a trauma activation.

If you use the Cribari method, use it as a first pass to identify potential undertriage. In most trauma programs, the raw undertriage number using the grid will be around 10-20%. Obviously, this is unacceptably high. It requires the second pass: manually examining the chart of every patient in the undertriage list to see if they meet any of your activation criteria. If they did not, they would most likely not have been undertriaged. The second pass process usually decreases the undertriage rate by about 10%, usually reducing it below the acceptable threshold of 5%

But now you need to do a third pass. Look at each patient’s injuries and overall condition to ask yourself if they might have been better cared for by your entire trauma team. Even though they don’t meet any of your existing criteria, should they have? If so, you may need to add a new activation criterion. Then, count that patient as undertriage, of course.

I’ve simplified the Cribari Grid calculation process as much as possible and have provided a Microsoft Word document that automates the task. Just download the file, fill in the four highlighted values in the table, update the formulas using the instructions, and voila! You’ve got your numbers! Instructions for manual calculations are also included. Download it by clicking the image below or the link at the end of this post.

In my next post, I’ll examine how the NFTI score (Need For Trauma Intervention) fits into your undertriage calculations.

Click here to download the calculator.

Performance Improvement

The Cribari Grid And Over/Undertriage

July 2, 2019 The Trauma Pro Leave a comment

I frequently get questions on the “Cribari grid” or “Cribari method” for calculating these numbers. Dr. Chris Cribari is a previous chair of the Verification Review Subcommittee of the ACS Committee on Trauma. He developed a table-format grid that provides a simplified method for calculating these numbers.

But remember, the gold standard for calculating over- and undertriage is examining each admission to see if they met any of your trauma activation triage criteria. The Cribari method is designed for those programs that do not check these on every admission. It is a surrogate that allows you to identify patients with higher ISS that might have benefited from a trauma activation.

So if you use the Cribari method, use it as a first pass to identify potential undertriage. Then, examine the chart of every patient in the undertriage list to see if they meet any of your activation criteria. If not, they were probably not undertriaged. However, you must then look at their injuries and overall condition to see if they might have been better cared for by your trauma team. If so, perhaps you need to add a new activation criterion. And then count that patient as undertriage, of course.

I’ve simplified the calculation process even more and provided a Microsoft Word document that automates the task for you. Just download the file, fill in four values in the table, update the formulas and voila, you’ve got your numbers! Instructions for manual calculations are also included. Download it by clicking the image below or the link at the end of this post.

Download the calculator by clicking here

In my next post, I’ll examine how the NFTI score (need for trauma intervention) fits into the undertriage/overtriage calculations.

Related posts:

Trauma Center, Trauma Systems

Secondary Overtriage: What Is It, And Why Is It Bad?

July 31, 2018 The Trauma Pro Leave a comment

Simply put, secondary overtriage (SO) is the unnecessary transfer of a patient to another hospital. How can you, as the referring trauma professional, know that it is unnecessary? Almost by definition, you can’t, unless you have some kind of precognition. If you knew it wasn’t necessary, you wouldn’t do it in the first place, right?

But using the retrospectoscope, it’s much easier. The classic definition describes a patient who is discharged from the hospital shortly after arrival there. What is “shortly?” Typically, it occurs within 48 hours in a patient with low injury severity (ISS < 16) and without operative intervention. Definitions may vary slightly.

And why is it bad?

Several states with rural trauma systems have scrutinized this issue. The first study is from West Virginia, where six years of state registry data were analyzed. Over 19,000 adults were discharged home from a non-Level I center within 48 hours after an injury. Of those, about 1,900 (10%) had been transferred to a “higher level of care” and discharged from that center (secondary overtriage, could be any higher-level trauma center).

The factoids:

Patients with ISS > 15 and requiring blood transfusion were more likely to be SO. (I would argue that this is appropriate triage in most cases!)
Neurosurgical, spine and facial injuries were also associated with SO. (This one is a little more interesting, see below).
SO was more likely for transfers during the night shift, when resources are often more scarce

The problem is that this study is descriptive only. It doesn’t really help us figure out which patients could/should be kept based on any of the variables they collected.

The next study is from Dartmouth in New Hampshire and examines transfers into that single Level I center from 72 other hospitals. Registry data were examined over 5 years, identifying transfer patients with ISS < 15 who were discharged within 48 hours without an operation.

Yet more factoids:

62% of the nearly 8,000 patients received by this center were transfers
Overall SO rate was 26%
A quarter of adult patients and one half of pediatric patients were considered SO, and about 15% of them were actually discharged from the ED (!)
Head and neck, and soft tissue injuries were most common among SO patients

The real bottom line: Here are my thoughts on what you can do to try to decrease the number of your patients with SO and optimize the transfer process:

Work with your upstream trauma center to determine how much imaging you really need to perform
Develop a reliable method of getting those images to them
Ask them to help you develop practice guidelines and educate your hospital/ED staff to help manage common diagnoses that often result in SO from your center
If you are located in a rural area, inquire about RTTD courses you might attend

References:

Secondary overtriage in a statewide rural trauma system. J Surg Research 198:462-467, 2015.
Secondary overtriage: the burden of unnecessary interfacility transfers in a rural trauma system. JAMA Surg 48(8):763-768, 2013.

General, Performance Improvement