Category Archives: Performance Improvement

The Implications Of A High Pediatric Readiness Score

In my last post, I described the Pediatric Readiness Score and its components. Today, I’ll explain why maintaining a high score may benefit your trauma center and what it costs to do so.

Research groups at the Oregon Health Sciences University and the University of Utah combined multiple data sources to estimate current levels of ED pediatric readiness, the cost to achieve it, the number of pediatric deaths in emergency departments, and the number of potential lives saved if readiness is maintained.

As you can imagine, this was an extensive data set suffering from the usual glitches. The authors either excluded incomplete data or managed it with sophisticated statistical methods. Data was included from 4,840 emergency departments in all 50 states and the District of Columbia.

Here are the factoids:

  • The authors estimated that nearly 670,000 children receive care in the emergency departments each year
  • Only 15% (842 EDs) had high readiness. The range was 2.9% in Arkansas to 100% in Delaware.
  • The annual cost to achieve high pediatric readiness nationwide was approximately $210 million
  • The annual cost per child to achieve high readiness ranged from $0 in Delaware to $11.84 in North Dakota
  • It was estimated that about 28% of the 7619 childhood deaths each year could be prevented if the treating ED had high pediatric readiness

Bottom line: This paper has a lot of information to digest. Please remember that these are not precisely measured numbers but estimates based on statistical models. So, minor inaccuracies in those models could change these results.

Nonetheless, the data demonstrate the importance of maintaining high pediatric readiness in your emergency department.  Don’t let the total cost of readiness frighten you. Spread evenly across all the EDs studied, this amounts to only about $43,000 annually.

I urge all trauma centers to measure their pediatric readiness score. Then, dedicate the resources your hospital can afford to improve it as much as possible/practical. The number of potential pediatric lives saved is substantial and meaningful.

Reference: State and National Estimates of the Cost of Emergency Department Pediatric Readiness and Lives Saved. JAMA Netw Open. 2024;7(11):e2442154.

Why Is Your Hospital’s Pediatric Readiness Score Important?

The Pediatric Readiness Score (PRS) is a new(er) metric that is now required for all US trauma centers verified by the American College Surgeons. There is no specific threshold that must be met, but the value must be reported for review at the time of the site visit.

What is the PRS? It is a measure introduced by the National Pediatric Readiness Project. This is a quality initiative that was developed by the Emergency Medical Services for Children program (EMS-C), which partnered with the American College of Emergency Physicians, the Emergency Nurses Association, and the American Academy of Pediatrics. The goal was to improve hospitals’ pediatric readiness through a self-administered survey. It was believed that by quantifying readiness, the hospitals would be better able to improve their scores via simple and, hopefully, inexpensive changes.

Each hospital completes a comprehensive assessment online (the paper version is 19 pages long). It solicits information on the following topics

  • presence of a physician pediatric care coordinator
  • presence of an ED nurse pediatric emergency care coordinator
  • pediatric training and education of any health professionals taking care of children
  • existence of an ED performance improvement plan for pediatric patients
  • details of monitoring and care of children in the ED
  • presence of social services and transfer guidelines for children
  • existence of policies for family-centered care in the ED
  • disaster planning polices including children
  • presence of pediatric equipment, supplies, and resuscitation equipment in the ED

The scores provided by this assessment provide a standardized measure of pediatric readiness, ranging from 0 to 100. Scores can be improved relatively easily by ensuring that appropriate pediatric equipment is available in the ED, and ensuring that social services and transfer agreements include children and are up to date. Tasking a physician and nurse to oversee pediatric readiness is not necessarily as easy, but many are more than willing to step in to improve pediatric care at their hospital.

The biggest question I have when any major assessment / intervention is rolled out is, does it do what it is intended to do? In my next post, I’ll review a paper published last week that looks at the real-world implications of pediatric readiness vs. the lack thereof. This is of significance to both trauma and non-trauma hospitals.

References:

  1. The National Pediatric Readiness Project website (pedsready.org)
  2. Download a copy of the assessment

How Often Should My Trauma Operations Committee Meet?

In my last post, I discussed how often your multidisciplinary trauma performance improvement committee (PI) should meet. As you know, one other mandatory committee is required of all trauma centers, the Trauma Operations Committee (Ops). In this post, I will:

  • describe how often your operations committee should meet
  • help you determine whether your two committees should meet on the same day or separately

How Often?

The short answer to this question is practically the same as for your PI committee, “it depends.” Whereas the PI committee schedule is determined more by the volume of your performance improvement activity, your ops committee is driven by its agenda.

First, look at what items are on your typical agenda:

  • Reports
  • Announcements
  • Policy discussion and revision
  • Marketing and outreach planning
  • TQIP report analysis
  • System issue analysis
  • Workgroup reports
  • Other stuff

Now, think back to your previous meetings. Do you sometimes have to cancel due to a lack of agenda items? Do you struggle to keep to the time allotted and frequently go over it? These are your biggest clues that let you know that you need to adjust the meeting frequency,

In general, your ops committee frequency is reasonably predictable from your trauma center level:

  • Level I – monthly
  • Moderate to high volume Level II – monthly
  • Lower volume Level II – bimonthly
  • Level III – bimonthly to quarterly
  • Level IV – quarterly

However, the agenda is really what drives meeting frequency. If you have a very active ops committee or are a “young” trauma center, this group may be very busy and need to meet more frequently than this. Base your final decision on your level of “busyness.”

To Combine Or Not Combine?

Combining your PI and Ops committee meetings has several pros and cons.

  Pros:

  • Decreases the number of meetings for everybody by one
  • Easier scheduling for attendees and venue
  • Consolidates agenda planning for the trauma admin team

  Cons:

  • May lead to loooong meetings
  • Frequently results in a less predictable start time for the second meeting
  • Requires extra administrative effort to maintain separate minutes and content
  • Often involves required attendees changing between meetings

Consider the logistics and personalities involved in your committees carefully. Do the attendees value shorter meetings with a predictable start time? Or do they just want to power through and take care of all of the business at hand?

Bottom line: First, determine the ideal frequency for your operations committee meeting. Is it the same as your PI committee? If so, consider combining them. If not, you will probably be forced to live with separate meetings. It is possible, however, to be creative. Consider a monthly PI meeting combined with the Ops meeting every other month.

What is the usual combined duration of the two meetings? If it is more than 2 hours, I recommend not combining them. That is just too long for your attendees to stay focused. If you can combine them, then look at the specific attendees for each meeting. Are they mostly the same? If they are, you are more likely to be successful when combining them. Reach out to your attendees to see if they would welcome a single meeting date and time. But warn them that it will routinely be 1.5 to 2 hours in length.

Now, plan your agendas carefully. If you have a substantial number of attendee changes between meetings, figure out how people will know when to show up for the second. It is easiest to have the smaller meeting first, and then add attendees when the second one starts. As for timing, there are two choices: always make each meeting a fixed length, or limit your first meeting to an exact length and allow the second to start at a fixed time and have a variable duration.

Finally, make sure the contents and minutes of the two meetings are separate. This keeps your documentation clean and easier to follow.

How Often Should My Trauma Multidisciplinary Performance Improvement Committee Meet?

Every trauma center is required to have two specific committees: a multidisciplinary trauma performance improvement committee (PI) and a trauma operations committee (ops).  However, a common question is, “How often do my committees need to meet?” Let’s start with your PI committee.

The answer, of course, is “it depends.” There is no cookie-cutter, one-size-fits-all answer. In this post, I’ll review the six factors you must consider when designing your meeting schedule.

Total Patient Volume

The number of patients seen at your center directly impacts your PI committee meeting schedule. The more patient encounters, the more likely that performance issues will arise and the more likely that some will need to be aired at the full committee meeting.

PI Issue Volume

What is the total number of PI items that your program identifies over time? Busy Level I centers may find five or ten items
every day!

In contrast, an average Level IV center may only find a PI issue to pursue every few weeks. This has a noticeable impact on how often these items need to be escalated, analyzed, and discussed at your PI meeting.

PI Issue Severity

What fraction of your PI cases actually require discussion by the full committee? How many can be processed and closed by the Trauma Program Manager alone (primary review) or with the Trauma Medical Director (secondary review)? Only complex cases that require the input of multiple liaisons actually need to go to the committee.

Alternate review pathways

There are more options for review other than the primary and secondary pathways mentioned in the previous paragraph. Typical options would be direct correspondence with a liaison for simple one-service issues or discussion (and good documentation) from a morbidity and mortality conference. The use of these alternatives will reduce the number of potential cases for your PI committee and decrease the overall number of meetings needed.

Age of your Trauma Program

Are you part of a mature, long-standing trauma center? Or is your program newly minted by the American College of Surgeons or state designating agency? Newer centers benefit from sending more items to the PI committee to build engagement of the liaisons and other attendees. More frequent meetings help get them used to the review process and the frank but friendly discussions required for effective PI review.

PI Committee “Leftovers”

How often do you need to table issues or cases until the next meeting because you ran out of time? If you are chronically short of time to discuss all the agenda items, it’s time to either make the meeting longer (groan!) or schedule them more frequently.

Bottom line: These six factors listed above must be considered when choosing your meeting schedule. Here are my starting suggestions for the ideal frequencies for adult trauma centers:

  • Level I – monthly
  • Moderate to high volume Level II – monthly
  • Lower volume Level II – bimonthly
  • Level III – bimonthly to quarterly
  • Level IV – quarterly

Most pediatric centers admit lower volumes and less complex patients, which usually only warrants a bimonthly meeting.
Remember, these are starting meeting frequencies only.
If you are a new trauma center, consider more frequent meetings for your first year to get your attendees used to and invested in the process. And if you need more cases to fill the meeting or have more hold-overs until the next meeting, adjust your calendar appropriately.

In my next post, I’ll cover this same topic for your trauma operations committee.

NFTI And STAT: Can They Replace The Cribari Grid?

In my last post, I reviewed using the Cribari grid to evaluate over- and under-triage at your trauma center.  This technique has been a mainstay for nearly two decades but has shortcomings. The most important one is that it relies only on the Injury Severity Score (ISS) to judge whether some type of mistriage occurred.  The ISS is usually calculated after discharge, so it can only be applied after the fact. And its correlation with outcomes varies.

What is NFTI, Exactly?

Five years ago, the Baylor University in Dallas group sought to develop an alternate method of determining who needed a full trauma team activation. They chose resource utilization as their surrogate to select these cases. They reviewed 2.5 years of their registry data (Level I center).  After several iterations, they settled on six “need for trauma intervention” (NFTI) criteria:

  • blood transfusion within 4 hours of arrival
  • discharge from ED to OR within 90 minutes of arrival
  • discharge from ED to interventional radiology (IR)
  • discharge from ED to ICU AND ICU length of stay at least three days
  • require mechanical ventilation during the first three days, excluding anesthesia
  • death within 60 hours of arrival

Patients who had at least one NFTI criterion were considered candidates for full trauma activation, and if an activation did not occur, the encounter would be regarded as undertriage. On the flip side, if no NFTI criteria were present and an activation did occur, it would be overtriage.

The First NFTI Paper

In their first published paper, the Baylor group analyzed nearly 5,000 trauma activations, split roughly in half for full versus partial trauma activations. Two-thirds of the full activations met at least one NFTI criterion. This means that about a third might be considered overtriage since they did not require one of the critical resources or die within 60 hours of arrival. And looking at the partial activations, fully 75% did not meet any NFTI criteria. There were 561 deaths in the overall group (12%). Of those, only 13 did not meet any NFTI criteria, but every one had a DNR order in place.

Now let’s translate all this into under- and overtriage numbers:

  • Undertriage: 22% (partial activations that were NFTI +)
  • Overtriage: 58% (any level of activation in a NFTI – patient)

The authors concluded that NFTI assesses anatomy and physiology using only measures of early resource utilization. They believe that it self-adjusts for age, frailty, and comorbidities and is a simple and effective tool for identifying major trauma patients.

But is it better for evaluating over- and undertriage than the Cribari grid? I’ve had several people tell me that it is. But if you look at the numbers above, overtriage is in the usual range, and undertriage is higher than the usual raw Cribari numbers. Even the authors suggest that it might be used to determine if the patient needed a trauma activation. Up to this point, NFTI is interesting, but not better than Cribari on its own.

The following year, these authors published a paper that further refined their concept. They rolled NFTI into something called the Standardized Triage Assessment Tool (STAT). Basically, the Cribari matrix is applied to the trauma activation data as usual. The fallouts (over- and undertriage groups) are then tested against the NFTI criteria. Cribari undertriage patients who were NFTI negative were now considered appropriate triage, as were Cribari overtriage who were NFTI positive. NFTI was basically used to do another level of screening on the outliers before resorting to individual chart review.

Once again, let’s look at over- and undertriage experience in the paper:

  • Undertriage: 9.1% undertriage (Cribari) reduced to 3.3% by adding STAT
  • Overtriage: 50% overtriage (Cribari) reduced to 31% by adding STAT

The authors concluded that adding STAT to the review process tightens up the numbers, reducing the number of charts that need to be reviewed individually. It also standardizes comparisons between hospitals that use STAT. This may be helpful for future triage-related research.

What Does It All Mean?

The Cribari grid has been around a long time, and people are both comfortable and facile using it. But it does tend to overestimate undertriage. In my experience, the raw Cribari undertriage rate is usually 12-22%. Individual chart analysis reduces this by about 10%. Overtriage rates are anywhere from 40% to 90%, and most centers do not review those charts because they don’t care much about reducing it.

Applying NFTI criteria to the over- and undertriage fallouts from Cribari makes sense. It appears to appropriately reduce both rates significantly. Undertriage remains the most significant factor to monitor. If you choose to adopt the use of the STAT technique, consider manually reviewing the undertriage charts that are being reclassified as appropriate for a few cycles. This should help confirm that STAT is really working for you.

One last thing. Using Cribari or NFTI or STAT does not absolve you of having good triage criteria for trauma activations. It is not possible to know a patient’s ISS or NFTI status as they are rolling through the door. The quality of your activation criteria are the first screen to try to ensure appropriate triage. If you keep finding undertriage events occurring, first look at your criteria. If those seem to be fine, then it’s time to scrutinize the people applying them!

Helpful Tools

The authors of the STAT paper provided some Excel spreadsheets to help add the Cribari matrix, NFTI, or STAT to your registry. Note that this only works for TraumaBase! If you use a different registry, contact your vendor for assistance.

The spreadsheets consist of three tabs/pages. On the first, enter the specific field names from your TraumaBase implementation. This fills in the code on the second tab which will be added to TraumaBase. The third tab gives explicit directions on how to add the feature to your registry.

Here are the downloadable file links provided by the authors:

References:

  1. Asking a Better Question: Development and Evaluation of the Need For Trauma Intervention (NFTI) Metric as a Novel Indicator of Major Trauma. J Trauma Nursing 24(3):150-157, 2017.
  2. Avoiding Cribari gridlock: The standardized triage assessment tool improves the accuracy of the Cribari matrix method in identifying potential overtriage and undertriage. J Trauma Acute Care Surg. 2018 May;84(5):718-726.