Category Archives: Philosophy

How To Tell If Research Is Crap

I recently read a very interesting article on research, and found it to be very pertinent to the state of academic research today. It was published on Manager Mint, a site that considers itself to be “the most valuable business resource.” (?) But the message is very applicable to trauma professionals, medical professionals, and probably anyone else who engages in research pursuits. The link to the full article is listed at the end of this post.

1. Research is not good because it is true, but because it is interesting.

Interesting research doesn’t just restate what is already known. It creates or explores new territory. Don’t just read and believe existing dogma.

Critique it.

Question it. Then devise a way to see if it’s really true.

2. Good research is innovative.

Some of the best ideas come from combining ideas from various disciplines.

Some of the best research ideas are derived from applying concepts from totally unrelated fields to your own.

That’s why I read so many journals, blogs, and newsfeeds from many different fields. And even if you are not doing the research, a broad background can help you sort out and gain perspective as you read the works of others.

3. Good research is useful.

Yes, basic bench level research can potentially be helpful in understanding all the nuances of a particular biochemical or disease process.But a lot of the time, it just demonstrates relatively unimportant chemical or biological reactions. And only a very small number actually contribute to the big picture. For most of us working at a macro level, research that could actually change our practice or policies is really what we need.

4. The best research should be empirically derived.

It shouldn’t rely on complicated statistical models. If it does, it means that the effect being measured is very subtle, and potentially not clinically significant. There is a big difference between statistical and clinical relevance.

Reference: If You Can’t Answer “Yes” To These 5 Questions, Your Research Is Rubbish. Garrett Stone. Click here to view on Manager Mint.

The Sixth Law Of Trauma

Here’s another one. I’ve seen the clinical problems and poor outcomes that can arise from ignoring it many times over the years.

You’ve ordered a CT or a conventional x-ray image. The result comes back in your EMR. You take a quick glance at the summary at the bottom of the report. No abnormal findings are listed. So now, in your own mind and in any sign-outs that you provide, the image is normal.

Here’s the rub. Saying something is not abnormal doesn’t necessarily mean that it’s normal. Hence the sixth law:

Always look at the image yourself.

Sometimes, the radiologist misses key findings on the image. Sometimes they see them and make a note of them in the body of the report. But they don’t get the clinical significance and don’t mention it in the summary (which is the only thing you looked at, remember?).

Bottom line: Always make a point to pull up the actual images and take a look. You have the full clinical picture, so you may appreciate findings that the radiologist may not. Sure, you may not have much experience or skill reading more sophisticated studies, but how do you think you develop that? Read it yourself!

Other Laws of Trauma: