You are here
Radiology Fast and Slow
By J. Raymond Geis, MD
Nobel Prize in Economics laureate David Kahneman, in his best-selling book Thinking Fast and Slow, describes two different thought systems we use daily. System 1, as he calls it, is the fast, instinctual decision making approach we use most of the time. System 2 is what we use when we stop and evaluate things in a methodical, logical manner.
After reading perhaps 250,000 cases over the years, I suspect I’m like most radiologists who read the majority of exams in System 1. As Dr. Kahneman’s research dramatically shows, however, this approach is regularly affected by cognitive bias, which distorts my perception and interpretations in ways that vary from accepted best practice.
Even when I know this, it’s hard to avoid bias. I’m prejudiced by the most recent unique case I dealt with, like the “exception” case of a 4 mm lung nodule in a young person that turned out to be cancer, despite statistics demonstrating the chance of that occurring as less than 1%. For a while after that I’m inclined to recommend short term CT follow up for any 4mm nodule, and to heck with standard Fleischner Society recommendations for what to do with such a nodule, which in this instance recommends do nothing.
I’m not alone. A 2010 RSNA article by Eisenberg, Bankier and Boiselle showed only 77% of radiologists even knew about the Fleischner criteria, and between 34% and 60% of radiologists followed them correctly. A 2011 AJR article by Feely and Hartman showed in one practice the criteria were followed correctly 52% of the time.
Even if I want to follow them, I don’t remember them. Each of our reading rooms has a bulletin board, and somewhere on it is a photocopy of the Fleischner Society recommendations. On a busy day on the assembly line of reading exams as fast as possible, finding that piece of paper among all the other recommendations tacked to the board takes time and cuts into my productivity. The urge is strong to assume I remember, give a recommendation, and move on to the next case.
A big advantage of computers is they don’t operate in System 1. They are less susceptible to emotion and cognitive bias. Give a computer Fleischner Society criteria and it will apply them consistently and reliably forever.
Here’s a thought. How about for my chest CT report, I put in all the findings, then turn off the mic and let a computer do the rest? Using natural language processing (NLP), the computer takes the patient’s age, relevant history and smoking history from the EMR, combines that with the findings I dictate, and provides interpretation and recommendations based on accepted criteria.
That scenario is a win all around. I will be more efficient, get through cases faster, and either get home for dinner with the family or make more money. Report recommendations would be more consistent and more accurate, so quality improves.
Dr. Eliot Siegel, a leader in imaging informatics, gets knowing laughs each time he shows the film clip of Lucille Ball on the chocolate factory assembly line, and her struggles to keep up with the increasing load. Radiologists are high-paid assembly line workers, just like Lucy. The future of our radiology assembly line will probably be similar to the evolution in other industries, like cars. Photos from Henry Ford’s original assembly lines show hundreds of people on the line. Modern automobile assembly lines instead have hundreds of robots, with a few highly trained people managing the process.
Efficiency, standardization, and quality assurance are goals of any industrial process, including medical imaging. Except in the rarest of cases we need to eliminate cognitive bias in radiology exam interpretation, to get away from the pitfalls common in Kahneman’s System 1 decision making style we use most of the time. Perhaps it is time for imaging informatics to provide tools to do that.







Comments
Dr. Geis — Thank you for the excellent, thought provoking blog post. New enhancements in imaging informatics that improve productivity and quality are important by leveraging data that is already being created, particularly through clever automation/artificial intelligence.
While these capabilities are interesting, I think we also need to recognize as an industry that there are much more basic capabilities that we should be contemplating. Basic capabilities are lacking in so many practices nationwide, and are an impediment to timely, quality care. Timely access to priors, especially across distributed systems, with multiple PACS, is a significant issue. The quality and reliability of hanging protocols is a major issue that is largely a forgotten story. I’d guess that more than half of the PACS users out there have given up on their PACS’ ability to support hanging protocols. They’ve thrown up their hands, and have resigned themselves to a dysfunctional system. Some groups actually manually hang every study, over and over and over again daily. Most practices do not have satisfactory remote access to imaging studies (current+priors) for distributed/remote/at home reading. Many groups have multiple viewers, from multiple vendors, for multiple applications because their PACS cannot adequately support multi-modality workflow. As the size of imaging studies have grown, viewers have not kept pace so performance is lagging. The workaround for this is exhaustive, costly DICOM routing eating up bandwidth and precious time to interpretation. And most PACS are restricted by the limited number of operating system and browsers that are supported. Frequently, we hear of referring practices that purchase the latest Microsoft and/or Mac computers only to be told their ‘new’ systems can’t access images. Similar to Maslow, there are basic needs in Radiology – Access, Functionality, Performance (for example). While we absolutely need to push the envelope of performance enhancing capabilities, these basics are foundational needs that are not being met for far too many radiology practices. Workarounds and ignoring these needs will undoubtedly leave many practices as poor performers, non-competitive and ultimately irrelevant in today’s challenging radiology environment.