Featured paper: Post-Hoc Explainability of BI-RADS Descriptors in a Multi-Task Framework for Breast Cancer Detection and Segmentation

Disclaimer: This content was generated by NotebookLM and has been reviewed for accuracy by Dr. Tram.

Breast cancer remains one of the most common and dangerous diseases affecting women today. Because of this, finding ways to detect it early and accurately is one of the most important goals in modern medicine. Doctors use several tools to look for cancer, including mammograms and MRIs, but Breast Ultrasound (BUS) is a favorite because it is non-invasive and uses simple sound waves to see inside the body.

In recent years, scientists have started using Artificial Intelligence (AI) and machine learning to help doctors analyze these ultrasound images. While these AI systems are incredibly fast and often very accurate, there has been a major problem: they are often “black boxes”. This means that even if the computer is right, it can’t explain why it decided a tumor was dangerous. This lack of transparency makes it hard for doctors to fully trust the technology in high-stakes medical situations.

A new research paper introduces a breakthrough called MT-BI-RADS, a deep learning model designed to not only find tumors but to explain its “thought process” to doctors in three different ways.

The Problem with the “Black Box”

Imagine a doctor shows an AI a picture of a patient’s breast tissue. The AI says, “There is a 90% chance this is cancer.” If the doctor asks, “Why do you think that?”, a traditional AI might have no answer. It just “knows” based on thousands of patterns it has seen before.

In healthcare, this is a huge obstacle. Doctors need to verify the AI’s work before they perform a surgery or a biopsy. To fix this, researchers are developing Explainable AI (XAI). These are systems that provide reasons for their answers, helping human experts understand and trust the results.

How MT-BI-RADS Works: The Three Levels of Explanation

The MT-BI-RADS model is unique because it provides three layers of information to help a radiologist understand a tumor.

1. Using the “Doctor’s Language” (BI-RADS Descriptors)

Radiologists around the world use a standardized system called BI-RADS (Breast Imaging-Reporting and Data System) to describe what they see in an image. Instead of just giving a “yes” or “no” answer, the MT-BI-RADS model analyzes the tumor using these same professional terms.

It looks for specific features, such as:

  • Shape: Is it round, oval, or irregular?
  • Orientation: Is it parallel to the skin surface?
  • Margin: Are the edges smooth (circumscribed) or fuzzy and jagged?
  • Echo Pattern: How do the sound waves bounce off it?

By outputting these specific descriptors, the AI speaks the same language as the doctor, making its findings easy to check.

2. Highlighting the Area (Segmentation)

The second level of explanation is visual. The model uses a technique called image segmentation to draw a “mask” around the tumor. This tells the doctor exactly where the AI is looking. If the AI highlights a piece of normal tissue by mistake, the doctor can immediately see the error. If it correctly highlights the tumor, it proves the AI is focusing on the right part of the image.

3. Giving Credit Where It’s Due (Shapley Values)

The most advanced part of this model is how it calculates the “contribution” of each feature. It uses a mathematical concept called Shapley Values.

Think of this like a team sport. If a basketball team wins a game, the Shapley Value tells you exactly how many “points” each player contributed to that win. In this case, the “players” are the tumor’s features (like its irregular shape or its fuzzy margin). The AI can tell the doctor, “I think this is malignant largely because of the jagged margin, but the oval shape actually made me think it might be benign”. This level of detail is called a post-hoc explanation, and it helps doctors see which specific physical signs are the most concerning.

Why Accuracy and Sensitivity Matter

In the world of cancer detection, missing a tumor is much more dangerous than accidentally labeling a healthy area as suspicious. Because of this, researchers look closely at sensitivity, which measures how good the AI is at finding every single case of cancer.

The MT-BI-RADS model performed exceptionally well in tests. It achieved:

  • 91.3% Accuracy in correctly identifying tumors.
  • 94% Sensitivity, meaning it was very unlikely to miss a malignant tumor.

The researchers trained this AI using over 2,000 ultrasound images from several different medical databases. They even used “data augmentation,” a trick where they slightly rotate or zoom in on images to teach the AI to recognize tumors from different angles.

Real-World Examples

The researchers shared examples of how the AI works in real life:

  • A Benign Case: In one ultrasound, the AI noticed the tumor was parallel to the skin and had a very smooth, “circumscribed” margin. These are classic signs of a benign (non-cancerous) growth, and the AI correctly identified it as such.
  • A Malignant Case: In another image, the AI saw an “irregular shape” and a “spiculated margin” (edges that look like little spikes). These are well-known signs of cancer. The AI highlighted these features as the main reasons for its malignant prediction.

The Path Forward

Technology like MT-BI-RADS represents a major shift in how we use AI in hospitals. Instead of the computer replacing the doctor, the computer acts as a transparent assistant. It provides the “math,” the “labels,” and the “visuals,” but the human doctor stays in control and makes the final decision.

By making AI explainable, we remove the “mystery” from the machine. This leads to more trust, fewer errors, and, ultimately, better care for patients facing a breast cancer diagnosis.


Analogy for Understanding Shapley Values: Imagine you are baking a cake, and it tastes delicious. You want to know which ingredient made it so good. The Shapley Value method is like baking the cake over and over again - once without the sugar, once without the vanilla, once with extra eggs - to see exactly how much each ingredient changed the final taste. In MT-BI-RADS, the AI “removes” and “adds” different tumor features to see which one has the biggest impact on the final diagnosis.


<
Previous Post
Training Neural Networks to Use Time Like the Brain Does
>
Next Post
From the Bayou to the Bio-Lab: How Scientists are Learning to “Put Crayfish to Sleep”