Researchers have been able to train a deep learning model to accurately predict a patient's race from just medical images, like X-rays and CT scans leaving researchers confused, reported the Boston Globe May 13.
In the study published in The Lancet Digital Health May 11, the researchers showed the machine learning program a large number of X-rays and CT scans that were labeled with the patient's race. The system was then asked the race of unlabeled sets of pictures, and was able to with an over 90 percent accuracy.
"When my graduate students showed me some of the results that were in this paper, I actually thought it must be a mistake," said Marzyeh Ghassemi, PhD, a coauthor of the paper and MIT professor.
Dr. Ghassemi is hypothesizing that the algorithm may detect melanin content from medical images in a way that human users haven't realized yet, but says it will require more research to understand.
"We need to take a pause,'' Leo Anthony Celi, MD, a coauthor and professor at Harvard Medical School told the Globe. "We cannot rush bringing the algorithms to hospitals and clinics until we’re sure they’re not making racist decisions or sexist decisions."