Deep learning models can be trained with limited data
Visual comparison of matched, mismatched and adapted (proposed) deep learning models in PnP-ADMM for the phase retrieval problem. The mismatched model is trained on pathology images instead of faces (matched). The proposed method applies domain adaptation to the mismatched model to restore a high-quality image, comparable in quality to the results achieved using the matched model, with fewer than 1% of the number of images required for training. Credit: Kamilov lab

Deep learning models, such as those used in medical imaging to help detect disease or abnormalities, must be trained with a lot of data. However, often there isn't enough data available to train these models, or the data is too diverse.

Ulugbek Kamilov, associate professor of computer science and engineering and of electrical and systems engineering in the McKelvey School of Engineering at Washington University in St. Louis, along with Shirin Shoushtari, Jiaming Liu and Edward Chandler, doctoral students in his group, have developed a method to get around this common problem in .

The team will present the results of the research this month at the International Conference on Machine Learning (ICML 2024) in Vienna, Austria.

For example, MRI data used to train deep learning models could come from different vendors, hospitals, machines, patients or body parts imaged. A model trained on one type of data could introduce errors when applied on other data. To avoid those errors, the team adopted the widely used deep learning approach known as Plug-and-Play Priors, accounted for the shift in the data with which the model was trained and adapted the model to a new incoming set of data.

"With our method, it doesn't matter if you don't have a lot of training data," Shoushtari said. "Our method enables adaptation to using a small set of training data, no matter what hospital, what machine or what body parts the images come from.

"What is significant about the domain adaptation strategy is that we can reduce the errors we fact in imaging due to a limited set of data," Shoushtari said. "This could help us apply deep learning to problems that were previously deemed impossible due to the data requirements."

One proposed use for this method would be in acquiring data from MRI, which requires patients to lie still for long periods of time. Any movement by the patient leads to errors.

"We have considered acquiring the data from the MRI in a shorter time," Shoushtari said. "While shorter scans typically lead to lower quality images, our method can be used to computationally increase as if the patient was in the machine for a longer time. The key innovation in our new approach is that it requires only tens of images to adapt an existing MRI model to new data."

The method is also applicable beyond radiology, and the team is collaborating with other colleagues to adopt the method to scientific imaging, microscopic imaging and other applications in which data can be represented as an image.

More information: Shoushtari S, Liu J, Chandler EP, Asif MS, Kamilov US. Prior Mismatch and Adaptation in PnP-ADMM with a Nonconvex Convergence Analysis. International Conference on Machine Learning, July 21–27, 2024. icml.cc/virtual/2024/poster/34765

The source code is available on GitHub: github.com/wustl-cig/MMPnPADMM

Citation: Deep learning models can be trained with limited data: New method could reduce errors in computational imaging (2024, July 26) retrieved 26 July 2024 from https://techxplore.com/news/2024-07-deep-limited-method-errors-imaging.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.