PRATIK SHAH

Application, interpretability and clinical translation of deep learning algorithms for medical images

My research reduces dependence on specialized medical imaging devices, biological and chemical processes and creates new paradigms for using low-cost images captured using simple optical principles for point-of-care clinical diagnosis. We have demonstrated a series of generative, prediction and classification algorithms for obtaining medical diagnostic information of organs and tissues from simple images captured by low-cost devices. For example:

  • In collaboration with Brigham and Women’s Hospital in Boston, MA, we devised and published a novel “Computational staining” system to digitally stain photographs of unstained tissue biopsies with Haematoxylin and Eosin (H&E) dyes to diagnose cancer [1]. This research also described an automated “Computational destaining” algorithm that can remove dyes and stains from photographs of previously stained tissues, allowing reuse of patient samples. Our method uses neural networks to help physicians provide timely information about the anatomy and structure of the organ and saving time and precious biopsy samples.
  • We also reported, In collaboration with Stanford University School of Medicine and Harvard Medical School, several novel mechanistic insights and methods to facilitate benchmarking and clinical and regulatory evaluations of generative neural networks and computationally H&E stained images . Specifically, high fidelity, explainable, and automated computational staining and destaining algorithms to learn mappings between pixels of nonstained cellular organelles and their stained counterparts were trained. A novel and robust loss function was devised for the deep learning algorithms to preserve tissue structure. We communicate that our virtual staining neural network models were generalizable to accurately stain previously unseen images acquired from patients and tumor grades not part of training data. Neural activation maps in response to various tumors and tissue types were generated to provide the first instance of explainability and mechanisms used by deep learning models for virtual H&E staining and destaining. And image processing analytics and statistical testing were used to benchmark the quality of generated images. Finally, we evaluated computationally stained images for prostate tumor diagnoses with multiple pathologists for clinical evaluations [2].
  • In collaboration with Beth Israel Deaconess Medical Center in Boston, MA, we investigated the use of dark field imaging of capillary bed under the tongue of consenting patients in emergency rooms for diagnosing sepsis (a blood borne bacterial infection). A neural network capable of distinguishing between images from non-septic and septic patients with more than 90% accuracy was reported for the first time [3]. This approach can rapidly stratify patients and offer rational use of antibiotics and reduce disease burden in hospital emergency rooms and combat antimicrobial resistance.
  • We successfully predicted signatures associated with fluorescent porphyrin biomarkers (linked with tumors and periodontal diseases) from standard white-light photographs of the mouth, thus reducing the need for fluorescent imaging [4].
  • We have also communicated research studies reporting automated segmentation of oral diseases from standard photographs [5] by neural networks and correlations with systemic health conditions such as optic nerve abnormalities in patients for personalized risk scores [6].

Examples listed above describe our contributions to design novel neural networks and processes that can assist physicians and patients by next-generation computational medicine algorithms at the point-of-care which integrate seamlessly into clinical workflows in hospitals all over the world.

Publications

  1. Computational histological staining and destaining of prostate core biopsy RGB images with generative adversarial neural networks. 2018. [Abstract] [Full Paper]

    Aman Rana, Yauney G, Lowe A, Shah P*

    (*Senior author supervising research)

    17th IEEE International Conference of Machine Learning and Applications. DOI: 10.1109/ICMLA.2018.00133

  2. Use of deep learning to develop and analyze computational hematoxylin and eosin staining of prostate core biopsy images for tumor diagnosis. 2020. [Abstract] [Full Paper]

    Aman Rana, Lowe A, Lithgow M, Horback K, Janovitz T, Da Silva A, Tsai H, Shanmugam V, Bayat A, Shah P

    JAMA Network. DOI: 10.1001/jamanetworkopen.2020.5111

  3. Machine learning algorithms for classification of microcirculation images from septic and non-septic patients. 2018. [Abstract] [Full Paper]

    Perikumar Javia, Rana A, Shapiro NI, Shah P*

    (*Senior author supervising research)

    17th IEEE International Conference of Machine Learning and Applications. DOI: 10.1109/ICMLA.2018.00097

  4. Convolutional neural network for combined classification of fluorescent biomarkers and expert annotations using white light images. 2017. [Abstract] [Full Paper]

    Gregory Yauney, Angelino K, Edlund D, Shah P*

    (*Senior author supervising research, Selected for oral presentation)

    17th annual IEEE International Conference on BioInformatics and BioEngineering. DOI: 10.1109/BIBE.2017.00-37

  5. Automated segmentation of gingival diseases from oral images. 2017. [Abstract] [Full Paper]

    Aman Rana, Yauney G, Wong L, Muftu A, Shah P*

    (*Senior author supervising research)

    IEEE-NIH 2017 Special Topics Conference on Healthcare Innovations and Point-of-Care Technologies. DOI: 10.1109/HIC.2017.8227605

  6. Automated process incorporating machine learning segmentation and correlation of oral diseases with systemic health. 2019. [Abstract] [Full Paper]

    Gregory Yauney, Rana A, Javia P, Wong L, Muftu A, Shah P*

    (*Senior author supervising research)

    41st IEEE International Engineering in Medicine and Biology Conference. DOI: 10.1109/EMBC.2019.8857965

Other MIT Research Areas