Go to CVPR 2025 Workshop CVDD homepageBridging Morphology and Molecular Signatures: Multi-Task Deep Learning for Multi-Omics Prediction from Histopathology
Keywords: Multi-Omics, Histopathology, Computational Pathology, Foundation Models, Multimodal, Multi-Task Deep Learning, Pathway Activity Prediction, microRNA (miRNA) Expression, Gene Expression, Protein Expression
Abstract: Whole slide images (WSIs) capture intricate morphological features that correlate with molecular profiles in tumors, making them valuable for non-invasive molecular profiling. While previous work in computational pathology has focused on predicting gene expression, protein levels, and mutation status from WSIs, we extend this by introducing a deep learning framework that predicts pathway activity and microRNA (miRNA) expression in addition to these commonly studied molecular layers. By employing multi-task learning, our model efficiently captures shared histological patterns across different molecular modalities, enhancing prediction accuracy. We show that pathway activity is the most reliably predicted feature, followed by protein expression, with gene expression and miRNA predictions being more challenging. These findings highlight the necessity of incorporating pathway and miRNA data for a more comprehensive and biologically relevant understanding of tumor biology. Our approach demonstrates significant potential for improving cancer diagnostics and biomarker discovery, offering a more comprehensive alternative to traditional molecular assays.
Submission Type: Original Work
Submission Number: 11
Loading