H&E to molecular targets
Predicting 80+ molecular targets from routine H&E whole-slide images.
- Problem
- Molecular testing is expensive and slow. If routine H&E slides could predict molecular targets directly, that would give clinicians a fast, cheap signal for which tests to order.
- Data
- H&E whole-slide images with molecular labels, spanning three independent cohorts so the model could be tested on sites it never trained on.
- Approach
- Foundation-model embeddings for each tile feed an attention-based multiple-instance learning model that aggregates thousands of tiles into a slide-level prediction. It runs as containerized, reproducible environments on HPC.
- Result
- Predicts more than 80 molecular targets, reaching AUROC up to 0.90 on external validation across the three cohorts.
- Next
- Stronger calibration and per-target reliability reporting, and more testing of robustness across scanners and staining protocols.
H&E slide
whole-slide image
Tiles
thousands per slide
Foundation model
tile embeddings
Attention MIL
aggregate to slide
80+ targets
AUROC up to 0.90
Clinical project at LMU University Hospital. Data cannot be shared; happy to walk through the methods.