Skip to content

Commit

Permalink
initial commit
Browse files Browse the repository at this point in the history
  • Loading branch information
Guo Zhengrui committed Jul 1, 2024
1 parent 8ddbf5c commit 31f49c0
Show file tree
Hide file tree
Showing 2 changed files with 5 additions and 4 deletions.
1 change: 1 addition & 0 deletions .gitattributes
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
*.pth filter=lfs diff=lfs merge=lfs -text
8 changes: 4 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ Paper: <https://arxiv.org/abs/2403.05396>

<!-- Link to our paper: [[arxiv]](https://arxiv.org/abs/2403.05396) -->

### Highlight of our work:
### Highlight of our work
- We introduce **HistGen**, a multiple instance learning-empowered framework for histopathology report generation together with the first benchmark dataset for evaluation.
- Inspired by diagnostic and report-writing workflows, HistGen features two delicately designed modules, aiming to boost report generation by aligning whole slide images (WSIs) and diagnostic reports from local and global granularity.
- To achieve this, a local-global hierarchical encoder is developed for efficient visual feature aggregation from a region-to-slide perspective. Meanwhile, a cross-modal context module is proposed to explicitly facilitate alignment and interaction between distinct modalities, effectively bridging the gap between the extensive visual sequences of WSIs and corresponding highly summarized reports.
Expand All @@ -22,10 +22,10 @@ Overview of the proposed HistGen framework: (a) local-global hierarchical encode

## Table of Contents
- [Dataset, model weight, source code for paper "HistGen: Histopathology Report Generation via Local-Global Feature Encoding and Cross-modal Context Interaction"](#dataset-model-weight-source-code-for-paper-histgen-histopathology-report-generation-via-local-global-feature-encoding-and-cross-modal-context-interaction)
- [Highlight of our work:](#highlight-of-our-work)
- [Highlight of our work](#highlight-of-our-work)
- [Methodology](#methodology)
- [Table of Contents](#table-of-contents)
- [TO-DO:](#to-do)
- [TO-DO](#to-do)
- [Prerequisite](#prerequisite)
- [HistGen WSI-report dataset](#histgen-wsi-report-dataset)
- [Preprocessing and Feature Extraction with Pre-trained DINOv2 ViT-L](#preprocessing-and-feature-extraction-with-pre-trained-dinov2-vit-l)
Expand All @@ -36,7 +36,7 @@ Overview of the proposed HistGen framework: (a) local-global hierarchical encode
- [Issues](#issues)
- [License and Usage](#license-and-usage)

## TO-DO:
## TO-DO
- [x] Release the source code for training and testing HistGen
- [x] Release the diagnostic report data
- [x] Release the DINOv2 ViT-L features of WSIs
Expand Down

0 comments on commit 31f49c0

Please sign in to comment.