Skip to content

Commit

Permalink
upload
Browse files Browse the repository at this point in the history
  • Loading branch information
chaoyi-wu committed Aug 8, 2023
1 parent 0ad576d commit 6da0e82
Show file tree
Hide file tree
Showing 6 changed files with 7 additions and 4 deletions.
Binary file added Images/result_rationale.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Images/result_report.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Images/result_report_generation.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Images/result_vqa.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Images/result_vqa.pdf
Binary file not shown.
11 changes: 7 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ The official code for "Towards Generalist Foundation Model for Radiology"

[Website](https://chaoyi-wu.github.io/RadFM/)

<img src="https://github.com/chaoyi-wu/PMC-LLaMA/blob/main/figures/zero-shot_cases.png"/>
<img src="https://github.com/chaoyi-wu/RadFM/tree/main/Images/GIF.gif"/>

## Quick Start:
Download [Model checkpoint](https://huggingface.co/chaoyi-wu/RadFM) and check `./src/test.py` for how to generate text with our model.
Expand All @@ -17,9 +17,12 @@ Our pre-train code is given in ```./src/train.py```.

## Case Study:

<img src="https://github.com/chaoyi-wu/RadFM/blob/main/figures/zero-shot_cases.png"/>
<img src="https://github.com/chaoyi-wu/PMC-LLaMA/blob/main/figures/zero-shot_cases.png"/>
<img src="https://github.com/chaoyi-wu/PMC-LLaMA/blob/main/figures/zero-shot_cases.png"/>

<img src="https://github.com/chaoyi-wu/RadFM/tree/main/Images/result_vqa.jpg"/>
<img src="https://github.com/chaoyi-wu/RadFM/tree/main/Images/result_report_generation.jpg"/>
<img src="https://github.com/chaoyi-wu/RadFM/tree/main/Images/result_report.jpg"/>
<img src="https://github.com/chaoyi-wu/RadFM/tree/main/Images/result_rationale.jpg"/>

## To-do List:
- Polish the code for easier usage.
- Update an easy sample for a quick start.
Expand Down

0 comments on commit 6da0e82

Please sign in to comment.