Skip to content

Commit

Permalink
update
Browse files Browse the repository at this point in the history
  • Loading branch information
jiexiaou committed Sep 21, 2022
1 parent 5587bcf commit a7625ac
Show file tree
Hide file tree
Showing 4 changed files with 80 additions and 9 deletions.
15 changes: 15 additions & 0 deletions .idea/deployment.xml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

14 changes: 14 additions & 0 deletions .idea/webServers.xml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

36 changes: 33 additions & 3 deletions .idea/workspace.xml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

24 changes: 18 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,11 @@
# [Image Deraining Transformer](https://ieeexplore.ieee.org/document/9798773) (IDT)
<hr />

### Update:

* **2022.09.21**: Add test code for full size images: <a href="test_full_size.py">test_full_size.py</a>


> **Abstract:** *Existing deep learning based de-raining approaches have resorted to the convolutional architectures. However, the intrinsic limitations of convolution, including local receptive fields and independence of input content, hinder the model's ability to capture long-range and complicated rainy artifacts. To overcome these limitations, we propose an effective and efficient transformer-based architecture for the image de-raining. Firstly, we introduce general priors of vision tasks, i.e., locality and hierarchy, into the network architecture so that our model can achieve excellent de-raining performance without costly pre-training. Secondly, since the geometric appearance of rainy artifacts is complicated and of significant variance in space, it is essential for de-raining models to extract both local and non-local features. Therefore, we design the complementary window-based transformer and spatial transformer to enhance locality while capturing long-range dependencies. Besides, to compensate for the positional blindness of self-attention, we establish a separate representative space for modeling positional relationship, and design a new relative position enhanced multi-head self-attention. In this way, our model enjoys powerful abilities to capture dependencies from both content and position, so as to achieve better image content recovery while removing rainy artifacts. Experiments substantiate that our approach attains more appealing results than state-of-the-art methods quantitatively and qualitatively.*
<hr />

Expand All @@ -12,17 +17,24 @@

## Dataset

-Rain200H/Rain200L: [Link](https://www.icst.pku.edu.cn/struct/Projects/joint_rain_removal.html)
- Rain200H/Rain200L: [Link](https://www.icst.pku.edu.cn/struct/Projects/joint_rain_removal.html)

- DDN-Data: [Link](https://xueyangfu.github.io/projects/cvpr2017.html)

- DID-Data: [Link](https://github.com/hezhangsprinter/DID-MDN)

-DDN-Data: [Link](https://xueyangfu.github.io/projects/cvpr2017.html)
- SPA-Data: [Link](https://github.com/stevewongv/SPANet)

-DID-Data: [Link](https://github.com/hezhangsprinter/DID-MDN)
- RainDS: [Link](https://github.com/Songforrr/RainDS_CCN)

-SPA-Data: [Link](https://github.com/stevewongv/SPANet)
- AGAN-Data: [Link](https://github.com/rui1996/DeRaindrop)

-RainDS: [Link](https://github.com/Songforrr/RainDS_CCN)
## Demo
To test the pre-trained IDT model on full size images:

-AGAN-Data: [Link](https://github.com/rui1996/DeRaindrop)
```
python test_full_size.py --arch IDT --save_path your_save_path --data_path your_input_path --weights pretrained_weights
```

## Results
For research convinience, we release both derained patches as well as full-size images.
Expand Down

0 comments on commit a7625ac

Please sign in to comment.