Add image-to-video pipeline tag and link to paper
Browse filesHi! I'm Niels from the Hugging Face community team.
This PR improves the model card by:
- Adding the `image-to-video` pipeline tag to the metadata for better categorization and discoverability on the Hub.
- Adding a direct link to the research paper and including the corresponding BibTeX citation.
- Maintaining the existing `library_name: diffsynth` and technical documentation for the checkpoints.
README.md
CHANGED
|
@@ -1,19 +1,22 @@
|
|
| 1 |
---
|
| 2 |
-
license: cc-by-4.0
|
| 3 |
language:
|
| 4 |
- en
|
|
|
|
|
|
|
|
|
|
| 5 |
tags:
|
| 6 |
- video-generation
|
| 7 |
- world-model
|
| 8 |
- memory
|
| 9 |
- action-conditioned
|
| 10 |
- wan
|
| 11 |
-
library_name: diffsynth
|
| 12 |
---
|
| 13 |
|
| 14 |
# Echo-Memory — Wan 2.1 1.3B memory baseline checkpoints
|
| 15 |
|
| 16 |
-
Paper-aligned **epoch-0** fine-tunes for [Echo-Memory](https://github.com/Echo-Team-Joy-Future-Academy-JD/Echo-Memory)
|
|
|
|
|
|
|
| 17 |
|
| 18 |
**Backbone:** [Wan-AI/Wan2.1-T2V-1.3B](https://huggingface.co/Wan-AI/Wan2.1-T2V-1.3B)
|
| 19 |
**Training:** static in-domain pool · 1 epoch · **30,000 steps** · 640×352 · 81-frame chunks
|
|
@@ -72,8 +75,20 @@ PHASE=stage1 OOD_DIR=assets/opendomain_revisit \
|
|
| 72 |
|
| 73 |
Memory runtime flags are inferred from the checkpoint path via `env/memory_baseline_runtime.py` — use the HF folder names above.
|
| 74 |
|
| 75 |
-
Full docs: [doc/checkpoints.md](https://github.com/Echo-Team-Joy-Future-Academy-JD/Echo-Memory/blob/main/doc/checkpoints.md)
|
| 76 |
-
|
| 77 |
## Citation
|
| 78 |
|
| 79 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
|
|
|
| 2 |
language:
|
| 3 |
- en
|
| 4 |
+
library_name: diffsynth
|
| 5 |
+
license: cc-by-4.0
|
| 6 |
+
pipeline_tag: image-to-video
|
| 7 |
tags:
|
| 8 |
- video-generation
|
| 9 |
- world-model
|
| 10 |
- memory
|
| 11 |
- action-conditioned
|
| 12 |
- wan
|
|
|
|
| 13 |
---
|
| 14 |
|
| 15 |
# Echo-Memory — Wan 2.1 1.3B memory baseline checkpoints
|
| 16 |
|
| 17 |
+
Paper-aligned **epoch-0** fine-tunes for [Echo-Memory](https://github.com/Echo-Team-Joy-Future-Academy-JD/Echo-Memory).
|
| 18 |
+
|
| 19 |
+
[**Paper**](https://huggingface.co/papers/2606.09803) | [**Project Page**](https://echo-team-joy-future-academy-jd.github.io/Echo-Memory/) | [**GitHub**](https://github.com/Echo-Team-Joy-Future-Academy-JD/Echo-Memory)
|
| 20 |
|
| 21 |
**Backbone:** [Wan-AI/Wan2.1-T2V-1.3B](https://huggingface.co/Wan-AI/Wan2.1-T2V-1.3B)
|
| 22 |
**Training:** static in-domain pool · 1 epoch · **30,000 steps** · 640×352 · 81-frame chunks
|
|
|
|
| 75 |
|
| 76 |
Memory runtime flags are inferred from the checkpoint path via `env/memory_baseline_runtime.py` — use the HF folder names above.
|
| 77 |
|
|
|
|
|
|
|
| 78 |
## Citation
|
| 79 |
|
| 80 |
+
If you use this repository or the Echo-Memory paper, please cite:
|
| 81 |
+
|
| 82 |
+
```bibtex
|
| 83 |
+
@article{king2026echomemory,
|
| 84 |
+
title={Echo-Memory: A Controlled Study of Memory in Action World Models},
|
| 85 |
+
author={King, Wayne and Xue, Zeyue and Bian, Yuxuan and Huang, Jie and Li, Haoran and Li, Yaowei and Su, Yaofeng and Li, Yuming and Wang, Haoyu and Zhang, Shiyi and Zhang, Songchun and Niu, Yuwei and Xu, Sihan and Zhuang, Junhao and Huang, Haoyang and Duan, Nan},
|
| 86 |
+
journal={arXiv preprint arXiv:2606.09803},
|
| 87 |
+
year={2026},
|
| 88 |
+
month={jun},
|
| 89 |
+
eprint={2606.09803},
|
| 90 |
+
archivePrefix={arXiv},
|
| 91 |
+
primaryClass={cs.CV},
|
| 92 |
+
url={https://arxiv.org/abs/2606.09803}
|
| 93 |
+
}
|
| 94 |
+
```
|