Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Reformer #414

Closed
1 task done
WenjieDu opened this issue May 15, 2024 · 0 comments
Closed
1 task done

Add Reformer #414

WenjieDu opened this issue May 15, 2024 · 0 comments
Assignees
Labels
enhancement New feature or request new algo Proposing to add a new model/algorithm

Comments

@WenjieDu
Copy link
Owner

1. Model description

Reformer should be included in PyPOTS, and could start from the imputation task.

@inproceedings{kitaev2020reformer,
title={Reformer: The Efficient Transformer},
author={Nikita Kitaev and Lukasz Kaiser and Anselm Levskaya},
booktitle={International Conference on Learning Representations},
year={2020},
url={https://openreview.net/forum?id=rkgNKkHtvB}
}

2. Check open-source status

  • The model implementation is publicly available

3. Provide useful information for the implementation

https://github.com/google/trax/tree/master/trax/models/reformer and https://github.com/lucidrains/reformer-pytorch

@WenjieDu WenjieDu added enhancement New feature or request new algo Proposing to add a new model/algorithm labels May 15, 2024
@WenjieDu WenjieDu self-assigned this May 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request new algo Proposing to add a new model/algorithm
Projects
None yet
Development

No branches or pull requests

1 participant