Gowrav Vishwakarma, Christopher J. Agostino
View original ↗Build a basic implementation of Phase-Associative Memory in PyTorch. This offers a potential drop-in replacement for standard RNN/Transformer layers with lower memory overhead.
Suggested repo: complex-memory
"A new complex-valued memory architecture that beats transformers on memory efficiency."
Estimated effort: 80h