Arth Singh
View original ↗Create a lightweight library for 'EMA-based' recurrent context probing in sequence models. This enables developers to determine when complex attention is actually needed versus simple temporal averages.
Suggested repo: ema-probe
"Measure the complexity gap between simple temporal averages and full attention."
Estimated effort: 25h