Chris Cameron, Wangzheng Wang, Nikita Ivanov, Ashmita Bhattacharyya, Didier Ch\'etelat, Yingxue Zhang
View original ↗Develop a lightweight library that demonstrates denoising recursion for small transformer models. This could enable efficient iterative refinement paths for LLMs without adding extra parameters.
Suggested repo: nanoLoop
"Scale reasoning depth without adding a single parameter."
Estimated effort: 40h