Gregory Magarshak
View original ↗Develop a lightweight implementation of Probabilistic Language Tries for efficient sequence compression and generation. This would be a high-performance utility for LLM developers looking to optimize token storage and inference speed.
Suggested repo: plt-core
"Compressing LLM generation trees into optimal probabilistic structures."
Estimated effort: 40h