Hari Sadasivan (Tinman Lab)
View original ↗Create an automated pipeline for distilling 'behavioral dispositions' into sub-1B parameter models. The goal is to make small models act more like larger ones through synthetic data distillation.
Suggested repo: tinySpirit
"Distill complex behavioral dispositions into pocket-sized LLMs."
Estimated effort: 80h