/u/HOLUPREDICTIONS
View original ↗Build a standardized 'LocalLLM-Playground' docker image that includes pre-configured tools for quantizing, testing, and comparing different small-scale LLMs.
Suggested repo: nanoEval
"Test any model, anywhere, in seconds."
Estimated effort: 60h