Maybe a party-pooper but: A dozen 120B models later, and GPTOSS-120B is still king

Develop an automated benchmark framework to compare open-weight models against GPT-4o specifically on long-context retention and tool-use reliability. This will help quantify the 'Toyota Tacoma' effect by measuring degradation over extended conversations and complex instruction sets.

Suggested repo: ReliabilityBench

"Stop guessing which model is actually stable—quantify reliability over long context windows."

Estimated effort: 40h