Truong Xuan Khanh, Truong Quynh Hoa, Luu Duc Trung, Phan Thanh Duc
View original ↗Create an evaluation script for detecting spectral entropy collapse as a diagnostic tool for transformer training stability. This is an essential diagnostic utility for developers attempting to scale training runs.
Suggested repo: spectral-scan
"Predict training failure with a single scalar."
Estimated effort: 15h