Revealing the Learning Dynamics of Long-Context Continual Pre-training

Develop a set of 'learning dynamics' visualization tools for long-context training, allowing developers to see training quality beyond just validation loss.

Suggested repo: context-viz

"Peek inside the mind of your long-context model during training."

Estimated effort: 60h