Ulysses Sequence Parallelism: Training with Million-Token Contexts

Implement a simplified Python-based implementation of sequence parallelism that allows individual devs to test long-context training on commodity multi-GPU setups.

Suggested repo: tiny-sp

"Training on millions of tokens shouldn't require a data center."

Estimated effort: 100h