Matched-Learning-Rate Analysis of Attention Drift and Transfer Retention in Fine-Tuned CLIP

Create a benchmarking tool that standardizes learning rate comparisons between full fine-tuning and LoRA for CLIP, visualizing attention drift.

Suggested repo: clipDrift

"Is your fine-tuning actually improving or just forgetting?"

Estimated effort: 20h