Less is More
Posted: Sat Feb 15, 2025 1:20 pm
Researchers find you don’t need a ton of data to train LLMs for reasoning tasks
https://venturebeat.com/ai/researchers- ... ing-tasks/
https://venturebeat.com/ai/researchers- ... ing-tasks/
With merely 817 curated training samples, LIMO achieves 57.1% accuracy on AIME and 94.8% on MATH, improving from previous SFT-based models' 6.5% and 59.2% respectively, while only using 1% of the training data required by previous approaches.