Less is More

[Antonio Linares]

Researchers find you don’t need a ton of data to train LLMs for reasoning tasks

https://venturebeat.com/ai/researchers- ... ing-tasks/

With merely 817 curated training samples, LIMO achieves 57.1% accuracy on AIME and 94.8% on MATH, improving from previous SFT-based models' 6.5% and 59.2% respectively, while only using 1% of the training data required by previous approaches.