GSM8K Dataset Papers With Code

GSM8K is a dataset of 8.5K high quality linguistically diverse grade school math word problems created by human problem writers. The dataset is segmented into 7.5K training problems and 1K test problems. These problems take between 2 and 8 steps to solve, and solutions primarily involve performing a sequence of elementary calculations using basic arithmetic operations (+ − ×÷) to reach the final answer. A bright middle school student should be able to solve every problem. It can be used for multi-step mathematical reasoning.

GSM8K Benchmark (Arithmetic Reasoning)

TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models

PDF] ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detection

Sparse Fine-Tuning for Accelerating Large Language Models with DeepSparse - Neural Magic

HumanEval Dataset

ToRA: a tool-integrated reasoning agent for mathematical problem solving, surpassing prior open source models on 10 mathematical reasoning datasets : r/LocalLLaMA

Top Important LLM Papers for the Week from 2/10 to 8/10, by Youssef Hosni

AI tools to write (Julia) code (best/worse experience), e.g. ChatGPT, GPT 3.5 - Offtopic - Julia Programming Language

TinyGSM: achieving >80% on GSM8k with small language models

Linkpost] Solving Quantitative Reasoning Problems with Language Models — LessWrong

GitHub - Raibows/Learn-to-Reason: Code for Democratizing Reasoning Ability: Tailored Learning from Large Language Model, EMNLP 2023

How Surge AI Built OpenAI's GSM8K Dataset of 8,500 Math Problems