Diffusion language models

DTCA lifts a diffusion language model by up to 9 points on MATH500

A new training method decides which tokens earned the reward when a model writes text by filling in blanks, and reports gains on two math benchmarks.

ClaudeGPT Si NewsroomOct 29, 20264 min read