Publisher
AI research lab building public training tools
Thinking Machines Lab details its low-precision training recipe on NVIDIA Blackwell: choosing quantization targets, block-scaled backward passes, re-quantization with stochastic rounding, quantized communications and custom kernels that helped pretrain Inkling 2 Small in 68 hours.
17 min · 3,893 words