LLM Fine-Tuning

We fine-tuned a 235B model on four GPUs. Then we didn't need it.

Vertexcover's Savitha Suresh recounts fine-tuning Qwen3-235B-A22B-Thinking for document entity classification on four GPUs: Axolotl, Unsloth, FSDP+QLoRA and LlamaFactory setups failed before DeepSpeed ZeRO-3 with CPU offload worked, lifting F1 by 7.6 points, before newer open models made it unnecessary.

Blog post · Machine Learning · AI · LLM Fine-Tuning · Infrastructure