Today, we release LFM2.5-24B-A2B, a 24B-parameter reasoning model with just 2B active parameters, built for fast, private agents on-device. It is the largest and final model in the LFM2.5 family, which now spans two orders of magnitude: from LFM2.5-230M to LFM2.5-24B-A2B.
\nLFM2.5-24B-A2B is competitive with Qwen3.6-35B-A3B, a model with ~50% more total and active parameters, on five of eight agentic and tool-use benchmarks, scoring 48.09 on LiveClaw versus 38.19 and 27.69 on AutomationBench versus 8.72. Because only 2B parameters are active per token, it runs up to 1.7× faster than comparable MoEs on-device, with 184 tokens/s on an Apple M5 Max and up to 21K output tokens/s on a single NVIDIA B300 GPU.
\nThe base (LFM2.5-24B-A2B-Base) and post-trained (LFM2.5-24B-A2B) models are open-weight and available today on Hugging Face and our Playground. Check out our docs on how to run and fine-tune it locally.
\nLFM2.5-24B-A2B builds on our previous LFM2-24B-A2B release, with an expanded vocabulary and context window, scaled-up pretraining, and large-scale reinforcement learning. Unlike its predecessor, LFM2.5-24B-A2B is a reasoning-only model that produces an explicit chain of thought before its final answer. We adopted this strategy to leverage its high decode speed and improve answer quality.
\nArchitecture. It keeps the 40 layers, 64 experts per MoE block with top-4 routing, and the same hybrid of gated short convolutions and GQA. The two architectural changes are the context window extension from 32,768 to 131,072 tokens, and the in-place tokenizer expansion, which doubles the vocabulary from 65K to 128K tokens for better non-Latin tokenization.
\nPre-training was scaled up from 17T tokens to 33T tokens.
\nMid-training has two phases. The first runs 2T tokens at 32K context on curated, higher-quality data weighted toward reasoning, math, code, instruction following, and multilingual text. The second runs 300B tokens at 131K context, weighted toward long context data. Tool calls and multi-turn trajectories appear throughout both phases to prepare the model for agentic workloads.
\nPost-trainingturns LFM2.5-24B-A2B-Base into the agentic LFM2.5-24B-A2B in a five-stage pipeline as illustrated below: (1) Supervised Fine-Tuning (SFT), (2) Teacher Specialization, (3) non-agentic and (4) agentic Multi-Domain On-Policy Distillation (MOPD), and (5) Agentic Reinforcement Learning (Agentic RL), training the model inside agent harnesses, such as
\n\n\nPi, and
\n\nDuring teacher specialization, LFM2.5-24B-A2B exhibited well-known reward-hacking behaviors: searching for the final answer in a repository's git history or on platforms like GitHub, PyPI, and Hugging Face. More surprisingly, it even figured out it was in a sandbox, as shown in the examples below.
\nThis behavior looks emergent but might be explained by training data containing similar patterns. We tightened our sandboxes in response, and all reported results below come from sealed evaluation environments.
\nWe evaluated LFM2.5-24B-A2B across 16 benchmarks covering tool use and agentic workflows, knowledge, instruction following, math, and coding. Despite being the smallest model in total and active number of parameters, it is competitive with, and often outperforms, larger MoEs with ~50% more total and active parameters, such as Qwen3.6-35B-A3B.
\n| Benchmark | LFM2.5-24B-A2B | Qwen3.6-35B-A3B | Gemma-4-26B-A4B-it | Nemotron-3.5-Lightning (30B-A3B) | \n| AutomationBench | 27.69 | 8.72 | 5.46 | 2.61 | \n| BFCLv4 | 65.01 | 65.00 | 57.09 | 53.78 | \n| ToolSandbox | 80.71 | 75.02 | 72.09 | 75.13 | \n| LiveClaw | 48.09 | 38.19 | 41.25 | 37.72 | \n| PinchBench | 83.18 | 89.93 | 77.12 | 84.20 | \n| τ³-Bench Banking | 8.04 | 7.63 | 4.54 | 7.01 | \n| WebArena Verified | 26.75 | 37.62 | 25.62 | 28.69 | \n| GPQA Diamond | 74.42 | 83.69 | 74.90 | 72.42 | \n| AA-Omniscience | -24.90 | -24.35 | -59.39 | -3.58 | \n| HLE | 7.40 | 7.69 | 8.57 | 5.65 | \n| IFEval | 96.75 | 93.06 | 92.00 | 94.19 | \n| IFBench | 74.69 | 64.21 | 47.44 | 71.67 | \n| Multi-IF | 84.38 | 81.53 | 82.19 | 82.34 | \n| MATH-500 | 96.04 | 96.73 | 95.66 | 96.40 | \n| SWE-Bench Verified (OpenCode) | 51.00 | 66.20 | 25.80 | 53.40 | \n| SciCode | 32.71 | 37.35 | 35.42 | 27.78 |
\nLFM2.5-24B-A2B leads or matches the competition on five of the eight tool-use and agentic benchmarks (AutomationBench, BFCLv4, ToolSandbox, LiveClaw, and τ³-Bench Banking), with its widest margin on AutomationBench, where it scores more than three times the next-best model. It also leads on all three instruction-following benchmarks. Larger models keep an edge on knowledge-heavy benchmarks like GPQA Diamond, HLE, and AA-Omniscience, and on coding benchmarks like SWE-Bench Verified (OpenCode) and SciCode.
\nThe results make LFM2.5-24B-A2B an ideal foundation for agents that need to reason, call tools, and run reliably on your device. For knowledge-heavy workloads, we recommend pairing LFM2.5-24B-A2B with retrieval or web search, which plays to its tool-calling strength.
\nLFM2.5-24B-A2B ships with day-one support across the inference ecosystem:
\nAll runs were collected on Pipette, the same benchmarking infrastructure behind Liquid AI's public device performance data.
\nEdge inference. Due to the efficient LFM2 architecture, LFM2.5-24B-A2B is the fastest of the compared MoEs at reading in prompts and generating answers. It decodes 184 tokens/s on an Apple M5 Max and 114 tokens/s on an AMD Ryzen AI Max+ 395, up to 1.7x faster than the next-best model, while using the least memory.
\nGPU inference. To demonstrate the competitiveness of LFM architecture we compare the GPU inference throughput to other similarly sized MoE models. We measure GPU throughput (total output tokens / wall time) on a single NVIDIA B300 GPU using a sustained-load setting: at each concurrency level, we continuously maintain the target number of in-flight requests, replacing each completed request immediately.
\nWe benchmark each model with SGLang 0.5.22, 1,024 input tokens, up to 256 output tokens, in BF16. LFM2.5-24B-A2B is the fastest model in its size class, reaching over 21K output tokens per second at high concurrency.
\nLFM2.5-24B-A2B’s size, speed, and capabilities make it a great choice for agents that run continuously on your own hardware. In the demo below, we run it inside Hermes Agent on an M5 Max MacBook Pro, where it plans, calls tools, and works through a real task entirely on-device, without any cloud API calls.
\nThe point of the demo is not the individual tools. It is that the tool-dispatch loop feels interactive on consumer hardware: ask, propose, confirm, run, repeat, all in well under a second per dispatch, with full audit trails and your data never leaving the device. Check out our local agent guide for how to serve the model locally and connect it with the agent harness of your choice.
\nStart building today with LFM2.5-24B-A2B, available on Hugging Face.
\nFor API inference, you can also sign up for Liquid Console where you'll receive $2 in credit to get started. The model is priced at $.10/1M input tokens (at $.05 for cached input) and $1.00/1M output tokens.
\nWith LFM2.5, we're delivering on our vision of AI that runs anywhere. These models are:
\nWe can't wait to see what you build.
\n\nRun your harness of choice locally with LFM2.5-24B-A2B
\n\nFor citations, please use the following reference or BibTeX:
\n<sub>*All the models were evaluated with vLLM and the following generation parameters:</sub>
\n