When Liquid AI, a startup founded by MIT laptop scientists again in 2023, launched its Liquid Basis Fashions collection 2 (LFM2) in July 2025, the pitch was easy: ship the quickest on-device basis fashions in the marketplace utilizing the brand new "liquid" structure, with coaching and inference effectivity that made small fashions a severe various to cloud-only giant language fashions (LLMs) akin to OpenAI's GPT collection and Google's Gemini.
The preliminary launch shipped dense checkpoints at 350M, 700M, and 1.2B parameters, a hybrid structure closely weighted towards gated brief convolutions, and benchmark numbers that positioned LFM2 forward of equally sized rivals like Qwen3, Llama 3.2, and Gemma 3 on each high quality and CPU throughput. The message to enterprises was clear: real-time, privacy-preserving AI on telephones, laptops, and autos now not required sacrificing functionality for latency.
Within the months since that launch, Liquid has expanded LFM2 right into a broader product line — including task-and-domain-specialized variants, a small video ingestion and evaluation mannequin, and an edge-focused deployment stack referred to as LEAP — and positioned the fashions because the management layer for on-device and on-prem agentic techniques.
Now, with the publication of the detailed, 51-page LFM2 technical report on arXiv, the corporate goes a step additional: making public the structure search course of, coaching information combination, distillation goal, curriculum technique, and post-training pipeline behind these fashions.
And in contrast to earlier open fashions, LFM2 is constructed round a repeatable recipe: a hardware-in-the-loop search course of, a coaching curriculum that compensates for smaller parameter budgets, and a post-training pipeline tuned for instruction following and gear use.
Moderately than simply providing weights and an API, Liquid is successfully publishing an in depth blueprint that different organizations can use as a reference for coaching their very own small, environment friendly fashions from scratch, tuned to their very own {hardware} and deployment constraints.
A mannequin household designed round actual constraints, not GPU labs
The technical report begins with a premise enterprises are intimately aware of: actual AI techniques hit limits lengthy earlier than benchmarks do. Latency budgets, peak reminiscence ceilings, and thermal throttling outline what can really run in manufacturing—particularly on laptops, tablets, commodity servers, and cellular gadgets.
To handle this, Liquid AI carried out structure search straight on the right track {hardware}, together with Snapdragon cellular SoCs and Ryzen laptop computer CPUs. The result’s a constant end result throughout sizes: a minimal hybrid structure dominated by gated brief convolution blocks and a small variety of grouped-query consideration (GQA) layers. This design was repeatedly chosen over extra unique linear-attention and SSM hybrids as a result of it delivered a greater quality-latency-memory Pareto profile below actual machine circumstances.
This issues for enterprise groups in 3 ways:
-
Predictability. The structure is straightforward, parameter-efficient, and steady throughout mannequin sizes from 350M to 2.6B.
-
Operational portability. Dense and MoE variants share the identical structural spine, simplifying deployment throughout combined {hardware} fleets.
-
On-device feasibility. Prefill and decode throughput on CPUs surpass comparable open fashions by roughly 2× in lots of circumstances, decreasing the necessity to offload routine duties to cloud inference endpoints.
As a substitute of optimizing for educational novelty, the report reads as a scientific try and design fashions enterprises can really ship.
That is notable and extra sensible for enterprises in a discipline the place many open fashions quietly assume entry to multi-H100 clusters throughout inference.
A coaching pipeline tuned for enterprise-relevant habits
LFM2 adopts a coaching method that compensates for the smaller scale of its fashions with construction moderately than brute drive. Key components embody:
-
10–12T token pre-training and a further 32K-context mid-training section, which extends the mannequin’s helpful context window with out exploding compute prices.
-
A decoupled High-Ok information distillation goal that sidesteps the instability of ordinary KL distillation when lecturers present solely partial logits.
-
A three-stage post-training sequence—SFT, length-normalized choice alignment, and mannequin merging—designed to supply extra dependable instruction following and tool-use habits.
For enterprise AI builders, the importance is that LFM2 fashions behave much less like “tiny LLMs” and extra like sensible brokers in a position to comply with structured codecs, adhere to JSON schemas, and handle multi-turn chat flows. Many open fashions at comparable sizes fail not as a result of lack of reasoning skill, however as a result of brittle adherence to instruction templates. The LFM2 post-training recipe straight targets these tough edges.
In different phrases: Liquid AI optimized small fashions for operational reliability, not simply scoreboards.
Multimodality designed for machine constraints, not lab demos
The LFM2-VL and LFM2-Audio variants replicate one other shift: multimodality constructed round token effectivity.
Moderately than embedding a large imaginative and prescient transformer straight into an LLM, LFM2-VL attaches a SigLIP2 encoder by way of a connector that aggressively reduces visible token depend through PixelUnshuffle. Excessive-resolution inputs mechanically set off dynamic tiling, protecting token budgets controllable even on cellular {hardware}. LFM2-Audio makes use of a bifurcated audio path—one for embeddings, one for technology—supporting real-time transcription or speech-to-speech on modest CPUs.
For enterprise platform architects, this design factors towards a sensible future the place:
-
doc understanding occurs straight on endpoints akin to discipline gadgets;
-
audio transcription and speech brokers run regionally for privateness compliance;
-
multimodal brokers function inside mounted latency envelopes with out streaming information off-device.
The through-line is similar: multimodal functionality with out requiring a GPU farm.
Retrieval fashions constructed for agent techniques, not legacy search
LFM2-ColBERT extends late-interaction retrieval right into a footprint sufficiently small for enterprise deployments that want multilingual RAG with out the overhead of specialised vector DB accelerators.
That is significantly significant as organizations start to orchestrate fleets of brokers. Quick native retrieval—working on the identical {hardware} because the reasoning mannequin—reduces latency and gives a governance win: paperwork by no means depart the machine boundary.
Taken collectively, the VL, Audio, and ColBERT variants present LFM2 as a modular system, not a single mannequin drop.
The rising blueprint for hybrid enterprise AI architectures
Throughout all variants, the LFM2 report implicitly sketches what tomorrow’s enterprise AI stack will appear like: hybrid local-cloud orchestration, the place small, quick fashions working on gadgets deal with time-critical notion, formatting, software invocation, and judgment duties, whereas bigger fashions within the cloud provide heavyweight reasoning when wanted.
A number of developments converge right here:
-
Value management. Operating routine inference regionally avoids unpredictable cloud billing.
-
Latency determinism. TTFT and decode stability matter in agent workflows; on-device eliminates community jitter.
-
Governance and compliance. Native execution simplifies PII dealing with, information residency, and auditability.
-
Resilience. Agentic techniques degrade gracefully if the cloud path turns into unavailable.
Enterprises adopting these architectures will probably deal with small on-device fashions because the “management aircraft” of agentic workflows, with giant cloud fashions serving as on-demand accelerators.
LFM2 is without doubt one of the clearest open-source foundations for that management layer thus far.
The strategic takeaway: on-device AI is now a design selection, not a compromise
For years, organizations constructing AI options have accepted that “actual AI” requires cloud inference. LFM2 challenges that assumption. The fashions carry out competitively throughout reasoning, instruction following, multilingual duties, and RAG—whereas concurrently attaining substantial latency good points over different open small-model households.
For CIOs and CTOs finalizing 2026 roadmaps, the implication is direct: small, open, on-device fashions are actually robust sufficient to hold significant slices of manufacturing workloads.
LFM2 won’t change frontier cloud fashions for frontier-scale reasoning. Nevertheless it presents one thing enterprises arguably want extra: a reproducible, open, and operationally possible basis for agentic techniques that should run anyplace, from telephones to industrial endpoints to air-gapped safe services.
Within the broadening panorama of enterprise AI, LFM2 is much less a analysis milestone and extra an indication of architectural convergence. The longer term is just not cloud or edge—it’s each, working in live performance. And releases like LFM2 present the constructing blocks for organizations ready to construct that hybrid future deliberately moderately than unintentionally.
