Skip to content

Search across models, tools, services, companies, providers, APIs, plans, articles and news.

Architecture & models

Small Language Model

Small Language Model (SLM)

Small Language Model

A lightweight language model (a few billion parameters) that runs on laptops and phones; cheaper and faster than an LLM for narrow tasks.

Small language models — a few billion parameters (Phi, Gemma, small Qwen) — run on laptops, phones and even edge devices. The 2025–2026 wave showed that with clean data and good distillation, the gap between SLMs and giants narrows dramatically on narrow tasks.

The chain of benefits: near-free inference on your own hardware, data privacy (nothing leaves the device), millisecond latency and offline deployment. For classification, summarization and small-bot chat, that is the rational pick.

When not to: multi-step complex reasoning, broad world knowledge and open-ended creative work — frontier territory still.

Back to glossary