Skip to content

Search across models, tools, services, companies, providers, APIs, plans, articles and news.

Core concepts

Parameter

Parameter

Parameter

The learned weights inside a model where its knowledge and abilities are stored; their count (e.g. 700 billion) indicates the model’s scale.

Parameters are the numeric weights inside a model, tuned during training — literally where its knowledge and skills are stored. A 7-billion-parameter model is 7 billion adjusted dials whose combination produces its behavior.

In the pre-scale era, parameter count was practically synonymous with intelligence. Scaling laws showed performance improves predictably with parameters × data × compute — but since 2024, smaller optimized models trained and deployed smartly beat raw giants.

Practical takeaway for model choice: parameter count alone is not a comparison; data quality, training method and context window matter just as much.

Back to glossary