Microsoft small-language-model line with high reasoning quality per parameter.
Specifications
- Provider
- Microsoft
- Type
- Open-source / open-weight
- Modality
- Text
- Category
- Small language model
- Context window
- 16K
- Parameters
- 14B
- License
- MIT
- Knowledge cutoff
- 2024
- Released
- December 12, 2024
What it was trained for
Reasoning-focused text generation with strong quality relative to its small parameter count, using curated and synthetic training data.
Best for
- ▸Math and logical reasoning
- ▸On-device or cost-constrained deployment
- ▸Education and tutoring use cases
- ▸Local development and prototyping
Capabilities
Text generationMulti-step reasoningCode generationInstruction following
Performance & positioning
Punches above its size on reasoning tasks, rivaling much larger models, while remaining efficient enough to run on modest hardware.
More from Microsoft