smollm2

SmolLM2 is a family of compact language models available in three size: 135M, 360M, and 1.7B parameters.

Araç Kullanımı 135m 360m 1.7b
Hızlı Kurulum (Ollama kuruluysa)
ollama run smollm2

Ollama kurulu değil mi? ollama.com/download — Windows, macOS ve Linux için ücretsiz. İlk çalıştırmada model indirilir, sonrası tamamen çevrimdışıdır.

Varyantlar

Boyut büyüdükçe kalite artar, donanım ihtiyacı yükselir. Başlangıç için küçük varyantı deneyin.

EtiketBoyutBağlamGirdiKomut
latest 1.8GB 8K Text ollama run smollm2:latest
135m 271MB 8K Text ollama run smollm2:135m
360m 726MB 8K Text ollama run smollm2:360m
1.7b 1.8GB 8K Text ollama run smollm2:1.7b
135m-instruct-q2_K 88MB 8K Text ollama run smollm2:135m-instruct-q2_K
135m-instruct-q3_K_S 88MB 8K Text ollama run smollm2:135m-instruct-q3_K_S
135m-instruct-q3_K_M 94MB 8K Text ollama run smollm2:135m-instruct-q3_K_M
135m-instruct-q3_K_L 98MB 8K Text ollama run smollm2:135m-instruct-q3_K_L
135m-instruct-q4_0 92MB 8K Text ollama run smollm2:135m-instruct-q4_0
135m-instruct-q4_1 98MB 8K Text ollama run smollm2:135m-instruct-q4_1
135m-instruct-q4_K_S 102MB 8K Text ollama run smollm2:135m-instruct-q4_K_S
135m-instruct-q4_K_M 105MB 8K Text ollama run smollm2:135m-instruct-q4_K_M
135m-instruct-q5_0 105MB 8K Text ollama run smollm2:135m-instruct-q5_0
135m-instruct-q5_1 112MB 8K Text ollama run smollm2:135m-instruct-q5_1
135m-instruct-q5_K_S 110MB 8K Text ollama run smollm2:135m-instruct-q5_K_S
135m-instruct-q5_K_M 112MB 8K Text ollama run smollm2:135m-instruct-q5_K_M
135m-instruct-q6_K 138MB 8K Text ollama run smollm2:135m-instruct-q6_K
135m-instruct-q8_0 145MB 8K Text ollama run smollm2:135m-instruct-q8_0
135m-instruct-fp16 271MB 8K Text ollama run smollm2:135m-instruct-fp16
360m-instruct-q2_K 219MB 8K Text ollama run smollm2:360m-instruct-q2_K
360m-instruct-q3_K_S 219MB 8K Text ollama run smollm2:360m-instruct-q3_K_S
360m-instruct-q3_K_M 235MB 8K Text ollama run smollm2:360m-instruct-q3_K_M
360m-instruct-q3_K_L 246MB 8K Text ollama run smollm2:360m-instruct-q3_K_L
360m-instruct-q4_0 229MB 8K Text ollama run smollm2:360m-instruct-q4_0
360m-instruct-q4_1 249MB 8K Text ollama run smollm2:360m-instruct-q4_1

24 varyant daha var — tümü için ollama.com.

Model Detayları ve Benchmarklar (kaynak: ollama.com)

y45hIMNREW7w_XpHYB_0q.png

SmolLM2 is a family of compact language models available in three size: 135M, 360M, and 1.7B parameters. They are capable of solving a wide range of tasks while being lightweight enough to run on-device.

benchmark

References

HuggingFace