Yz

starcoder2

StarCoder2 is the next generation of transparently trained open code LLMs that comes in three sizes: 3B, 7B and 15B parameters.

3b 7b 15b
Hızlı Kurulum (Ollama kuruluysa) 
ollama run starcoder2

Ollama kurulu değil mi? ollama.com/download — Windows, macOS ve Linux için ücretsiz. İlk çalıştırmada model indirilir, sonrası tamamen çevrimdışıdır.

Varyantlar

Boyut büyüdükçe kalite artar, donanım ihtiyacı yükselir. Başlangıç için küçük varyantı deneyin.

EtiketBoyutBağlamGirdiKomut
latest 1.7GB 16K Text ollama run starcoder2:latest
instruct 9.1GB 16K Text ollama run starcoder2:instruct
3b 1.7GB 16K Text ollama run starcoder2:3b
7b 4.0GB 16K Text ollama run starcoder2:7b
15b 9.1GB 16K Text ollama run starcoder2:15b
3b-q2_K 1.1GB 16K Text ollama run starcoder2:3b-q2_K
3b-q3_K_S 1.3GB 16K Text ollama run starcoder2:3b-q3_K_S
3b-q3_K_M 1.5GB 16K Text ollama run starcoder2:3b-q3_K_M
3b-q3_K_L 1.7GB 16K Text ollama run starcoder2:3b-q3_K_L
3b-q4_0 1.7GB 16K Text ollama run starcoder2:3b-q4_0
3b-q4_1 1.9GB 16K Text ollama run starcoder2:3b-q4_1
3b-q4_K_S 1.7GB 16K Text ollama run starcoder2:3b-q4_K_S
3b-q4_K_M 1.8GB 16K Text ollama run starcoder2:3b-q4_K_M
3b-q5_0 2.1GB 16K Text ollama run starcoder2:3b-q5_0
3b-q5_1 2.3GB 16K Text ollama run starcoder2:3b-q5_1
3b-q5_K_S 2.1GB 16K Text ollama run starcoder2:3b-q5_K_S
3b-q5_K_M 2.2GB 16K Text ollama run starcoder2:3b-q5_K_M
3b-q6_K 2.5GB 16K Text ollama run starcoder2:3b-q6_K
3b-q8_0 3.2GB 16K Text ollama run starcoder2:3b-q8_0
3b-fp16 6.1GB 16K Text ollama run starcoder2:3b-fp16
7b-q2_K 2.7GB 16K Text ollama run starcoder2:7b-q2_K
7b-q3_K_S 3.1GB 16K Text ollama run starcoder2:7b-q3_K_S
7b-q3_K_M 3.6GB 16K Text ollama run starcoder2:7b-q3_K_M
7b-q3_K_L 4.0GB 16K Text ollama run starcoder2:7b-q3_K_L
7b-q4_0 4.0GB 16K Text ollama run starcoder2:7b-q4_0

42 varyant daha var — tümü için ollama.com.

Model Detayları ve Benchmarklar (kaynak: ollama.com)

StarCode 2

Supporting a context window of up to 16,384 tokens, StarCoder2 is the next generation of transparently trained open code LLMs.

  • starcoder2:instruct: a 15B model that follows natural and human-written instructions
  • starcoder2:15b was trained on 600+ programming languages and 4+ trillion tokens.
  • starcoder2:7b was trained on 17 programming languages and 3.5+ trillion tokens.
  • starcoder2:3b was trained on 17 programming languages and 3+ trillion tokens.

StarCoder2-15B is the best in its size class and matches 33B+ models on many evaluations. StarCoder2-3B matches the performance of StarCoder1-15B.

References