The Dolphin model by Eric Hartford based on Mixtral that is trained with additional datasets:
- Synthia, OpenHermes and PureDove
- New Dolphin-Coder
- MagiCoder
Sizes
dolphin-mixtral:8x22bdolphin-mixtral:8x7b
dolphin-mixtral
Uncensored, 8x7b and 8x22b fine-tuned models based on the Mixtral mixture of experts models that excels at coding tasks. Created by Eric Hartford.
8x7b
8x22b
Hızlı Kurulum (Ollama kuruluysa)
ollama run dolphin-mixtral
Ollama kurulu değil mi? ollama.com/download — Windows, macOS ve Linux için ücretsiz. İlk çalıştırmada model indirilir, sonrası tamamen çevrimdışıdır.
Varyantlar
Boyut büyüdükçe kalite artar, donanım ihtiyacı yükselir. Başlangıç için küçük varyantı deneyin.
| Etiket | Boyut | Bağlam | Girdi | Komut |
|---|---|---|---|---|
| latest | 26GB | 32K | Text |
ollama run dolphin-mixtral:latest
|
| v2.5 | 26GB | 32K | Text |
ollama run dolphin-mixtral:v2.5
|
| v2.6 | 26GB | 32K | Text |
ollama run dolphin-mixtral:v2.6
|
| v2.7 | 26GB | 32K | Text |
ollama run dolphin-mixtral:v2.7
|
| 8x7b | 26GB | 32K | Text |
ollama run dolphin-mixtral:8x7b
|
| 8x22b | 80GB | 64K | Text |
ollama run dolphin-mixtral:8x22b
|
| 8x7b-v2.5 | 26GB | 32K | Text |
ollama run dolphin-mixtral:8x7b-v2.5
|
| 8x7b-v2.5-q2_K | 17GB | 32K | Text |
ollama run dolphin-mixtral:8x7b-v2.5-q2_K
|
| 8x7b-v2.5-q3_K_S | 20GB | 32K | Text |
ollama run dolphin-mixtral:8x7b-v2.5-q3_K_S
|
| 8x7b-v2.5-q3_K_M | 23GB | 32K | Text |
ollama run dolphin-mixtral:8x7b-v2.5-q3_K_M
|
| 8x7b-v2.5-q3_K_L | 24GB | 32K | Text |
ollama run dolphin-mixtral:8x7b-v2.5-q3_K_L
|
| 8x7b-v2.5-q4_0 | 26GB | 32K | Text |
ollama run dolphin-mixtral:8x7b-v2.5-q4_0
|
| 8x7b-v2.5-q4_1 | 29GB | 32K | Text |
ollama run dolphin-mixtral:8x7b-v2.5-q4_1
|
| 8x7b-v2.5-q4_K_S | 27GB | 32K | Text |
ollama run dolphin-mixtral:8x7b-v2.5-q4_K_S
|
| 8x7b-v2.5-q4_K_M | 28GB | 32K | Text |
ollama run dolphin-mixtral:8x7b-v2.5-q4_K_M
|
| 8x7b-v2.5-q5_0 | 32GB | 32K | Text |
ollama run dolphin-mixtral:8x7b-v2.5-q5_0
|
| 8x7b-v2.5-q5_1 | 35GB | 32K | Text |
ollama run dolphin-mixtral:8x7b-v2.5-q5_1
|
| 8x7b-v2.5-q5_K_S | 32GB | 32K | Text |
ollama run dolphin-mixtral:8x7b-v2.5-q5_K_S
|
| 8x7b-v2.5-q5_K_M | 33GB | 32K | Text |
ollama run dolphin-mixtral:8x7b-v2.5-q5_K_M
|
| 8x7b-v2.5-q6_K | 38GB | 32K | Text |
ollama run dolphin-mixtral:8x7b-v2.5-q6_K
|
| 8x7b-v2.5-q8_0 | 50GB | 32K | Text |
ollama run dolphin-mixtral:8x7b-v2.5-q8_0
|
| 8x7b-v2.5-fp16 | 93GB | 32K | Text |
ollama run dolphin-mixtral:8x7b-v2.5-fp16
|
| 8x7b-v2.6 | 26GB | 32K | Text |
ollama run dolphin-mixtral:8x7b-v2.6
|
| 8x7b-v2.6-q2_K | 17GB | 32K | Text |
ollama run dolphin-mixtral:8x7b-v2.6-q2_K
|
| 8x7b-v2.6-q3_K_S | 20GB | 32K | Text |
ollama run dolphin-mixtral:8x7b-v2.6-q3_K_S
|
45 varyant daha var — tümü için ollama.com.