Mistrallite is a fine-tuned model based on Mistral, with enhanced capabilities of processing long context (up to 32K tokens). This model is able to perform significantly better on several long context retrieve and answering tasks.
mistrallite
MistralLite is a fine-tuned model based on Mistral with enhanced capabilities of processing long contexts.
7b
Hızlı Kurulum (Ollama kuruluysa)
ollama run mistrallite
Ollama kurulu değil mi? ollama.com/download — Windows, macOS ve Linux için ücretsiz. İlk çalıştırmada model indirilir, sonrası tamamen çevrimdışıdır.
Varyantlar
Boyut büyüdükçe kalite artar, donanım ihtiyacı yükselir. Başlangıç için küçük varyantı deneyin.
| Etiket | Boyut | Bağlam | Girdi | Komut |
|---|---|---|---|---|
| latest | 4.1GB | 32K | Text |
ollama run mistrallite:latest
|
| 7b | 4.1GB | 32K | Text |
ollama run mistrallite:7b
|
| 7b-v0.1-q2_K | 3.1GB | 32K | Text |
ollama run mistrallite:7b-v0.1-q2_K
|
| 7b-v0.1-q3_K_S | 3.2GB | 32K | Text |
ollama run mistrallite:7b-v0.1-q3_K_S
|
| 7b-v0.1-q3_K_M | 3.5GB | 32K | Text |
ollama run mistrallite:7b-v0.1-q3_K_M
|
| 7b-v0.1-q3_K_L | 3.8GB | 32K | Text |
ollama run mistrallite:7b-v0.1-q3_K_L
|
| 7b-v0.1-q4_0 | 4.1GB | 32K | Text |
ollama run mistrallite:7b-v0.1-q4_0
|
| 7b-v0.1-q4_1 | 4.6GB | 32K | Text |
ollama run mistrallite:7b-v0.1-q4_1
|
| 7b-v0.1-q4_K_S | 4.1GB | 32K | Text |
ollama run mistrallite:7b-v0.1-q4_K_S
|
| 7b-v0.1-q4_K_M | 4.4GB | 32K | Text |
ollama run mistrallite:7b-v0.1-q4_K_M
|
| 7b-v0.1-q5_0 | 5.0GB | 32K | Text |
ollama run mistrallite:7b-v0.1-q5_0
|
| 7b-v0.1-q5_1 | 5.4GB | 32K | Text |
ollama run mistrallite:7b-v0.1-q5_1
|
| 7b-v0.1-q5_K_S | 5.0GB | 32K | Text |
ollama run mistrallite:7b-v0.1-q5_K_S
|
| 7b-v0.1-q5_K_M | 5.1GB | 32K | Text |
ollama run mistrallite:7b-v0.1-q5_K_M
|
| 7b-v0.1-q6_K | 5.9GB | 32K | Text |
ollama run mistrallite:7b-v0.1-q6_K
|
| 7b-v0.1-q8_0 | 7.7GB | 32K | Text |
ollama run mistrallite:7b-v0.1-q8_0
|
| 7b-v0.1-fp16 | 14GB | 32K | Text |
ollama run mistrallite:7b-v0.1-fp16
|