neural-chat

A fine-tuned model based on Mistral with good coverage of domain and language.

7b
Hızlı Kurulum (Ollama kuruluysa)
ollama run neural-chat

Ollama kurulu değil mi? ollama.com/download — Windows, macOS ve Linux için ücretsiz. İlk çalıştırmada model indirilir, sonrası tamamen çevrimdışıdır.

Varyantlar

Boyut büyüdükçe kalite artar, donanım ihtiyacı yükselir. Başlangıç için küçük varyantı deneyin.

EtiketBoyutBağlamGirdiKomut
latest 4.1GB 32K Text ollama run neural-chat:latest
7b 4.1GB 32K Text ollama run neural-chat:7b
7b-v3.1 4.1GB 32K Text ollama run neural-chat:7b-v3.1
7b-v3.1-q2_K 3.1GB 32K Text ollama run neural-chat:7b-v3.1-q2_K
7b-v3.1-q3_K_S 3.2GB 32K Text ollama run neural-chat:7b-v3.1-q3_K_S
7b-v3.1-q3_K_M 3.5GB 32K Text ollama run neural-chat:7b-v3.1-q3_K_M
7b-v3.1-q3_K_L 3.8GB 32K Text ollama run neural-chat:7b-v3.1-q3_K_L
7b-v3.1-q4_0 4.1GB 32K Text ollama run neural-chat:7b-v3.1-q4_0
7b-v3.1-q4_1 4.6GB 32K Text ollama run neural-chat:7b-v3.1-q4_1
7b-v3.1-q4_K_S 4.1GB 32K Text ollama run neural-chat:7b-v3.1-q4_K_S
7b-v3.1-q4_K_M 4.4GB 32K Text ollama run neural-chat:7b-v3.1-q4_K_M
7b-v3.1-q5_0 5.0GB 32K Text ollama run neural-chat:7b-v3.1-q5_0
7b-v3.1-q5_1 5.4GB 32K Text ollama run neural-chat:7b-v3.1-q5_1
7b-v3.1-q5_K_S 5.0GB 32K Text ollama run neural-chat:7b-v3.1-q5_K_S
7b-v3.1-q5_K_M 5.1GB 32K Text ollama run neural-chat:7b-v3.1-q5_K_M
7b-v3.1-q6_K 5.9GB 32K Text ollama run neural-chat:7b-v3.1-q6_K
7b-v3.1-q8_0 7.7GB 32K Text ollama run neural-chat:7b-v3.1-q8_0
7b-v3.1-fp16 14GB 32K Text ollama run neural-chat:7b-v3.1-fp16
7b-v3.2 4.1GB 32K Text ollama run neural-chat:7b-v3.2
7b-v3.2-q2_K 3.1GB 32K Text ollama run neural-chat:7b-v3.2-q2_K
7b-v3.2-q3_K_S 3.2GB 32K Text ollama run neural-chat:7b-v3.2-q3_K_S
7b-v3.2-q3_K_M 3.5GB 32K Text ollama run neural-chat:7b-v3.2-q3_K_M
7b-v3.2-q3_K_L 3.8GB 32K Text ollama run neural-chat:7b-v3.2-q3_K_L
7b-v3.2-q4_0 4.1GB 32K Text ollama run neural-chat:7b-v3.2-q4_0
7b-v3.2-q4_1 4.6GB 32K Text ollama run neural-chat:7b-v3.2-q4_1

25 varyant daha var — tümü için ollama.com.

Model Detayları ve Benchmarklar (kaynak: ollama.com)

NeuralChat is a fine-tuned model released by Intel that’s based on Mistral, designed to be used for high-performance chatbot applications.

References

HuggingFace