llama3

Meta Llama 3: The most capable openly available LLM to date

8b 70b
Hızlı Kurulum (Ollama kuruluysa)
ollama run llama3

Ollama kurulu değil mi? ollama.com/download — Windows, macOS ve Linux için ücretsiz. İlk çalıştırmada model indirilir, sonrası tamamen çevrimdışıdır.

Varyantlar

Boyut büyüdükçe kalite artar, donanım ihtiyacı yükselir. Başlangıç için küçük varyantı deneyin.

EtiketBoyutBağlamGirdiKomut
latest 4.7GB 8K Text ollama run llama3:latest
instruct 4.7GB 8K Text ollama run llama3:instruct
text 4.7GB 8K Text ollama run llama3:text
8b 4.7GB 8K Text ollama run llama3:8b
70b 40GB 8K Text ollama run llama3:70b
8b-instruct-q2_K 3.2GB 8K Text ollama run llama3:8b-instruct-q2_K
8b-instruct-q3_K_S 3.7GB 8K Text ollama run llama3:8b-instruct-q3_K_S
8b-instruct-q3_K_M 4.0GB 8K Text ollama run llama3:8b-instruct-q3_K_M
8b-instruct-q3_K_L 4.3GB 8K Text ollama run llama3:8b-instruct-q3_K_L
8b-instruct-q4_0 4.7GB 8K Text ollama run llama3:8b-instruct-q4_0
8b-instruct-q4_1 5.1GB 8K Text ollama run llama3:8b-instruct-q4_1
8b-instruct-q4_K_S 4.7GB 8K Text ollama run llama3:8b-instruct-q4_K_S
8b-instruct-q4_K_M 4.9GB 8K Text ollama run llama3:8b-instruct-q4_K_M
8b-instruct-q5_0 5.6GB 8K Text ollama run llama3:8b-instruct-q5_0
8b-instruct-q5_1 6.1GB 8K Text ollama run llama3:8b-instruct-q5_1
8b-instruct-q5_K_S 5.6GB 8K Text ollama run llama3:8b-instruct-q5_K_S
8b-instruct-q5_K_M 5.7GB 8K Text ollama run llama3:8b-instruct-q5_K_M
8b-instruct-q6_K 6.6GB 8K Text ollama run llama3:8b-instruct-q6_K
8b-instruct-q8_0 8.5GB 8K Text ollama run llama3:8b-instruct-q8_0
8b-instruct-fp16 16GB 8K Text ollama run llama3:8b-instruct-fp16
8b-text 4.7GB 8K Text ollama run llama3:8b-text
8b-text-q2_K 3.2GB 8K Text ollama run llama3:8b-text-q2_K
8b-text-q3_K_S 3.7GB 8K Text ollama run llama3:8b-text-q3_K_S
8b-text-q3_K_M 4.0GB 8K Text ollama run llama3:8b-text-q3_K_M
8b-text-q3_K_L 4.3GB 8K Text ollama run llama3:8b-text-q3_K_L

43 varyant daha var — tümü için ollama.com.

Model Detayları ve Benchmarklar (kaynak: ollama.com)

Llama 3

The most capable openly available LLM to date.

Meta Llama 3, a family of models developed by Meta Inc. are new state-of-the-art , available in both 8B and 70B parameter sizes (pre-trained or instruction-tuned).

Llama 3 instruction-tuned models are fine-tuned and optimized for dialogue/chat use cases and outperform many of the available open-source chat models on common benchmarks.

CLI

Open the terminal and run ollama run llama3

API

Example using curl:

curl -X POST http://localhost:11434/api/generate -d '{
  "model": "llama3",
  "prompt":"Why is the sky blue?"
 }'

API documentation

Model variants

Instruct is fine-tuned for chat/dialogue use cases.

Example: ollama run llama3 ollama run llama3:70b

Pre-trained is the base model.

Example: ollama run llama3:text ollama run llama3:70b-text

References

Introducing Meta Llama 3: The most capable openly available LLM to date