llama3.1

Llama 3.1 is a new state-of-the-art model from Meta available in 8B, 70B and 405B parameter sizes.

Araç Kullanımı 8b 70b 405b
Hızlı Kurulum (Ollama kuruluysa)
ollama run llama3.1

Ollama kurulu değil mi? ollama.com/download — Windows, macOS ve Linux için ücretsiz. İlk çalıştırmada model indirilir, sonrası tamamen çevrimdışıdır.

Varyantlar

Boyut büyüdükçe kalite artar, donanım ihtiyacı yükselir. Başlangıç için küçük varyantı deneyin.

EtiketBoyutBağlamGirdiKomut
latest 4.9GB 128K Text ollama run llama3.1:latest
8b 4.9GB 128K Text ollama run llama3.1:8b
70b 43GB 128K Text ollama run llama3.1:70b
405b 243GB 128K Text ollama run llama3.1:405b
8b-instruct-q2_K 3.2GB 128K Text ollama run llama3.1:8b-instruct-q2_K
8b-instruct-q3_K_S 3.7GB 128K Text ollama run llama3.1:8b-instruct-q3_K_S
8b-instruct-q3_K_M 4.0GB 128K Text ollama run llama3.1:8b-instruct-q3_K_M
8b-instruct-q3_K_L 4.3GB 128K Text ollama run llama3.1:8b-instruct-q3_K_L
8b-instruct-q4_0 4.7GB 128K Text ollama run llama3.1:8b-instruct-q4_0
8b-instruct-q4_1 5.1GB 128K Text ollama run llama3.1:8b-instruct-q4_1
8b-instruct-q4_K_S 4.7GB 128K Text ollama run llama3.1:8b-instruct-q4_K_S
8b-instruct-q4_K_M 4.9GB 128K Text ollama run llama3.1:8b-instruct-q4_K_M
8b-instruct-q5_0 5.6GB 128K Text ollama run llama3.1:8b-instruct-q5_0
8b-instruct-q5_1 6.1GB 128K Text ollama run llama3.1:8b-instruct-q5_1
8b-instruct-q5_K_S 5.6GB 128K Text ollama run llama3.1:8b-instruct-q5_K_S
8b-instruct-q5_K_M 5.7GB 128K Text ollama run llama3.1:8b-instruct-q5_K_M
8b-instruct-q6_K 6.6GB 128K Text ollama run llama3.1:8b-instruct-q6_K
8b-instruct-q8_0 8.5GB 128K Text ollama run llama3.1:8b-instruct-q8_0
8b-instruct-fp16 16GB 128K Text ollama run llama3.1:8b-instruct-fp16
8b-text-q2_K 3.2GB 128K Text ollama run llama3.1:8b-text-q2_K
8b-text-q3_K_S 3.7GB 128K Text ollama run llama3.1:8b-text-q3_K_S
8b-text-q3_K_M 4.0GB 128K Text ollama run llama3.1:8b-text-q3_K_M
8b-text-q3_K_L 4.3GB 128K Text ollama run llama3.1:8b-text-q3_K_L
8b-text-q4_0 4.7GB 128K Text ollama run llama3.1:8b-text-q4_0
8b-text-q4_1 5.1GB 128K Text ollama run llama3.1:8b-text-q4_1

68 varyant daha var — tümü için ollama.com.

Model Detayları ve Benchmarklar (kaynak: ollama.com)

Meta Llama 3.1

image.png

Llama 3.1 family of models available:

  • 8B
  • 70B
  • 405B

Llama 3.1 405B is the first openly available model that rivals the top AI models when it comes to state-of-the-art capabilities in general knowledge, steerability, math, tool use, and multilingual translation.

The upgraded versions of the 8B and 70B models are multilingual and have a significantly longer context length of 128K, state-of-the-art tool use, and overall stronger reasoning capabilities. This enables Meta’s latest models to support advanced use cases, such as long-form text summarization, multilingual conversational agents, and coding assistants.

Meta also has made changes to their license, allowing developers to use the outputs from Llama models, including the 405B model, to improve other models.

Model evaluations

For this release, Meta has evaluation the performance on over 150 benchmark datasets that span a wide range of languages. In addition, Meta performed extensive human evaluations that compare Llama 3.1 with competing models in real-world scenarios. Meta’s experimental evaluation suggests that our flagship model is competitive with leading foundation models across a range of tasks, including GPT-4, GPT-4o, and Claude 3.5 Sonnet. Additionally, Meta’s smaller models are competitive with closed and open models that have a similar number of parameters.

image.png

image.png

image.png

References