reflection

A high-performing model trained with a new technique called Reflection-tuning that teaches a LLM to detect mistakes in its reasoning and correct course.

70b
Hızlı Kurulum (Ollama kuruluysa)
ollama run reflection

Ollama kurulu değil mi? ollama.com/download — Windows, macOS ve Linux için ücretsiz. İlk çalıştırmada model indirilir, sonrası tamamen çevrimdışıdır.

Varyantlar

Boyut büyüdükçe kalite artar, donanım ihtiyacı yükselir. Başlangıç için küçük varyantı deneyin.

EtiketBoyutBağlamGirdiKomut
latest 40GB 128K Text ollama run reflection:latest
70b 40GB 128K Text ollama run reflection:70b
70b-q2_K 26GB 128K Text ollama run reflection:70b-q2_K
70b-q3_K_S 31GB 128K Text ollama run reflection:70b-q3_K_S
70b-q3_K_M 34GB 128K Text ollama run reflection:70b-q3_K_M
70b-q3_K_L 37GB 128K Text ollama run reflection:70b-q3_K_L
70b-q4_0 40GB 128K Text ollama run reflection:70b-q4_0
70b-q4_1 44GB 128K Text ollama run reflection:70b-q4_1
70b-q4_K_S 40GB 128K Text ollama run reflection:70b-q4_K_S
70b-q4_K_M 43GB 128K Text ollama run reflection:70b-q4_K_M
70b-q5_0 49GB 128K Text ollama run reflection:70b-q5_0
70b-q5_1 53GB 128K Text ollama run reflection:70b-q5_1
70b-q5_K_S 49GB 128K Text ollama run reflection:70b-q5_K_S
70b-q5_K_M 50GB 128K Text ollama run reflection:70b-q5_K_M
70b-q6_K 58GB 128K Text ollama run reflection:70b-q6_K
70b-q8_0 75GB 128K Text ollama run reflection:70b-q8_0
70b-fp16 141GB 128K Text ollama run reflection:70b-fp16

Model Detayları ve Benchmarklar (kaynak: ollama.com)

During sampling, the model will start by outputting reasoning inside <thinking> and </thinking> tags, and then once it is satisfied with its reasoning, it will output the final answer inside <output> and </output> tags. Each of these tags are special tokens, trained into the model.

This enables the model to separate its internal thoughts and reasoning from its final answer, improving the experience for the user.

Inside the <thinking> section, the model may output one or more <reflection> tags, which signals the model has caught an error in its reasoning and will attempt to correct it before providing a final answer.

References

Hugging Face