phind-codellama

Code generation model based on Code Llama.

34b
Hızlı Kurulum (Ollama kuruluysa)
ollama run phind-codellama

Ollama kurulu değil mi? ollama.com/download — Windows, macOS ve Linux için ücretsiz. İlk çalıştırmada model indirilir, sonrası tamamen çevrimdışıdır.

Varyantlar

Boyut büyüdükçe kalite artar, donanım ihtiyacı yükselir. Başlangıç için küçük varyantı deneyin.

EtiketBoyutBağlamGirdiKomut
latest 19GB 16K Text ollama run phind-codellama:latest
34b 19GB 16K Text ollama run phind-codellama:34b
34b-python 19GB 16K Text ollama run phind-codellama:34b-python
34b-python-q2_K 14GB 16K Text ollama run phind-codellama:34b-python-q2_K
34b-python-q3_K_S 15GB 16K Text ollama run phind-codellama:34b-python-q3_K_S
34b-python-q3_K_M 16GB 16K Text ollama run phind-codellama:34b-python-q3_K_M
34b-python-q3_K_L 18GB 16K Text ollama run phind-codellama:34b-python-q3_K_L
34b-python-q4_0 19GB 16K Text ollama run phind-codellama:34b-python-q4_0
34b-python-q4_1 21GB 16K Text ollama run phind-codellama:34b-python-q4_1
34b-python-q4_K_S 19GB 16K Text ollama run phind-codellama:34b-python-q4_K_S
34b-python-q4_K_M 20GB 16K Text ollama run phind-codellama:34b-python-q4_K_M
34b-python-q5_0 23GB 16K Text ollama run phind-codellama:34b-python-q5_0
34b-python-q5_1 25GB 16K Text ollama run phind-codellama:34b-python-q5_1
34b-python-q5_K_S 23GB 16K Text ollama run phind-codellama:34b-python-q5_K_S
34b-python-q5_K_M 24GB 16K Text ollama run phind-codellama:34b-python-q5_K_M
34b-python-q6_K 28GB 16K Text ollama run phind-codellama:34b-python-q6_K
34b-python-q8_0 36GB 16K Text ollama run phind-codellama:34b-python-q8_0
34b-python-fp16 67GB 16K Text ollama run phind-codellama:34b-python-fp16
34b-v2 19GB 16K Text ollama run phind-codellama:34b-v2
34b-v2-q2_K 14GB 16K Text ollama run phind-codellama:34b-v2-q2_K
34b-v2-q3_K_S 15GB 16K Text ollama run phind-codellama:34b-v2-q3_K_S
34b-v2-q3_K_M 16GB 16K Text ollama run phind-codellama:34b-v2-q3_K_M
34b-v2-q3_K_L 18GB 16K Text ollama run phind-codellama:34b-v2-q3_K_L
34b-v2-q4_0 19GB 16K Text ollama run phind-codellama:34b-v2-q4_0
34b-v2-q4_1 21GB 16K Text ollama run phind-codellama:34b-v2-q4_1

24 varyant daha var — tümü için ollama.com.

Model Detayları ve Benchmarklar (kaynak: ollama.com)

Phind CodeLlama is a code generation model based on CodeLlama 34B fine-tuned for instruct use cases. There are two versions of the model: v1 and v2. v1 is based on CodeLlama 34B and CodeLlama-Python 34B. v2 is an iteration on v1, trained on an additional 1.5B tokens of high-quality programming-related data.

Usage

CLI

Open the terminal and run ollama run phind-codellama

API

Example

curl -X POST http://localhost:11434/api/generate -d '{
  "model": "phind-codellama",
  "prompt":"Implement a linked list in C++"
 }'

Memory requirements

  • 34b models generally require at least 32GB of RAM

References

Beating GPT-4 on HumanEval with a Fine-Tuned CodeLlama-34B

HuggingFace