medllama2

Fine-tuned Llama 2 model to answer medical questions based on an open source medical dataset.

7b
Hızlı Kurulum (Ollama kuruluysa)
ollama run medllama2

Ollama kurulu değil mi? ollama.com/download — Windows, macOS ve Linux için ücretsiz. İlk çalıştırmada model indirilir, sonrası tamamen çevrimdışıdır.

Varyantlar

Boyut büyüdükçe kalite artar, donanım ihtiyacı yükselir. Başlangıç için küçük varyantı deneyin.

EtiketBoyutBağlamGirdiKomut
latest 3.8GB 4K Text ollama run medllama2:latest
7b 3.8GB 4K Text ollama run medllama2:7b
7b-q2_K 2.8GB 4K Text ollama run medllama2:7b-q2_K
7b-q3_K_S 2.9GB 4K Text ollama run medllama2:7b-q3_K_S
7b-q3_K_M 3.3GB 4K Text ollama run medllama2:7b-q3_K_M
7b-q3_K_L 3.6GB 4K Text ollama run medllama2:7b-q3_K_L
7b-q4_0 3.8GB 4K Text ollama run medllama2:7b-q4_0
7b-q4_1 4.2GB 4K Text ollama run medllama2:7b-q4_1
7b-q4_K_S 3.9GB 4K Text ollama run medllama2:7b-q4_K_S
7b-q4_K_M 4.1GB 4K Text ollama run medllama2:7b-q4_K_M
7b-q5_0 4.7GB 4K Text ollama run medllama2:7b-q5_0
7b-q5_1 5.1GB 4K Text ollama run medllama2:7b-q5_1
7b-q5_K_S 4.7GB 4K Text ollama run medllama2:7b-q5_K_S
7b-q5_K_M 4.8GB 4K Text ollama run medllama2:7b-q5_K_M
7b-q6_K 5.5GB 4K Text ollama run medllama2:7b-q6_K
7b-q8_0 7.2GB 4K Text ollama run medllama2:7b-q8_0
7b-fp16 13GB 4K Text ollama run medllama2:7b-fp16

Model Detayları ve Benchmarklar (kaynak: ollama.com)

MedLlama2 by Siraj Raval is a Llama 2-based model trained with MedQA dataset to be able to provide medical answers to questions. It is not intended to replace a medical professional, but to provide a starting point for further research.

CLI

Open the terminal and run ollama run medllama2

API

Example:

curl -X POST http://localhost:11434/api/generate -d '{
  "model": "medllama2",
  "prompt":"A 35-year-old woman presents with a persistent dry cough, shortness of breath, and fatigue. She is initially suspected of having asthma, but her spirometry results do not improve with bronchodilators. What could be the diagnosis?"
 }'

Memory requirements

  • 7b models generally require at least 8GB of RAM

Reference

llSourcell