I've found a Medical LLaMA-13B Model, which can response the medical problem wonderful.
The model needs at least 14G+ GPU memory when load_in_8bit, 40G+ when load by float32.
pip install requirements.txt -r
run medical_llama.py to directly chat or query.
run app.py to chat or query in a web.
run ex.py to generate the medical transcripts results.


app.py : a web server
medical_llama.py : the medical llama model
templates : html objects
static : css/images/js
Python
68.1%
HTML
19.8%
CSS
12.1%
I've found a Medical LLaMA-13B Model, which can response the medical problem wonderful.
The model needs at least 14G+ GPU memory when load_in_8bit, 40G+ when load by float32.
pip install requirements.txt -r
run medical_llama.py to directly chat or query.
run app.py to chat or query in a web.
run ex.py to generate the medical transcripts results.


app.py : a web server
medical_llama.py : the medical llama model
templates : html objects
static : css/images/js
Python
68.1%
HTML
19.8%
CSS
12.1%