h2oGPT from Meta

A clone of h2oGPT project with my custom config

Install with customization with Anaconda 3 envirnoment

conda install ninja

pip install -r requirements.txt

Required for Doc Q/A: LangChain:

pip install -r reqs_optional/requirements_optional_langchain.txt

Required for CPU: LLaMa/GPT4All:

pip install -r reqs_optional/requirements_optional_gpt4all.txt

Optional: PyMuPDF/ArXiv:

pip install -r reqs_optional/requirements_optional_langchain.gpllike.txt

Optional: Selenium/PlayWright:

pip install -r reqs_optional/requirements_optional_langchain.urls.txt

Optional: for supporting unstructured package

python -m nltk.downloader all

Optional but required for PlayWright

playwright install --with-deps

conda install cudatoolkit -y

pip install xformers

pip install cchardet

pip install tensorflow

conda install -c conda-forge librosa

conda install tokenizers, transformers

pip install pytorch-transformers

Detecting GPU by install CUDA 11.8

conda install -c "nvidia/label/cuda-11.8.0" cuda conda install pytorch==2.0.1 torchvision==0.15.2 torchaudio==2.0.2 pytorch-cuda=11.8 -c pytorch -c nvidia

transformers library on a machine with GPUs from h2ogpt-oasst1-512-12b

pip install transformers==4.33.2 pip install accelerate==0.20.3 pip install litellm==0.1.2291 pip install tokenizers==0.13.3

qwen model need this

pip install transformers_stream_generator pip install flash-attn

Enjoy!