Shadowgraph
TrendingBuzzResearch
Chrome extension
Sign in

pratheeshrussell/llm_experiments

Just checking out LLM from huggingface

Python

0

19 commits

updated Feb 15, 2024

See the code

README

Hugging Face LLM Experiments

Install

pip install diffusers transformers omegaconf accelerate xformers langchain compel  llama-cpp-python

you can also install gradio to use the gradio_interface.py

pip install gradio

To install torch use the following link (If you have Graphics card use cuda enabled version or cpu only version)
https://pytorch.org/get-started/locally/

In windows the next headache is installing llama-cpp-python
https://github.com/abetlen/llama-cpp-python/releases
you can use the following command - make sure python version matches

pip install LINK_FROM_RELEASE

Env Vars

In windows I had to set the following env vars also

  • HF_DATASETS_OFFLINE=1
  • TRANSFORMERS_OFFLINE=1
  • HUGGINGFACE_HUB_CACHE The third might not be required but since I didnt want to store everything in C: I changed it. Link

Does this work??

throws random errors. Try running from repo first before using a local model
In windows local model didnt run at all - maybe a path problem

Download and place it in models folder

-- Image generation models should be downloaded from hugging face directly

Model repo from Hugging face

Image generation models

  • runwayml/stable-diffusion-v1-5
  • emilianJR/epiCRealism
  • Justin-Choo/epiCRealism-Natural_Sin_RC1_VAE
  • Lykon/dreamshaper-8
  • digiplay/Juggernaut_final

Prompt generation model

  • Gustavosta/MagicPrompt-Stable-Diffusion

Stable Diffusion

Upscaler

Issues

  1. Truncated to 77 Tokens

Similar repos

Pyr-000/YetAnotherStableDiffusion

StableDiffusion scripts based on huggingface diffusers.

16

Uminosachi/open-llm-webui

This repository contains a web application designed to execute relatively compact, locally-operated…

47

LocalResearchGroup/llm-foundry

5

0xSojalSec/LLMs-local

list of awesome platforms, tools, and resources run for LLMs locally

1,196

Alpha-VLLM/Lumina-T2I

Model

Lumina-T2I

88

ruslanmv/How-to-load-Diffusion-Models-in-Python

How to Generate Images in Python with Diffusion Models

6

TonyLianLong/LLM-groundedDiffusion

LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large…

485

Stu-Pid1/AI_agent_loader

I want to be able to run the tensors that come from hugging face to be able to run them locally

0

pratheeshrussell/llm_experiments

Just checking out LLM from huggingface

Python

0

19 commits

updated Feb 15, 2024

See the code

README

Hugging Face LLM Experiments

Install

pip install diffusers transformers omegaconf accelerate xformers langchain compel  llama-cpp-python

you can also install gradio to use the gradio_interface.py

pip install gradio

To install torch use the following link (If you have Graphics card use cuda enabled version or cpu only version)
https://pytorch.org/get-started/locally/

In windows the next headache is installing llama-cpp-python
https://github.com/abetlen/llama-cpp-python/releases
you can use the following command - make sure python version matches

pip install LINK_FROM_RELEASE

Env Vars

In windows I had to set the following env vars also

  • HF_DATASETS_OFFLINE=1
  • TRANSFORMERS_OFFLINE=1
  • HUGGINGFACE_HUB_CACHE The third might not be required but since I didnt want to store everything in C: I changed it. Link

Does this work??

throws random errors. Try running from repo first before using a local model
In windows local model didnt run at all - maybe a path problem

Download and place it in models folder

-- Image generation models should be downloaded from hugging face directly

Model repo from Hugging face

Image generation models

  • runwayml/stable-diffusion-v1-5
  • emilianJR/epiCRealism
  • Justin-Choo/epiCRealism-Natural_Sin_RC1_VAE
  • Lykon/dreamshaper-8
  • digiplay/Juggernaut_final

Prompt generation model

  • Gustavosta/MagicPrompt-Stable-Diffusion

Stable Diffusion

Upscaler

Issues

  1. Truncated to 77 Tokens

Similar repos

Pyr-000/YetAnotherStableDiffusion

StableDiffusion scripts based on huggingface diffusers.

16

Uminosachi/open-llm-webui

This repository contains a web application designed to execute relatively compact, locally-operated…

47

LocalResearchGroup/llm-foundry

5

0xSojalSec/LLMs-local

list of awesome platforms, tools, and resources run for LLMs locally

1,196

Alpha-VLLM/Lumina-T2I

Model

Lumina-T2I

88

ruslanmv/How-to-load-Diffusion-Models-in-Python

How to Generate Images in Python with Diffusion Models

6

TonyLianLong/LLM-groundedDiffusion

LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large…

485

Stu-Pid1/AI_agent_loader

I want to be able to run the tensors that come from hugging face to be able to run them locally

0