Shadowgraph
TrendingBuzzAbout
Sign in

yrezehi/ggmlcs

Simple lightweight up-to-date llama.cpp & ggml.cpp binding - whisper, gpt-2, LLava, starcoder and Mistral - ONGOING

C#

6

189 commits

updated Jan 13, 2024

See the code

README


ggmlcs

GGMLCS

Models

Verfied Models on current state of the project

Model
LLama2
TinyLLama

TODO

  • Plain models installer
  • HF models installer
  • LLama.cpp builder
  • GGML Converter
  • Binding GGML
  • GPT-2 Binding
  • Binding LLAMA
  • Quantization support
  • Serve as server
  • Serve concurrent users

Similar repos

HimariO/llama.cpp.qwen2.5vl

Port of Facebook's LLaMA model in C/C++

66

Ni-co-la-s/llama.cpp-gemmeh

LLM inference in C/C++

0

satindergrewal/llama.cpp

LLM inference in C/C++

2

poolsideai/llama.cpp

LLM inference in C/C++

6

wendadawen/llama.cpp

LLM inference in C/C++

0

alainnothere/llama.cpp

LLM inference in C/C++

1

antirez/llama.cpp-deepseek-v4-flash

Experimental implementation of DeepSeek v4 flaash in llama.cpp

347

wsbagnsv1/LLaDA2.0-mini-preview-GGUF

Model

can be run with my experimental llama.cpp fork, im currently working on a draft pr to iron out…

2

yrezehi/ggmlcs

Simple lightweight up-to-date llama.cpp & ggml.cpp binding - whisper, gpt-2, LLava, starcoder and Mistral - ONGOING

C#

6

189 commits

updated Jan 13, 2024

See the code

README


ggmlcs

GGMLCS

Models

Verfied Models on current state of the project

Model
LLama2
TinyLLama

TODO

  • Plain models installer
  • HF models installer
  • LLama.cpp builder
  • GGML Converter
  • Binding GGML
  • GPT-2 Binding
  • Binding LLAMA
  • Quantization support
  • Serve as server
  • Serve concurrent users

Similar repos

HimariO/llama.cpp.qwen2.5vl

Port of Facebook's LLaMA model in C/C++

66

Ni-co-la-s/llama.cpp-gemmeh

LLM inference in C/C++

0

satindergrewal/llama.cpp

LLM inference in C/C++

2

poolsideai/llama.cpp

LLM inference in C/C++

6

wendadawen/llama.cpp

LLM inference in C/C++

0

alainnothere/llama.cpp

LLM inference in C/C++

1

antirez/llama.cpp-deepseek-v4-flash

Experimental implementation of DeepSeek v4 flaash in llama.cpp

347

wsbagnsv1/LLaDA2.0-mini-preview-GGUF

Model

can be run with my experimental llama.cpp fork, im currently working on a draft pr to iron out…

2