Shadowgraph
TrendingAbout
Sign in
← Explore by area/GGML and LLM Inference

Cluster 635319

28 repos

C++ · 19
Python · 8
C · 1
ggml ·268,883
gguf ·63,723
cross-platform ·51,970
local-inference ·51,970
open-source-ai ·51,970
single-file-executable ·51,970
llama-cpp ·51,970
local-llm ·51,970
local-ai ·51,970
speech-to-text ·51,970

Related clusters

LLM Inference Optimization & Quantization20Cluster 63523818PyTorch Deep Learning & NLP23Mistral 7B Model Variants & GGUF Quantization11GGUF quantized language models36Image Generation and Diffusion Models28

poolsideai/llama.cpp

LLM inference in C/C++

C++

6

8,486 commits

ggml-org/llama.cpp

LLM inference in C/C++

C++

128,588

8,823 commits

wendadawen/llama.cpp

LLM inference in C/C++

C++

0

8,391 commits

alainnothere/llama.cpp

LLM inference in C/C++

C++

1

8,043 commits

ggerganov/llama.cpp

LLM inference in C/C++

C++

128,542

8,993 commits

vagrillo/llama.cpp

LLM inference in C/C++

C++

1

8,956 commits

unslothai/llama.cpp

LLM inference in C/C++

C++

213

9,119 commits

gaetan-puleo/llama-cpp-strix-halo

No description

C++

13

8,880 commits

Veridian-Zenith/llama.cpp

No description

C++

0

9,049 commits

alin-o/llama.cpp-qwen38

No description

C++

0

9,044 commits

nathanmp/delphi.cpp

A hardware-aware fork of llama.cpp.

C++

0

9,039 commits

XHToken/llama.cpp

LLM inference in C/C++

C++

11

8,804 commits

chynggi/gigatoken-llama.cpp

LLM inference in C/C++ with Gigatoken / This Repo is Very Vibe-Coded-Experimental

C++

11

9,220 commits

LostRuins/koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

C++

11,753

13,404 commits

HimariO/llama.cpp.qwen2.5vl

Port of Facebook's LLaMA model in C/C++

C++

66

4,513 commits

ggerganov/ggml

Tensor library for machine learning

C++

15,368

4,140 commits

ggml-org/ggml

Tensor library for machine learning

C++

15,368

4,104 commits

amstaff666/llama-cpp-python

No description

Python

0

2,105 commits

abetlen/llama-cpp-python

Python bindings for llama.cpp

Python

10,623

2,118 commits

ali3alnasser/llama-cpp-python

No description

Python

0

1,955 commits

inference-sh/llama-cpp-python

No description

Python

12

2,017 commits

machaao/llama-cpp-python

Python bindings for llama.cpp

Python

0

1,969 commits

TmLev/llama-cpp-python

No description

Python

1

1,692 commits

jaepil/llama-cpp-python-deprecated

Python bindings for llama.cpp

Python

0

1,932 commits

mozilla-ai/llamafile

Distribute and run LLMs with a single file.

C++

25,985

859 commits

Mozilla-Ocho/llamafile

Distribute and run LLMs with a single file.

C++

25,985

859 commits

containers/ramalama

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any…

Python

3,050

4,485 commits

tarruda/llama.cpp

Port of Facebook's LLaMA model in C/C++

C

14

189 commits