A simple Rust client directly linking to llama.cpp, useful for directly speaking to a LLM.
Rust
0
3 commits
updated Jan 29, 2025
README
simple_llama_client
This is a simple llama.cpp client in Rust, based on an example from llama-rust-2 - currently the only difference is that it is a separate package that has llama.cpp-rs-2 as dependency but still links statically with llama.cpp so the executable is independent.
I am planning to extend it a bit for logged conversations etc. but please don't expect any breakthroughs here; the main purpose of this project is for myself to understand how these things work.
Contributors
3 commits
Similar repos
Languages
Rust
100.0%
A simple Rust client directly linking to llama.cpp, useful for directly speaking to a LLM.
Rust
0
3 commits
updated Jan 29, 2025
README
simple_llama_client
This is a simple llama.cpp client in Rust, based on an example from llama-rust-2 - currently the only difference is that it is a separate package that has llama.cpp-rs-2 as dependency but still links statically with llama.cpp so the executable is independent.
I am planning to extend it a bit for logged conversations etc. but please don't expect any breakthroughs here; the main purpose of this project is for myself to understand how these things work.
Similar repos
Contributors
3 commits
Languages
Rust
100.0%