can be run with my experimental llama.cpp fork, im currently working on a draft pr to iron out issues. Remember this is experimental there can be issues! https://github.com/ggml-org/llama.cpp/pull/17454
6 commits
can be run with my experimental llama.cpp fork, im currently working on a draft pr to iron out issues. Remember this is experimental there can be issues! https://github.com/ggml-org/llama.cpp/pull/17454
6 commits