nikitavbv/llama-inference

playing with llama inference in rust for fun and learning

Rust

33 commits

updated Feb 18, 2024

See the code

Contributors

nikitavbv

33 commits

Similar repos

Prathmesh234/simple-inference

Simple inference engine for llama from first principles

Leosang-lx/LLM-Inference

Research and develop distributed LLM inference

LoselSpt/LLM

wzy816/llm-pilot

ramoneirao/llm-projects

barcelonaChinesegit/llm

llm study

jonathanschaab/MiniInferenceEngine

toy project to produce an inference engine.

Glanderlice/open_llm

Languages

Rust

99.2%

nikitavbv/llama-inference

playing with llama inference in rust for fun and learning

Rust

33 commits

updated Feb 18, 2024

See the code

Similar repos

Prathmesh234/simple-inference

Simple inference engine for llama from first principles

Leosang-lx/LLM-Inference

Research and develop distributed LLM inference

LoselSpt/LLM

wzy816/llm-pilot

ramoneirao/llm-projects

barcelonaChinesegit/llm

llm study

jonathanschaab/MiniInferenceEngine

toy project to produce an inference engine.

Glanderlice/open_llm

Contributors

nikitavbv

33 commits

Languages

Rust

99.2%