Shadowgraph
TrendingAbout
Sign in

fern-robotics/iris

VLM inference engine on Jetson Orin NX's SM87 architecture

Rust

1

10 commits

updated Aug 21, 2026

See the code
nvidia-jetson
robotics
vision-language-model

README

iris

logo

License: MIT

Iris: A Low-Latency Rust/CUDA Runtime for Vision-Language Model Inference.

Iris is built on top of Candle.

Environment: Jetson Orin NX 16 GB (SM87)

Author: Ryan Adidaru

Contributors

coolcmyk

10 commits

Similar repos

dusty-nv/NanoLLM

Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language…

382

LaunchCo/vision_llm

This repo is intended to be a public, open-source, simple inference engine for donut AI

0

saurabhaloneai/Hermes

Inference engine for vlm

1

Boominathan2355/QorVix

0

leaatimberini/GRETA-N-engine

0

omnimind-ai/OmniInfer-LLM

36

SuJerry46/jetson-containers

0

Eormeci/nvidia-apis

1

Languages

Rust

80.8%

Cuda

11.3%

C++

7.7%

fern-robotics/iris

VLM inference engine on Jetson Orin NX's SM87 architecture

Rust

1

10 commits

updated Aug 21, 2026

See the code
nvidia-jetson
robotics
vision-language-model

README

iris

logo

License: MIT

Iris: A Low-Latency Rust/CUDA Runtime for Vision-Language Model Inference.

Iris is built on top of Candle.

Environment: Jetson Orin NX 16 GB (SM87)

Author: Ryan Adidaru

Similar repos

dusty-nv/NanoLLM

Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language…

382

LaunchCo/vision_llm

This repo is intended to be a public, open-source, simple inference engine for donut AI

0

saurabhaloneai/Hermes

Inference engine for vlm

1

Boominathan2355/QorVix

0

leaatimberini/GRETA-N-engine

0

omnimind-ai/OmniInfer-LLM

36

SuJerry46/jetson-containers

0

Eormeci/nvidia-apis

1

Contributors

coolcmyk

10 commits

Languages

Rust

80.8%

Cuda

11.3%

C++

7.7%