LaunchCo/vision_llm

This repo is intended to be a public, open-source, simple inference engine for donut AI

0

stars

38

commits

Python

primary language

May 9, 2025

updated

README

vision_llm

vision_llm is intended to act as an inference engine for visual models.

Objectives:

  • Run most visual models from a CLI
  • Utilize GPU when available for fast inference
  • Expose an endpoint on a local port that accepts images and instruction

Contributors

jackson338

35 commits

LaunchCo

3 commits

LaunchCo/vision_llm

This repo is intended to be a public, open-source, simple inference engine for donut AI

0

stars

38

commits

Python

primary language

May 9, 2025

updated

README

vision_llm

vision_llm is intended to act as an inference engine for visual models.

Objectives:

  • Run most visual models from a CLI
  • Utilize GPU when available for fast inference
  • Expose an endpoint on a local port that accepts images and instruction

Contributors

jackson338

35 commits

LaunchCo

3 commits

Languages

Python

100.0%