docling-gguf

• run it with gguf-connector; simply execute the command below in console/terminal

ggc n3

GGUF file(s) available. Select which one to use:

1. docling-iq4_nl.gguf
2. docling-q6_k.gguf
3. docling-q8_0.gguf

Enter your choice (1 to 3): _

• opt a gguf file in your current directory to interact with; nothing else

docling is a multimodal image-text-to-text model engineered for efficient document conversion; for more details, please refer to the base model from ibm🐥 btw, you are able to customize the output token (more tokens longer wait) with ggc n3

reference

• gguf-connector (pypi)