centillex-labs/laya-goish

Laya GGUF inference and HTTP server in Goish Rust

Rust

17

1 commits

updated Sep 23, 2026

See the code

README

Laya Goish

Turn text into decisions.

Route a support ticket. Score urgency. Detect a refund request. Laya Goish turns English and Thai text into structured answers your application can use, running on your own infrastructure.

Download v0.1.0 · Get started · API reference

Ask for the answer your workflow needs

TaskWhat you getPut it to work
ChooseA choice from your options, with probabilities and confidenceRoute tickets, classify messages, select a next step
ScoreA score against your ordered criteriaAssess urgency, sentiment, or quality
CheckThe probability that a condition is trueDetect intent, flag a request, check a requirement

Define the questions and criteria. Send text or a JSON object. Receive structured JSON.

curl http://localhost:8080/v1/decide \
  -H 'Content-Type: application/json' \
  -d '{
    "model": "laya",
    "state": "I was charged twice. Please refund the duplicate payment.",
    "questions": {
      "refund": {
        "type": "noul",
        "instructions": "Does the customer ask for money back?"
      }
    }
  }'

Explore example requests · Use built-in presets

English and Thai. One API.

Use Laya for English decisions or OpenThai-SystemOne for Thai and English. Load both into one server and select a model in each request.

ModelLanguagesGuide
Laya EnglishEnglishDownload and run
OpenThai-SystemOne v0.3Thai and EnglishConvert and run

Serve multiple models

Run where your data lives

A single Linux executable runs inference on your CPU. No hosted inference service is required. Keep the models on your machine and integrate through HTTP, the command line, or a persistent JSON-lines process.

Batch requests let you apply the same questions to a collection of inputs. Optional bearer authentication controls access to the decision API.

Start with Laya

Download and extract the Linux release, then run:

bash scripts/download-models.sh f16
./laya serve models/laya_english_f16.gguf --port 8080 --threads 4

Requires Linux x86-64 with AVX2/FMA. Model weights are downloaded separately.

Installation and requirements · HTTP API · Release notes


Built with Goish Rust. Laya inference is ported from ggmlc; Thai/English support uses OpenThai-SystemOne.

Architecture · Validation · Attribution

centillex-labs/laya-goish

Laya GGUF inference and HTTP server in Goish Rust

Rust

17

1 commits

updated Sep 23, 2026

See the code

README

Laya Goish

Turn text into decisions.

Route a support ticket. Score urgency. Detect a refund request. Laya Goish turns English and Thai text into structured answers your application can use, running on your own infrastructure.

Download v0.1.0 · Get started · API reference

Ask for the answer your workflow needs

TaskWhat you getPut it to work
ChooseA choice from your options, with probabilities and confidenceRoute tickets, classify messages, select a next step
ScoreA score against your ordered criteriaAssess urgency, sentiment, or quality
CheckThe probability that a condition is trueDetect intent, flag a request, check a requirement

Define the questions and criteria. Send text or a JSON object. Receive structured JSON.

curl http://localhost:8080/v1/decide \
  -H 'Content-Type: application/json' \
  -d '{
    "model": "laya",
    "state": "I was charged twice. Please refund the duplicate payment.",
    "questions": {
      "refund": {
        "type": "noul",
        "instructions": "Does the customer ask for money back?"
      }
    }
  }'

Explore example requests · Use built-in presets

English and Thai. One API.

Use Laya for English decisions or OpenThai-SystemOne for Thai and English. Load both into one server and select a model in each request.

ModelLanguagesGuide
Laya EnglishEnglishDownload and run
OpenThai-SystemOne v0.3Thai and EnglishConvert and run

Serve multiple models

Run where your data lives

A single Linux executable runs inference on your CPU. No hosted inference service is required. Keep the models on your machine and integrate through HTTP, the command line, or a persistent JSON-lines process.

Batch requests let you apply the same questions to a collection of inputs. Optional bearer authentication controls access to the decision API.

Start with Laya

Download and extract the Linux release, then run:

bash scripts/download-models.sh f16
./laya serve models/laya_english_f16.gguf --port 8080 --threads 4

Requires Linux x86-64 with AVX2/FMA. Model weights are downloaded separately.

Installation and requirements · HTTP API · Release notes


Built with Goish Rust. Laya inference is ported from ggmlc; Thai/English support uses OpenThai-SystemOne.

Architecture · Validation · Attribution