Valen-Training-General-100k

GitHub · Preview model · General evaluation · Technical notes

✨ Introduction

Valen brings visual perception to System One decision-making: text, images or video in, candidate probabilities out. This dataset provides 100,000 image-based decision records for supervised training and decision-head learning in Valen, spanning visual question answering, interfaces, games and documents.

Each record contains one decision question, a target probability distribution, local image references and provenance metadata. All records are marked as English in the supplied metadata. Use Valen-Eval-General-5k for companion evaluation; this repository is the training split.

📥 Dataset downloads

Images are packaged in assets.zip. Extract it before loading records; the relative image paths and data_manifest.json refer to the extracted files.

📊 Dataset composition

• Records / questions: 100,000 / 100,000.
• Referenced image files: 50,203; unique image SHA-256 hashes: 48,445.
• Distinct groups: 48,445. Multiple questions can share an image or group.
• Domains: vqa: 33,334, ui: 28,572, game: 19,047, document: 19,047.
• Local split metadata: meta.split = "train".

noul is a binary judgment with implicit candidate keys true and false. choice maps candidate IDs to answer descriptions in criteria. score uses an ordered list of descriptions; target keys are the zero-based index strings ("0", "1", ...). All supplied targets are one-hot distributions; these are finite-candidate decisions rather than free-form text targets.

🚀 Quick start

Download the dataset and extract its image archive:

hf download Valen-Team/Valen-Training-General-100k \
  --repo-type dataset --local-dir data/Valen-Training-General-100k
unzip -n data/Valen-Training-General-100k/assets.zip -d data/Valen-Training-General-100k

After downloading the repository with its image files, use Python's JSON reader. This preserves the heterogeneous criteria field, which is a mapping for choice questions, a list for score questions and absent for binary questions. Automatic Arrow/JSON loading may require normalization of that field.

import json
from pathlib import Path
from PIL import Image

root = Path("data/Valen-Training-General-100k")
with (root / "train.jsonl").open(encoding="utf-8") as stream:
    record = json.loads(next(stream))

request = record["request"]
question = request["questions"]["decision"]
probabilities = record["targets"]["decision"]["probabilities"]
correct_candidate = max(probabilities, key=probabilities.get)
with Image.open(root / record["assets"][0]["path"]) as image:
    print(image.size, question["type"], correct_candidate)

For candidate-selection evaluation, compare the predicted candidate ID against the target distribution, and report overall accuracy together with per-source and per-question-type accuracy. Score questions also allow ordered-error metrics when explicitly defined; noul outputs may be evaluated as probabilities when calibration is relevant.

For training with this dataset, follow the Valen training guide. Set the training config's data to the downloaded train.jsonl; keep its extracted assets/ directory alongside it.

Record format

Only request is model input. Keep targets, grouping identifiers and provenance outside the model prompt.

Repository layout

train.jsonl           # Complete 100,000-record training file
<source>.jsonl        # Ten per-source subsets of train.jsonl
assets/<source>/...   # Images referenced by relative path
dataset_info.json     # Counts, source metadata and validation results
data_manifest.json    # SHA-256 and byte size of every supplied data file
README.md
card-assets/         # Dataset-card branding; not part of the training data

The original filename train.jsonl is preserved for compatibility. It is the training split. The complete train.jsonl is the canonical entry point: its group IDs have been normalized, while some per-source files retain original grouping prefixes. The number of such differences is recorded in dataset_info.json; all other record fields match. Per-source files contain the same examples as the complete file: read either train.jsonl or the source subsets, not both.

All image paths are relative to the repository root. The image files are stored in the ZIP archives listed below; extract them before using these relative paths. The dataset payload occupies approximately 6.32 GiB, including both the complete JSONL and its per-source copies.

Sources and provenance

The table reproduces source identifiers and license strings from the supplied record metadata; it is not an independent verification of upstream licensing or label quality.

Upstream identifiers, revisions, source splits and label provenance are retained in each record's meta fields where provided. meta.source_split describes the upstream source partition; meta.split describes this assembled dataset partition. They need not have the same name.

Historical identifiers such as visionjev/programmatic and Visual-Jev-Training-General-100k remain in the original provenance and metadata files. The project and Hub repository are now named Valen; the data itself has not been renamed internally or relabeled.

Integrity and split isolation

Packaging validated all record schemas, unique record IDs, target distributions, referenced image paths and image SHA-256 hashes. Each per-source subset was checked against the corresponding records in the complete JSONL, allowing only the documented group-ID normalization difference. Across the 100k training and 5k evaluation repositories, overlap is 0 record IDs, 0 group IDs and 0 exact image SHA-256 hashes. This does not establish semantic or near-duplicate independence.

The complete file SHA-256 is:

5762c39f4440dcaa2443cc07773bb26e36ac499a68e87eeb35e609a91032788b

Counts and audit details are in dataset_info.json; data-file checksums are in data_manifest.json. The original JSONL records and images are preserved without relabeling or rewriting.

Image archives

Images are distributed as ZIP archives. Each archive preserves its folder prefix and all nested paths. The original image directories have been removed after verifying their contents against the archives. Extract the ZIP files to restore them. Record paths are unchanged; after downloading archives, extract them from the repository root before loading the JSONL data.

unzip -n assets.zip -d .

unzip -n preserves existing extracted files. image_archives.json records archive SHA-256 hashes, source sizes and file counts. Every member was decompressed and checked against the original data manifest by SHA-256; ZIP CRC checks also passed. ZIP64 is enabled for large archives.

🤝 Contributions

Contributions to Valen are welcome. Open an issue to report a problem, share a use case or discuss experimental results. Submit a pull request to improve the code or documentation, contribute training data or add evaluation tasks.

Scan the QR code below to join the Valen WeChat group, discuss the project and share your experiments.

📄 Annotation status and terms

The supplied metadata marks 99,047 records as human_audit: pending and 953 as not_required. Packaging checks establish structural and file integrity, not independent semantic verification of every answer.

The repository retains its existing Apache-2.0 metadata tag. This does not replace the source-specific terms recorded above for third-party images and annotations. Source attribution and license metadata remain attached to the records.

Valen is built on Qwen3.5, with its decision interface inspired by TypeSafe's Jev. Project documentation and evaluation results are available in the GitHub README.