avbiswas/bev-decision

Dataset

BEV 200K Decision Mix

17

4 commits

17 linked in READMEs

updated Sep 27, 2026

See the code

README

BEV 200K Decision Mix

200,000 English-language decision rows drawn from existing datasets, public records, text-based game environments, and procedural generators. Each row presents source-grounded input state and one or more bounded decisions inspired by the JEV CHOICE, NOUL, and SCORE contracts. The mixture aims to train models that select an option, judge a proposition, or assign an ordered score without generating a long free-form answer.

SplitRows
Train167,614
Test32,386

There is no validation split. The first 150,000 rows (125,614 train / 24,386 test) are the original release, unchanged and in the same order; the hard 50K batch (42,000 train / 8,000 test) is appended after them. When packaging, 169 rows of the original release were reassigned: 166 Upworthy rows moved from test to train and three rows moved from train to test, to keep repeated input states and related source groups on one side. The release contains 185,637 distinct normalized input states; repeated states within a split can carry different decision questions. No state appears in both splits.

Decision formats

Each decision row has a state string and a questions_json string containing a questions object keyed by meaningful decision names. Question types are:

TypeTargetQuestionsRows containing itShare of all questions
CHOICESelect a key from a bounded criteria map172,163138,11344.6%
NOULJudge a yes/no proposition155,98995,83940.4%
SCORESelect an index on an ordered, described scale57,95544,61415.0%
Total386,107200,000 unique rows100%

The number of questions exceeds the number of rows because a state can have several decision targets. For CHOICE, criteria maps stable answer keys to option descriptions and label is one key. For NOUL, label is a boolean. For SCORE, criteria is an ordered list of anchored levels and label is its zero-based index. A SCORE label is an ordinal target; it is not a calibrated probability or an unconstrained numeric prediction.

Domains and skills

The table uses one primary domain per row. It describes the actual released mixture, not the sizes of the upstream datasets. Each link leads to an original source or source collection.

DomainRowsShareExample decisions and upstream sources
Sentiment, emotion, and moderation25,15612.6%Sentiment intensity, emotion, and toxicity from SST-5, GoEmotions, and Civil Comments
Retail, product, and shopping19,8839.9%Purchase/cancellation outcomes, product categories, and review ratings from Online Retail II, Online Shoppers, Product Classification, and Recipe Reviews
Support and intent routing19,6569.8%Classify a request and route it to a service area using CLINC150, MASSIVE, and BANKING77; the hard batch adds confusable-neighbor options with definitions and a none_of_these option, plus handler catalogs whose scopes differ by one decisive condition
Spatial and logical reasoning19,5799.8%Spatial relations and true/false/unknown inference from SpaRTQA, SpaRP/SpaRTUN, and ProofWriter
Financial reporting and banking13,2036.6%Report-table magnitude and observed term-deposit outcomes from TAT-QA and UCI Bank Marketing; the hard batch adds exact-value choices from FinQA executed programs and TAT-QA with near-miss distractors
Multi-hop reading and evidence10,5005.2%Chained answers with bridge-entity distractors and a not_stated option from MuSiQue (answerable/unanswerable twins) and 2WikiMultihopQA (intact/deleted-paragraph twins)
Tool and workflow decisions10,2245.1%Choose a service/tool and some enum or boolean arguments from Taskmaster-1 and Glaive Function Calling v2
Software engineering and code9,2864.6%Select test transitions or assertion outcomes from SWE-smith-py and MBPP; the hard batch adds executed MBPP single-point mutants (passes-all / first failing test)
Scientific and paper understanding9,1334.6%Citation intent, claim evidence, and scientific yes/no judgments from SciCite, SciFact, and SciRIFF
Response preference and quality8,6934.3%Choose a preferred response or an ordered human/reward rating from HelpSteer2 and UltraFeedback Binarized
Trap and adversarial reading8,5004.2%Negation edits from CondaQA; procedural access logs with revocations, expiries, pending requests, look-alike names, and stale summaries; quoted, on-behalf, negated, misleading-subject, and injected-instruction pairs over CLINC150/BANKING77/MASSIVE requests
Software security7,0003.5%Source-assigned CVSS severity from NIST NVD descriptions
Answer and solution verification6,9003.5%First incorrect step from PRM800K human step ratings; correct vs. planted-flaw answers over MuSiQue and FinQA sources
Policy and rule reasoning5,0002.5%Required approval under generated policies with aliases, schedules, annexes, footnote exceptions, dated amendments, and expiring waivers (template and model-rewritten prose; labels computed in code)
Temporal and unit reasoning4,8002.4%Deadlines across time zones and DST, business days with holidays, mixed-unit totals, thresholds, age boundaries, event ordering, proration, and deadline urgency (computed with the IANA tz database)
Browser interaction4,7862.4%Pick a demonstrated page element from Mind2Web candidates
Engagement and ranking4,2482.1%Compare measured headline click-through rates from the Upworthy Archive
Contract evidence4,0002.0%Supported, contradicted, or unmentioned claims from ContractNLI; the hard batch adds fresh pairs and evidence-span-deleted twins
Reading comprehension3,6191.8%Answer grounded yes/no reading questions from BoolQ
Game-state decisions2,0001.0%Immediate action and score decisions from TextWorldExpress, ScienceWorld, and OpenSpiel
Spam detection1,3990.7%SMS screening from the UCI SMS Spam Collection
Sensory quality rating1,3000.7%Ordered wine quality from UCI Wine Quality
Civic and safety operations1,1350.6%Service routing, recall class/remedy, and deadline policy from NYC 311, FDA, CPSC, and CISA KEV

Construction and provenance

Five independently built batches contribute 50,000; 19,997; 50,000; 30,003; and 50,000 rows. Most labels come from upstream annotations, recorded outcomes, test transitions, simulator replays, executed programs, or declared deterministic policies. In one 20,000-row slice of the original release, GPT-6 Luna rewrote bounded decision questions and selected source quotes from existing records; source-backed labels were kept. Other smaller Luna steps named existing response options or produced date-checkable deadline questions.

The fifth batch (hard 50K) targets multi-hop lookup, confusable routing, temporal and numeric reasoning, trap cases, unsettled evidence, and answer adequacy. About 60% of its rows are purely procedural, and none of its labels come from a model. In 9,576 of its rows, GPT-6 Luna wrote text that the row contains:

  • policy prose (2,077 rows), checked by a second call to have the same rules as a code-generated template;
  • a correct or planted-flaw answer (3,000 rows), where a blind judge must recover both verdicts;
  • a rewritten or annotated request (1,999 rows);
  • handler catalogs and requests (2,500 rows), where a blind router must pick the intended handler.

Outputs that failed a check were dropped. Luna also wrote the one-line option definitions for routing intents.

Some upstream corpora are themselves synthetic, template-generated, or model-generated. This is not a collection of exclusively human-written prompts.

The published rows include a primary domain category. The domain table above links the upstream sources. Row-level source identifiers, raw source downloads, and generation scripts are not included in this release.

Loading the data

data/train.parquet and data/test.parquet are the Hub-compatible viewer files. Their five columns are state, questions_json, domain, question_types, and question_count. The JSON column contains the flexible JEV-like question object. Read the decision questions with:

import json
from datasets import load_dataset

ds = load_dataset("avbiswas/bev-decision-150K")
example = ds["train"][0]
state = example["state"]
questions = json.loads(example["questions_json"])

The release contains only the two Parquet data files. Parquet is used because the heterogeneous nested question objects cannot be reliably inferred as one Arrow JSON schema.

Intended use and limits

This mixture is for training and studying bounded decision models. Its test split is a held-out portion of the mixture, not an independent benchmark suite. It includes existing benchmark families, so evaluating on those same public benchmarks requires checking record and source-family overlap first. Some choice alternatives are sampled or constructed, and answer frequencies were sometimes rebalanced; neither the test split nor SCORE outputs imply real-world calibration.

Several labels have narrower meanings than their names may suggest: a bank subscription is an observed outcome, not a causal recommendation to contact that customer; CVSS base severity is not asset-specific risk; game scores describe immediate transitions, not long-run expected return; and Taskmaster service choices are derived from annotated dialogues, not logs of executed tools. Some source judgments and LLM-rewritten questions may be noisy. English filtering was automated and should not be read as a guarantee that every excerpt is perfect English.

Hard-50K caveats:

  • Deletion twins (MuSiQue unanswerable, 2Wiki and ContractNLI deleted evidence) are checked only for the absence of the deciding value, not for every possible implication.
  • PRM800K step ratings and CondaQA answers are human judgments.
  • The rulebook, temporal, and access-log generators use fixed templates, so their wording varies less than natural text.
  • Luna checks are model judgments. They filter noise but may favor cases that model resolves easily.
  • A MuSiQue sub-question can appear in both splits.

Attribution and redistribution

No single blanket license is asserted for this mixed-source release. The Hub metadata uses license: unknown for that reason. Consult the linked upstream sources, their papers, and their current terms before public redistribution or commercial use, and attribute every source used. In particular, the ProofWriter mirror leaves upstream redistribution rights to the user to confirm; NVD descriptions may be authored by third-party CVE reporters; and the GoEmotions release includes Reddit text. The hard 50K batch adds MuSiQue, TAT-QA, ContractNLI, MASSIVE and MBPP (CC BY 4.0), CLINC150 (CC BY 3.0), 2WikiMultihopQA and CondaQA (Apache-2.0), and FinQA and PRM800K (MIT). No share-alike or non-commercial source was added. The generated question wording does not erase those upstream obligations.

Please cite this dataset's Hub page and the relevant upstream datasets or papers linked in the domain table above when using a subset.

boolean-classification
decision-making
multiple-choice
ordinal-regression
source-grounded
structured-prediction
tool-routing

Contributors

avbiswas

4 commits

Linked in READMEs

avbiswas/bev-decision

Dataset

BEV 200K Decision Mix

17

4 commits

17 linked in READMEs

updated Sep 27, 2026

See the code

README

BEV 200K Decision Mix

200,000 English-language decision rows drawn from existing datasets, public records, text-based game environments, and procedural generators. Each row presents source-grounded input state and one or more bounded decisions inspired by the JEV CHOICE, NOUL, and SCORE contracts. The mixture aims to train models that select an option, judge a proposition, or assign an ordered score without generating a long free-form answer.

SplitRows
Train167,614
Test32,386

There is no validation split. The first 150,000 rows (125,614 train / 24,386 test) are the original release, unchanged and in the same order; the hard 50K batch (42,000 train / 8,000 test) is appended after them. When packaging, 169 rows of the original release were reassigned: 166 Upworthy rows moved from test to train and three rows moved from train to test, to keep repeated input states and related source groups on one side. The release contains 185,637 distinct normalized input states; repeated states within a split can carry different decision questions. No state appears in both splits.

Decision formats

Each decision row has a state string and a questions_json string containing a questions object keyed by meaningful decision names. Question types are:

TypeTargetQuestionsRows containing itShare of all questions
CHOICESelect a key from a bounded criteria map172,163138,11344.6%
NOULJudge a yes/no proposition155,98995,83940.4%
SCORESelect an index on an ordered, described scale57,95544,61415.0%
Total386,107200,000 unique rows100%

The number of questions exceeds the number of rows because a state can have several decision targets. For CHOICE, criteria maps stable answer keys to option descriptions and label is one key. For NOUL, label is a boolean. For SCORE, criteria is an ordered list of anchored levels and label is its zero-based index. A SCORE label is an ordinal target; it is not a calibrated probability or an unconstrained numeric prediction.

Domains and skills

The table uses one primary domain per row. It describes the actual released mixture, not the sizes of the upstream datasets. Each link leads to an original source or source collection.

DomainRowsShareExample decisions and upstream sources
Sentiment, emotion, and moderation25,15612.6%Sentiment intensity, emotion, and toxicity from SST-5, GoEmotions, and Civil Comments
Retail, product, and shopping19,8839.9%Purchase/cancellation outcomes, product categories, and review ratings from Online Retail II, Online Shoppers, Product Classification, and Recipe Reviews
Support and intent routing19,6569.8%Classify a request and route it to a service area using CLINC150, MASSIVE, and BANKING77; the hard batch adds confusable-neighbor options with definitions and a none_of_these option, plus handler catalogs whose scopes differ by one decisive condition
Spatial and logical reasoning19,5799.8%Spatial relations and true/false/unknown inference from SpaRTQA, SpaRP/SpaRTUN, and ProofWriter
Financial reporting and banking13,2036.6%Report-table magnitude and observed term-deposit outcomes from TAT-QA and UCI Bank Marketing; the hard batch adds exact-value choices from FinQA executed programs and TAT-QA with near-miss distractors
Multi-hop reading and evidence10,5005.2%Chained answers with bridge-entity distractors and a not_stated option from MuSiQue (answerable/unanswerable twins) and 2WikiMultihopQA (intact/deleted-paragraph twins)
Tool and workflow decisions10,2245.1%Choose a service/tool and some enum or boolean arguments from Taskmaster-1 and Glaive Function Calling v2
Software engineering and code9,2864.6%Select test transitions or assertion outcomes from SWE-smith-py and MBPP; the hard batch adds executed MBPP single-point mutants (passes-all / first failing test)
Scientific and paper understanding9,1334.6%Citation intent, claim evidence, and scientific yes/no judgments from SciCite, SciFact, and SciRIFF
Response preference and quality8,6934.3%Choose a preferred response or an ordered human/reward rating from HelpSteer2 and UltraFeedback Binarized
Trap and adversarial reading8,5004.2%Negation edits from CondaQA; procedural access logs with revocations, expiries, pending requests, look-alike names, and stale summaries; quoted, on-behalf, negated, misleading-subject, and injected-instruction pairs over CLINC150/BANKING77/MASSIVE requests
Software security7,0003.5%Source-assigned CVSS severity from NIST NVD descriptions
Answer and solution verification6,9003.5%First incorrect step from PRM800K human step ratings; correct vs. planted-flaw answers over MuSiQue and FinQA sources
Policy and rule reasoning5,0002.5%Required approval under generated policies with aliases, schedules, annexes, footnote exceptions, dated amendments, and expiring waivers (template and model-rewritten prose; labels computed in code)
Temporal and unit reasoning4,8002.4%Deadlines across time zones and DST, business days with holidays, mixed-unit totals, thresholds, age boundaries, event ordering, proration, and deadline urgency (computed with the IANA tz database)
Browser interaction4,7862.4%Pick a demonstrated page element from Mind2Web candidates
Engagement and ranking4,2482.1%Compare measured headline click-through rates from the Upworthy Archive
Contract evidence4,0002.0%Supported, contradicted, or unmentioned claims from ContractNLI; the hard batch adds fresh pairs and evidence-span-deleted twins
Reading comprehension3,6191.8%Answer grounded yes/no reading questions from BoolQ
Game-state decisions2,0001.0%Immediate action and score decisions from TextWorldExpress, ScienceWorld, and OpenSpiel
Spam detection1,3990.7%SMS screening from the UCI SMS Spam Collection
Sensory quality rating1,3000.7%Ordered wine quality from UCI Wine Quality
Civic and safety operations1,1350.6%Service routing, recall class/remedy, and deadline policy from NYC 311, FDA, CPSC, and CISA KEV

Construction and provenance

Five independently built batches contribute 50,000; 19,997; 50,000; 30,003; and 50,000 rows. Most labels come from upstream annotations, recorded outcomes, test transitions, simulator replays, executed programs, or declared deterministic policies. In one 20,000-row slice of the original release, GPT-6 Luna rewrote bounded decision questions and selected source quotes from existing records; source-backed labels were kept. Other smaller Luna steps named existing response options or produced date-checkable deadline questions.

The fifth batch (hard 50K) targets multi-hop lookup, confusable routing, temporal and numeric reasoning, trap cases, unsettled evidence, and answer adequacy. About 60% of its rows are purely procedural, and none of its labels come from a model. In 9,576 of its rows, GPT-6 Luna wrote text that the row contains:

  • policy prose (2,077 rows), checked by a second call to have the same rules as a code-generated template;
  • a correct or planted-flaw answer (3,000 rows), where a blind judge must recover both verdicts;
  • a rewritten or annotated request (1,999 rows);
  • handler catalogs and requests (2,500 rows), where a blind router must pick the intended handler.

Outputs that failed a check were dropped. Luna also wrote the one-line option definitions for routing intents.

Some upstream corpora are themselves synthetic, template-generated, or model-generated. This is not a collection of exclusively human-written prompts.

The published rows include a primary domain category. The domain table above links the upstream sources. Row-level source identifiers, raw source downloads, and generation scripts are not included in this release.

Loading the data

data/train.parquet and data/test.parquet are the Hub-compatible viewer files. Their five columns are state, questions_json, domain, question_types, and question_count. The JSON column contains the flexible JEV-like question object. Read the decision questions with:

import json
from datasets import load_dataset

ds = load_dataset("avbiswas/bev-decision-150K")
example = ds["train"][0]
state = example["state"]
questions = json.loads(example["questions_json"])

The release contains only the two Parquet data files. Parquet is used because the heterogeneous nested question objects cannot be reliably inferred as one Arrow JSON schema.

Intended use and limits

This mixture is for training and studying bounded decision models. Its test split is a held-out portion of the mixture, not an independent benchmark suite. It includes existing benchmark families, so evaluating on those same public benchmarks requires checking record and source-family overlap first. Some choice alternatives are sampled or constructed, and answer frequencies were sometimes rebalanced; neither the test split nor SCORE outputs imply real-world calibration.

Several labels have narrower meanings than their names may suggest: a bank subscription is an observed outcome, not a causal recommendation to contact that customer; CVSS base severity is not asset-specific risk; game scores describe immediate transitions, not long-run expected return; and Taskmaster service choices are derived from annotated dialogues, not logs of executed tools. Some source judgments and LLM-rewritten questions may be noisy. English filtering was automated and should not be read as a guarantee that every excerpt is perfect English.

Hard-50K caveats:

  • Deletion twins (MuSiQue unanswerable, 2Wiki and ContractNLI deleted evidence) are checked only for the absence of the deciding value, not for every possible implication.
  • PRM800K step ratings and CondaQA answers are human judgments.
  • The rulebook, temporal, and access-log generators use fixed templates, so their wording varies less than natural text.
  • Luna checks are model judgments. They filter noise but may favor cases that model resolves easily.
  • A MuSiQue sub-question can appear in both splits.

Attribution and redistribution

No single blanket license is asserted for this mixed-source release. The Hub metadata uses license: unknown for that reason. Consult the linked upstream sources, their papers, and their current terms before public redistribution or commercial use, and attribute every source used. In particular, the ProofWriter mirror leaves upstream redistribution rights to the user to confirm; NVD descriptions may be authored by third-party CVE reporters; and the GoEmotions release includes Reddit text. The hard 50K batch adds MuSiQue, TAT-QA, ContractNLI, MASSIVE and MBPP (CC BY 4.0), CLINC150 (CC BY 3.0), 2WikiMultihopQA and CondaQA (Apache-2.0), and FinQA and PRM800K (MIT). No share-alike or non-commercial source was added. The generated question wording does not erase those upstream obligations.

Please cite this dataset's Hub page and the relevant upstream datasets or papers linked in the domain table above when using a subset.

boolean-classification
decision-making
multiple-choice
ordinal-regression
source-grounded
structured-prediction
tool-routing

Linked in READMEs

Contributors

avbiswas

4 commits