200,000 English-language decision rows drawn from existing datasets, public
records, text-based game environments, and procedural generators. Each row presents source-grounded
input state and one or more bounded decisions inspired by the JEV CHOICE,
NOUL, and SCORE contracts. The mixture aims to train models that select an
option, judge a proposition, or assign an ordered score without generating a
long free-form answer.
| Split | Rows |
|---|---|
| Train | 167,614 |
| Test | 32,386 |
There is no validation split. The first 150,000 rows (125,614 train / 24,386 test) are the original release, unchanged and in the same order; the hard 50K batch (42,000 train / 8,000 test) is appended after them. When packaging, 169 rows of the original release were reassigned: 166 Upworthy rows moved from test to train and three rows moved from train to test, to keep repeated input states and related source groups on one side. The release contains 185,637 distinct normalized input states; repeated states within a split can carry different decision questions. No state appears in both splits.
Each decision row has a state string and a questions_json string
containing a questions object keyed by meaningful decision names. Question
types are:
| Type | Target | Questions | Rows containing it | Share of all questions |
|---|---|---|---|---|
| CHOICE | Select a key from a bounded criteria map | 172,163 | 138,113 | 44.6% |
| NOUL | Judge a yes/no proposition | 155,989 | 95,839 | 40.4% |
| SCORE | Select an index on an ordered, described scale | 57,955 | 44,614 | 15.0% |
| Total | 386,107 | 200,000 unique rows | 100% |
The number of questions exceeds the number of rows because a state can have
several decision targets. For CHOICE, criteria maps stable answer keys to
option descriptions and label is one key. For NOUL, label is a boolean.
For SCORE, criteria is an ordered list of anchored levels and label is its
zero-based index. A SCORE label is an ordinal target; it is not a
calibrated probability or an unconstrained numeric prediction.
The table uses one primary domain per row. It describes the actual released mixture, not the sizes of the upstream datasets. Each link leads to an original source or source collection.
| Domain | Rows | Share | Example decisions and upstream sources |
|---|---|---|---|
| Sentiment, emotion, and moderation | 25,156 | 12.6% | Sentiment intensity, emotion, and toxicity from SST-5, GoEmotions, and Civil Comments |
| Retail, product, and shopping | 19,883 | 9.9% | Purchase/cancellation outcomes, product categories, and review ratings from Online Retail II, Online Shoppers, Product Classification, and Recipe Reviews |
| Support and intent routing | 19,656 | 9.8% | Classify a request and route it to a service area using CLINC150, MASSIVE, and BANKING77; the hard batch adds confusable-neighbor options with definitions and a none_of_these option, plus handler catalogs whose scopes differ by one decisive condition |
| Spatial and logical reasoning | 19,579 | 9.8% | Spatial relations and true/false/unknown inference from SpaRTQA, SpaRP/SpaRTUN, and ProofWriter |
| Financial reporting and banking | 13,203 | 6.6% | Report-table magnitude and observed term-deposit outcomes from TAT-QA and UCI Bank Marketing; the hard batch adds exact-value choices from FinQA executed programs and TAT-QA with near-miss distractors |
| Multi-hop reading and evidence | 10,500 | 5.2% | Chained answers with bridge-entity distractors and a not_stated option from MuSiQue (answerable/unanswerable twins) and 2WikiMultihopQA (intact/deleted-paragraph twins) |
| Tool and workflow decisions | 10,224 | 5.1% | Choose a service/tool and some enum or boolean arguments from Taskmaster-1 and Glaive Function Calling v2 |
| Software engineering and code | 9,286 | 4.6% | Select test transitions or assertion outcomes from SWE-smith-py and MBPP; the hard batch adds executed MBPP single-point mutants (passes-all / first failing test) |
| Scientific and paper understanding | 9,133 | 4.6% | Citation intent, claim evidence, and scientific yes/no judgments from SciCite, SciFact, and SciRIFF |
| Response preference and quality | 8,693 | 4.3% | Choose a preferred response or an ordered human/reward rating from HelpSteer2 and UltraFeedback Binarized |
| Trap and adversarial reading | 8,500 | 4.2% | Negation edits from CondaQA; procedural access logs with revocations, expiries, pending requests, look-alike names, and stale summaries; quoted, on-behalf, negated, misleading-subject, and injected-instruction pairs over CLINC150/BANKING77/MASSIVE requests |
| Software security | 7,000 | 3.5% | Source-assigned CVSS severity from NIST NVD descriptions |
| Answer and solution verification | 6,900 | 3.5% | First incorrect step from PRM800K human step ratings; correct vs. planted-flaw answers over MuSiQue and FinQA sources |
| Policy and rule reasoning | 5,000 | 2.5% | Required approval under generated policies with aliases, schedules, annexes, footnote exceptions, dated amendments, and expiring waivers (template and model-rewritten prose; labels computed in code) |
| Temporal and unit reasoning | 4,800 | 2.4% | Deadlines across time zones and DST, business days with holidays, mixed-unit totals, thresholds, age boundaries, event ordering, proration, and deadline urgency (computed with the IANA tz database) |
| Browser interaction | 4,786 | 2.4% | Pick a demonstrated page element from Mind2Web candidates |
| Engagement and ranking | 4,248 | 2.1% | Compare measured headline click-through rates from the Upworthy Archive |
| Contract evidence | 4,000 | 2.0% | Supported, contradicted, or unmentioned claims from ContractNLI; the hard batch adds fresh pairs and evidence-span-deleted twins |
| Reading comprehension | 3,619 | 1.8% | Answer grounded yes/no reading questions from BoolQ |
| Game-state decisions | 2,000 | 1.0% | Immediate action and score decisions from TextWorldExpress, ScienceWorld, and OpenSpiel |
| Spam detection | 1,399 | 0.7% | SMS screening from the UCI SMS Spam Collection |
| Sensory quality rating | 1,300 | 0.7% | Ordered wine quality from UCI Wine Quality |
| Civic and safety operations | 1,135 | 0.6% | Service routing, recall class/remedy, and deadline policy from NYC 311, FDA, CPSC, and CISA KEV |
Five independently built batches contribute 50,000; 19,997; 50,000; 30,003; and 50,000 rows. Most labels come from upstream annotations, recorded outcomes, test transitions, simulator replays, executed programs, or declared deterministic policies. In one 20,000-row slice of the original release, GPT-6 Luna rewrote bounded decision questions and selected source quotes from existing records; source-backed labels were kept. Other smaller Luna steps named existing response options or produced date-checkable deadline questions.
The fifth batch (hard 50K) targets multi-hop lookup, confusable routing, temporal and numeric reasoning, trap cases, unsettled evidence, and answer adequacy. About 60% of its rows are purely procedural, and none of its labels come from a model. In 9,576 of its rows, GPT-6 Luna wrote text that the row contains:
Outputs that failed a check were dropped. Luna also wrote the one-line option definitions for routing intents.
Some upstream corpora are themselves synthetic, template-generated, or model-generated. This is not a collection of exclusively human-written prompts.
The published rows include a primary domain category. The domain table
above links the upstream sources. Row-level source identifiers, raw source
downloads, and generation scripts are not included in this release.
data/train.parquet and data/test.parquet are the Hub-compatible viewer
files. Their five columns are state, questions_json, domain,
question_types, and question_count. The JSON column contains the flexible
JEV-like question object. Read the decision questions with:
import json
from datasets import load_dataset
ds = load_dataset("avbiswas/bev-decision-150K")
example = ds["train"][0]
state = example["state"]
questions = json.loads(example["questions_json"])
The release contains only the two Parquet data files. Parquet is used because the heterogeneous nested question objects cannot be reliably inferred as one Arrow JSON schema.
This mixture is for training and studying bounded decision models. Its test split is a held-out portion of the mixture, not an independent benchmark suite. It includes existing benchmark families, so evaluating on those same public benchmarks requires checking record and source-family overlap first. Some choice alternatives are sampled or constructed, and answer frequencies were sometimes rebalanced; neither the test split nor SCORE outputs imply real-world calibration.
Several labels have narrower meanings than their names may suggest: a bank subscription is an observed outcome, not a causal recommendation to contact that customer; CVSS base severity is not asset-specific risk; game scores describe immediate transitions, not long-run expected return; and Taskmaster service choices are derived from annotated dialogues, not logs of executed tools. Some source judgments and LLM-rewritten questions may be noisy. English filtering was automated and should not be read as a guarantee that every excerpt is perfect English.
Hard-50K caveats:
No single blanket license is asserted for this mixed-source release.
The Hub metadata uses license: unknown for that reason. Consult the linked
upstream sources, their papers, and their current terms before public
redistribution or commercial use, and attribute every source used. In
particular, the ProofWriter mirror leaves upstream redistribution rights to
the user to confirm; NVD descriptions may be authored by third-party CVE
reporters; and the GoEmotions release includes Reddit text. The hard 50K batch adds
MuSiQue, TAT-QA, ContractNLI, MASSIVE and MBPP (CC BY 4.0), CLINC150
(CC BY 3.0), 2WikiMultihopQA and CondaQA (Apache-2.0), and FinQA and PRM800K
(MIT). No share-alike or non-commercial source was added. The generated
question wording does not erase those upstream obligations.
Please cite this dataset's Hub page and the relevant upstream datasets or papers linked in the domain table above when using a subset.
4 commits
200,000 English-language decision rows drawn from existing datasets, public
records, text-based game environments, and procedural generators. Each row presents source-grounded
input state and one or more bounded decisions inspired by the JEV CHOICE,
NOUL, and SCORE contracts. The mixture aims to train models that select an
option, judge a proposition, or assign an ordered score without generating a
long free-form answer.
| Split | Rows |
|---|---|
| Train | 167,614 |
| Test | 32,386 |
There is no validation split. The first 150,000 rows (125,614 train / 24,386 test) are the original release, unchanged and in the same order; the hard 50K batch (42,000 train / 8,000 test) is appended after them. When packaging, 169 rows of the original release were reassigned: 166 Upworthy rows moved from test to train and three rows moved from train to test, to keep repeated input states and related source groups on one side. The release contains 185,637 distinct normalized input states; repeated states within a split can carry different decision questions. No state appears in both splits.
Each decision row has a state string and a questions_json string
containing a questions object keyed by meaningful decision names. Question
types are:
| Type | Target | Questions | Rows containing it | Share of all questions |
|---|---|---|---|---|
| CHOICE | Select a key from a bounded criteria map | 172,163 | 138,113 | 44.6% |
| NOUL | Judge a yes/no proposition | 155,989 | 95,839 | 40.4% |
| SCORE | Select an index on an ordered, described scale | 57,955 | 44,614 | 15.0% |
| Total | 386,107 | 200,000 unique rows | 100% |
The number of questions exceeds the number of rows because a state can have
several decision targets. For CHOICE, criteria maps stable answer keys to
option descriptions and label is one key. For NOUL, label is a boolean.
For SCORE, criteria is an ordered list of anchored levels and label is its
zero-based index. A SCORE label is an ordinal target; it is not a
calibrated probability or an unconstrained numeric prediction.
The table uses one primary domain per row. It describes the actual released mixture, not the sizes of the upstream datasets. Each link leads to an original source or source collection.
| Domain | Rows | Share | Example decisions and upstream sources |
|---|---|---|---|
| Sentiment, emotion, and moderation | 25,156 | 12.6% | Sentiment intensity, emotion, and toxicity from SST-5, GoEmotions, and Civil Comments |
| Retail, product, and shopping | 19,883 | 9.9% | Purchase/cancellation outcomes, product categories, and review ratings from Online Retail II, Online Shoppers, Product Classification, and Recipe Reviews |
| Support and intent routing | 19,656 | 9.8% | Classify a request and route it to a service area using CLINC150, MASSIVE, and BANKING77; the hard batch adds confusable-neighbor options with definitions and a none_of_these option, plus handler catalogs whose scopes differ by one decisive condition |
| Spatial and logical reasoning | 19,579 | 9.8% | Spatial relations and true/false/unknown inference from SpaRTQA, SpaRP/SpaRTUN, and ProofWriter |
| Financial reporting and banking | 13,203 | 6.6% | Report-table magnitude and observed term-deposit outcomes from TAT-QA and UCI Bank Marketing; the hard batch adds exact-value choices from FinQA executed programs and TAT-QA with near-miss distractors |
| Multi-hop reading and evidence | 10,500 | 5.2% | Chained answers with bridge-entity distractors and a not_stated option from MuSiQue (answerable/unanswerable twins) and 2WikiMultihopQA (intact/deleted-paragraph twins) |
| Tool and workflow decisions | 10,224 | 5.1% | Choose a service/tool and some enum or boolean arguments from Taskmaster-1 and Glaive Function Calling v2 |
| Software engineering and code | 9,286 | 4.6% | Select test transitions or assertion outcomes from SWE-smith-py and MBPP; the hard batch adds executed MBPP single-point mutants (passes-all / first failing test) |
| Scientific and paper understanding | 9,133 | 4.6% | Citation intent, claim evidence, and scientific yes/no judgments from SciCite, SciFact, and SciRIFF |
| Response preference and quality | 8,693 | 4.3% | Choose a preferred response or an ordered human/reward rating from HelpSteer2 and UltraFeedback Binarized |
| Trap and adversarial reading | 8,500 | 4.2% | Negation edits from CondaQA; procedural access logs with revocations, expiries, pending requests, look-alike names, and stale summaries; quoted, on-behalf, negated, misleading-subject, and injected-instruction pairs over CLINC150/BANKING77/MASSIVE requests |
| Software security | 7,000 | 3.5% | Source-assigned CVSS severity from NIST NVD descriptions |
| Answer and solution verification | 6,900 | 3.5% | First incorrect step from PRM800K human step ratings; correct vs. planted-flaw answers over MuSiQue and FinQA sources |
| Policy and rule reasoning | 5,000 | 2.5% | Required approval under generated policies with aliases, schedules, annexes, footnote exceptions, dated amendments, and expiring waivers (template and model-rewritten prose; labels computed in code) |
| Temporal and unit reasoning | 4,800 | 2.4% | Deadlines across time zones and DST, business days with holidays, mixed-unit totals, thresholds, age boundaries, event ordering, proration, and deadline urgency (computed with the IANA tz database) |
| Browser interaction | 4,786 | 2.4% | Pick a demonstrated page element from Mind2Web candidates |
| Engagement and ranking | 4,248 | 2.1% | Compare measured headline click-through rates from the Upworthy Archive |
| Contract evidence | 4,000 | 2.0% | Supported, contradicted, or unmentioned claims from ContractNLI; the hard batch adds fresh pairs and evidence-span-deleted twins |
| Reading comprehension | 3,619 | 1.8% | Answer grounded yes/no reading questions from BoolQ |
| Game-state decisions | 2,000 | 1.0% | Immediate action and score decisions from TextWorldExpress, ScienceWorld, and OpenSpiel |
| Spam detection | 1,399 | 0.7% | SMS screening from the UCI SMS Spam Collection |
| Sensory quality rating | 1,300 | 0.7% | Ordered wine quality from UCI Wine Quality |
| Civic and safety operations | 1,135 | 0.6% | Service routing, recall class/remedy, and deadline policy from NYC 311, FDA, CPSC, and CISA KEV |
Five independently built batches contribute 50,000; 19,997; 50,000; 30,003; and 50,000 rows. Most labels come from upstream annotations, recorded outcomes, test transitions, simulator replays, executed programs, or declared deterministic policies. In one 20,000-row slice of the original release, GPT-6 Luna rewrote bounded decision questions and selected source quotes from existing records; source-backed labels were kept. Other smaller Luna steps named existing response options or produced date-checkable deadline questions.
The fifth batch (hard 50K) targets multi-hop lookup, confusable routing, temporal and numeric reasoning, trap cases, unsettled evidence, and answer adequacy. About 60% of its rows are purely procedural, and none of its labels come from a model. In 9,576 of its rows, GPT-6 Luna wrote text that the row contains:
Outputs that failed a check were dropped. Luna also wrote the one-line option definitions for routing intents.
Some upstream corpora are themselves synthetic, template-generated, or model-generated. This is not a collection of exclusively human-written prompts.
The published rows include a primary domain category. The domain table
above links the upstream sources. Row-level source identifiers, raw source
downloads, and generation scripts are not included in this release.
data/train.parquet and data/test.parquet are the Hub-compatible viewer
files. Their five columns are state, questions_json, domain,
question_types, and question_count. The JSON column contains the flexible
JEV-like question object. Read the decision questions with:
import json
from datasets import load_dataset
ds = load_dataset("avbiswas/bev-decision-150K")
example = ds["train"][0]
state = example["state"]
questions = json.loads(example["questions_json"])
The release contains only the two Parquet data files. Parquet is used because the heterogeneous nested question objects cannot be reliably inferred as one Arrow JSON schema.
This mixture is for training and studying bounded decision models. Its test split is a held-out portion of the mixture, not an independent benchmark suite. It includes existing benchmark families, so evaluating on those same public benchmarks requires checking record and source-family overlap first. Some choice alternatives are sampled or constructed, and answer frequencies were sometimes rebalanced; neither the test split nor SCORE outputs imply real-world calibration.
Several labels have narrower meanings than their names may suggest: a bank subscription is an observed outcome, not a causal recommendation to contact that customer; CVSS base severity is not asset-specific risk; game scores describe immediate transitions, not long-run expected return; and Taskmaster service choices are derived from annotated dialogues, not logs of executed tools. Some source judgments and LLM-rewritten questions may be noisy. English filtering was automated and should not be read as a guarantee that every excerpt is perfect English.
Hard-50K caveats:
No single blanket license is asserted for this mixed-source release.
The Hub metadata uses license: unknown for that reason. Consult the linked
upstream sources, their papers, and their current terms before public
redistribution or commercial use, and attribute every source used. In
particular, the ProofWriter mirror leaves upstream redistribution rights to
the user to confirm; NVD descriptions may be authored by third-party CVE
reporters; and the GoEmotions release includes Reddit text. The hard 50K batch adds
MuSiQue, TAT-QA, ContractNLI, MASSIVE and MBPP (CC BY 4.0), CLINC150
(CC BY 3.0), 2WikiMultihopQA and CondaQA (Apache-2.0), and FinQA and PRM800K
(MIT). No share-alike or non-commercial source was added. The generated
question wording does not erase those upstream obligations.
Please cite this dataset's Hub page and the relevant upstream datasets or papers linked in the domain table above when using a subset.
4 commits