ReASC: Reliability-Aware Adaptive Self-Consistency for Efficient Sampling in LLM ReasoningThe Official code for Reliability-Aware Adaptive Self-Consistency for Efficient Sampling in LLM Reasoning
$ conda env create -f environment.yaml
$ conda activate reasc
run_self_certainty_calibration.sh to get result for calibration set in offline settingsrun_sc_self_certainty.sh and run it for the result of standard Self Consistency../notebooks for the result of ASC, ESC, ReASC Offline and ReASC Online1 commits
Jupyter Notebook
98.0%
Python
1.9%
ReASC: Reliability-Aware Adaptive Self-Consistency for Efficient Sampling in LLM ReasoningThe Official code for Reliability-Aware Adaptive Self-Consistency for Efficient Sampling in LLM Reasoning
$ conda env create -f environment.yaml
$ conda activate reasc
run_self_certainty_calibration.sh to get result for calibration set in offline settingsrun_sc_self_certainty.sh and run it for the result of standard Self Consistency../notebooks for the result of ASC, ESC, ReASC Offline and ReASC Online1 commits
Jupyter Notebook
98.0%
Python
1.9%