This is the code of the paper OutHopEff. You can use this repo to reproduce the results in the paper.
You can set up the experimental environment by running the following command line:
$ cd baselines/src
$ pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118
pip install -r requirements.txt
$ pip3 install -r requirements.txt
$ export PYTHONPATH=$PYTHONPATH:$PWD
Download the datasets from the following:
https://github.com/kojima-takeshi188/zero_shot_cot/tree/main/dataset
https://github.com/kojima-takeshi188/zero_shot_cot/tree/main/log
You can run any baseline with our code provide, suchas auto_cot.py, few_shot.py, sc.py,....