dataset-opencompass/configs/multimodal/otter

OTTER: Multi-modal In-context Instruction Tuning.

Prepare the environment

pip install otter_ai

Start evaluation

Slurm

cd $root
python run.py configs/multimodal/tasks.py --mm-eval --slurm -p $PARTITION

PyTorch

cd $root
python run.py configs/multimodal/tasks.py --mm-eval