LLM Eval
VLMEvalKit 환경세팅(Gemma3)
minty_y
2025. 6. 4. 14:59
반응형
pip install git+https://github.com/huggingface/transformers@v4.49.0-Gemma-3!pip3 install -q -U datasets==2.18.
export TRANSFORMERS_NO_FLASH_ATTN=1
https://github.com/open-compass/VLMEvalKit/blob/main/docs/en/Quickstart.md
VLMEvalKit/docs/en/Quickstart.md at main · open-compass/VLMEvalKit
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks - open-compass/VLMEvalKit
github.com
https://github.com/open-compass/VLMEvalKit/blob/main/vlmeval/vlm/gemma.py
VLMEvalKit/vlmeval/vlm/gemma.py at main · open-compass/VLMEvalKit
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks - open-compass/VLMEvalKit
github.com
반응형