Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

remote repo main 브랜치 업데이트 적용 #8

Merged
merged 11 commits into from
Mar 4, 2025
Merged

remote repo main 브랜치 업데이트 적용 #8

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
352b62d
Fix mmmu doc to text (#540)
kcz358 Feb 14, 2025
c548a19
Yhzhang/add charades sta (#536)
ZhangYuanhan-AI Feb 18, 2025
2508d42
[Fix] of "evaluation of llava_vid on mvbench" (#541)
zhshj0110 Feb 19, 2025
968d5f1
[Model] add vllm compatible models (#544)
Luodian Feb 20, 2025
8b68660
[Model] add openai compatible API interface (#546)
Luodian Feb 20, 2025
eb2dadc
Update README.md
Luodian Feb 22, 2025
00febf5
[Model] Support Ola (#558)
Devininthelab Feb 26, 2025
56cf355
Improve string processing order for better whitespace handling (#554)
Ryoo72 Feb 27, 2025
13d139a
Fix mlvu aggregation utils logic (#555)
shuyansy Feb 27, 2025
d6ed800
Contribute EgoLife model and evaluation pipeline for EgoPlan & Egothi…
choiszt Feb 27, 2025
a314bda
Resolved conflicts
hancheolcho Feb 28, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions .github/workflows/lint.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,9 @@ jobs:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v3
with:
submodules: true
fetch-depth: 0
- name: Set up Python
uses: actions/setup-python@v4
with:
Expand Down
3 changes: 2 additions & 1 deletion .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -42,4 +42,5 @@ VATEX/
lmms_eval/tasks/vatex/__pycache__/utils.cpython-310.pyc
lmms_eval/tasks/mlvu/__pycache__/utils.cpython-310.pyc

scripts/
scripts/
.env
26 changes: 15 additions & 11 deletions lmms_eval/models/__init__.py
View file
Open in desktop
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

모델 추가된 것 확인했습니다.

Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,7 @@
logger.add(sys.stdout, level="WARNING")

AVAILABLE_MODELS = {
"aria": "Aria",
"auroracap": "AuroraCap",
"batch_gpt4": "BatchGPT4",
"claude": "Claude",
Expand All @@ -21,45 +22,48 @@
"gpt4v": "GPT4V",
"idefics2": "Idefics2",
"instructblip": "InstructBLIP",
"internvideo2": "InternVideo2",
"internvl": "InternVLChat",
"internvl2": "InternVL2",
"llama_vid": "LLaMAVid",
"llama_vision": "LlamaVision",
"llava": "Llava",
"llava_hf": "LlavaHf",
"llava_onevision": "Llava_OneVision",
"llava_onevision_moviechat": "Llava_OneVision_MovieChat",
"llava_sglang": "LlavaSglang",
"llava_vid": "LlavaVid",
"slime": "Slime",
"longva": "LongVA",
"mantis": "Mantis",
"minicpm_v": "MiniCPM_V",
"minimonkey": "MiniMonkey",
"moviechat": "MovieChat",
"mplug_owl_video": "mplug_Owl",
"ola": "Ola",
"openai_compatible": "OpenAICompatible",
"oryx": "Oryx",
"phi3v": "Phi3v",
"qwen_vl": "Qwen_VL",
"qwen2_vl": "Qwen2_VL",
"qwen2_5_vl": "Qwen2_5_VL",
"qwen2_5_vl_interleave": "Qwen2_5_VL_Interleave",
"qwen2_audio": "Qwen2_Audio",
"qwen2_vl": "Qwen2_VL",
"qwen_vl": "Qwen_VL",
"qwen_vl_api": "Qwen_VL_API",
"reka": "Reka",
"ross": "Ross",
"slime": "Slime",
"srt_api": "SRT_API",
"tinyllava": "TinyLlava",
"videoChatGPT": "VideoChatGPT",
"videochat2": "VideoChat2",
"video_llava": "VideoLLaVA",
"vila": "VILA",
"xcomposer2_4KHD": "XComposer2_4KHD",
"internvideo2": "InternVideo2",
"xcomposer2d5": "XComposer2D5",
"oryx": "Oryx",
"videochat2": "VideoChat2",
"llama_vision": "LlamaVision",
"aria": "Aria",
"ross": "Ross",
"vita": "VITA",
"docvision": "DocVision",
"vllm": "VLLM",
"xcomposer2_4KHD": "XComposer2_4KHD",
"xcomposer2d5": "XComposer2D5",
"egogpt": "EgoGPT",
}


Expand Down
Loading
Loading