Skip to content

Actions: huggingface/lighteval

Build Documentation

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
92 workflow runs
92 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Add subsets for lcb (#587)
Build Documentation #92: Commit ed08481 pushed by NathanHB
February 26, 2025 09:52 2m 1s main
February 26, 2025 09:52 2m 1s
adds aime24, 25 and math500 (#586)
Build Documentation #91: Commit 4c9af85 pushed by NathanHB
February 25, 2025 17:06 1m 37s main
February 25, 2025 17:06 1m 37s
docs: update README to reflect new model evaluation entry points (#581)
Build Documentation #90: Commit 066f84f pushed by NathanHB
February 25, 2025 09:50 1m 27s main
February 25, 2025 09:50 1m 27s
parse seed for vllm (#585)
Build Documentation #89: Commit 95068aa pushed by NathanHB
February 25, 2025 09:50 1m 30s main
February 25, 2025 09:50 1m 30s
Push details without converting fields to str (#572)
Build Documentation #88: Commit 7b42113 pushed by NathanHB
February 25, 2025 09:06 1m 39s main
February 25, 2025 09:06 1m 39s
Add turkish and word (#583)
Build Documentation #87: Commit bd578a8 pushed by clefourrier
February 24, 2025 07:11 1m 33s main
February 24, 2025 07:11 1m 33s
Fix vLLM generation with sampling params (#578)
Build Documentation #86: Commit ebb7377 pushed by lewtun
February 21, 2025 10:30 1m 37s main
February 21, 2025 10:30 1m 37s
Humanity's last exam (#520)
Build Documentation #85: Commit 782afe8 pushed by NathanHB
February 18, 2025 16:01 1m 29s main
February 18, 2025 16:01 1m 29s
Let lighteval support sglang (#552)
Build Documentation #84: Commit 086cf90 pushed by NathanHB
February 18, 2025 14:13 1m 27s main
February 18, 2025 14:13 1m 27s
raise exception when generation size is more than model length (#571)
Build Documentation #83: Commit bee02f7 pushed by NathanHB
February 18, 2025 14:04 1m 30s main
February 18, 2025 14:04 1m 30s
Add extended task for LiveCodeBench codegeneration (#548)
Build Documentation #82: Commit fd479ee pushed by NathanHB
February 18, 2025 09:54 1m 33s main
February 18, 2025 09:54 1m 33s
allows better flexibility for litellm endpoints (#549)
Build Documentation #81: Commit d6de1fe pushed by NathanHB
February 13, 2025 13:37 1m 49s main
February 13, 2025 13:37 1m 49s
typo(vllm): gpu_memory_utilisation typo (#553)
Build Documentation #80: Commit fac17bb pushed by clefourrier
February 12, 2025 18:50 1m 34s main
February 12, 2025 18:50 1m 34s
[VLLM] Allows for max tokens to be set in model config file (#547)
Build Documentation #79: Commit 78b68ab pushed by NathanHB
February 12, 2025 13:25 1m 48s main
February 12, 2025 13:25 1m 48s
fix: broken URLs (#550)
Build Documentation #78: Commit da119e8 pushed by NathanHB
February 12, 2025 12:52 1m 59s main
February 12, 2025 12:52 1m 59s
Fix loading of vllm model from files (#533)
Build Documentation #77: Commit d4e6f59 pushed by NathanHB
February 10, 2025 09:44 1m 23s main
February 10, 2025 09:44 1m 23s
Fix VLLM data-parallel (#541)
Build Documentation #76: Commit 86f6225 pushed by hynky1999
February 6, 2025 13:33 1m 34s main
February 6, 2025 13:33 1m 34s
Bug fix extractive match (#540)
Build Documentation #75: Commit 3c9b0c9 pushed by clefourrier
February 6, 2025 12:35 1m 23s main
February 6, 2025 12:35 1m 23s
Update README.md (#539)
Build Documentation #74: Commit f8405ee pushed by clefourrier
February 6, 2025 12:02 1m 31s main
February 6, 2025 12:02 1m 31s
Pass@k (#519)
Build Documentation #73: Commit 441d7a4 pushed by clefourrier
February 6, 2025 07:57 1m 56s main
February 6, 2025 07:57 1m 56s
Make BLEURT lazy (#536)
Build Documentation #72: Commit 15bdbb8 pushed by clefourrier
February 6, 2025 07:57 2m 11s main
February 6, 2025 07:57 2m 11s
Add GPQA for instruct models (#534)
Build Documentation #71: Commit 1ce7331 pushed by lewtun
February 5, 2025 15:39 1m 27s main
February 5, 2025 15:39 1m 27s
Sync Math-verify (#535)
Build Documentation #70: Commit cb35bea pushed by hynky1999
February 5, 2025 11:34 1m 32s main
February 5, 2025 11:34 1m 32s
Add custom task (bac-fr) for evaluation of models in french (#518)
Build Documentation #69: Commit d7a1f11 pushed by clefourrier
February 3, 2025 16:08 1m 37s main
February 3, 2025 16:08 1m 37s
Update french_evals.py
Build Documentation #68: Commit be7da17 pushed by clefourrier
February 3, 2025 12:13 1m 40s main
February 3, 2025 12:13 1m 40s