Skip to content

Pull requests: OpenEuroLLM/oellm-eval

New pull request New
13 Open 76 Closed
13 Open 76 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat: evaluate a model's tasks in one lm_eval call instead of one per task
#110 opened Aug 19, 2026 by gdols Loading…
1
fix: collect every top-level group aggregate instead of the first one
#109 opened Aug 19, 2026 by gdols Loading…
1
docs: add lighteval acc_norm workaround
#108 opened Aug 12, 2026 by Nivedhitha-Duggi Loading…
1
[DRAFT][FOR REVIEW] Merging elliot eval platform with oellm
#107 opened Aug 11, 2026 by islobozhan • Draft
Add Okapi HellaSwag new_benchmark
#102 opened Jul 2, 2026 by haideraltahan Collaborator Loading…
add MMMLU new_benchmark
#98 opened Jun 30, 2026 by haideraltahan Collaborator Loading…
fix singularity bind params when using --lm_eval_include_path argument
#88 opened Jun 11, 2026 by jindrahelcl Loading…
1
Eval deps
#79 opened Jun 2, 2026 by kpoeppel Loading…
6
Collect results all metrics enhancement New feature or request
#77 opened May 27, 2026 by haideraltahan Collaborator Loading…
1
6
Added Xcopa new_benchmark
#66 opened May 18, 2026 by haideraltahan Collaborator Loading…
Add MultiBLIMP new_benchmark
#65 opened May 18, 2026 by haideraltahan Collaborator Loading…
Add pretrain decom eval
#63 opened May 13, 2026 by kerkathy Member Loading…
Add function calling benchmark using Gorilla OpenFunctions v2
#62 opened Apr 23, 2026 by BirgerMoell Loading…
2
ProTip! Updated in the last three days: updated:>2026-08-16.