Skip to content

Pull requests: open-compass/VLMEvalKit

New pull request New
52 Open 957 Closed
52 Open 957 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Benchmark] Add MDPBench support
#1597 opened Jul 4, 2026 by Delores-Lin Loading…
[Benchmark] Add support for LongDocURL
#1595 opened Jul 1, 2026 by zhaowei-wang-nlp Contributor Loading…
[Fix] Correct LOCAL_RANK default value to 0 in run.py
#1593 opened Jul 1, 2026 by pranaysb Loading…
1
Add defaultdict import to omnidocbench.py
#1585 opened Jun 27, 2026 by shenyunhang Contributor Loading…
[Dataset] Add BenchCAD (CAD code-understanding VQA)
#1583 opened Jun 25, 2026 by HaozheZhang6 Loading…
[Benchmark] Add support for FinixDocBench benchmark
#1579 opened Jun 17, 2026 by Helen1p Loading…
[Benchmark] Add support for realdoc-bench benchmark
#1577 opened Jun 13, 2026 by Helen1p Loading…
[Benchmark] Add support for olmOCR-bench benchmark
#1576 opened Jun 13, 2026 by Helen1p Loading…
[Benchmark] Add support for ParseBench benchmark WIP
#1575 opened Jun 12, 2026 by Helen1p Loading…
1
[Benchmark] Add support for OmniDocBench v1.6 benchmark
#1572 opened Jun 10, 2026 by Helen1p Loading…
[Mode] add support for flyai-vl
#1571 opened Jun 10, 2026 by zhangxuewei-xirui Loading…
2
Add BGPT REFUTE benchmark WIP
#1569 opened Jun 5, 2026 by connerlambden Loading…
1
[Feature] Support DiffSpot (fine-grained visual change detection on web UIs)
#1568 opened Jun 4, 2026 by banyinjushi Loading…
3 tasks done
2
[Feature] Add Rebellions (RBLN) NPU evaluation backend
#1566 opened Jun 2, 2026 by rebel-hwkim Loading…
[Benchmark] Add support for MaRVL, xGQA and ALM-Bench
#1564 opened Jun 1, 2026 by inakiLakunza Contributor Loading…
[Benchmark]Add TextHalu-Bench
#1561 opened May 31, 2026 by Sammy20207109 Loading…
Handle recoverable truncated image payloads
#1554 opened May 25, 2026 by rajantripathi Loading…
1
[Fix] Video-MME-v2: improve acc calculation and data preparation
#1551 opened May 20, 2026 by EliYuan30 Loading…
fix: guard choices[0] and message=None before content access
#1550 opened May 17, 2026 by qizwiz Loading…
[Cleanup] Remove unused Polygon3 dependency (#1528)
#1548 opened May 16, 2026 by SHAI-Akshay-Tripathi Contributor Loading…
1
[Benchmark] Add Spatial-DISE benchmark
#1542 opened May 9, 2026 by shinmohuang Loading…
[Fix] Fix default judge model selection conflict in run.py and tools.py
#1532 opened May 6, 2026 by TianhaoLiang2000 Collaborator Loading…
1
[Fix] Fix judge intermediate result caching and resume support
#1531 opened May 6, 2026 by TianhaoLiang2000 Collaborator Loading…
[Benchmark] Add support for MMOral-Uni benchmark
#1527 opened Apr 26, 2026 by isjinghao Contributor Loading…
5
[Benchmark] Add support for Ref-L4_test benchmark
#1525 opened Apr 22, 2026 by rshube Loading…
ProTip! Updated in the last three days: updated:>2026-07-01.