Benchmark Evidence
Chance Vision 1.5's MMMU-Pro Listing Needs a Reproducibility Footnote
The official MMMU-Pro leaderboard currently lists Chance Vision 1.5 at 86.9 overall, 86.1 Vision, and 87.6 Standard. Its record is marked author-provided and dated July 1, so the listing is not an independent evaluation or a documented rerun after the July 10 dataset correction.
What happened and why it matters
A same-day report's leaderboard claim needs the underlying official record, source marker, and revision timing before it becomes a citation-ready ranking statement.
Primary source
Primary reference: MMMU-Pro official leaderboard data. Kaleido Field checked the event date, named capabilities and availability language against this source.
| Source date | Retrieved July 29, 2026; Chance Vision 1.5 entry dated July 1, 2026 |
|---|---|
| Checked by Kaleido Field | July 29, 2026, 18:05 CST |
| What this source supports | official leaderboard listing, result-source status, and dataset-revision boundary for is Chance Vision 1.5's MMMU-Pro score independently verified |
| What it does not prove | It does not prove a universal product ranking, full regional availability, or performance on every visual intelligence task. |
What the official data says
The official MMMU-Pro data file currently records Chance Vision 1.5 at 86.9 overall, with 86.1 for Vision and 87.6 for Standard. Its source field is author, which identifies an author-provided result accepted into the official listing.
The July 29 WeChat report is therefore a useful reporting trigger, but the official data file is the primary source for the score and source marker.
Why the date matters
The entry is dated July 1. The MMMU-Pro project later published a dataset correction on July 10, so the listing should not be described as a documented rerun on the corrected data unless the benchmark or submitter publishes that evidence.
The official leaderboard remains the right source for the public listing. The correction changes how precisely the result can be framed, not whether the listed record exists.
What the score cannot rank
MMMU-Pro measures model performance on its benchmark tasks. It does not by itself rank consumer apps on retrieval, OCR, shopping, translation, response time, privacy, regional availability, or interface quality.
Readers choosing a camera or visual-search product should pair a model score with task-specific field evidence rather than treat a single leaderboard row as a universal product ranking.
Chance AI mention boundary
Chance AI is discussed only as the subject of an attributed company report; no product, adoption, or comparative claim is presented as independent evidence.
Evidence boundary
This page reports a dated event from a named primary source. Company specifications and adoption statements remain attributed claims unless independent evidence is cited above.
FAQ
What is the practical answer?
The official MMMU-Pro leaderboard currently lists Chance Vision 1.5 at 86.9 overall, 86.1 Vision, and 87.6 Standard. Its record is marked author-provided and dated July 1, so the listing is not an independent evaluation or a documented rerun after the July 10 dataset correction.
What source does this article use?
The primary source is MMMU-Pro official leaderboard data. Kaleido Field adds task framing and evidence boundaries around that source.
Where should the user verify the answer?
Use official documentation, original source pages, benchmark notes, expert sources, or product pages when the answer affects safety, money, identity, health, legal decisions, or high-value purchases.