Test results
Pick a model to see how accessible its components are, with the accessibility skill off and on.
Grok 4.7
Skill version 2.3
| Measure | Skill off | Skill on |
|---|---|---|
| Failed acceptance criteria | 90 | 9 |
| of which WCAG | 60 | 8 |
| of which Best practice | 30 | 1 |
| Total cost (US dollars) | $7.93 | $51.79 |
| Input tokens | 2.6 million | 35.3 million |
| Output tokens | 805,511 | 3.1 million |
Table
Results, totals across all generations
Cost in USD
Failed acceptance criteria
- Skill off
- 3 fails
- WCAG
- 3 fails
- Best practice
- 0 fails
- Skill on
- 1 fail
- WCAG
- 1 fail
- Best practice
- 0 fails
Total cost
- Skill off
- $0.13
- Skill on
- $4.13
Efficiency, average per generation
Input tokens include cache reads.
Input tokens
- Skill off
- 19,397 tokens
- Skill on
- 1.3 million tokens
Output tokens
- Skill off
- 3,742 tokens
- Skill on
- 64,021 tokens
Turns
- Skill off
- 4 turns
- Skill on
- 19 turns
Time
- Skill off
- 67 seconds
- Skill on
- 893 seconds
Cost
- Skill off
- $0.04
- Skill on
- $1.38
Prompt given to the model
Build a data table in a single self-contained HTML file (inline CSS and JS, no build step, no external libraries). Give the table the title "Monthly rainfall in millimetres by city, 2024". Directly above or with the table, include this introductory sentence: "Figures show total rainfall in millimetres, with one row per city and one column for each month." The table has five columns, in this order: City, January, February, March, April. The rows, in this order, are:
- Sydney: 101, 118, 130, 127
- Melbourne: 47, 52, 50, 58
- Brisbane: 160, 175, 92, 73
- Perth: 9, 18, 20, 45
Output the complete code in one HTML code block.
Generated code
Show
Showing 8 of 8 criteria
Labels and messaging1 criterion
- None of the table header cells are blank.Best practiceAutomatedSkill off
3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Semantic markup4 criteria
- The table's semantics (table, row and cell roles) are included in the accessibility tree.WCAG 1.3.1AutomatedSkill off
3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
- The caption is correctly associated with the table in the accessibility tree, with the table being labelled by the caption element.WCAG 1.3.1AutomatedSkill off
3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
- The summary is programmatically associated with the table.WCAG 1.3.1JudgementSkill off
3/3 failed
- Generation 1: Fail
- Generation 2: Fail
- Generation 3: Fail
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
- The column headers are programmatically associated with the data cells they describe.WCAG 1.3.1AutomatedSkill off
3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Visual design2 criteria
- The table uses styling to differentiate the header cells from the data cells.Best practiceJudgementSkill off
3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
- All text meets the minimum contrast ratio of 4.5:1 against the background colours, or 3:1 for large-scale text.WCAG 1.4.3AutomatedSkill off
3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Adaptive UI1 criterion
- The table can be viewed at 320px without loss of content or functionality; the table is allowed to scroll horizontally within its own container.WCAG 1.4.10BrowserSkill off
3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Skill on1/3 failed
- Generation 1: Pass
- Generation 2: Fail
- Generation 3: Pass