Skip to main content

Test results

Pick a model to see how accessible its components are, with the accessibility skill off and on.

GPT-6 Luna

Skill version 2.3

Totals for the whole run, across 3 generations of each of the 22 components
MeasureSkill offSkill on
Failed acceptance criteria14312
of which WCAG1007
of which Best practice435
Total cost (US dollars)$0.09$0.36
Input tokens199,4426.2 million
Output tokens132,160369,858

Table

Results, totals across all generations

Cost in USD

Failed acceptance criteria

Skill off
4 fails
WCAG
4 fails
Best practice
0 fails
Skill on
0 fails
WCAG
0 fails
Best practice
0 fails

Total cost

Skill off
$0.0029
Skill on
$0.0096

Efficiency, average per generation

Input tokens include cache reads.

Input tokens

Skill off
1,547 tokens
Skill on
47,192 tokens

Output tokens

Skill off
1,633 tokens
Skill on
3,029 tokens

Turns

Skill off
2 turns
Skill on
5 turns

Time

Skill off
15 seconds
Skill on
32 seconds

Cost

Skill off
$0.00097
Skill on
$0.0032
Prompt given to the model
Build a data table in a single self-contained HTML file (inline CSS and JS, no build step, no external libraries). Give the table the title "Monthly rainfall in millimetres by city, 2024". Directly above or with the table, include this introductory sentence: "Figures show total rainfall in millimetres, with one row per city and one column for each month." The table has five columns, in this order: City, January, February, March, April. The rows, in this order, are: - Sydney: 101, 118, 130, 127 - Melbourne: 47, 52, 50, 58 - Brisbane: 160, 175, 92, 73 - Perth: 9, 18, 20, 45 Output the complete code in one HTML code block.

Generated code

Show

Showing 8 of 8 criteria

Labels and messaging1 criterion

  • None of the table header cells are blank.Best practiceAutomated
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass

Semantic markup4 criteria

  • The table's semantics (table, row and cell roles) are included in the accessibility tree.WCAG 1.3.1Automated
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • The caption is correctly associated with the table in the accessibility tree, with the table being labelled by the caption element.WCAG 1.3.1Automated
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • The summary is programmatically associated with the table.WCAG 1.3.1Judgement
    Skill off

    3/3 failed

    • Generation 1: Fail
    • Generation 2: Fail
    • Generation 3: Fail
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • The column headers are programmatically associated with the data cells they describe.WCAG 1.3.1Automated
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass

Visual design2 criteria

  • The table uses styling to differentiate the header cells from the data cells.Best practiceJudgement
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • All text meets the minimum contrast ratio of 4.5:1 against the background colours, or 3:1 for large-scale text.WCAG 1.4.3Automated
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass

Adaptive UI1 criterion

  • The table can be viewed at 320px without loss of content or functionality; the table is allowed to scroll horizontally within its own container.WCAG 1.4.10Browser
    Skill off

    1/3 failed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Fail
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass

Back to top