Skip to main content

Test results

Pick a model to see how accessible its components are, with the accessibility skill off and on.

GPT-6 Luna

Skill version 2.3

Totals for the whole run, across 3 generations of each of the 22 components
MeasureSkill offSkill on
Failed acceptance criteria14312
of which WCAG1007
of which Best practice435
Total cost (US dollars)$0.09$0.36
Input tokens199,4426.2 million
Output tokens132,160369,858

Disclosure

Results, totals across all generations

Cost in USD

Failed acceptance criteria

Skill off
0 fails
WCAG
0 fails
Best practice
0 fails
Skill on
0 fails
WCAG
0 fails
Best practice
0 fails

Total cost

Skill off
$0.0019
Skill on
$0.01

Efficiency, average per generation

Input tokens include cache reads.

Input tokens

Skill off
2,639 tokens
Skill on
86,201 tokens

Output tokens

Skill off
730 tokens
Skill on
3,472 tokens

Turns

Skill off
3 turns
Skill on
8 turns

Time

Skill off
9 seconds
Skill on
47 seconds

Cost

Skill off
$0.00063
Skill on
$0.0042
Prompt given to the model
Build a delivery information section in a single self-contained HTML file (inline CSS and JS, no build step, no external libraries). It has a button labelled "Show delivery details"; clicking it shows or hides a block of delivery information below it. The delivery information is hidden when the page first loads. Use this exact text for the delivery information: "Standard delivery takes 3 to 5 business days. Express delivery takes 1 to 2 business days and costs an extra $9.95." Output the complete code in one HTML code block.

Generated code

Show

Showing 16 of 16 criteria

Labels and messaging1 criterion

  • The disclosure button has a visible label.WCAG 2.4.6Automated
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass

Semantic markup6 criteria

  • The disclosure button's role is included in the accessibility tree (button, or the native disclosure role a <summary> carries).WCAG 4.1.2Automated
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • The disclosure button's accessible name is included in the accessibility tree.WCAG 4.1.2Automated
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • The disclosure button's expanded or collapsed state is included in the accessibility tree.WCAG 4.1.2Automated
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • If the disclosure is a custom button/content pair, the disclosure button has aria-controls set to the ID of the element containing the disclosed content.WCAG 1.3.1Automated
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • When the content is collapsed, it is not included in the accessibility tree.WCAG 1.3.2Automated
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • The content comes directly after the disclosure button in the accessibility tree.WCAG 1.3.2Browser
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass

Keyboard6 criteria

  • The disclosure button is focusable using the keyboard.WCAG 2.1.1Browser
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • When the content is collapsed and the disclosure button is pressed, the content is expanded and it is included in the accessibility tree.WCAG 1.3.2Browser
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • When the content is expanded and the disclosure button is pressed, the content is collapses and it is not included in the accessibility tree.WCAG 1.3.2Browser
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • When the disclosure button is activated, focus stays on the disclosure button.WCAG 2.4.3Browser
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • The disclosure button has a focus style when it receives focus using a keyboard.WCAG 2.4.7Browser
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • The keyboard focus style still renders in forced-colours mode (e.g. Windows High Contrast Mode).Best practiceBrowser
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass

Visual design2 criteria

  • All text meets the minimum contrast ratio of 4.5:1 against the background colour, or 3:1 for large-scale text.WCAG 1.4.3Automated
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • If the disclosure button uses a custom focus style, the focus style has a contrast ratio of 3:1 against the background colours.WCAG 1.4.11Browser
    Skill off

    0/3 passed

    • Generation 1: Not applicable
    • Generation 2: Not applicable
    • Generation 3: Not applicable
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass

Adaptive UI1 criterion

  • The disclosure content can be viewed at smaller screen widths (320px) without loss of content or functionality, and without requiring horizontal scrolling.WCAG 1.4.10Browser
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass

Back to top