Skip to main content

Test results

Pick a model to see how accessible its components are, with the accessibility skill off and on.

GPT-6.1 Terra

Skill version 2.3

Results for 22 components, each generated 3 times.Each acceptance criterion is counted once per component if it fails in any generation.
MeasureSkill offSkill on
Failed acceptance criteria341
of which WCAG251
of which Best practice90
Total cost (US dollars)$0.61$2.61

Toggle button

Results, totals across all generations

Failed acceptance criteria

Each acceptance criterion is counted once per component if it fails in any generation.

Skill off
1 fail
WCAG
1 fail
Best practice
0 fails
Skill on
0 fails
WCAG
0 fails
Best practice
0 fails

Efficiency, average per generation

Input tokens include cache reads.

Cost in USD

Input tokens

Skill off
1,701 tokens
Skill on
73,269 tokens

Output tokens

Skill off
1,276 tokens
Skill on
2,211 tokens

Turns

Skill off
2 turns
Skill on
7 turns

Time

Skill off
17 seconds
Skill on
35 seconds

Cost

Skill off
$0.0082
Skill on
$0.03

Generated components

Prompt given to the model
Build a toggle button in a single self-contained HTML file (inline CSS and JS, no build step, no external libraries). It is a Mute button: activating it switches muting on and off, and it stays labelled "Mute" in both states. Output the complete code in one HTML code block.

Acceptance criteria

Show

Showing 15 of 15 criteria

Labels and messaging1 criterion

  • The button has a visible label.WCAG 3.3.2Automated
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass

Semantic markup6 criteria

  • The button's role is included in the accessibility tree.WCAG 4.1.2Automated
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • The toggle button's accessible name is included in the accessibility tree.WCAG 4.1.2Automated
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • The button's accessible name contains the text of its visible label.WCAG 2.5.3Automated
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • The button's accessible name matches its visible label exactly, or at least starts with the exact text of the visible label.Best practiceAutomated
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • The button's pressed and not pressed state is included in the accessibility tree (aria-pressed).WCAG 4.1.2Automated
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • Activating the toggle flips its pressed state while the accessible name stays the same.WCAG 4.1.2Browser
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass

Keyboard4 criteria

  • The button is focusable using a keyboard.WCAG 2.1.1Browser
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • The button is activated by pressing the Space or Enter keys on the keyboard.Best practiceBrowser
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • The button has a focus style when it receives focus using a keyboard.WCAG 2.4.7Browser
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • The keyboard focus style still renders in forced-colours mode (e.g. Windows High Contrast Mode).Best practiceBrowser
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass

Visual design4 criteria

  • All text meets the minimum contrast ratio of 4.5:1 against the background colour, or 3:1 for large-scale text.WCAG 1.4.3Automated
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • If the button uses a custom focus style, the focus indicator has a contrast ratio of at least 3:1 against its background colour.WCAG 1.4.11Browser
    Skill off

    2/3 failed

    • Generation 1: Pass
    • Generation 2: Fail
    • Generation 3: Fail
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • Visual information needed to identify the button's pressed state has a contrast ratio of at least 3:1 against adjacent colours.WCAG 1.4.11Browser
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • The button's pressed state does not rely on colour alone to show that it is pressed.WCAG 1.4.1Browser
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass

Feedback on this result

Spotted a result that looks wrong, or a problem our tests don’t catch? Let us know. We’ll check it, correct any errors and use your feedback to improve the tests.

Back to top