Skip to main content

Test results

Pick a model to see how accessible its components are, with the accessibility skill off and on.

Claude Fable 5.1

Skill version 2.3

Totals for the whole run, across 3 generations of each of the 22 components
MeasureSkill offSkill on
Failed acceptance criteria492
of which WCAG372
of which Best practice120
Total cost (US dollars)$22.27$70.03
Input tokens1.0 million11.1 million
Output tokens347,316745,150

Icon button

Results, totals across all generations

Cost in USD

Failed acceptance criteria

Skill off
0 fails
WCAG
0 fails
Best practice
0 fails
Skill on
0 fails
WCAG
0 fails
Best practice
0 fails

Total cost

Skill off
$0.84
Skill on
$4.40

Efficiency, average per generation

Input tokens include cache reads.

Input tokens

Skill off
8,231 tokens
Skill on
248,116 tokens

Output tokens

Skill off
4,487 tokens
Skill on
16,272 tokens

Turns

Skill off
3 turns
Skill on
11 turns

Time

Skill off
54 seconds
Skill on
198 seconds

Cost

Skill off
$0.28
Skill on
$1.47
Prompt given to the model
Build an icon button in a single self-contained HTML file (inline CSS and JS, no build step, no external libraries). The button shows only an icon (for example a magnifying-glass search icon) with no visible text label. Include one enabled icon button and one disabled icon button. Output the complete code in one HTML code block.

Generated code

Show

Showing 9 of 9 criteria

Labels and messaging1 criterion

  • The icon button has a programmatic accessible name (aria-label, aria-labelledby, or title) and no visible text label.WCAG 4.1.2Automated
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass

Semantic markup3 criteria

  • The button's role is included in the accessibility tree.WCAG 4.1.2Automated
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • The icon button's accessible name is included in the accessibility tree.WCAG 4.1.2Automated
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • If the button is disabled, the button's disabled state is included in the accessibility tree.WCAG 4.1.2Automated
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass

Keyboard4 criteria

  • The button is focusable using a keyboard.WCAG 2.1.1Browser
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • The button is activated by pressing the Space or Enter keys on the keyboard.Best practiceBrowser
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • The button has a focus style when it receives focus using a keyboard.WCAG 2.4.7Browser
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
  • The keyboard focus style still renders in forced-colours mode (e.g. Windows High Contrast Mode).Best practiceBrowser
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass

Visual design1 criterion

  • If the button uses a custom focus style, the focus indicator has a contrast ratio of at least 3:1 against its background colour.WCAG 1.4.11Browser
    Skill off

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass
    Skill on

    3/3 passed

    • Generation 1: Pass
    • Generation 2: Pass
    • Generation 3: Pass

Back to top