Test results
Pick a model to see how accessible its components are, with the accessibility skill off and on.
GPT-6.1 Terra
Skill version 2.3
| Measure | Skill off | Skill on |
|---|---|---|
| Failed acceptance criteria | 34 | 1 |
| of which WCAG | 25 | 1 |
| of which Best practice | 9 | 0 |
| Total cost (US dollars) | $0.61 | $2.61 |
Select
Results, totals across all generations
Failed acceptance criteria
Each acceptance criterion is counted once per component if it fails in any generation.
- Skill off
- 1 fail
- WCAG
- 1 fail
- Best practice
- 0 fails
- Skill on
- 0 fails
- WCAG
- 0 fails
- Best practice
- 0 fails
Efficiency, average per generation
Input tokens include cache reads.
Cost in USD
Input tokens
- Skill off
- 830 tokens
- Skill on
- 59,374 tokens
Output tokens
- Skill off
- 873 tokens
- Skill on
- 1,990 tokens
Turns
- Skill off
- 1 turn
- Skill on
- 6 turns
Time
- Skill off
- 11 seconds
- Skill on
- 31 seconds
Cost
- Skill off
- $0.0052
- Skill on
- $0.03
Generated components
Prompt given to the model
Acceptance criteria
Showing 22 of 22 criteria
Labels and messaging1 criterion
- The select has a permanent visible label.WCAG 3.3.2AutomatedSkill off
3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Semantic markup10 criteria
- The select's role is included in the accessibility tree.WCAG 4.1.2AutomatedSkill off
3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
- The select has an accessible name in the accessibility tree.WCAG 4.1.2AutomatedSkill off
3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
- The select's accessible name contains the text of its visible label.WCAG 2.5.3AutomatedSkill off
3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
- The select's accessible name matches its visible label, or at least starts with the text of the visible label.Best practiceAutomatedSkill off
3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
- The options' role and text are included in the accessibility tree.WCAG 4.1.2AutomatedSkill off
3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
- The select's current value is included in the accessibility tree.WCAG 4.1.2AutomatedSkill off
3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
- The select has an accessible description (a hint that helps people choose) included in the accessibility tree.WCAG 1.3.1AutomatedSkill off
3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
- The select's required state is included in the accessibility tree.WCAG 1.3.1AutomatedSkill off
3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
- The error message is programmatically associated with the select and is included in the accessibility tree.WCAG 1.3.1AutomatedSkill off
3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
- The select's expanded or collapsed state is included in the accessibility tree.WCAG 4.1.2AutomatedSkill off
3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Keyboard7 criteria
- The select is focusable using a keyboard.WCAG 2.1.1BrowserSkill off
3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
- People can select an option using a keyboard.WCAG 2.1.1BrowserSkill off
3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
- Pressing Enter, Space, or the arrow keys opens the dropdown (custom combobox; native selects are handled by the browser).Best practiceBrowserSkill off
0/3 passed
- Generation 1: Unmeasured
- Generation 2: Unmeasured
- Generation 3: Unmeasured
Skill on0/3 passed
- Generation 1: Unmeasured
- Generation 2: Unmeasured
- Generation 3: Unmeasured
- Pressing Escape when the dropdown is open closes it (custom combobox; native selects are handled by the browser).Best practiceBrowserSkill off
0/3 passed
- Generation 1: Unmeasured
- Generation 2: Unmeasured
- Generation 3: Unmeasured
Skill on0/3 passed
- Generation 1: Unmeasured
- Generation 2: Unmeasured
- Generation 3: Unmeasured
- The options have a focus style when they receive focus using a keyboard (custom combobox; native selects are handled by the browser).WCAG 2.4.7BrowserSkill off
0/3 passed
- Generation 1: Unmeasured
- Generation 2: Unmeasured
- Generation 3: Unmeasured
Skill on0/3 passed
- Generation 1: Unmeasured
- Generation 2: Unmeasured
- Generation 3: Unmeasured
- The select has a focus style when it receives focus using a keyboard.WCAG 2.4.7BrowserSkill off
3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
- The keyboard focus style still renders in forced-colours mode (e.g. Windows High Contrast Mode).Best practiceBrowserSkill off
3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Visual design4 criteria
- The error state does not use colour as the only method to indicate an error.WCAG 1.4.1AutomatedSkill off
3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
- All text meets the minimum contrast ratio of 4.5:1 against the background colour, or 3:1 for large-scale text.WCAG 1.4.3AutomatedSkill off
3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
- The option focus style has a contrast ratio of at least 3:1 against the option's resting appearance (custom combobox; native selects are handled by the browser).WCAG 1.4.11BrowserSkill off
0/3 passed
- Generation 1: Unmeasured
- Generation 2: Unmeasured
- Generation 3: Unmeasured
Skill on0/3 passed
- Generation 1: Unmeasured
- Generation 2: Unmeasured
- Generation 3: Unmeasured
- If the select uses a custom focus style, the focus indicator has a contrast ratio of at least 3:1 against its background colour.WCAG 1.4.11BrowserSkill off
3/3 failed
- Generation 1: Fail
- Generation 2: Fail
- Generation 3: Fail
Skill on3/3 passed
- Generation 1: Pass
- Generation 2: Pass
- Generation 3: Pass
Feedback on this result
Spotted a result that looks wrong, or a problem our tests don’t catch? Let us know. We’ll check it, correct any errors and use your feedback to improve the tests.
