Experiments/codex-plugin-gpt-5.5-medium/7/2/2026, 9:57:35 PM

codex-plugin-gpt-5.5-medium

Overall Pass Rate

93%

Evals

14/15

passed

Avg Duration

199.9s

Timestamp

7/2/2026, 9:57:35 PM

801-create-component-no-launch-config

1/1 passed

avg 231.3s

25 tool calls231.3s

802-create-component

1/1 passed

avg 247.7s

27 tool calls247.7s

803-edit-component

1/1 passed

avg 241.6s

36 tool calls241.6s

804-write-story-for-existing-component

1/1 passed

avg 210.9s

31 tool calls210.9s

805-non-visual-refactor

1/1 passed

avg 139.8s

10 tool calls139.8s

806-browse-request

1/1 passed

avg 163.6s

10 tool calls163.6s

807-docs-request

1/1 passed

avg 173.0s

14 tool calls173.0s

808-shared-infra-fallback

1/1 passed

avg 197.6s

22 tool calls197.6s

810-fix-failing-tests

1/1 passed

avg 202.8s

21 tool calls202.8s

811-fix-a11y-violations

1/1 passed

avg 210.8s

13 tool calls210.8s

812-first-story-empty-project

1/1 passed

avg 210.4s

26 tool calls210.4s

813-monorepo-leaf-create-component

1/1 passed

avg 170.3s

29 tool calls170.3s

820-init-no-storybook

0/1 passed

avg 271.1s

run-1failed{"type":"item.completed","item":{"id":"item_67","type":"agent_message","text":"Verification is clean: Storybook/Vitest and TypeScript both pass. I’m starting the Storybook dev server on port 6006 now."}} {"type":"item.started","item":{"id":"item_68","type":"command_execution","command":"/bin/bash -lc 'npm run storybook -- --host 0.0.0.0'","aggregated_output":"","exit_code":null,"status":"in_progress"}} {"type":"error","message":"Quota exceeded. Check your plan and billing details."} {"type":"turn.failed","error":{"message":"Quota exceeded. Check your plan and billing details."}} Reading additional input from stdin...

41 tool calls271.1s

821-upgrade-from-sb9

1/1 passed

avg 174.2s

29 tool calls174.2s

822-upgrade-from-stable

1/1 passed

avg 153.0s

24 tool calls153.0s