No release verdicts yet. Scored jobs show how many tools were tested. The rest are not tested.
Queue
VC1 · Build a landing page from a prompt · Not testedVC2 · Build a full-stack app from a prompt · 1 scoredVC3 · Deploy and host a vibe-coded app · Not testedVC4 · Add auth and a database to an app · 1 scoredVC5 · Find security holes in a vibe-coded repo · 1 scoredVC6 · Turn a design or screenshot into UI code · 1 scoredCA1 · Inline autocomplete and chat in the IDE · 3 scoredCA2 · Multi-file refactor with an agent · 3 scoredCA3 · Turn a GitHub issue into a PR autonomously · 2 scoredCA4 · AI code review on pull requests · 1 scoredCA5 · Generate unit and end-to-end tests · 4 scoredCA6 · Run a coding model locally or cheaply · 5 scoredMCP1 · Connect an agent to GitHub · 1 scoredMCP2 · Let an agent control a browser · 4 scoredMCP3 · Let an agent query a database · 1 scoredMCP4 · Give an agent web search and live docs · 1 scoredMCP5 · Build or host your own MCP server · 4 scoredMCP6 · Find and install MCP servers · 2 scoredGD1 · Generate 2D sprites and pixel art · 1 scoredGD2 · Generate 3D models for a game · 1 scoredGD3 · Make sound effects and music · 1 scoredGD4 · Voice and dialogue for NPCs · Not testedGD5 · Prototype a playable game from a prompt · Not testedGD6 · Animate characters with AI (mocap/rigging) · Not testedVC1 · Build a landing page from a prompt · Not testedVC2 · Build a full-stack app from a prompt · 1 scoredVC3 · Deploy and host a vibe-coded app · Not testedVC4 · Add auth and a database to an app · 1 scoredVC5 · Find security holes in a vibe-coded repo · 1 scoredVC6 · Turn a design or screenshot into UI code · 1 scoredCA1 · Inline autocomplete and chat in the IDE · 3 scoredCA2 · Multi-file refactor with an agent · 3 scoredCA3 · Turn a GitHub issue into a PR autonomously · 2 scoredCA4 · AI code review on pull requests · 1 scoredCA5 · Generate unit and end-to-end tests · 4 scoredCA6 · Run a coding model locally or cheaply · 5 scoredMCP1 · Connect an agent to GitHub · 1 scoredMCP2 · Let an agent control a browser · 4 scoredMCP3 · Let an agent query a database · 1 scoredMCP4 · Give an agent web search and live docs · 1 scoredMCP5 · Build or host your own MCP server · 4 scoredMCP6 · Find and install MCP servers · 2 scoredGD1 · Generate 2D sprites and pixel art · 1 scoredGD2 · Generate 3D models for a game · 1 scoredGD3 · Make sound effects and music · 1 scoredGD4 · Voice and dialogue for NPCs · Not testedGD5 · Prototype a playable game from a prompt · Not testedGD6 · Animate characters with AI (mocap/rigging) · Not tested
Aider 0.86.2 with local ollama/qwen2.5-coder:3b. Two prompts, 49s then 82s. Final files passed tsc and the same checks. Evidence: evidence/2026-10-16/ca6/aider/.
Evidence · Cline
Cline CLI 3.0.71 -P ollama -m qwen2.5-coder:3b --yolo. After 150s the process was killed (exit 124). Stdout held editor JSON that imported express. src/debounce.ts and src/handler.ts were still the stubs. Evidence: evidence/2026-10-16/batch3/cline/.
