No release verdicts yet. Scored jobs show how many tools were tested. The rest are not tested.
Queue
VC1 · Build a landing page from a prompt · Not testedVC2 · Build a full-stack app from a prompt · 1 scoredVC3 · Deploy and host a vibe-coded app · Not testedVC4 · Add auth and a database to an app · 1 scoredVC5 · Find security holes in a vibe-coded repo · 1 scoredVC6 · Turn a design or screenshot into UI code · 1 scoredCA1 · Inline autocomplete and chat in the IDE · 3 scoredCA2 · Multi-file refactor with an agent · 3 scoredCA3 · Turn a GitHub issue into a PR autonomously · 2 scoredCA4 · AI code review on pull requests · 1 scoredCA5 · Generate unit and end-to-end tests · 4 scoredCA6 · Run a coding model locally or cheaply · 5 scoredMCP1 · Connect an agent to GitHub · 1 scoredMCP2 · Let an agent control a browser · 4 scoredMCP3 · Let an agent query a database · 1 scoredMCP4 · Give an agent web search and live docs · 1 scoredMCP5 · Build or host your own MCP server · 4 scoredMCP6 · Find and install MCP servers · 2 scoredGD1 · Generate 2D sprites and pixel art · 1 scoredGD2 · Generate 3D models for a game · 1 scoredGD3 · Make sound effects and music · 1 scoredGD4 · Voice and dialogue for NPCs · Not testedGD5 · Prototype a playable game from a prompt · Not testedGD6 · Animate characters with AI (mocap/rigging) · Not testedVC1 · Build a landing page from a prompt · Not testedVC2 · Build a full-stack app from a prompt · 1 scoredVC3 · Deploy and host a vibe-coded app · Not testedVC4 · Add auth and a database to an app · 1 scoredVC5 · Find security holes in a vibe-coded repo · 1 scoredVC6 · Turn a design or screenshot into UI code · 1 scoredCA1 · Inline autocomplete and chat in the IDE · 3 scoredCA2 · Multi-file refactor with an agent · 3 scoredCA3 · Turn a GitHub issue into a PR autonomously · 2 scoredCA4 · AI code review on pull requests · 1 scoredCA5 · Generate unit and end-to-end tests · 4 scoredCA6 · Run a coding model locally or cheaply · 5 scoredMCP1 · Connect an agent to GitHub · 1 scoredMCP2 · Let an agent control a browser · 4 scoredMCP3 · Let an agent query a database · 1 scoredMCP4 · Give an agent web search and live docs · 1 scoredMCP5 · Build or host your own MCP server · 4 scoredMCP6 · Find and install MCP servers · 2 scoredGD1 · Generate 2D sprites and pixel art · 1 scoredGD2 · Generate 3D models for a game · 1 scoredGD3 · Make sound effects and music · 1 scoredGD4 · Voice and dialogue for NPCs · Not testedGD5 · Prototype a playable game from a prompt · Not testedGD6 · Animate characters with AI (mocap/rigging) · Not tested
Continue CLI 1.5.47 with a local Ollama config. Ping returned pong. The task reply in 86s included a trailing debounce and a handler whose import is an unterminated string. tsc reported TS1002. The repair reply was tool-call JSON and did not change the file. Evidence: evidence/2026-10-16/batch3/continue/.
Evidence · Qwen Code
Qwen Code 0.25.2 with --auth-type openai and Ollama's /v1 endpoint. A 60s ping returned tool-call text. A 20s task returned grep_search JSON and did not write the files. A 120s run with --max-tool-calls 0 was cancelled with an empty stdout. Evidence: evidence/2026-10-16/batch3/qwen-code/.
