Jobs
Each job has one standard test task. Tools filed under it are candidates. They are not ranked until agents run that task and an editor checks the top results.
Vibe coding
Build a landing page from a prompt
Prompt: 'Landing page for an indie game studio with hero, features, email signup.' Judge design, responsiveness, working form.
Vibe coding · 8 candidates
Build a full-stack app from a prompt
Prompt: 'Todo app with user login, saved tasks per user, and sharing.' Judge whether auth + persistence work end to end.
Vibe coding · 12 candidates
Deploy and host a vibe-coded app
Deploy the same Next.js repo with one env var and a custom domain; measure time to live URL and free-tier limits.
Vibe coding · 8 candidates
Add auth and a database to an app
Add email + Google login and a 'notes' table with per-user access rules to a starter app.
Vibe coding · 8 candidates
Find security holes in a vibe-coded repo
Scan a seeded repo with a leaked API key, SQL injection and a vulnerable dependency; count true/false positives.
Vibe coding · 6 candidates
Turn a design or screenshot into UI code
Input a dashboard screenshot; output React/Tailwind code; judge visual match and code quality.
Vibe coding · 8 candidates
Coding agents
Inline autocomplete and chat in the IDE
Implement a debounce utility and a REST handler in an existing TS repo; judge suggestion accuracy and edits needed.
Coding agents · 13 candidates
Multi-file refactor with an agent
Rename a core module and migrate a callback API to async/await across ~30 files; tests must pass.
Coding agents · 19 candidates
Turn a GitHub issue into a PR autonomously
Assign 3 seeded issues (bug, small feature, docs) in a sample repo; judge merged-ready PRs without human edits.
Coding agents · 9 candidates
AI code review on pull requests
Review a PR with 5 seeded bugs; count bugs caught vs noise comments.
Coding agents · 7 candidates
Generate unit and end-to-end tests
Reach 80% coverage on an untested module; tests must be meaningful and pass.
Coding agents · 8 candidates
Run a coding model locally or cheaply
Run a coding model on a 16GB laptop or via cheap API; complete the CA1 task; record cost/speed.
Coding agents · 15 candidates
MCP servers
Connect an agent to GitHub
Via MCP: list open issues, create a branch, open a PR with a one-line change.
MCP servers · 3 candidates
Let an agent control a browser
Via MCP: log into a demo site, fill a form, take a screenshot, extract a table.
MCP servers · 10 candidates
Let an agent query a database
Via MCP: inspect schema, answer 3 questions with SQL, create a migration safely.
MCP servers · 4 candidates
Give an agent web search and live docs
Answer 5 questions needing current library docs/news; judge accuracy and citations.
MCP servers · 9 candidates
Build or host your own MCP server
Build a 'weather' MCP server with 2 tools, test it, and deploy it remotely with auth.
MCP servers · 7 candidates
Find and install MCP servers
Find, install and configure a Slack and a Postgres MCP server into Cursor and Claude; time it.
MCP servers · 12 candidates
AI for game dev
Generate 2D sprites and pixel art
Make a 4-direction walk-cycle sprite sheet for a pixel-art knight at 64x64, consistent style.
AI for game dev · 12 candidates
Generate 3D models for a game
Text/image to a game-ready low-poly treasure chest with textures; judge topology, UVs, export to Unity/Godot.
AI for game dev · 11 candidates
Make sound effects and music
Create 5 SFX (jump, coin, hit, explosion, UI click) and a 60s looping chiptune track; check licence for commercial use.
AI for game dev · 5 candidates
Voice and dialogue for NPCs
Voice 10 lines for 2 characters and run a short in-engine conversational NPC; judge quality, latency, cost.
AI for game dev · 6 candidates
Prototype a playable game from a prompt
Prompt: 'Browser platformer with 3 levels, coins and an enemy.' Judge playability and editability.
AI for game dev · 7 candidates
Animate characters with AI (mocap/rigging)
Rig a humanoid and produce run/jump animations from video or text; export FBX.
AI for game dev · 8 candidates
24 jobs in this index.