What did Hlido score HKUDS/DeepCode?

HKUDS/DeepCode scored 90/100 (VITAL) in Hlido's independent, hands-on review.

Does any vendor pay Hlido for placement?

No. Hlido takes no money from the agents it rates — scoring weights stay private and the evidence behind every verdict is public.

Coding · Reviewed 2026-07-21

HKUDS/DeepCode

Name: HKUDS/DeepCode review
Item: HKUDS/DeepCode
Rating: 90
Author: Hlido Editor

VITAL · 90/100

Research-lab multi-agent coding system with a real benchmark to back the claims — Paper2Code is the standout, and the PaperBench number is checkable.

Visit HKUDS/DeepCode →

Hlido Editor · 2026-07-21

DeepCode comes out of the Data Intelligence Lab at the University of Hong Kong, and the academic pedigree is doing useful work here: unlike most 'AI turns ideas into production code' repos, this one cites a published paper (arXiv:2512.07921) and a benchmark result — 75.9% on OpenAI's PaperBench, above the quoted top-ML-PhD baseline of 72.4%. That is a claim you can actually go verify, which is rare in this category and is exactly the kind of trust signal Hlido rewards. The system spans three workflows — Paper2Code (papers/algorithms to implementations), Text2Web, and Text2Backend — coordinated by a multi-agent architecture with planning, document-analysis, code-generation and debugging roles, plus CodeRAG for retrieving patterns and MCP integration for filesystem/fetch/exec tools. At 16k+ stars it has real community traction. The honest caveats: benchmark leadership is a snapshot, not a durability guarantee; 'production-ready code' is a strong phrase for any autonomous generator and should be read as 'a strong first draft under test loops' rather than ship-it-unreviewed; and the setup (Python 3.9+, Node 18+, config JSON, API keys) is researcher-grade, not one-click.

Why VITAL

VITAL (90) because it pairs a genuinely differentiated capability (paper-to-code) with a public, third-party-checkable benchmark and a named academic maintainer — the trust and evidence signals are unusually strong for an open-source agent. The MIT license, active releases (v1.3.0), and MCP tool integration round it out. The one thing keeping it honest rather than infallible is that autonomous 'production-ready' output still warrants human review.

What it does well

Paper2Code turns research papers/algorithms into runnable implementations — a genuinely differentiated capability
Backs claims with a published paper and a checkable PaperBench result (75.9%)
Multi-agent architecture with autonomous test-until-pass loops and conflict detection in team mode
MCP integration for filesystem, fetch, GitHub and code execution
Named academic maintainer (HKU Data Intelligence Lab) and strong community traction (16k+ stars)

What it fails at

'Production-ready code' overstates what any autonomous generator should be trusted with unreviewed
Setup is researcher-grade (Python + Node + config JSON + keys), not one-click
Benchmark leadership is a point-in-time snapshot in a fast-moving field
Real-world reliability outside benchmark tasks is not yet independently established

Best for

Researchers reproducing paper implementations quickly
Teams prototyping web/backend scaffolds from natural-language specs
Engineers who want an agent whose claims come with a citable benchmark
Anyone integrating a coding agent via MCP into a larger toolchain

Not recommended for

Non-technical users wanting a hosted, zero-setup product
Teams that will ship generated code without review
Buyers needing commercial support/SLAs rather than a lab-maintained OSS project

Compared to

openhands paper-to-code
OpenHands is the general-purpose autonomous software engineer; DeepCode's differentiator is the paper-to-code workflow and its published benchmark. Choose DeepCode for research-implementation tasks, OpenHands for broad end-to-end dev automation.
aider autonomy-vs-control
Aider is a lightweight human-in-the-loop pair programmer; DeepCode is a heavier autonomous multi-agent system aimed at generating whole implementations. Aider for controlled edits, DeepCode for spec/paper-to-scaffold generation.

Agent relevance

API CLI MCP Behavioral-testable

Agentic-Commerce Readiness 24/100 · CLOSED

Independent readiness for agent delegation & transaction. How it’s scored · check live

Strong. Offers a CLI, a headless REST API with WebSocket streaming for CI/CD, and integrates external tools over MCP. Can be embedded as an autonomous code-generation stage in a larger agent workflow.

Agent-friendly score: 8/10

What we saw

1 screenshot captured by the Hlido engine during the reviewed run (run-f18e5d5279d30201-github-com). Our own captures — not vendor marketing material.

HKUDS/DeepCode — run screenshot 1 (home.png) — home.png

Evidence

Paper2Code / Text2Web / Text2Backend multi-agent workflows — source (2026-07-21) verified
75.9% on OpenAI PaperBench (vs 72.4% baseline) — source (2026-07-21) verified
Published paper arXiv:2512.07921; MIT license; 16.1k stars — source (2026-07-21) verified
MCP integration for filesystem/fetch/GitHub/exec — source (2026-07-21) verified

Public-surface checklist

✓ homepage_loads (required)
✓ primary_value_prop (required)
✓ cta_present (required)
✓ pricing_or_access
✓ evidence_or_demo

scorecard.json · registry · methodology

Verdict by Hlido Editor · Method: public-surface-tier-1+editorial-narrative-v2 · Methodology version 2026.07 · Next review due 2026-10-19

Embed this trust badge

Live, always-current independent score — free to embed on your site or README. No vendor pays for placement.

Markdown

[![Hlido trust score](https://hlido.eu/badge/hkuds-deepcode.svg)](https://hlido.eu/check/?agent=hkuds-deepcode)

HTML

<a href="https://hlido.eu/check/?agent=hkuds-deepcode"><img src="https://hlido.eu/badge/hkuds-deepcode.svg" alt="Hlido trust score"></a>