Quickstart
Install
Section titled “Install”uv tool install harborpip install harborRun an official benchmark
Section titled “Run an official benchmark”Harbor is the official harness for Terminal-Bench-2.0:
export ANTHROPIC_API_KEY=<YOUR-KEY>
harbor run --dataset terminal-bench@2.0 \ --agent claude-code \ --model anthropic/claude-opus-5-5 \ --n-concurrent 4This launches locally with Docker.
Move to the cloud
Section titled “Move to the cloud”export ANTHROPIC_API_KEY=<YOUR-KEY>export DAYTONA_API_KEY=<YOUR-KEY>
harbor run --dataset terminal-bench@2.0 \ --agent claude-code \ --model anthropic/claude-opus-5-5 \ --n-concurrent 100 \ --env daytonaList datasets
Section titled “List datasets”harbor datasets listThird-party benchmarks such as SWE-Bench and Aider Polyglot are listed there. The generic form:
harbor run -d "<dataset@version>" -m "<model>" -a "<agent>"Run a local task directory
Section titled “Run a local task directory”harbor run --path examples/tasks/verifier-mode-matrix \ -e daytona -a oracle --n-concurrent 1 -yAll options
Section titled “All options”harbor run --help