All plugins

dsh-eval-infra

Verified

by TT-Wang · UI & Clients

Paired A/B evaluation infrastructure for DeepSeek Harness (dsh) components: interleaved repeated runs through the real runtime, verifier self-checks, one-variable arms, regression gating, cache- and calendar-aware cost, CLI + web UI

Verified plugin

Depends on the Cordis runtime or ships a cordis.yml, so it loads as a real dsh plugin.

What we found in the repo

  • — depends on @deepseek-ai/cordis
  • — depends on @deepseek-ai/dsh-llm
  • — npm package @dsh-external/dsh-eval-infra

Installing

Install the package, then register it in your cordis.yml:

npm install @dsh-external/dsh-eval-infra
# cordis.yml
plugins:
  dsh-eval-infra:

Plugin keys and config options vary — check the repo's README before copying this in. dsh is in developer preview and its loader format is still changing.

Before you install

A listing here is not a security audit. The tier above records whether this repo is wired as a real dsh plugin — not whether it is safe to run. A plugin executes with your agent's permissions: your files, your shell, your network. How to vet a dsh plugin before installing

Found malware or an impersonation in this repo? Report this listing

Repository details

Stars
1
Forks
0
Open issues
0
Language
Python
License
BSD-3-Clause
npm package
@dsh-external/dsh-eval-infra @ 0.1.0
Created
2026-09-03
Last push
2026-09-09

Topics

ab-testingagent-evaluationdeepseek-harnessdsh-pluginllm-evaluation

More in UI & Clients