The four numbers are buttons. Click 29 failed to see only broken sessions. Click a row to read the conversation on the right. When you are ready, press the gold button — that is the only action that builds knowledge.
Collected traces
Recorded agent sessions from several products, stored as episodes.
Where the data came from
Click a source to show only its episodes. Click the number 6 sources above to come back here.
What happened in this session
Empty until you click a row in the table. Prefer a red fail row — those feed failure modes.
Every session (episode)
Click a row to open it. Use the chips or the numbers above to filter.
A cell is not a spreadsheet cell. It is a bucket: same kind of user, same kind of task, same topic. Click failure modes to jump to step 3, or press Next.
AKB knowledge
Grouped sessions. Dual representation: example traces + structured failure modes.
Cells — click a row that has failures
Opens the failure-mode list filtered to that cell. Accept is the share of sessions in the cell that succeeded.
Support is how many failed sessions look like this. Click a card (or the gold strip on it). That does not run anything yet — it only opens the skill-optimization form with this failure filled in.
Failure modes
Repeated ways the agent broke. This portal’s working example.
Same as eval-platform’s judge token: paste or upload a Cursor API key, click Test connection, then pick teacher / student / optimizer from that key’s catalog. Each iteration writes a new SKILL.md; the result panel diffs it against the previous file. The key is this-run only — never stored in the job JSON.
Skill optimization
Start from Failure modes if this form is empty.
Job config — what you are asking for
Eval-platform rule: never logged, not written to jobs, cost rides on your token. Upload a file or paste. Optional base URL if you go through an OpenAI-compatible gateway.
Not connected. Run optimization will use the local fake teacher.
Diagnoses the failure. After Test connection this list is the models your key can actually call.
Gates the rewrite (no-retry / preservation). Same catalog as teacher once the key is live.
Rewrites SKILL.md. Can be the same model as teacher.
0.2 is conservative. Eval-platform pins temperature for comparable runs.
Each pass diffs new SKILL.md vs the previous file. Eval-platform asks for ≥3 LLM samples; default 3 when a key is connected, 1 for the local teacher.
Result — per-iteration file diff
Each block is one rewrite: diagnosis, student gate, then unified diff of old vs new SKILL.md.