Agent systems · Playbooks · Work in progress

Agent Lab

Working AI systems from my own setup, each written up as a playbook you can copy: the problem, how it works, the guardrails, and what broke along the way.

  • 5 live
  • 4 testing
  • 4 retired
  • Updated Oct 29, 2026

Live now

1 / 5

Still in testing

In use, but not settled yet. Each has its own page with the setup, guardrails, and what broke.

  • 03 · Gate Testing

    Screen email before any automation touches it

    A Jev screen labels new mail for phishing and prompt injection; elevated risk is a veto for every other mail automation.

  • 06 · Policy fork Testing

    Self-repair inside a policy

    Narrow, reversible fixes inside a written policy; everything else becomes a read-only diagnosis for me.

  • 05 · Fan-out Testing

    Haiku Maxxing

    Claude Haiku 5.5 takes bounded text tasks from a coordinating Claude model, which checks the exact model on every call.

  • 05 · Fan-out Testing

    Terra Maxxing

    GPT-6.1 Terra handles computer use: browser and desktop tasks. In a three-run test it wasn’t reliably faster yet.

Lessons log

What I tried, and what it taught me. The first four are the retired builds on the status line.

  1. Retired Capturing short-lived secrets locally so the model never saw them.

    The value still passed through the messaging service, so it wasn’t the protection it looked like. Not a method I recommend.

  2. Retired Earlier agent gateways, replaced by Hermes.

    Retired names linger in old files and notes. They must never be mistaken for live services.

  3. Retired AI-assisted matching between two sets of equipment records.

    Coverage is not accuracy. Some rows simply lacked the data to match.

  4. Retired Moving monitoring between agents by handoff note, back and forth.

    One owner per topic, and a handoff isn’t done until the old job is confirmed off. See Playbook 04.

  5. A calendar brief reported “no events” when its sign-in had expired.

    Unavailable is not empty. A source that can’t be read gets named, never treated as quiet.

  6. Building every component of a receipt-intake redesign before any record went all the way through.

    Prove one record end to end first, then build out.

  7. Trusting a worker’s “done” for a change to an outside system.

    For external writes, check the target itself.

  8. Comparing two prompts while shared memory leaked into both runs.

    Test isolation fails quietly, and two trials don’t support a general claim.

  9. Building a website traffic “AI report” whose first version turned out to be fixed text.

    Check that the data can answer the question before building the report.