Your Agent Evals Are Reductionist: Why Component Scores Can't Explain System Behavior
Per-component benchmarks and unit-level debugging are structurally incapable of explaining emergent multi-agent behavior, because behavior is produced by the relationships between components; teams need a complementary interaction-level observability layer or they will keep shipping systems whose failures they cannot localize.
AngleTake the reductionism critique seriously as an engineering claim: name the specific failure classes (non-reproducible, cross-component, context-loss, handoff) that component inspection misses, then specify what an interaction-level metric actually measures.
Source video ↗Fix the Handoffs, Not the Prompts: Conway's Law as an Agent Architecture Principle
In multi-agent systems the topology of message passing and shared context is the upstream control variable, so subagent boundaries, handoff protocols, and context-sharing paths should be designed before individual agent capabilities; capability-first design will repeatedly regress toward the communication structure it actually has.
AngleInvert the usual build order: derive agent boundaries from communication paths, and treat prompt/capability work as downstream tuning that cannot compensate for a bad topology.
Source video ↗The Delegation Boundary: What to Automate and What to Keep Human
The usable automation boundary is not 'hard vs easy' but language-level transformation (delegable) versus judgment about relationships and coherence (retained); without an explicit criterion, over-delegation silently removes the architectural judgment that keeps a system coherent.
AnglePropose a task-classification rubric and show how it translates into concrete human review gates and agent workflow checkpoints.
Source video ↗Car-Boats: How Uncoordinated Requirements Destroy Conceptual Integrity
Satisfying each stakeholder requirement in isolation produces incoherent designs, because coherence is a property of the relationships between requirements, not of the requirements individually; governance must surface conflicts before a combined design is commissioned.
AngleUse the car-boat failure as a diagnostic pattern and derive governance mechanisms (conflict surfacing, invariant checks, coherence review gates) that catch it earlier.
Source video ↗