Stop Wrapping Agents Around Your Processes—Rebuild the Workflow Around the Agent
Agents fail to reach their potential when grafted onto static process automations; they require the operating process itself to be redesigned as a durable, event-driven human-agent decision system.
AngleTechnical architecture plus enterprise implementation, using the Shopify CEO's 'native AI workflows' as the canonical example of forward-leaning AI design.
Source video ↗The Lab Is Not Where AI Becomes Safe; Production Is
Offline red-teaming and alignment research are necessary but insufficient; for open-ended AI behavior, iterative deployment with tight feedback loops is the actual safety mechanism, making telemetry a safety-critical investment.
AngleFlipping the conventional safety-first release model and showing why bounded early exposure to imperfect AI is the responsible default for capability-unbounded systems.
Source video ↗The AI Revolution Will Be Slower Than You Think—and That Is a Design Constraint
The dominant timeline for AI value is set not by model capability curves but by institutional and behavioral inertia; therefore AI product roadmaps must include adoption curves, staged autonomy, and legacy compatibility as first-class design elements.
AngleCounterpoint to capability-driven hype, framing inertia as an engineering input rather than a market failure.
Source video ↗Benchmark Averages Hide the Power Law in AI Research
Because returns from research bets are power-law distributed, an evaluation culture optimizing for mean benchmark improvements filters out the non-consensus high-variance projects that drive breakthroughs; AI labs should rank portfolios by tail scores, not averages.
AngleMethodological critique of comparison culture and a proposal for portfolio-level extreme-outcome metrics.
Source video ↗Agent-Native Workflow vs Agent Wrapper Benchmark
movement-labFor an operational workflow with non-deterministic exceptions, an agent-native implementation modeled as an event-driven state machine with human approval nodes will resolve at least 30% more exceptions end-to-end without escalation than an LLM wrapper over a fixed process graph, at equal model capability.
Proof of conceptBuild a support-ticket resolution flow in two architectures: (A) wrapper—a fixed five-step graph where each step invokes an LLM; (B) native—a durable state machine where agents and human approvers subscribe to events and can route exceptions dynamically. Run both on a corpus of synthetic tickets with injected exceptions.
MeasurementException resolution rate, human escalation rate, average completion time, and number of wrong-path recoveries.
Source video ↗Canary-Feedback Safe Deployment Simulator
gatehouseUnder a simulated stream of agent actions with stochastic harm, a bounded-exposure deployment policy (small canary cohort, real-time feedback, rollback on harm threshold) accumulates fewer severe harms than a policy requiring offline validation to pass an internal safety threshold before any deployment.
Proof of conceptImplement an event-based simulator of a tool-using agent in a sandbox where actions may cause harm. Compare Policy A (offline-validation-only) with Policy B (staged canary with feedback-driven rollback) over 1,000 episodes each.
MeasurementNumber of irreversible harm events, detection latency, action throughput, and final task success rate.
Source video ↗Power-Law Portfolio Allocator
beyond-evalsRanking a fixed set of research project proposals by a non-consensus score (absolute difference between the proposal's predicted impact and the panel's mean prediction) and allocating resources as a power-law function of that rank yields higher total simulated return than equal-weighted allocation across the same proposals.
Proof of conceptCollect or simulate panel impact predictions for twenty research ideas; implement equal, proportionate, and power-law allocation strategies; run Monte Carlo simulations using a calibrated power-law return model.
MeasurementExpected total portfolio return, contribution of the top 10% projects, and variance of return across allocations.
Source video ↗Institutional Inertia Field Kit
newWhen an AI assistance tool is deployed in two isomorphic workflows that differ only in organizational complexity (e.g., number of handoffs and approvals), the simpler workflow will show at least 50% higher active adoption rate after one month than the complex workflow, holding task type and user role constant.
Proof of conceptCreate a lightweight AI assistant for a routine task and integrate it in an internal pilot into (1) a direct single-user workflow and (2) a multi-approval, multi-system workflow; track usage automatically with consent.
MeasurementWeekly active use as a share of eligible tasks, override rate, end-to-end completion time, and user-reported willingness to delegate.
Source video ↗