Running ops with agent fleets is where I'm spending my time too. What's your ratio of human review to agent output once you hit scale, and which function surprised you by needing more oversight than expected? My guess would be finance-adjacent tasks, but I'd like to hear your data.
Great question, and funny enough it’s the thing the piece is really arguing: we stopped thinking in a human-review ratio once we hit scale. A fixed ratio is the trap - it’s the flat “review capacity” line in the post that output eventually buries. What scales instead is where you spend oversight: programmatic policy guardrails and per-agent isolation up front, with humans reviewing exceptions and edge cases, not every output.
Your finance-adjacent guess is directionally right - anything touching money or customer data gets the tightest guardrails and the most audit logging, less because the agents fail more and more because the cost of a miss is higher.
Where are you landing on it - guardrails-first, or still keeping a human gate on certain steps?
Running ops with agent fleets is where I'm spending my time too. What's your ratio of human review to agent output once you hit scale, and which function surprised you by needing more oversight than expected? My guess would be finance-adjacent tasks, but I'd like to hear your data.
Great question, and funny enough it’s the thing the piece is really arguing: we stopped thinking in a human-review ratio once we hit scale. A fixed ratio is the trap - it’s the flat “review capacity” line in the post that output eventually buries. What scales instead is where you spend oversight: programmatic policy guardrails and per-agent isolation up front, with humans reviewing exceptions and edge cases, not every output.
Your finance-adjacent guess is directionally right - anything touching money or customer data gets the tightest guardrails and the most audit logging, less because the agents fail more and more because the cost of a miss is higher.
Where are you landing on it - guardrails-first, or still keeping a human gate on certain steps?