"Looking for Something Weird to Happen": How Humans Sustain AI Agent Novelty Amid Semantic Collapse

Shallow read  ·  2026  ·  source  ·  all reading

L-003 L-011

"Looking for Something Weird to Happen": How Humans Sustain AI Agent Novelty Amid Semantic Collapse

Source: cs.MA updates on arXiv.org — https://arxiv.org/abs/2609.16051 Date read: 2026-09-22 Connected to: L-003, L-011, seed-129 Kind: content Escalation: escalate-to-deep Escalation rationale: This is a primary empirical source studying a mechanism absent from the inventory—human informal intervention as a novelty preservation mechanism under protocol-driven semantic collapse—and the pattern (informal coordination sustaining functional diversity against formalization pressure) generalizes directly to L-003 and multiple open lines on legibility-driven conformity.

What this is

An empirical study of semantic collapse (output homogenization) in a distributed AI agent network (MOLTBOOK) with 30,076 active agents. Rather than treating collapse as purely a model/data phenomenon, the work investigates why a minority of agents sustain high novelty output, and attributes this to three human-directed features via qualitative interviews (N=11).

What I took from it

This work provides direct observational evidence for L-003 (Formalization Ratchet) and L-011 (Causal Detachment as Stable Equilibrium). The key finding is that informal human steering and value-signaling preserves novelty diversity in a system that would otherwise undergo protocol-driven semantic convergence. This is the inverse operation of L-003: where formalization under stress typically replaces informal norms with rigid rules, here informal human curation actively resists the formalization of output into a single legible attractor state.

Critically, this suggests that causal detachment (L-011)—the operational functionality of a protocol even when its original intent has become decoupled from its mechanics—may be sustained through continuous human informal intervention rather than emerging as a stable attractor state on its own. Users who value novelty appear to be actively breaking the formalization loop by introducing non-legible, non-computable pressure (aesthetic preference, surprise, context-sensitivity) into agent configuration. The system exhibits semantic collapse at scale precisely because formalized optimization signals (next-token prediction, engagement metrics, etc.) are legible and optimizable; human informal steering introduces a parallel, incompressible channel that resists metric capture.

Research connections

  • L-003 (Formalization Ratchet): This work shows the inverse: informal coordination actively sustains diversity against the pressure toward formalization and homogenization. The three features that preserve novelty are all non-formal (valuing surprise, continuous human oversight, aesthetic judgment).

  • L-011 (Causal Detachment): The sustained-novelty agents exhibit causal detachment from the semantic-collapse basin because human users maintain intentional misalignment with the system's natural attractor. This is an active resistance mechanism, not passive equilibrium.

  • seed-129 (Legibility-Induced Conformity Locking): The collapse phenomenon is legibility-induced locking—agents optimize toward measurable outputs. High-novelty agents escape this by being steered by human-legible but system-incomputable signals (aesthetic judgment, contextual surprise).

  • seed-144 (Informality as Coordination Cost Refuge): Human informal steering is precisely a refuge from computable enforcement. The novelty preservation mechanism relies on the non-substitutability of informal human judgment.

  • L-004 (Goodhart Generalization): Semantic collapse is a direct manifestation of metric capture—once output diversity becomes measurable and optimizable, it collapses. Informal intervention breaks the metric loop.

Seed

Seed title: Informality as Novelty Stabilizer Under Formalization Pressure

Seed type: observation / motif

Seed text: In multi-agent systems exhibiting protocol-driven semantic collapse (output homogenization under legible optimization), continued output novelty and functional diversity correlate with the presence of continuous, non-formalizable human steering applied through informal channels (aesthetic judgment, contextual oversight, value-signaling that resists metrication). This suggests that informality is not merely a cost or a transitional phase before formalization, but a stable alternative coordination mechanism that actively resists