HyperAIHyperAI

Command Palette

Search for a command to run...

il y a 4 heures
LLM

Flow-by-Flow : contourner le jugement de contenu pour gouverner les productions d’IA dans les domaines à pertes élevées

Hiroki Naito

Résumé

Des travaux antérieurs ont montré que la supervision humaine dans la boucle devient structurellement intenable dans les domaines à pertes élevées lorsque la vélocité de production de l’IA, V, dépasse la capacité cognitive humaine C_max. La contrainte opérante n’est toutefois pas V seule, mais V × L, où L désigne la charge cognitive par élément. L se compose du triage, du jugement et de la réponse, qui réagissent de manière asymétrique à l’amélioration des capacités de l’IA. Le coût du triage ne diminue pas à mesure que les modèles deviennent plus performants, car l’indétermination sémantique est inhérente à la conception généraliste. Le coût de la réponse est invariant face aux gains de précision. Seul le coût du jugement subit une pression à la baisse, et cette pression opère souvent en induisant une omission plutôt qu’une réduction véritable. L’amélioration des capacités restructure donc L au lieu de le réduire. Les mécanismes de gouvernance fondés sur l’évaluation de la justesse des productions de l’IA délèguent cette évaluation soit à l’IA elle-même, héritant alors du risque d’hallucination, soit aux humains, se heurtant alors au plafond V × L. Nous proposons Flow-by-Flow, un paradigme de gouvernance qui contrôle la charge de supervision sans évaluer le contenu. Un score de coût cognitif fondé sur des caractéristiques formelles et dénombrables impose des coûts non linéaires à la production en grand volume, tandis qu’un plafond de capacité institutionnelle maintient le volume de traitement dans les limites de C_max. Nous dérivons quatre invariants de conception pour toute voie de dépassement contournant le jugement de contenu : absence de jugement de contenu, absence de consommation évolutive de la capacité de l’examinateur, friction identitaire par application, et absence d’autorisation par lots. Une implémentation de référence est discutée pour montrer que ces invariants sont conjointement satisfaisables, tandis que ses difficultés pratiques sont explicitement reconnues. Une analyse de Monte Carlo illustrative portant sur 1 000 tirages de paramètres suggère que le contrôle de flux composite multi-métrique surpasse le seul renforcement de la supervision dans 90,8 % des essais.

One-sentence Summary

Researchers from UTIE Research Institute and UTIE Instruments Inc. propose Flow-by-Flow, a content-judgment-bypass governance paradigm for high-loss domains that imposes a cognitive cost score based on formal, countable features and an institutional capacity cap to maintain supervisory load within CmaxC_{\max}Cmax without evaluating output, outperforming supervision reinforcement alone in 90.8% of 1,000-parameter Monte Carlo trials.

Key Contributions

  • Flow-by-Flow controls supervisory load without evaluating content by applying a cognitive cost score based on formal, countable features and an institutional capacity cap that keeps processing volume within human cognitive limits.
  • The paper derives four design invariants for any content-judgment-bypass exceedance pathway: no substantive content judgment, no scalable consumption of examiner capacity, identity-bound per-application friction, and no batch clearance.
  • An illustrative Monte Carlo analysis across 1,000 parameter draws suggests that composite multi-metric flow control outperforms supervision reinforcement alone in 90.8% of trials.

Introduction

The authors observe that current AI governance frameworks, including the EU AI Act and the U.S. NIST framework, rest on the assumption that human oversight can keep generative AI systems safe even as output volumes grow. However, decades of research on automation bias and normal accidents show that human operators are poorly suited to monitoring highly automated systems, and in generative AI the problem intensifies: errors appear as subtle semantic or logical flaws rather than physical deviations, and exposure to statistically regular AI outputs can degrade a supervisor's internal error-detection frame. Prior work by Naito (2026) formalized a condition where human oversight becomes nominal when the output rate V exceeds cognitive capacity C_max, but that model treated all outputs as equally burdensome and offered only a broad direction for institutional response, leaving the bridge from diagnosis to implementable design unbuilt.

The authors' main contribution is a theoretical refinement that extends the model to V × L, where L captures the per-item cognitive load of verification and response, and the proposal of a "Flow-by-Flow" institutional design. This design enforces a flow-rate limitation without evaluating the truth or content of outputs, instead inferring cognitive cost from formal quantitative features such as counts of citations, modalities, or word lengths. The paper derives four invariants that any such content-judgment-bypass mechanism must satisfy in high-loss domains where errors are severe and formal verification is impossible, and it demonstrates through simulation that strategies limiting total throughput buy more time before oversight collapse than simply adding more human supervisors.

Method

The authors ground their approach in a theoretical extension of the earlier monitoring constraint VCmaxV \leq C_{\max}VCmax. They observe that the original variable VVV, representing the AI output rate as a simple count, abstracts away the per-item cognitive burden that supervisors must bear. Real-world scrutiny of patent applications, legal documents, or academic papers shows that the load imposed by each output can vary dramatically. Hence, the relevant quantity is not VVV alone but the product V×LV \times LV×L, where LLL is the cognitive load per output. The human cognitive capacity ceiling is rewritten as CmaxC_{\max}Cmax per unit time, and the fundamental inequality becomes

V×L    Cmax.V \times L \;\leq\; C_{\max}.V×LCmax.

The variable LLL is decomposed into three irreducible tasks: triage (deciding what type of information the output represents), judgment (evaluating correctness or validity under that assumption), and response (acting on the evaluation). Crucially, triage and response do not decrease with improvements in AI accuracy. In fact, higher accuracy can increase the volume of responses that must be carried out and can make triage more difficult, because outputs from a highly capable model look more plausible and require finer discrimination. Thus, efforts to improve content judgment alone cannot guarantee that the throughput constraint is satisfied.

The Flow-by-Flow framework is introduced to enforce the inequality without relying on content judgment. Instead of trying to assess the truth or quality of each output, the system controls the flow rate so that the aggregate cognitive load presented to human supervisors stays within their biologically bounded capacity. The design rests on a single principle: implement an asymmetric incentive structure that makes AI-enabled mass production costly while keeping AI-enabled concision inexpensive. All components derive from this principle.

The first component is the cognitive cost score, an automatically computed quantity that measures the formal, quantitative features of a submission. For a patent application these might include number of claims, word count of the specification, and number of citations; for an academic paper they could be word count, number of references, figures, and supplementary-material volume. The features are first made dimensionless by dividing by field-specific median values, and then combined into a product:

S=i=1Nfimedian(fi).S = \prod_{i=1}^{N} \frac{f_i}{\text{median}(f_i)}.S=i=1Nmedian(fi)fi.

The score is a product of multiple mutually constraining features. Because each feature is tied to the content of the submission, compressing one dimension (e.g., reducing the number of claims) forces burden onto another (e.g., longer descriptions per claim). The score does not need to be a precise proxy for LLL; its function is to transform evasive optimization from a one-dimensional problem into a multidimensional constraint-satisfaction problem. The institution can add new features or recalibrate weights as processing-time data accumulate, without ever evaluating the semantic content of the outputs.

The second component is the institutional capacity cap, which makes explicit the finite processing capacity of the human side. The annual processable load is computed as

annual load=(number of examiners)×Cmax×(annual working hours).\text{annual load} = (\text{number of examiners}) \times C_{\max} \times (\text{annual working hours}).annual load=(number of examiners)×Cmax×(annual working hours).

Applications whose cognitive cost score falls within the cap proceed directly to human examination. Those that exceed the cap are not rejected; they are routed into an exceedance pathway that imposes a bounded, identity-bound per-application friction. The cap thereby creates a natural incentive for submitters to make their applications concise and understandable, because only a limited number of processing slots exist.

The overall architecture is a two-layer structure. The first layer is fully automatic and performs only counting-based measurement of formal features to compute the cognitive cost score. This layer contains no content judgment and therefore avoids the hallucination risks that would arise if AI were asked to evaluate semantic quality. The second layer is human: only the submissions that remain within the institutional capacity cap are examined by human experts. Because the flow rate is controlled, the human workload is guaranteed to stay within CmaxC_{\max}Cmax, preserving the effective cognitive capacity (CeffC_{\text{eff}}Ceff) of the examiners.

The authors analyze the limits of relying solely on first-stage controls, such as know-your-customer (KYC) identity verification and per-actor submission-count limits. In a first-stage-only institution, once the number of submissions is capped, rational applicants using AI will redirect optimization pressure toward increasing the information density of each item. This can push LLL upward, causing V×LV \times LV×L to exceed CmaxC_{\max}Cmax even though VVV is fixed. The second stage the cognitive cost score with an exceedance mechanism is therefore necessary to prevent such inside-the-cap escalation.

The choice of a composite metric is justified through a toy model of applicant behavior. Under a single-metric limit, large language models (LLMs) can easily find evasion strategies, such as compressing text while preserving claims. With a product of NNN features, however, the applicant must simultaneously satisfy multiple constraints. Because the features are rooted in the content itself, substantive trade-offs (e.g., narrowing the scope of protection when reducing claims) cannot be eliminated by improvements in LLM capability. The institution can increase NNN at low cost, raising the computational and economic burden of evasion.

For applications that exceed the cognitive cost score threshold, the authors propose a reference implementation of the exceedance pathway: the physical waiting path. An applicant must visit a designated KYC-enabled office, verify identity, and wait for a period proportional to the amount by which the score exceeds the cap. The waiting time is T×kT \times kT×k (where TTT is a baseline and kkk is the threshold multiplier). A 16-digit submission passcode is issued after waiting, enabling the application to be accepted despite the exceedance. This mechanism satisfies four design invariants that are necessary for any flow-control mechanism that bypasses content judgment:

  1. No substantive content judgment the path does not evaluate the quality of the output.
  2. No scalable consumption of examiner capacity identity verification is handled by service-desk staff, not domain experts.
  3. Identity-bound per-application friction each waiting event is tied to a verified identity through passport checks.
  4. No batch clearance each application requires a separate waiting instance and a unique passcode.

The physical waiting path transforms the marginal-cost structure of digital mass production into the marginal-cost structure of physical presence. While a single user can generate thousands of outputs through API calls at near-zero marginal cost, one thousand threshold-exceeding applications require one thousand separate waiting events. The authors note that the physical waiting path is one reference design; any mechanism that satisfies all four invariants can serve the same role, and alternatives such as remote identity-verified time-lock passes are discussed for improved accessibility.

The framework also replaces traditional AI-use disclosure requirements with a process-time declaration requirement. Instead of asking whether AI was used a yes/no question that cannot be verified submitters declare the number of real-time hours spent on each stage of the workflow (e.g., literature review, writing, experimentation). These declarations provide a channel for statistical verification: a paper claiming three hours of literature review but citing 200 references implies implausibly fast reading, and such inconsistencies can be flagged without external identity checks. Process-time declarations are not used to determine the cognitive cost score; they serve as an independent source of calibration data and help quantify the B variable, which measures the extent to which a domain’s workflow is anchored in physical-space activities and thus resistant to AI-driven acceleration.

Together, the cognitive cost score, the institutional capacity cap, and the exceedance pathway form a flow-control system that does not attempt to judge the truth or falsity of AI outputs. It systematically arranges the conditions under which human supervisors can exercise quality judgment, by ensuring that the volume and complexity of the material they review never exceed their cognitive limits.

Experiment

The first-stage-only institution analysis shows that even with identity verification and submission caps, AI users can cheaply escalate per-item information density, causing aggregate cognitive load to exceed processing capacity. The Monte Carlo simulation evaluates the robustness of three strategies under wide parametric uncertainty and finds that composite flow control consistently outperforms supervision enhancement alone, even when given extremely favorable initial conditions. The experiment does not predict exact collapse timing but validates that the relative superiority of flow control is robust, supporting its adoption as a resilient institutional design across diverse AI growth scenarios.

Across 1,000 Monte Carlo trials, the strategy combining supervision enhancement with composite flow proved best in 90.8% of cases, far outpacing supervision enhancement alone (1.6%) and supervision with simple flow (7.6%). Even when initial conditions were deliberately skewed to favor supervision enhancement, composite flow remained the most robust approach under wide parameter uncertainty. The results confirm that the relative ordering of these strategies is stable, though the absolute timing of system collapse depends on domain-specific factors. Composite flow was the top-performing strategy in 90.8% of trials, even though the simulation was intentionally biased toward supervision enhancement alone. The performance ordering – composite flow first, then simple flow, then supervision only – held consistently across a broad range of parameters, underscoring the resilience of flow-based interventions.

A Monte Carlo simulation with 1,000 trials compared three strategies under broad parameter uncertainty, deliberately biasing initial conditions to favor supervision enhancement alone. The composite flow strategy proved most robust, ranking first in 90.8% of trials, and the consistent performance ordering was composite flow, followed by simple flow, then supervision only. These findings confirm that flow-based interventions maintain their advantage even when the simulation is skewed against them.


Créer de l'IA avec l'IA

De l'idée au lancement — accélérez votre développement IA avec le co-codage IA gratuit, un environnement prêt à l'emploi et le meilleur prix pour les GPU.

Codage assisté par IA
GPU prêts à l’emploi
Tarifs les plus avantageux

HyperAI Newsletters

Abonnez-vous à nos dernières mises à jour
Nous vous enverrons les dernières mises à jour de la semaine dans votre boîte de réception à neuf heures chaque lundi matin
Propulsé par MailChimp