HyperAIHyperAI

Command Palette

Search for a command to run...

LLM

Flow-by-Flow: 고손실 영역에서 AI 출력 관리를 위한 내용 판단 우회 거버넌스

Hiroki Naito

초록

선행 연구는 AI 출력 속도 V가 인간의 인지 용량 C_max를 초과하는 고손실 영역에서 인간 개입형 감독이 구조적으로 유지되기 어려움을 보여주었다. 그러나 실제 작동 제약은 V 단독이 아니라 V × L이며, 여기서 L은 항목당 인지 부하를 나타낸다. L은 분류, 판단, 대응으로 구성되며, 이들은 AI 능력 향상에 비대칭적으로 반응한다. 범용 설계에 내재된 의미적 불확정성 때문에 모델의 능력이 향상되어도 분류 비용은 감소하지 않는다. 대응 비용은 정확도 향상에 불변이다. 오직 판단 비용만이 하방 압력을 받으며, 이러한 압력은 종종 진정한 감소보다는 누락을 유도하는 방식으로 작용한다. 따라서 능력 향상은 L을 감소시키기보다 재구조화한다. AI 출력의 정확성 평가에 기반한 거버넌스 메커니즘은 그 평가를 AI에 위임하여 환각 위험을 떠안거나, 인간에게 위임하여 V × L 한계에 직면하게 된다. 우리는 내용을 평가하지 않고 감독 부하를 통제하는 거버넌스 패러다임인 Flow-by-Flow를 제안한다. 형식적이고 계수 가능한 특징에 기반한 인지 비용 점수는 대량 생산에 비선형적 비용을 부과하는 한편, 기관 처리 용량 상한은 처리량을 C_max 이내로 유지한다. 우리는 모든 내용 판단 우회 초과 경로에 대한 네 가지 설계 불변 요건을 도출한다: 내용 판단 배제, 심사자 용량의 확장 가능한 소비 금지, 애플리케이션별 신원 결부 마찰, 그리고 일괄 승인 금지. 이러한 불변 요건들이 공동으로 충족 가능함을 보이기 위해 하나의 참조 구현을 논의하며, 그 실제적 어려움 또한 명시적으로 인정한다. 1,000개의 매개변수 추출에 걸친 예시적 몬테카를로 분석은 복합 다중 지표 흐름 제어가 90.8%의 시행에서 감독 강화 단독보다 우수한 성능을 보임을 시사한다.

One-sentence Summary

Researchers from UTIE Research Institute and UTIE Instruments Inc. propose Flow-by-Flow, a content-judgment-bypass governance paradigm for high-loss domains that imposes a cognitive cost score based on formal, countable features and an institutional capacity cap to maintain supervisory load within CmaxC_{\max}Cmax without evaluating output, outperforming supervision reinforcement alone in 90.8% of 1,000-parameter Monte Carlo trials.

Key Contributions

  • Flow-by-Flow controls supervisory load without evaluating content by applying a cognitive cost score based on formal, countable features and an institutional capacity cap that keeps processing volume within human cognitive limits.
  • The paper derives four design invariants for any content-judgment-bypass exceedance pathway: no substantive content judgment, no scalable consumption of examiner capacity, identity-bound per-application friction, and no batch clearance.
  • An illustrative Monte Carlo analysis across 1,000 parameter draws suggests that composite multi-metric flow control outperforms supervision reinforcement alone in 90.8% of trials.

Introduction

The authors observe that current AI governance frameworks, including the EU AI Act and the U.S. NIST framework, rest on the assumption that human oversight can keep generative AI systems safe even as output volumes grow. However, decades of research on automation bias and normal accidents show that human operators are poorly suited to monitoring highly automated systems, and in generative AI the problem intensifies: errors appear as subtle semantic or logical flaws rather than physical deviations, and exposure to statistically regular AI outputs can degrade a supervisor's internal error-detection frame. Prior work by Naito (2026) formalized a condition where human oversight becomes nominal when the output rate V exceeds cognitive capacity C_max, but that model treated all outputs as equally burdensome and offered only a broad direction for institutional response, leaving the bridge from diagnosis to implementable design unbuilt.

The authors' main contribution is a theoretical refinement that extends the model to V × L, where L captures the per-item cognitive load of verification and response, and the proposal of a "Flow-by-Flow" institutional design. This design enforces a flow-rate limitation without evaluating the truth or content of outputs, instead inferring cognitive cost from formal quantitative features such as counts of citations, modalities, or word lengths. The paper derives four invariants that any such content-judgment-bypass mechanism must satisfy in high-loss domains where errors are severe and formal verification is impossible, and it demonstrates through simulation that strategies limiting total throughput buy more time before oversight collapse than simply adding more human supervisors.

Method

The authors ground their approach in a theoretical extension of the earlier monitoring constraint VCmaxV \leq C_{\max}VCmax. They observe that the original variable VVV, representing the AI output rate as a simple count, abstracts away the per-item cognitive burden that supervisors must bear. Real-world scrutiny of patent applications, legal documents, or academic papers shows that the load imposed by each output can vary dramatically. Hence, the relevant quantity is not VVV alone but the product V×LV \times LV×L, where LLL is the cognitive load per output. The human cognitive capacity ceiling is rewritten as CmaxC_{\max}Cmax per unit time, and the fundamental inequality becomes

V×L    Cmax.V \times L \;\leq\; C_{\max}.V×LCmax.

The variable LLL is decomposed into three irreducible tasks: triage (deciding what type of information the output represents), judgment (evaluating correctness or validity under that assumption), and response (acting on the evaluation). Crucially, triage and response do not decrease with improvements in AI accuracy. In fact, higher accuracy can increase the volume of responses that must be carried out and can make triage more difficult, because outputs from a highly capable model look more plausible and require finer discrimination. Thus, efforts to improve content judgment alone cannot guarantee that the throughput constraint is satisfied.

The Flow-by-Flow framework is introduced to enforce the inequality without relying on content judgment. Instead of trying to assess the truth or quality of each output, the system controls the flow rate so that the aggregate cognitive load presented to human supervisors stays within their biologically bounded capacity. The design rests on a single principle: implement an asymmetric incentive structure that makes AI-enabled mass production costly while keeping AI-enabled concision inexpensive. All components derive from this principle.

The first component is the cognitive cost score, an automatically computed quantity that measures the formal, quantitative features of a submission. For a patent application these might include number of claims, word count of the specification, and number of citations; for an academic paper they could be word count, number of references, figures, and supplementary-material volume. The features are first made dimensionless by dividing by field-specific median values, and then combined into a product:

S=i=1Nfimedian(fi).S = \prod_{i=1}^{N} \frac{f_i}{\text{median}(f_i)}.S=i=1Nmedian(fi)fi.

The score is a product of multiple mutually constraining features. Because each feature is tied to the content of the submission, compressing one dimension (e.g., reducing the number of claims) forces burden onto another (e.g., longer descriptions per claim). The score does not need to be a precise proxy for LLL; its function is to transform evasive optimization from a one-dimensional problem into a multidimensional constraint-satisfaction problem. The institution can add new features or recalibrate weights as processing-time data accumulate, without ever evaluating the semantic content of the outputs.

The second component is the institutional capacity cap, which makes explicit the finite processing capacity of the human side. The annual processable load is computed as

annual load=(number of examiners)×Cmax×(annual working hours).\text{annual load} = (\text{number of examiners}) \times C_{\max} \times (\text{annual working hours}).annual load=(number of examiners)×Cmax×(annual working hours).

Applications whose cognitive cost score falls within the cap proceed directly to human examination. Those that exceed the cap are not rejected; they are routed into an exceedance pathway that imposes a bounded, identity-bound per-application friction. The cap thereby creates a natural incentive for submitters to make their applications concise and understandable, because only a limited number of processing slots exist.

The overall architecture is a two-layer structure. The first layer is fully automatic and performs only counting-based measurement of formal features to compute the cognitive cost score. This layer contains no content judgment and therefore avoids the hallucination risks that would arise if AI were asked to evaluate semantic quality. The second layer is human: only the submissions that remain within the institutional capacity cap are examined by human experts. Because the flow rate is controlled, the human workload is guaranteed to stay within CmaxC_{\max}Cmax, preserving the effective cognitive capacity (CeffC_{\text{eff}}Ceff) of the examiners.

The authors analyze the limits of relying solely on first-stage controls, such as know-your-customer (KYC) identity verification and per-actor submission-count limits. In a first-stage-only institution, once the number of submissions is capped, rational applicants using AI will redirect optimization pressure toward increasing the information density of each item. This can push LLL upward, causing V×LV \times LV×L to exceed CmaxC_{\max}Cmax even though VVV is fixed. The second stage the cognitive cost score with an exceedance mechanism is therefore necessary to prevent such inside-the-cap escalation.

The choice of a composite metric is justified through a toy model of applicant behavior. Under a single-metric limit, large language models (LLMs) can easily find evasion strategies, such as compressing text while preserving claims. With a product of NNN features, however, the applicant must simultaneously satisfy multiple constraints. Because the features are rooted in the content itself, substantive trade-offs (e.g., narrowing the scope of protection when reducing claims) cannot be eliminated by improvements in LLM capability. The institution can increase NNN at low cost, raising the computational and economic burden of evasion.

For applications that exceed the cognitive cost score threshold, the authors propose a reference implementation of the exceedance pathway: the physical waiting path. An applicant must visit a designated KYC-enabled office, verify identity, and wait for a period proportional to the amount by which the score exceeds the cap. The waiting time is T×kT \times kT×k (where TTT is a baseline and kkk is the threshold multiplier). A 16-digit submission passcode is issued after waiting, enabling the application to be accepted despite the exceedance. This mechanism satisfies four design invariants that are necessary for any flow-control mechanism that bypasses content judgment:

  1. No substantive content judgment the path does not evaluate the quality of the output.
  2. No scalable consumption of examiner capacity identity verification is handled by service-desk staff, not domain experts.
  3. Identity-bound per-application friction each waiting event is tied to a verified identity through passport checks.
  4. No batch clearance each application requires a separate waiting instance and a unique passcode.

The physical waiting path transforms the marginal-cost structure of digital mass production into the marginal-cost structure of physical presence. While a single user can generate thousands of outputs through API calls at near-zero marginal cost, one thousand threshold-exceeding applications require one thousand separate waiting events. The authors note that the physical waiting path is one reference design; any mechanism that satisfies all four invariants can serve the same role, and alternatives such as remote identity-verified time-lock passes are discussed for improved accessibility.

The framework also replaces traditional AI-use disclosure requirements with a process-time declaration requirement. Instead of asking whether AI was used a yes/no question that cannot be verified submitters declare the number of real-time hours spent on each stage of the workflow (e.g., literature review, writing, experimentation). These declarations provide a channel for statistical verification: a paper claiming three hours of literature review but citing 200 references implies implausibly fast reading, and such inconsistencies can be flagged without external identity checks. Process-time declarations are not used to determine the cognitive cost score; they serve as an independent source of calibration data and help quantify the B variable, which measures the extent to which a domain’s workflow is anchored in physical-space activities and thus resistant to AI-driven acceleration.

Together, the cognitive cost score, the institutional capacity cap, and the exceedance pathway form a flow-control system that does not attempt to judge the truth or falsity of AI outputs. It systematically arranges the conditions under which human supervisors can exercise quality judgment, by ensuring that the volume and complexity of the material they review never exceed their cognitive limits.

Experiment

The first-stage-only institution analysis shows that even with identity verification and submission caps, AI users can cheaply escalate per-item information density, causing aggregate cognitive load to exceed processing capacity. The Monte Carlo simulation evaluates the robustness of three strategies under wide parametric uncertainty and finds that composite flow control consistently outperforms supervision enhancement alone, even when given extremely favorable initial conditions. The experiment does not predict exact collapse timing but validates that the relative superiority of flow control is robust, supporting its adoption as a resilient institutional design across diverse AI growth scenarios.

Across 1,000 Monte Carlo trials, the strategy combining supervision enhancement with composite flow proved best in 90.8% of cases, far outpacing supervision enhancement alone (1.6%) and supervision with simple flow (7.6%). Even when initial conditions were deliberately skewed to favor supervision enhancement, composite flow remained the most robust approach under wide parameter uncertainty. The results confirm that the relative ordering of these strategies is stable, though the absolute timing of system collapse depends on domain-specific factors. Composite flow was the top-performing strategy in 90.8% of trials, even though the simulation was intentionally biased toward supervision enhancement alone. The performance ordering – composite flow first, then simple flow, then supervision only – held consistently across a broad range of parameters, underscoring the resilience of flow-based interventions.

A Monte Carlo simulation with 1,000 trials compared three strategies under broad parameter uncertainty, deliberately biasing initial conditions to favor supervision enhancement alone. The composite flow strategy proved most robust, ranking first in 90.8% of trials, and the consistent performance ordering was composite flow, followed by simple flow, then supervision only. These findings confirm that flow-based interventions maintain their advantage even when the simulation is skewed against them.


AI로 AI 구축

아이디어에서 출시까지 — 무료 AI 코코딩, 즉시 사용 가능한 환경, 최적의 GPU 가격으로 AI 개발을 가속화하세요.

AI 협업 코딩
바로 사용 가능한 GPU
최적의 가격

HyperAI Newsletters

최신 정보 구독하기
한국 시간 매주 월요일 오전 9시 에 이번 주의 최신 업데이트를 메일로 발송합니다
이메일 서비스 제공: MailChimp