HyperAIHyperAI

Command Palette

Search for a command to run...

가볍게 싸고 CarryOn: 장기 지평 에이전트를 위한 객체 지향 컨텍스트 구축

Yuchen Lu Julian McAuley Lei Zhang

초록

장기 지평(long-horizon) 에이전트는 영속적인 작업 상태에 진행 상황을 축적하지만, 해당 진행이 어떻게 이루어졌는지를 기술하는 상호작용 이력을 반복적으로 처리한다. 이는 자연스러운 질문을 제기한다. 장기 지평 컨텍스트를 그것을 만들어낸 이력보다는 재사용 가능한 진행 상황을 중심으로 구성할 수 있을까? 본 논문에서는 재사용 가능한 작업 객체를 중심으로 지속(continuation)을 구성하는 객체 지향 컨텍스트 런타임인 CarryOn을 소개한다. CarryOn은 압축된 이력이나 재구성된 진행 설명을 지속의 일차적 기반으로 삼는 대신, 지속 캐리어(continuation carrier), 보완적 실행 컨텍스트, 그리고 최근 상호작용의 실시간 테일(tail)로부터 컨텍스트 뷰를 구축한다. 핵심 과제는 주변 이력이 폐기된 후에도 이 재사용 가능한 기반을 유효하게 유지하는 것이다. 즉, 모든 폴드(fold)에서 전체 표현을 재구성하지 않고도 CarryOn이 기반을 갱신할 수 있는가이다. CarryOn은 폴드 전반에 걸쳐 캐리어 레코드를 유지하며, 영향을 받은 레코드는 결합된 증거(bound evidence)와 적용 가능한 환경 검사를 바탕으로 수정하고, 영향을 받지 않은 레코드는 그대로 이월하면서 실행 컨텍스트를 함께 갱신한다. OSWorld2.0과 BrowseComp-Plus에 대한 실험에서 각각 5.8%와 7.0%의 성능 향상을 보였으며, 총 토큰 사용량은 각각 51.9%와 22.9% 감소했다. 프로젝트 페이지: https://ethannju.github.io/carryon.

One-sentence Summary

Researchers at the University of California San Diego introduce CarryOn, an object-oriented context runtime that organizes long-horizon agent continuation around reusable task objects, maintains carrier records via bound evidence and environment checks without full reconstruction, and improves gains by 5.8%5.8\%5.8% on OSWorld2.0 and 7.0%7.0\%7.0% on BrowseComp-Plus while reducing total token usage by 51.9%51.9\%51.9% and 22.9%22.9\%22.9%, respectively.

Key Contributions

  • CarryOn is an object-oriented context runtime that organizes long-horizon agent continuation around reusable task objects rather than raw or compressed interaction history. It combines continuation carriers, execution context for goals, constraints, and unresolved issues, and a live tail of recent interactions.
  • CarryOn maintains carrier records across folds, revising only affected records against bound evidence and applicable environment checks, carrying forward unaffected records, and jointly updating execution context without reconstructing the full representation at every fold.
  • Evaluation on OSWorld 2.0 and BrowseComp-Plus shows that CarryOn lifts Claude Opus 4.7 from 43.9% to 49.7% and from 49% to 56%, respectively, while reducing total token usage by 51.9% and 22.9% and total cost by 35.9% and 7.1%.

Introduction

Long-horizon agents often accumulate redundant context because interaction history repeats information already present in persistent task state, raising token cost and making continuation depend on selective reconstructions that can drift from the actual state. Prior methods address this through compression, summarization, retrieval, pruning, or externalized state, but they may still organize continuation around compressed history rather than reusable results. The authors introduce CarryOn, an object-oriented context runtime that combines continuation carriers for reusable task objects and explicit conditions of use, execution context for active goals and unresolved issues, and a live tail of recent interactions. A fold operation progressively replaces covered history with an updated object-oriented context view, preserving what the agent still needs to continue.

Method

The authors propose CarryOn, a framework designed to organize long-horizon agent continuation around reusable task objects rather than the raw interactions that produced them. This approach allows established progress to be carried forward for subsequent inspection and use, while explicit context retains complementary continuation information.

The framework structures the agent's active context into three complementary components, forming the Context View. Continuation Carriers expose reusable progress to subsequent execution. These carriers maintain a stable identity and record reusable content or its location, along with conditions for reuse. CarryOn supports three forms of carriers: External Objects, which are work products existing independently in the environment such as code files; Information Products, which capture reusable findings obtained through interaction; and Situated State, which captures progress available only within a particular application or session. Execution Context complements these carriers by retaining information needed for execution but not encoded in reusable task objects, such as current focus, unresolved constraints, and pending work. Finally, the Live Tail contains the original agent-environment interactions accumulated since the most recent fold.

At interaction step ttt, let kkk denote the most recent fold and bkb_kbk​ the last interaction step covered by that fold. The fold establishes a maintained set of continuation carrier records AkA_kAk​ and execution context EkE_kEk​, while interactions occurring afterward remain in the live tail Lt=(hbk+1,…,ht)L_t = (h_{b_k + 1}, \ldots, h_t)Lt​=(hbk​+1​,…,ht​). The context view is therefore defined as:

Vt=(Ak,Ek,Lt).V_t = (A_k, E_k, L_t).Vt​=(Ak​,Ek​,Lt​).

To maintain this context view during execution, CarryOn periodically folds accumulated interactions in the live tail into the maintained representation. This update process proceeds in four distinct stages: tracking candidates, preparing evidence, joint compilation, and validation and commitment.

First, in the Tracking Candidates stage, a Tracker identifies progress that may become reusable in subsequent execution. It maintains candidates representing potential new carriers or updates to existing ones. Once a candidate reaches a state that can support continuation, the Tracker requests its compilation, specifying what should be compiled and the evidence needed to support it.

Next, during Preparing Evidence, the system gathers the evidence authorized for each selected candidate. For information products, it checks that the selected material is consistent with recorded sources. For external objects and situated state, it binds the request to the corresponding environment object, and a Grounder performs read-only checks of relevant conditions. The resulting input package UtU_tUt​ contains the selected candidates, applicable carrier records, authorized source material, object references, and available check results.

In the Joint Compilation stage, a Compiler jointly updates continuation carriers and execution context to preserve the information needed for subsequent execution. The Compiler receives the prepared input package UtU_tUt​, the current execution context EkE_kEk​, and a chronological text projection Π(Lt)\Pi(L_t)Π(Lt​) of the live tail. It proposes carrier edits ΔAt\Delta A_tΔAt​ and a revised execution context E^k+1\widehat{E}_{k+1}Ek+1​:

(ΔAt,E^k+1)=Compile(Ut,Ek,Π(Lt)).(\Delta A_t, \widehat{E}_{k+1}) = \mathrm{Compile}(U_t, E_k, \Pi(L_t)).(ΔAt​,Ek+1​)=Compile(Ut​,Ek​,Π(Lt​)).

The Compiler proposes edits only for the selected candidates, grounding each edit in its authorized evidence, while revising the execution context against the entire live tail to preserve continuation-relevant information.

Finally, in the Validation and Commitment stage, CarryOn checks that the proposed carrier edits still refer to the current candidate and carrier versions and are consistent with the authorized evidence. It also verifies required identity, reference, and output constraints. If these checks pass, CarryOn atomically applies the carrier edits and commits the revised execution context, advancing the fold through the covered interactions. The resulting carrier set and execution context define the folded portion of the next context view, while subsequent interactions begin a new live tail. If the checks fail, the existing context view and live tail remain unchanged.

Experiment

The experiments evaluate CarryOn on OSWorld 2.0 and BrowseComp-Plus using Claude Opus 4.7, measuring task performance, token usage, and cost across long-horizon computer-use and information-seeking tasks. CarryOn improves task scores while reducing token consumption and cost in both settings, and its context remains compact even as execution length grows. Comparisons with sliding-window and summary-based compression show that aggressive history reduction alone harms performance, whereas CarryOn’s object-oriented organization preserves useful task state and supports better continuation. Ablations further show that continuation carriers and execution context provide complementary information, helping the agent resume from established progress rather than repeating prior work.

CarryOn improves both binary and partial task completion on OSWorld 2.0 relative to its Claude Opus host agent, with partial score rising from 43.9% to 49.7% and binary score from 15.7% to 19.4%. These gains exceed the other evaluated frontier models while also reducing total token usage by 51.9% and cost per task by 35.9%, indicating lower long-horizon execution cost without sacrificing task performance. CarryOn adds 5.8 percentage points to partial score and 3.7 points to binary score over the same host agent. The improved scores surpass other frontier models while cost per task drops by about a third and token usage falls by more than half.

CarryOn reduces resource usage per task on both OSWorld 2.0 and BrowseComp-Plus relative to baseline. The largest savings appear on OSWorld 2.0, where total token usage falls by more than half and total cost by about a third, while BrowseComp-Plus shows smaller but consistent reductions. These improvements align with lower context-processing overhead without sacrificing task performance. CarryOn lowers total token usage per task on both benchmarks, with a larger relative reduction on OSWorld 2.0 than on BrowseComp-Plus. Total cost per task also declines, mainly reflecting reduced agent token usage and agent cost rather than added runtime overhead.

On the 100-question BrowseComp-Plus subset, adding CarryOn to Claude Opus 4.7 improves accuracy from 49.0% to 56.0%, surpassing the compared frontier models. This gain is accompanied by lower token usage and cost relative to the Claude Opus baseline. CarryOn raises Claude Opus 4.7 accuracy from 49.0% to 56.0% on this BrowseComp-Plus subset, moving it ahead of GPT-5, o3, GPT-OSS-120B, and the standalone Claude Opus baseline. The same CarryOn configuration reduces total token usage by 22.9% and total cost by 7.1% compared with the Claude Opus baseline.

On a shared OSWorld 2.0 subset, aggressive context compression alone lowers both binary and partial scores relative to an uncompressed baseline. Applying object-oriented organization within a textual summary recovers much of that loss, but the full CarryOn runtime reaches the highest partial score while matching the baseline binary score. CarryOn also achieves this with less retained text than the guided summary approach. Sliding Window and Generic Summary retain the shortest contexts but reduce both binary and partial scores relative to the baseline. CarryOn-Guided Summary recovers much of the lost partial score, while full CarryOn improves partial score by 5 percentage points with about 10 percent shorter post-fold text. CarryOn matches the baseline binary score and achieves the highest partial score without retaining the most text.

An ablation on the shared OSWorld 2.0 subset shows that both execution context and continuation carriers contribute to CarryOn's partial score. Removing execution context lowers binary and partial scores without substantially changing agent calls, while removing continuation carriers lowers partial score and increases agent calls and cost. The two components appear to provide complementary information for continuing tasks. Removing execution context caused a substantial drop in binary and partial scores while agent calls remained nearly unchanged. Removing continuation carriers increased agent calls and cost while partial score fell, suggesting the agent had to recover or reproduce prior progress.

CarryOn is evaluated on OSWorld 2.0 task completion and a 100-question BrowseComp-Plus subset using a Claude Opus host, where it improves partial and binary task scores or accuracy over the baseline while reducing total token usage and cost per task. Ablations show that aggressive context compression alone hurts performance, whereas the full runtime with object-oriented organization and both execution context and continuation carriers recovers or improves scores. The two carrier components provide complementary support, with execution context mainly preserving task success and continuation carriers reducing agent calls and helping the agent avoid reproducing prior progress.


AI로 AI 구축

아이디어에서 출시까지 — 무료 AI 코코딩, 즉시 사용 가능한 환경, 최적의 GPU 가격으로 AI 개발을 가속화하세요.

AI 협업 코딩
바로 사용 가능한 GPU
최적의 가격

HyperAI Newsletters

최신 정보 구독하기
한국 시간 매주 월요일 오전 9시 에 이번 주의 최신 업데이트를 메일로 발송합니다
이메일 서비스 제공: MailChimp