Command Palette
Search for a command to run...
「意識」の心を探る:視覚言語モデルにおける選択的アクセスとグローバルワークスペース
「意識」の心を探る:視覚言語モデルにおける選択的アクセスとグローバルワークスペース
Jiahao Huang Jun Wang
概要
視覚言語モデル(VLM)は視覚情報とテキスト情報を統合し、多様なマルチモーダルタスクを実行するが、その出力からモデル内部の概念表現を知ることはできない。脳科学において、グローバルワークスペース理論(GWT)は、情報が複数の並列的な脳プロセスから選択され、共有ワークスペースで統合され、異なる特殊化されたプロセスに利用可能になると提唱する。本研究では、これらのグローバルワークスペース機能との関連で、VLMにおけるマルチモーダル概念処理を調査する。我々は、視覚エンコーダレンズと言語デコーダレンズを組み合わせたマルチモーダルヤコビアンレンズであるMultimodal Concept Lens(MC-Lens)を導入する。両レンズは中間状態をデコーダの出力語彙によって定義される共有意味空間に写像し、視覚処理と言語処理にわたる概念アクセス可能性の比較を可能にする。MC-Lensはまた、下流の計算におけるアクセスされた概念の役割を調べるための内部概念介入もサポートする。我々の実験は4つの関連する側面に取り組む。(i)アクセス可能性と選択的アクセス。マルチモーダル概念情報は中間状態から読み取り可能であり、タスク要求に応じて選択的にアクセスできる。我々は「読み出しキャリア」を単一の名前トークンからトークン集合へ拡張し、概念情報をよりよく捉えて表現し、後続の反事実実験を支援する。(ii)下流計算における概念。反事実実験により、我々がアクセスする概念情報は読み取り可能であるだけでなく、下流の計算と推論にも関与することが示される。(iii)クロスモーダルアラインメントと選択的アクセスの発達。我々はクロスモーダル概念アラインメントを追跡するための2つのJ空間ベースの指標を開発する。制御されたVLM訓練において、これらの指標は隠れ状態コサインよりもその発達を明確に反映する。実験はまた、信頼できる選択的アクセスが概念アクセス可能性よりも訓練の後期に発達することを示す。(iv)モデル間で共有される機能。VLMのファミリーとサイズを横断して、内部組織の違いにもかかわらず、概念アクセス可能性、クエリ依存の選択性、クロスタスク介入効果の共有パターンを見いだす。これらの知見は、マルチモーダル人工システムにおけるGWTを研究するための実験的基盤を提供し、GWTがクロスモーダルアラインメントの改善をどのように導き得るかを調査する道を開く。
One-sentence Summary
Researchers from Imperial College London and University College London introduce the Multimodal Concept Lens (MC-Lens), a multimodal Jacobian lens that combines vision-encoder and language-decoder lenses to map intermediate states into a shared semantic space, with experiments showing selective concept access, causal roles in downstream reasoning, and shared global-workspace patterns across VLM families and sizes.
Key Contributions
- Introduces the Multimodal Concept Lens (MC-Lens), a multimodal Jacobian lens combining vision encoder and language decoder lenses to map intermediate visual and language states into a shared semantic space defined by the decoder’s output vocabulary.
- Extends concept readouts from a single name token to a set of tokens and uses counterfactual interventions to show that accessed concept information is not only readable but also participates in downstream computation and reasoning.
- Develops two J-space based metrics for tracking cross-modal concept alignment; in controlled VLM training, these metrics reflect cross-modal alignment development more clearly than hidden state cosine. The experiments also show that reliable selective access develops later than concept accessibility, and shared patterns of concept accessibility, query-dependent selectivity, and cross-task intervention effects hold across VLM families and sizes.
Introduction
Vision-language models (VLMs) integrate visual and textual information for tasks such as visual question answering, but their outputs do not expose internal concept representations, and they can make errors even when the needed visual information remains readable in intermediate states. Existing Jacobian-based methods such as J-Lens provide vocabulary readouts of intermediate language-model states and have been used to study global workspace behavior in large language models, but they focus on language-only states and often represent concepts through single name tokens, limiting multimodal analysis. The authors introduce the Multimodal Concept Lens (MC-Lens), which combines a vision encoder lens and a language decoder lens to map intermediate visual and language states into a shared semantic space defined by the decoder output vocabulary. This approach supports concept readouts, counterfactual interventions, richer multi-token concept direction sets, and the study of selective access and cross-modal alignment in VLMs.
Method
The authors develop MC-Lens, a Jacobian-based method designed to access concept information from intermediate states in Vision-Language Models (VLMs) and investigate the role of these concepts in downstream computation. Since a VLM's final output provides only a limited view of its internal processing, MC-Lens combines V-Lens and L-Lens to measure the effects of intermediate hidden states on the final-layer decoder hidden states.
For a multimodal input x, let hℓ,pm(x) denote the intermediate state at layer ℓ and position p, where m∈{E,D,C} marks the vision encoder, the language decoder, and the connector, respectively. The partial derivatives of the final decoder state hL,qD(x) with respect to the intermediate state form the Jacobian matrix Jℓ,p→qm(x), which provides a first-order Taylor approximation of how a small change in the intermediate state affects the final output.
To isolate the general effect of an intermediate state across contexts, the authors average the Jacobian matrices. However, unlike pure language models, VLMs contain significantly more image tokens than text tokens. A uniform averaging strategy would disproportionately weight image positions. To address this, MC-Lens groups intermediate positions into categories (e.g., image, text, and template tokens for L-Lens; all patches for V-Lens) and averages within each category before averaging across categories. This ensures each category receives equal total weight regardless of token count. The final-layer positions are restricted to text positions in the decoder to focus on the model's textual output.
To determine where specific concepts appear within the model's internal states, the authors employ a vocabulary-based concept readout. An intermediate state h is mapped through the estimated lens Jℓ into the final-layer decoder state space. The resulting vector is processed through the decoder's final normalization and unembedding matrix WU to produce logits for every word in the vocabulary, ranking tokens by their proximity to the state.
Visual states often contain a large component common to different images, which can bury the specific object name under uninformative tokens. To resolve this, the authors introduce reference centring. A reference state μℓ is computed by averaging the readout states over a set of natural reference images. Subtracting μℓ from the target state h removes this common component, allowing the readout to rank tokens based on how the specific image state differs from an average image.
Because a hidden state typically carries more information about a concept than a single name token can express, the authors describe concepts using a set of tokens rather than a single token. They construct concept direction sets using two methods: word-form selection and greedy selection.
Word-form selection collects pre-defined tokens that name the concept, including its case forms, inflections, aliases, translations, and the first tokens of multi-token forms. Greedy selection, on the other hand, reconstructs the concept-specific part of the hidden state using vocabulary directions chosen from the entire vocabulary via orthogonal matching pursuit.
In the greedy selection process, the algorithm iteratively selects the token whose vocabulary direction has the largest inner product with the remaining state difference. It then refits the coefficients of all selected directions using non-negative least squares and updates the remaining difference. This process repeats until a specified budget of tokens is reached, capturing not only direct name forms but also related concepts that contribute to the representation.
To investigate whether the accessed concepts are actively used in downstream reasoning or merely present in the states, the authors perform counterfactual interventions. They define a source concept and a target concept, running the model on inputs for both to obtain their respective hidden states. Interventions are then applied at chosen layers during the forward pass.
For single-token concepts, the authors utilize PairSwap, which exchanges the coordinates of the source and target states along their respective vocabulary directions. For concept direction sets, they introduce Subspace Replacement (SubRep). SubRep projects both the source and target states onto the subspace spanned by the combined concept directions of both sets. It then replaces the source state's component within this subspace with the target state's component, while retaining the orthogonal component of the source state. By comparing the model's answers before and after these interventions, the authors can verify if altering the concept representation directly influences the model's computational output.
Experiment
The paper evaluates a multimodal concept lens, MC-Lens, across VQA, object recognition, spatial readout, autoregressive generation, and counterfactual intervention settings. These experiments validate that image and text evidence improve concept readability, that expanded and greedy token sets capture broader concept-related information, and that query-dependent selective access emerges mainly within an estimated workspace. Causal interventions show that accessed concept directions influence direct, one-hop, and multi-hop reasoning, while comparisons across Qwen, DeepSeek, and Gemma models plus training checkpoints indicate shared workspace-like functions and progressive development of cross-modal alignment and selective access.
The same concept can be accessed through multiple word forms, and these forms differ in how readable they are. The canonical name form is the most readable, while case or spacing variants and related word forms rank lower. The canonical name token is the most accessible word form for the concept. Case or spacing variants and other related word forms are progressively less readable.
Greedy selection based on reconstruction weight can identify concept-related tokens outside a predefined word-form set. In the Canada flag example, out-of-set tokens such as 'maple', '.C', and 'bc' rank much lower in the readout than the word-form tokens but still show relatively large reconstruction weights. The top reconstruction-weight tokens include both word-form tokens ('Canada', 'Canadian') and tokens outside that set ('maple', '.C', 'bc'). Lower readout rank does not prevent an out-of-set token from having a relatively large reconstruction weight. The in-set tokens have the highest readout ranks, while the out-of-set tokens still appear among the largest reconstruction weights.
These experiments evaluate how multiple word forms affect access to a concept and how reconstruction weights reveal concept-related tokens. The canonical name form is the most readable and accessible, while case or spacing variants and related word forms are progressively less accessible. Greedy selection by reconstruction weight identifies concept-related tokens outside the predefined set, as shown by the Canada flag example where out-of-set tokens like “maple,” “.C,” and “bc” have lower readout ranks but still show relatively large reconstruction weights. Thus, reconstruction weight can surface concept-relevant tokens even when readout rank does not prioritize them.