319 lines
25 KiB
XML
319 lines
25 KiB
XML
<?xml version='1.0' encoding='UTF-8'?>
|
|
<feed xmlns:opensearch="http://a9.com/-/spec/opensearch/1.1/" xmlns:arxiv="http://arxiv.org/schemas/atom" xmlns="http://www.w3.org/2005/Atom">
|
|
<id>https://arxiv.org/api/lzCoOKH2nei3auM0yuLPfHykWJM</id>
|
|
<title>arXiv Query: search_query=&id_list=2610.25640,2610.27032,2610.27234,2610.27634,2610.28223,2610.28385,2610.28441,2610.29820,2610.31169&start=0&max_results=50</title>
|
|
<updated>2026-10-25T14:14:40Z</updated>
|
|
<link href="https://arxiv.org/api/query?search_query=&start=0&max_results=50&id_list=2610.25640,2610.27032,2610.27234,2610.27634,2610.28223,2610.28385,2610.28441,2610.29820,2610.31169" type="application/atom+xml"/>
|
|
<opensearch:itemsPerPage>50</opensearch:itemsPerPage>
|
|
<opensearch:totalResults>9</opensearch:totalResults>
|
|
<opensearch:startIndex>0</opensearch:startIndex>
|
|
<entry>
|
|
<id>http://arxiv.org/abs/2610.28223v1</id>
|
|
<title>Local Inference of LLMs on Long Contexts: A Data Systems Perspective</title>
|
|
<updated>2026-10-20T13:56:12Z</updated>
|
|
<link href="https://arxiv.org/abs/2610.28223v1" rel="alternate" type="text/html"/>
|
|
<link href="https://arxiv.org/pdf/2610.28223v1" rel="related" type="application/pdf" title="pdf"/>
|
|
<summary>Large language models can solve complex problems across a variety of subjects, such as mathematics and coding. For such complex analytical tasks, models with a long context perform better. Serving models with long context is currently mostly done on powerful systems with multiple GPUs, which are too expensive for most users. An alternative is local inference, or serving a model on a user's own machine, which removes per-token costs and rate limits, besides keeping sensitive data private and giving users full control over the models they run. The common understanding, however, is that local LLMs need compression (e.g., quantization) to run on a single GPU. In this paper, we set out to study the limitations that prevent serving long-context models for single users, besides the capacity issue. Rather than characterizing a single model on one GPU, we analyze how different models behave across several GPU generations. This lets us uncover not just individual bottlenecks but broader trends in where inefficiencies arise. Our analysis confirms that, as expected, self-attention dominates the runtime for long-context inference. More unexpectedly, our evaluation reveals that the current structure of self-attention leaves key GPU resources significantly underutilized, and the newest GPU is often the least well served. Many of these findings are fundamentally data management problems, from paging the KV cache to improving cache utilization and synchronization in the GPU, which is why we bring this study to the Data Systems community. To engage this community, we present our findings as a series of experimental observations and formulate recommendations for future work.</summary>
|
|
<category term="cs.DB" scheme="http://arxiv.org/schemas/atom"/>
|
|
<category term="cs.AI" scheme="http://arxiv.org/schemas/atom"/>
|
|
<published>2026-10-20T13:56:12Z</published>
|
|
<arxiv:primary_category term="cs.DB"/>
|
|
<author>
|
|
<name>Mattias Dürrmeier</name>
|
|
</author>
|
|
<author>
|
|
<name>Alberto Lerner</name>
|
|
</author>
|
|
</entry>
|
|
<entry>
|
|
<id>http://arxiv.org/abs/2610.28441v1</id>
|
|
<title>Stratified Sparse Attention: Reducing the Sparse-to-Dense Gap at Extreme Sparsity</title>
|
|
<updated>2026-10-20T16:02:12Z</updated>
|
|
<link href="https://arxiv.org/abs/2610.28441v1" rel="alternate" type="text/html"/>
|
|
<link href="https://arxiv.org/pdf/2610.28441v1" rel="related" type="application/pdf" title="pdf"/>
|
|
<summary>Large Language Model inference over long contexts is increasingly bottlenecked by the cost of attending to a growing Key-Value (KV) cache. Sparse attention reduces this cost by accessing only a fraction of the cache, but existing methods face a trade-off between deterministic retrieval, which captures high-scoring tokens but discards residual attention mass, and sampling, which improves coverage at the cost of higher variance. Hybrid methods combine top-$k$ retrieval with uniform sampling, yet still exhibit a substantial gap from dense attention at aggressive sparsity. We introduce \emph{Stratified Sparse Attention (SSA)}, a unified framework combining deterministic retrieval with score-guided sampling. SSA deterministically attends to high-scoring tokens while sampling the residual using proxy attention scores and correcting for their inclusion probabilities, thereby recovering attention mass beyond the retrieval set. SSA encompasses top-$k$, top-$p$, and hybrid top-$k$+sampling as special cases. Across RULER, LongBench, LOFT, and AIME, and five models ranging from 3B to 27B parameters, SSA consistently improves over the baselines at matched sparsity. On RULER-HARD with Ministral-3-8B, SSA improves accuracy over the strongest practical baseline from 81.8\% to 84.2\% at 32K and from 63.8\% to 69.3\% at 128K under $50\times$ attention sparsity, recovering 94\% and 85\% of dense-attention performance, respectively. With optimized CUDA kernels, SSA achieves up to $2.96\times$ decode speedup over FlashInfer at 1M context, demonstrating that its accuracy gains translate into practical long-context inference acceleration. We open-source our code at https://github.com/skylight-org/SSA-Paper-Code.</summary>
|
|
<category term="cs.AI" scheme="http://arxiv.org/schemas/atom"/>
|
|
<published>2026-10-20T16:02:12Z</published>
|
|
<arxiv:comment>26 pages, 5 figures, 13 tables</arxiv:comment>
|
|
<arxiv:primary_category term="cs.AI"/>
|
|
<author>
|
|
<name>Sahil Joshi</name>
|
|
</author>
|
|
<author>
|
|
<name>Prithvi Dixit</name>
|
|
</author>
|
|
<author>
|
|
<name>Aryan Katiyar</name>
|
|
</author>
|
|
<author>
|
|
<name>Agniva Chowdhury</name>
|
|
</author>
|
|
<author>
|
|
<name>Joseph E. Gonzalez</name>
|
|
</author>
|
|
<author>
|
|
<name>Anshumali Shrivastava</name>
|
|
</author>
|
|
<author>
|
|
<name>Aditya Desai</name>
|
|
</author>
|
|
<author>
|
|
<name>Kumar Krishna Agrawal</name>
|
|
</author>
|
|
</entry>
|
|
<entry>
|
|
<id>http://arxiv.org/abs/2610.27032v1</id>
|
|
<title>M-Plan: Comprehensive Planning For LLM Agents with Memory Arrangement</title>
|
|
<updated>2026-10-19T16:30:42Z</updated>
|
|
<link href="https://arxiv.org/abs/2610.27032v1" rel="alternate" type="text/html"/>
|
|
<link href="https://arxiv.org/pdf/2610.27032v1" rel="related" type="application/pdf" title="pdf"/>
|
|
<summary>Large language model (LLM)-based agents have recently demonstrated outstanding performance in single-turn tasks, yet they continue to struggle with long-horizon tasks, particularly in environments without prior training. A key limitation of single LLMs is their difficulty in processing long contexts, which stems from weaknesses in continuous decision-making and reasoning capabilities. Although existing multi-agent systems (MAS) equipped with long-term memory bases can partially address this gap, they mostly rely on knowledge reuse or summarization, an approach that is often constrained by directly retrieval without any adaptation for the current task, while the retrieved memory may contain much history noises waiting to be preprocessed. In contrast, MAS characterized by task-specific guidance often lack long-term memory specifically designed for the guidance. To address these challenges, we propose M-Plan, a closed-loop MAS framework that integrates long-term and short-term memory. By combining global-local and past-current guidance, M-Plan enhances agents' performance on multi-turn tasks while maintaining a plug-and-play design. During task execution, agents receive task-specific milestones and insights, and are provided with local hints only when confusion arises, which form global-local guidance together. These guidance generation and utilization construct the short-term memory as well. After task completion, relevant information about the current task is optimized or reorganized before being sent to the long-term memory storage for future retrieval. The designments mentioned above build a comprehensive framework different from other individual long-term or short-term memory works. Extensive experiments on multi-turn tasks including ALFWorld, Webshop, and PDDL across diverse models demonstrate that M-Plan outperforms multiple baseline methods in both accuracy and efficiency.</summary>
|
|
<category term="cs.AI" scheme="http://arxiv.org/schemas/atom"/>
|
|
<published>2026-10-19T16:30:42Z</published>
|
|
<arxiv:primary_category term="cs.AI"/>
|
|
<author>
|
|
<name>Ziyang Liu</name>
|
|
</author>
|
|
<author>
|
|
<name>Jiakang Yuan</name>
|
|
</author>
|
|
<author>
|
|
<name>Jiayuan Fan</name>
|
|
</author>
|
|
<author>
|
|
<name>Tao Chen</name>
|
|
</author>
|
|
</entry>
|
|
<entry>
|
|
<id>http://arxiv.org/abs/2610.27634v1</id>
|
|
<title>Standards-Guided and Dependency-Aware Code-Level Documentation Generation</title>
|
|
<updated>2026-10-20T04:58:06Z</updated>
|
|
<link href="https://arxiv.org/abs/2610.27634v1" rel="alternate" type="text/html"/>
|
|
<link href="https://arxiv.org/pdf/2610.27634v1" rel="related" type="application/pdf" title="pdf"/>
|
|
<summary>Automatically generating high-quality documentation for software repositories remains challenging: existing approaches largely treat documentation as unconstrained text generation, lacking explicit quality specifications, depending heavily on long-context prompts over raw code, and offering limited support for reproducible evaluation. We argue that code-level documentation generation should instead be a standards-guided software engineering task, in which documentation is generated and assessed against explicit, reusable quality requirements derived from authoritative standards. We define code documentation as natural-language descriptions of repository functions and classes, organized by source-code path. We present CODEDOC, a standards-guided and dependency-aware framework that identifies dependencies between code entities via static call-graph and AST analysis and constructs dependency-aware structured prompts combining local code context, repository paths, and documentation criteria drawn from authoritative standards and style guides. We further introduce an interactive LLM-as-a-judge protocol that supplies criterion-aligned feedback to refine generated documentation along fine-grained dimensions from formal and practice-oriented standards. Experiments on ten open-source Python repositories show that CODEDOC produces higher-quality documentation than RepoAgent and a long-context baseline under standards-aligned evaluation, with relative improvements of 11.6%-17.0% and 21.4%-29.6%, respectively, while consuming roughly an order of magnitude fewer tokens per documentation entity than the long-context baseline. A human study confirms substantial alignment between LLM-based and human judgments (Spearman's rho = 0.72), and the relative findings hold across different judge LLMs. Code is available at https://github.com/ControllableModel/CodeDoc.</summary>
|
|
<category term="cs.SE" scheme="http://arxiv.org/schemas/atom"/>
|
|
<published>2026-10-20T04:58:06Z</published>
|
|
<arxiv:primary_category term="cs.SE"/>
|
|
<author>
|
|
<name>Tingxu Han</name>
|
|
</author>
|
|
<author>
|
|
<name>Wei Song</name>
|
|
</author>
|
|
<author>
|
|
<name>Ziming Li</name>
|
|
</author>
|
|
<author>
|
|
<name>Yuchen Chen</name>
|
|
</author>
|
|
<author>
|
|
<name>Weisong Sun</name>
|
|
</author>
|
|
<author>
|
|
<name>Zhenpeng Chen</name>
|
|
</author>
|
|
<author>
|
|
<name>Chunrong Fang</name>
|
|
</author>
|
|
<author>
|
|
<name>Zhenyu Chen</name>
|
|
</author>
|
|
<author>
|
|
<name>Yang Liu</name>
|
|
</author>
|
|
</entry>
|
|
<entry>
|
|
<id>http://arxiv.org/abs/2610.28385v1</id>
|
|
<title>RACE: RoPE-Aligned Attention Compression Based on Query-Key Activation Energies</title>
|
|
<updated>2026-10-20T15:34:02Z</updated>
|
|
<link href="https://arxiv.org/abs/2610.28385v1" rel="alternate" type="text/html"/>
|
|
<link href="https://arxiv.org/pdf/2610.28385v1" rel="related" type="application/pdf" title="pdf"/>
|
|
<summary>Head-dimension compression can reduce the memory required by the key-value (KV) cache, but existing methods often reconstruct full-dimensional representations during inference, adding significant decoding FLOPs overhead. We formalize the design considerations for converting pretrained attention into a natively reduced-dimensional form that reduces both KV-cache storage and attention computation using a calibration set. Specifically, we consider reductions that (1) apply a shared projection to queries and keys so that they remain in a common reduced feature space, (2) derive this projection jointly from query and key activations to better preserve their interaction, and (3) are compatible with the pretrained RoPE transformation. To obtain a reconstruction-free realization of this reduction, we restrict it to coordinate selection and theoretically show that RoPE compatibility then holds if and only if complete rotary pairs are retained. Building on this characterization, we introduce RACE, a post-training method that selects rotary pairs using their joint query-key activation energy. We theoretically show that this criterion minimizes a separable, calibration-dependent upper bound on post-RoPE query-key product approximation error. The resulting reductions are folded into the model weights and require neither runtime reconstruction nor specialized kernels. Across three model families and different compression levels, RACE outperforms structured pruning and remains competitive with reconstruction-based methods on language-modeling, zero-shot, and long-context tasks. At 50% KV-cache retention and 256K context, RACE reduces total inference FLOPs by 47.8%, yielding 1.79x higher throughput, 43.2% lower time-to-first-token (TTFT), and 28.1% lower allocated GPU memory in comparison to an uncompressed model.</summary>
|
|
<category term="cs.AI" scheme="http://arxiv.org/schemas/atom"/>
|
|
<published>2026-10-20T15:34:02Z</published>
|
|
<arxiv:primary_category term="cs.AI"/>
|
|
<author>
|
|
<name>Irene Tenison</name>
|
|
</author>
|
|
<author>
|
|
<name>Abdulrahman Alabdulkareem</name>
|
|
</author>
|
|
<author>
|
|
<name>Daniel Karl I. Weidele</name>
|
|
</author>
|
|
<author>
|
|
<name>Nima Dehmamy</name>
|
|
</author>
|
|
<author>
|
|
<name>Dan Gutfreund</name>
|
|
</author>
|
|
</entry>
|
|
<entry>
|
|
<id>http://arxiv.org/abs/2610.27234v1</id>
|
|
<title>EGI-BENCH: An Enterprise General Intelligence Benchmark Suite</title>
|
|
<updated>2026-10-19T20:02:07Z</updated>
|
|
<link href="https://arxiv.org/abs/2610.27234v1" rel="alternate" type="text/html"/>
|
|
<link href="https://arxiv.org/pdf/2610.27234v1" rel="related" type="application/pdf" title="pdf"/>
|
|
<summary>Enterprise adoption of LLMs in agentic workflows is gated by evaluations that span a wide arc of abilities: CRM operations, heterogeneous-document retrieval, personal data understanding, multi-turn planning, tool use, function calling, long-horizon research, and long-context software engineering. These evaluations live today in separate repositories with divergent runners, dependencies, and scoring conventions, which makes cross-benchmark comparison difficult and obscures what a single aggregate number actually represents. We release EGI-BENCH, a unified LLM agent benchmark suite that consolidates eight enterprise facing agent benchmarks (CRMARENA, HERB, PERSONABENCH, USERBENCH, MCP-UNIVERSE, MCPEVAL, BENCHFORCE, LOCOBENCH) behind a single command-line interface with two runtime-budgeted execution modes. On top of the suite we define the Enterprise General Intelligence (EGI) Score, a six-dimensional framework (M1-M6) whose buckets are populated by fine-grained sub-metrics routed from each benchmark rather than by benchmark-level averages. We describe the suite, the sub-metric routing, and the quick/deep budgets, and report results for fourteen frontier and cost-efficient LLMs spanning the GPT, Claude, and Gemini families under quick mode. Top-line EGI ranges from 39.6 (GPT-4o mini) to 65.6 (gpt-5.5), and no single model dominates every capability axis: gpt-5.5 leads task outcome, planning, and retrieval grounding; Claude Sonnet 4.5 leads tool actioning and safety/abstention; and Claude Haiku 4.5 leads engineering quality. Code is available at https://github.com/SalesforceAIResearch/egi-bench.</summary>
|
|
<category term="cs.AI" scheme="http://arxiv.org/schemas/atom"/>
|
|
<published>2026-10-19T20:02:07Z</published>
|
|
<arxiv:primary_category term="cs.AI"/>
|
|
<author>
|
|
<name>Zhiwei Liu</name>
|
|
</author>
|
|
<author>
|
|
<name>Zhujun Lan</name>
|
|
</author>
|
|
<author>
|
|
<name>Jielin Qiu</name>
|
|
</author>
|
|
<author>
|
|
<name>Zixiang Chen</name>
|
|
</author>
|
|
<author>
|
|
<name>Liangwei Yang</name>
|
|
</author>
|
|
<author>
|
|
<name>Ming Zhu</name>
|
|
</author>
|
|
<author>
|
|
<name>Akshara Prabhakar</name>
|
|
</author>
|
|
<author>
|
|
<name>Wenting Zhao</name>
|
|
</author>
|
|
<author>
|
|
<name>John Emmons</name>
|
|
</author>
|
|
<author>
|
|
<name>Jason Wu</name>
|
|
</author>
|
|
<author>
|
|
<name>Shafiq Rayhan Joty</name>
|
|
</author>
|
|
<author>
|
|
<name>Junnan Li</name>
|
|
</author>
|
|
<author>
|
|
<name>Shelby Heinecke</name>
|
|
</author>
|
|
<author>
|
|
<name>Silvio Savarese</name>
|
|
</author>
|
|
<author>
|
|
<name>Huan Wang</name>
|
|
</author>
|
|
</entry>
|
|
<entry>
|
|
<id>http://arxiv.org/abs/2610.29820v1</id>
|
|
<title>UlaCache: Unified Logical Addressing for Sparse LLM Serving</title>
|
|
<updated>2026-10-21T14:46:11Z</updated>
|
|
<link href="https://arxiv.org/abs/2610.29820v1" rel="alternate" type="text/html"/>
|
|
<link href="https://arxiv.org/pdf/2610.29820v1" rel="related" type="application/pdf" title="pdf"/>
|
|
<summary>Long contexts increase the memory cost of the key-value (KV) cache in large language model (LLM) inference. Sparse attention reduces attention computation and memory traffic by selecting historical tokens, but the retained KV cache must remain available for later decoding steps. We present UlaCache, a KV cache management system built around a unified logical address space spanning GPU KV pools and optional CPU memory. Stable logical references let the inference engine allocate and select KV independently of physical placement. Common allocation and sparse-access interfaces support data-parallel (DP) and tensor-parallel (TP) attention. For distributed storage, local GPU buffers retain selected KV across decoding steps, so only missing entries require transfers. When CPU storage is enabled, Parallel Bucketed LRU (PB-LRU) manages a GPU pool shared across requests. It updates recency metadata and selects eviction victims in parallel. UlaCache transfers KV and then updates the address mappings. With speculative decoding enabled under matched CPU and GPU memory budgets, UlaCache achieves peak decoding throughput speedups of 1.16 $\times$ (DP) and 1.70 $\times$ (TP) on H200, and 1.73 $\times$ (DP) and 2.51 $\times$ (TP) on B300, compared with the state-of-the-art baseline.</summary>
|
|
<category term="cs.DC" scheme="http://arxiv.org/schemas/atom"/>
|
|
<published>2026-10-21T14:46:11Z</published>
|
|
<arxiv:primary_category term="cs.DC"/>
|
|
<author>
|
|
<name>Isaac Zhu</name>
|
|
</author>
|
|
<author>
|
|
<name>Alan Cao</name>
|
|
</author>
|
|
<author>
|
|
<name>Hugh Yin</name>
|
|
</author>
|
|
<author>
|
|
<name>Rocky Wang</name>
|
|
</author>
|
|
<author>
|
|
<name>Orion Wang</name>
|
|
</author>
|
|
<author>
|
|
<name>Hscos Zhang</name>
|
|
</author>
|
|
<author>
|
|
<name>Jack Li</name>
|
|
</author>
|
|
<author>
|
|
<name>Jason Zhao</name>
|
|
</author>
|
|
</entry>
|
|
<entry>
|
|
<id>http://arxiv.org/abs/2610.31169v1</id>
|
|
<title>SARIA: Persistence-Aware KV Caching with Coordinated DRAM--SSD Reload for LLM Agents</title>
|
|
<updated>2026-10-22T12:25:27Z</updated>
|
|
<link href="https://arxiv.org/abs/2610.31169v1" rel="alternate" type="text/html"/>
|
|
<link href="https://arxiv.org/pdf/2610.31169v1" rel="related" type="application/pdf" title="pdf"/>
|
|
<summary>Multi-turn LLM agents usually reuse long context prefixes, making key value (KV) caching crucial for reducing prefill latency. SSDs provide a low-cost extension to limited DRAM capacity but introduce two key challenges. Eagerly persisting all KV cache blocks incurs substantial write traffic and rapidly consumes finite SSD endurance. Meanwhile, the small number of SSDs provisioned in typical GPU servers limits aggregate reload bandwidth, making SSD-resident KV cache much slower to retrieve than that in DRAM and inflating prefill latency.
|
|
We present \textsc{Saria} (Selective Admission and Reload for Inference Acceleration), a KV caching system that jointly manages DRAM and SSD by exploiting the session-level temporal locality of LLM agents to reduce SSD writes and accelerate cache reload. On the write path, \textsc{Saria} uses eviction and reuse history to selectively persist KV cache blocks that exhibit reuse opportunities beyond their DRAM residency, avoiding unnecessary writes for KV cache already hosted in DRAM. On the read path, \textsc{Saria} promotes selected SSD-hit KV cache blocks from GPU memory into DRAM after prefill, allowing subsequent reuse within the same session to reduce SSD read traffic while limiting DRAM contention. A transfer coordinator paces DRAM reads while SSD transfers are active, allowing both paths to make progress and efficiently share GPU ingress bandwidth.
|
|
We implement \textsc{Saria} on LMCache MP and evaluate it using workloads from TraceLab and WEKA, covering both full-attention and hybrid-attention models. The results show that \textsc{Saria} reduces SSD writes by 57.1--58.9\% compared with popular full duplicate caching and the mean time to first token (TTFT) by 42.3--79.7\% over DRAM-only caching.</summary>
|
|
<category term="cs.OS" scheme="http://arxiv.org/schemas/atom"/>
|
|
<published>2026-10-22T12:25:27Z</published>
|
|
<arxiv:comment>12 pages, 16 figures</arxiv:comment>
|
|
<arxiv:primary_category term="cs.OS"/>
|
|
<author>
|
|
<name>Hui Li</name>
|
|
</author>
|
|
<author>
|
|
<name>Qihui Zhou</name>
|
|
</author>
|
|
<author>
|
|
<name>Xiao Yan</name>
|
|
</author>
|
|
<author>
|
|
<name>Shumeng Zhang</name>
|
|
</author>
|
|
<author>
|
|
<name>Zijie Dai</name>
|
|
</author>
|
|
<author>
|
|
<name>Zequn Gong</name>
|
|
</author>
|
|
<author>
|
|
<name>Mingcong Song</name>
|
|
</author>
|
|
<author>
|
|
<name>Guoping Long</name>
|
|
</author>
|
|
<author>
|
|
<name>Hongjie Si</name>
|
|
</author>
|
|
<author>
|
|
<name>James Cheng</name>
|
|
</author>
|
|
</entry>
|
|
<entry>
|
|
<id>http://arxiv.org/abs/2610.25640v1</id>
|
|
<title>Think, Compress, Answer: Reinforcement Learning for Multimodal Grounding via Reasoning Compression</title>
|
|
<updated>2026-10-19T01:34:19Z</updated>
|
|
<link href="https://arxiv.org/abs/2610.25640v1" rel="alternate" type="text/html"/>
|
|
<link href="https://arxiv.org/pdf/2610.25640v1" rel="related" type="application/pdf" title="pdf"/>
|
|
<summary>Extended reasoning has substantially improved multimodal large language models (MLLMs) on tasks requiring compositional and relational inference. However, multimodal grounding imposes a distinct requirement: reasoning must ultimately converge on a target-specific compact representation that supports precise localization. As reasoning trajectories grow longer, they often expand into broad scene narratives and peripheral relational details, which can dilute grounded perceptual evidence and lead to ambiguous or incorrect predictions. Motivated by the information bottleneck principle, we propose Think-Compress-Answer (TCA), a reinforcement learning framework that decomposes multimodal grounding into three phases: free-form reasoning, target-aware context compression, and answer generation conditioned on the compressed context. TCA is optimized through a multi-stage Group Relative Policy Optimization (GRPO) with progressive rewards that establish the structured output protocol, minimize reasoning-specific information while preserving target-relevant content, and directly improve localization accuracy. This staged design enables MLLMs to retain the benefits of extended reasoning while distilling it into the minimal context required for grounding. Experiments across six multimodal grounding benchmarks show that TCA attains substantial zero-shot performance gains, demonstrating the effectiveness of reasoning compression.</summary>
|
|
<category term="cs.AI" scheme="http://arxiv.org/schemas/atom"/>
|
|
<published>2026-10-19T01:34:19Z</published>
|
|
<arxiv:primary_category term="cs.AI"/>
|
|
<author>
|
|
<name>Jinbae Seo</name>
|
|
</author>
|
|
<author>
|
|
<name>Hyeongjun Kwon</name>
|
|
</author>
|
|
<author>
|
|
<name>Jiyoung Lee</name>
|
|
</author>
|
|
<author>
|
|
<name>Hyunsung Jang</name>
|
|
</author>
|
|
<author>
|
|
<name>Namkoo Ha</name>
|
|
</author>
|
|
<author>
|
|
<name>Jungin Park</name>
|
|
</author>
|
|
<author>
|
|
<name>Kwanghoon Sohn</name>
|
|
</author>
|
|
</entry>
|
|
</feed>
|