Skip to content
archive

arxiv-2026-06-07

AI · · 6 min read

arXiv Papers - 2026-06-07

Total papers: 15

TailLoR: Protecting Principal Components in Parameter-Efficient Continual Learning

  • Authors: Marius Dragoi, Ioana Pintilie, Alexandra Dragomir et al.
  • Published: 2026-06-04
  • arXiv ID: http://arxiv.org/abs/2606.06494v1
  • Summary: Parameter-efficient finetuning methods based on spectral decomposition have enabled progress in Continual Learning. In this paper we introduce TailLoR, which utilizes the singular bases U and V of the pre-trained weights as a fixed reference frame to learn a low-rank update applied to the singular value matrix. A soft spectral penalty discourages updates aligned with dominant singular directions, reducing interference while routing fine-grained adaptation into the highly flexible, long-tail spec

HANDOFF: Humanoid Agentic Task-Space Whole-Body Control via Distilled Complementary Teachers

  • Authors: Lizhi Yang, Junheng Li, Nehar Poddar et al.
  • Published: 2026-06-04
  • arXiv ID: http://arxiv.org/abs/2606.06493v1
  • Summary: For a humanoid robot to be deployed in the real world, the choice of command space (i.e., the interface between task planning and whole-body control) is crucial. Existing whole-body controllers typically demand dense kinematic or spatial references that planners struggle to synthesize from task semantics. We instead propose a compact, explicit interface that is intuitive, general, modular, and expressive enough for diverse manipulation skills. To this end, we introduce HANDOFF, a single humanoid

Code2LoRA: Hypernetwork-Generated Adapters for Code Language Models under Software Evolution

  • Authors: Liliana Hotsko, Yinxi Li, Yuntian Deng et al.
  • Published: 2026-06-04
  • arXiv ID: http://arxiv.org/abs/2606.06492v1
  • Summary: Code language models need repository-level context to resolve imports, APIs, and project conventions. Existing methods inject this knowledge as long inputs (retrieved through RAG or dependency analysis) or through per-repository fine-tuning and LoRA -- costly at repository scale and brittle to evolving codebases. We introduce Code2LoRA, a hypernetwork framework that generates repository-specific LoRA adapters, effectively injecting repository knowledge with zero inference-time token overhead. Co

TempoVLA: Learning Speed-Controllable Vision-Language-Action Policies

  • Authors: Dong Jing, Jingchen Nie, Tianqi Zhang et al.
  • Published: 2026-06-04
  • arXiv ID: http://arxiv.org/abs/2606.06491v1
  • Summary: Robot manipulation alternates between low-risk transit phases that call for fast execution and high-risk contact stages that demand slow, precise motion. Yet existing Vision-Language-Action models (VLAs) only inherit a single fixed speed from training demonstrations. Prior efforts to accelerate VLAs through model compression, KV-cache reuse, or reinforcement learning only shift the policy from one fixed speed to another, and leave deceleration almost unexplored. We observe that the magnitude of

Regret Minimization with Adaptive Opponents in Repeated Games

  • Authors: Mingyang Liu, Asuman Ozdaglar, Tiancheng Yu et al.
  • Published: 2026-06-04
  • arXiv ID: http://arxiv.org/abs/2606.06486v1
  • Summary: In this paper, we study regret minimization in repeated games with \emph{adaptive} opponents who can respond based on histories of play. The standard metric of \emph{external regret} in online learning is known to fail to capture such adaptivity. To account for players' counterfactual reasoning, we introduce {\tt Repeated Policy Regret (RP-Regret)}, a game-theoretic metric that measures the difference between the \emph{realized} and the \emph{best-in-hindsight} accumulated utility when all playe

Operation-Guided Progressive Human-to-AI Text Transformation Benchmark for Multi-Granularity AI-Text Detection

  • Authors: Sondos Mahmoud Bsharat, Jiacheng Liu, Xiaohan Zhao et al.
  • Published: 2026-06-04
  • arXiv ID: http://arxiv.org/abs/2606.06481v1
  • Summary: As AI writing assistants become increasingly integrated into real-world drafting and revision workflows, many documents are no longer purely human-written or AI-generated, but instead result from progressive human-AI co-editing. However, existing AI-text detection benchmarks largely focus on final outputs and provide limited understanding of how AI authorship signals emerge, accumulate, or disappear throughout the revision process. We introduce OpAI-Bench, an operation-guided benchmark for study

DNQ: Deep Nash Q-Network for Partially Observable n-Player Games

  • Authors: Qintong Xie, Edward Koh, Xavier Cadet et al.
  • Published: 2026-06-04
  • arXiv ID: http://arxiv.org/abs/2606.06480v1
  • Summary: Many real-world competitive systems require multiple decision-makers to act simultaneously under shared constraints, limited information, and repeated interaction, as in auctions, resource allocation, and security competition. We study multi-turn simultaneous bidding as a controlled testbed for such problems and propose DNQ, a solver-in-the-loop equilibrium supervision framework for training bidding agents. DNQ alternates between trajectory collection, critic-based payoff estimation, equilibrium

Pretraining Recurrent Networks without Recurrence

  • Authors: Akarsh Kumar, Phillip Isola
  • Published: 2026-06-04
  • arXiv ID: http://arxiv.org/abs/2606.06479v1
  • Summary: Training recurrent neural networks (RNNs) requires assigning credit across long sequences of computations. Standard backpropagation through time (BPTT) addresses this problem poorly: it is sequential in time, limiting parallelism, and suffers from vanishing or exploding gradients, making long-range associations difficult to learn. We propose Supervised Memory Training (SMT), a method for training nonlinear RNNs that sidesteps recurrent credit propagation entirely by reducing RNN training to supe

RREDCoT: Segment-Level Reward Redistribution for Reasoning Models

  • Authors: Mykyta Ielanskyi, Kajetan Schweighofer, Lukas Aichberger et al.
  • Published: 2026-06-04
  • arXiv ID: http://arxiv.org/abs/2606.06475v1
  • Summary: Recent advancements in reasoning language models have been driven by Reinforcement Learning (RL) fine-tuning. Most often, these rely on the Group Relative Policy Optimization (GRPO) algorithm or modifications thereof to steer the models to produce Chain-of-Thought (CoT) traces. The final answer can only be verified, and the reward assigned, after the CoT trace is complete, making it a delayed reward problem. GRPO and its modifications correspond to Monte Carlo methods in standard RL, which are k

Self-Augmenting Retrieval for Diffusion Language Models

  • Authors: Paul Jünger, Justin Lovelace, Linxi Zhao et al.
  • Published: 2026-06-04
  • arXiv ID: http://arxiv.org/abs/2606.06474v1
  • Summary: Discrete diffusion language models generate text by iteratively denoising an entire response in parallel. At each step, they predict tentative tokens for every masked position, committing the confident predictions to the output and discarding the unconfident ones. We show that the discarded tokens are in fact a useful lookahead signal for retrieval-augmented generation: even low-confidence tokens often surface salient entities early in the denoising trajectory, enabling retrieval of stronger evi

MLEvolve: A Self-Evolving Framework for Automated Machine Learning Algorithm Discovery

  • Authors: Shangheng Du, Xiangchao Yan, Jinxin Shi et al.
  • Published: 2026-06-04
  • arXiv ID: http://arxiv.org/abs/2606.06473v1
  • Summary: Large language model (LLM) agents are increasingly applied to long-horizon tasks such as scientific discovery and machine learning engineering (MLE), where sustained self-evolution becomes a key capability. However, existing MLE agents suffer from inter-branch information isolation, memoryless search, and lack of hierarchical control, which together hinder long-horizon optimization. We present MLEvolve, an LLM-based self-evolving multi-agent framework for end-to-end machine learning algorithm di

PC Layer: Polynomial Weight Preconditioning for Improving LLM Pre-Training

  • Authors: Senmiao Wang, Tiantian Fang, Haoran Zhang et al.
  • Published: 2026-06-04
  • arXiv ID: http://arxiv.org/abs/2606.06470v1
  • Summary: We propose a preconditioning (PC) layer, a weight parameterization via polynomial preconditioner that ensures stable weight conditioning throughout LLM training. The PC module reshapes the singular-value spectrum of weight matrices via low-degree polynomial preconditioning. After training, the preconditioned weights can be merged back into the original architecture, incurring no inference overhead. We demonstrate the advantage of the proposed PC layer over standard transformers in Llama-1B pre-t

How abundant are good interpolators?

  • Authors: August Y. Chen, Ahmed El Alaoui
  • Published: 2026-06-04
  • arXiv ID: http://arxiv.org/abs/2606.06469v1
  • Summary: Let $S$ be the set of unit norm linear classifiers $θ\in \mathbb{R}^d$ which correctly classify every point of a labeled dataset $(X_i,y_i)_{i=1}^n$, $X_i \in \mathbb{R}^d$, $y_i \in {-1,+1}$, with a possibly negative margin $κ$ fixed in advance. Under two natural data-generating distributions of the $(X,y)$ pairs -- a Gaussian mixture model and a logistic model with Gaussian features -- and in the proportional regime $n/d \to α$ with small enough $α$, we establish a large deviation principle

Goedel-Architect: Streamlining Formal Theorem Proving with Blueprint Generation and Refinement

  • Authors: Jui-Hui Chung, Ziyang Cai, Zihao Li et al.
  • Published: 2026-06-04
  • arXiv ID: http://arxiv.org/abs/2606.06468v1
  • Summary: We introduce Goedel-Architect, an agentic framework for formal theorem proving in Lean 4 centered on blueprint generation and refinement. A blueprint is a dependency graph of definitions and lemmas that builds up to the main theorem. First, Goedel-Architect generates a blueprint of formally stated definitions and lemmas, along with declared dependencies. This blueprint is optionally guided by a natural language proof. Then, a tool-equipped Lean prover component closes each open lemma node in par

You Only Index Once: Cross-Layer Sparse Attention with Shared Routing

  • Authors: Yutao Sun, Yanqi Zhang, Li Dong et al.
  • Published: 2026-06-04
  • arXiv ID: http://arxiv.org/abs/2606.06467v1
  • Summary: Long-context inference in modern LLMs is increasingly constrained by decoding efficiency, especially in reasoning-heavy settings where models generate long intermediate chains of thought. Existing sparse attention methods often face a practical efficiency-quality trade-off. Structured block sparse methods typically provide stronger acceleration but incur noticeable quality loss, while token sparse methods are usually more accurate yet deliver limited end-to-end speedup because top-k routing over