Skip to content
archive

arxiv-2026-06-06

AI · · 5 min read

TailLoR: Protecting Principal Components in Parameter-Efficient Continual Learning

  • Authors: Marius Dragoi, Ioana Pintilie, Alexandra Dragomir et al.
  • Published: 2026-06-04
  • Link: https://arxiv.org/abs/2606.06494v1
  • Abstract: Parameter-efficient finetuning methods based on spectral decomposition have enabled progress in Continual Learning. In this paper we introduce TailLoR, which utilizes the singular bases U and V of the pre-trained weights as a fixed reference frame to learn a low-rank update applied to the singular value matrix. A soft spectral penalty discourages updates aligned with dominant singular directions, ...

HANDOFF: Humanoid Agentic Task-Space Whole-Body Control via Distilled Complementary Teachers

  • Authors: Lizhi Yang, Junheng Li, Nehar Poddar et al.
  • Published: 2026-06-04
  • Link: https://arxiv.org/abs/2606.06493v1
  • Abstract: For a humanoid robot to be deployed in the real world, the choice of command space (i.e., the interface between task planning and whole-body control) is crucial. Existing whole-body controllers typically demand dense kinematic or spatial references that planners struggle to synthesize from task semantics. We instead propose a compact, explicit interface that is intuitive, general, modular, and exp...

Code2LoRA: Hypernetwork-Generated Adapters for Code Language Models under Software Evolution

  • Authors: Liliana Hotsko, Yinxi Li, Yuntian Deng et al.
  • Published: 2026-06-04
  • Link: https://arxiv.org/abs/2606.06492v1
  • Abstract: Code language models need repository-level context to resolve imports, APIs, and project conventions. Existing methods inject this knowledge as long inputs (retrieved through RAG or dependency analysis) or through per-repository fine-tuning and LoRA -- costly at repository scale and brittle to evolving codebases. We introduce Code2LoRA, a hypernetwork framework that generates repository-specific L...

TempoVLA: Learning Speed-Controllable Vision-Language-Action Policies

  • Authors: Dong Jing, Jingchen Nie, Tianqi Zhang et al.
  • Published: 2026-06-04
  • Link: https://arxiv.org/abs/2606.06491v1
  • Abstract: Robot manipulation alternates between low-risk transit phases that call for fast execution and high-risk contact stages that demand slow, precise motion. Yet existing Vision-Language-Action models (VLAs) only inherit a single fixed speed from training demonstrations. Prior efforts to accelerate VLAs through model compression, KV-cache reuse, or reinforcement learning only shift the policy from one...

Regret Minimization with Adaptive Opponents in Repeated Games

  • Authors: Mingyang Liu, Asuman Ozdaglar, Tiancheng Yu et al.
  • Published: 2026-06-04
  • Link: https://arxiv.org/abs/2606.06486v1
  • Abstract: In this paper, we study regret minimization in repeated games with \emph{adaptive} opponents who can respond based on histories of play. The standard metric of \emph{external regret} in online learning is known to fail to capture such adaptivity. To account for players' counterfactual reasoning, we introduce {\tt Repeated Policy Regret (RP-Regret)}, a game-theoretic metric that measures the differ...

Operation-Guided Progressive Human-to-AI Text Transformation Benchmark for Multi-Granularity AI-Text Detection

  • Authors: Sondos Mahmoud Bsharat, Jiacheng Liu, Xiaohan Zhao et al.
  • Published: 2026-06-04
  • Link: https://arxiv.org/abs/2606.06481v1
  • Abstract: As AI writing assistants become increasingly integrated into real-world drafting and revision workflows, many documents are no longer purely human-written or AI-generated, but instead result from progressive human-AI co-editing. However, existing AI-text detection benchmarks largely focus on final outputs and provide limited understanding of how AI authorship signals emerge, accumulate, or disappe...

DNQ: Deep Nash Q-Network for Partially Observable n-Player Games

  • Authors: Qintong Xie, Edward Koh, Xavier Cadet et al.
  • Published: 2026-06-04
  • Link: https://arxiv.org/abs/2606.06480v1
  • Abstract: Many real-world competitive systems require multiple decision-makers to act simultaneously under shared constraints, limited information, and repeated interaction, as in auctions, resource allocation, and security competition. We study multi-turn simultaneous bidding as a controlled testbed for such problems and propose DNQ, a solver-in-the-loop equilibrium supervision framework for training biddi...

Pretraining Recurrent Networks without Recurrence

  • Authors: Akarsh Kumar, Phillip Isola
  • Published: 2026-06-04
  • Link: https://arxiv.org/abs/2606.06479v1
  • Abstract: Training recurrent neural networks (RNNs) requires assigning credit across long sequences of computations. Standard backpropagation through time (BPTT) addresses this problem poorly: it is sequential in time, limiting parallelism, and suffers from vanishing or exploding gradients, making long-range associations difficult to learn. We propose Supervised Memory Training (SMT), a method for training ...

RREDCoT: Segment-Level Reward Redistribution for Reasoning Models

  • Authors: Mykyta Ielanskyi, Kajetan Schweighofer, Lukas Aichberger et al.
  • Published: 2026-06-04
  • Link: https://arxiv.org/abs/2606.06475v1
  • Abstract: Recent advancements in reasoning language models have been driven by Reinforcement Learning (RL) fine-tuning. Most often, these rely on the Group Relative Policy Optimization (GRPO) algorithm or modifications thereof to steer the models to produce Chain-of-Thought (CoT) traces. The final answer can only be verified, and the reward assigned, after the CoT trace is complete, making it a delayed rewa...

Self-Augmenting Retrieval for Diffusion Language Models

  • Authors: Paul Jünger, Justin Lovelace, Linxi Zhao et al.
  • Published: 2026-06-04
  • Link: https://arxiv.org/abs/2606.06474v1
  • Abstract: Discrete diffusion language models generate text by iteratively denoising an entire response in parallel. At each step, they predict tentative tokens for every masked position, committing the confident predictions to the output and discarding the unconfident ones. We show that the discarded tokens are in fact a useful lookahead signal for retrieval-augmented generation: even low-confidence tokens ...

MLEvolve: A Self-Evolving Framework for Automated Machine Learning Algorithm Discovery

  • Authors: Shangheng Du, Xiangchao Yan, Jinxin Shi et al.
  • Published: 2026-06-04
  • Link: https://arxiv.org/abs/2606.06473v1
  • Abstract: Large language model (LLM) agents are increasingly applied to long-horizon tasks such as scientific discovery and machine learning engineering (MLE), where sustained self-evolution becomes a key capability. However, existing MLE agents suffer from inter-branch information isolation, memoryless search, and lack of hierarchical control, which together hinder long-horizon optimization. We present MLE...

PC Layer: Polynomial Weight Preconditioning for Improving LLM Pre-Training

  • Authors: Senmiao Wang, Tiantian Fang, Haoran Zhang et al.
  • Published: 2026-06-04
  • Link: https://arxiv.org/abs/2606.06470v1
  • Abstract: We propose a preconditioning (PC) layer, a weight parameterization via polynomial preconditioner that ensures stable weight conditioning throughout LLM training. The PC module reshapes the singular-value spectrum of weight matrices via low-degree polynomial preconditioning. After training, the preconditioned weights can be merged back into the original architecture, incurring no inference overhead...

How abundant are good interpolators?

  • Authors: August Y. Chen, Ahmed El Alaoui
  • Published: 2026-06-04
  • Link: https://arxiv.org/abs/2606.06469v1
  • Abstract: Let $S$ be the set of unit norm linear classifiers $θ\in \mathbb{R}^d$ which correctly classify every point of a labeled dataset $(X_i,y_i)_{i=1}^n$, $X_i \in \mathbb{R}^d$, $y_i \in {-1,+1}$, with a possibly negative margin $κ$ fixed in advance. Under two natural data-generating distributions of the $(X,y)$ pairs -- a Gaussian mixture model and a logistic model with Gaussian features -- and in ...

Goedel-Architect: Streamlining Formal Theorem Proving with Blueprint Generation and Refinement

  • Authors: Jui-Hui Chung, Ziyang Cai, Zihao Li et al.
  • Published: 2026-06-04
  • Link: https://arxiv.org/abs/2606.06468v1
  • Abstract: We introduce Goedel-Architect, an agentic framework for formal theorem proving in Lean 4 centered on blueprint generation and refinement. A blueprint is a dependency graph of definitions and lemmas that builds up to the main theorem. First, Goedel-Architect generates a blueprint of formally stated definitions and lemmas, along with declared dependencies. This blueprint is optionally guided by a na...

You Only Index Once: Cross-Layer Sparse Attention with Shared Routing

  • Authors: Yutao Sun, Yanqi Zhang, Li Dong et al.
  • Published: 2026-06-04
  • Link: https://arxiv.org/abs/2606.06467v1
  • Abstract: Long-context inference in modern LLMs is increasingly constrained by decoding efficiency, especially in reasoning-heavy settings where models generate long intermediate chains of thought. Existing sparse attention methods often face a practical efficiency-quality trade-off. Structured block sparse methods typically provide stronger acceleration but incur noticeable quality loss, while token sparse...