arXiv AI/ML Papers — 2026-06-01

Recent submissions in cs.CL, cs.AI, and cs.LG.

Lumos-Nexus: Efficient Frequency Bridging with Homogeneous Latent Space for Video Unified Models

Authors: Jiazheng Xing, Hangjie Yuan, Lingling Cai et al.
Published: 2026-05-29
Categories: cs.CV, cs.AI
Summary: Connector-based video unified models have demonstrated strong capability in instruction-grounded video synthesis, but integrating a large high-fidelity generator into the unified training loop is computationally prohibitive, limiting achievable visual quality. We therefore propose Lumos-Nexus, a training-efficient unified video generation framework that facilitates the development of strong reasoning-driven generation capabilities while significantly enhancing visual fidelity. Lumos-Nexus adopts...

KLIP: localized distribution shift detection via KL-divergence with diffusion priors in Inverse Problems

Authors: Alireza Kheirandish, Jihoon Hong, Sara Fridovich-Keil
Published: 2026-05-29
Categories: cs.CV, cs.LG
Summary: Diffusion models have shown promising performance as data-driven priors for computational imaging, as well as some capacity to detect out-of-distribution (OOD) images. However, existing approaches to OOD detection often require some knowledge of the shifted distribution, fail to detect subtle or localized distribution shifts, and operate on full images, rather than the indirect measurements available in inverse problems. We propose an OOD detection metric based on the Kullback-Leibler divergence...

A Tight Theory of Error Feedback Algorithms in Distributed Optimization

Authors: Daniel Berg Thomsen, Adrien Taylor, Aymeric Dieuleveut
Published: 2026-05-29
Categories: cs.LG, math.OC
Summary: Communication costs are a major bottleneck in distributed learning and first-order optimization. A common approach to alleviate this issue is to compress the gradient information exchanged between agents. However, such compression typically degrades the convergence guarantees of gradient-based methods. Error feedback mechanisms provide a simple and computationally cheap remedy for this issue, but numerous variants have been proposed, and their relative performance remains poorly understood. This...

Stateful Online Monitoring Catches Distributed Agent Attacks

Authors: Davis Brown, Samarth Bhargav, Arav Santhanam et al.
Published: 2026-05-29
Categories: cs.CR, cs.AI
Summary: Language models can find thousands of severe software vulnerabilities, and agents are increasingly being misused for cyberattacks. To avoid detection, attackers frequently distribute their misuse, splitting a harmful task across many user accounts so each individual transcript looks benign. Because safety monitors score only one agent context at a time, they are structurally blind to misuse that is only visible in aggregate, across many accounts. We show this gap is real by building, to our know...

TunerDiT: Training-free Progressive Steering of Diffusion Transformer for Multi-Event Video Generation

Authors: Ruotong Liao, Guowen Huang, Qing Cheng et al.
Published: 2026-05-29
Categories: cs.CV, cs.AI
Summary: Text-to-video (T2V) generation faces challenging questions when generating videos with long horizons containing multiple events. Inspired by the intrinsics of the diffusion process, we probe video diffusion transformers (DiTs) and uncover intrinsic turning points in the DiT denoising trajectory where conditioning text affects generation from global layout to fine-grained details. Building on this finding, we present TunerDiT, a simple yet effective progressive steering method that requires no ad...

Language Models Learn Constructional Semantics, Not To Mention Syntax: Investigating LM Understanding of Paired-Focus Constructions

Authors: Wesley Scivetti, Ethan Wilcox, Nathan Schneider et al.
Published: 2026-05-29
Categories: cs.CL, cs.AI
Summary: Grasping the semantics of rare constructions (form-meaning pairings) has been shown to be a challenging problem that has currently only been solved by the largest LLMs. It remains an open question if open-source models have robust constructional understanding, and if so, what learning dynamics underlie the acquisition of this knowledge. Focusing on a set of rare Paired-Focus constructions in English (e.g. "let alone", "much less"), we construct a novel dataset to test their meanings using both s...

LongTraceRL: Learning Long-Context Reasoning from Search Agent Trajectories with Rubric Rewards

Authors: Nianyi Lin, Jiajie Zhang, Lei Hou et al.
Published: 2026-05-29
Categories: cs.CL, cs.AI, cs.LG
Summary: Long-context reasoning remains a central challenge for large language models, which often fail to locate and integrate key information in extensive distracting content. Reinforcement learning with verifiable rewards (RLVR) has shown promise for this task, yet existing methods are limited by low-confusability distractors and sparse, outcome-only reward signals that cannot supervise intermediate reasoning steps. To address these issues, we introduce \textsc{LongTraceRL}. For data construction, we ...

Choosing the Lens: Strategic Perspective Activation in Context-Dependent Argumentation

Authors: Albert Sadowski, Jarosław A. Chudziak
Published: 2026-05-29
Categories: cs.AI
Summary: The same arguments often need to be evaluated under different external regimes. An agent with influence over the regime has a strategic lever that standard formalisms do not directly capture. We introduce context-dependent argumentation frameworks (CDAFs), an extension of Dung's theory in which a defeat function determines, per context, which attacks succeed. A perspective-labeled specialisation derives the defeat function from a relevance set $ρ$ and a priority $π$. The relevance set is the age...

Giving Sensors a Voice: Multimodal JEPA for Semantic Time-Series Embeddings

Authors: Utsav Dutta, Gerardo Pastrana, Sina Khoshfetrat Pakazad et al.
Published: 2026-05-29
Categories: cs.LG
Summary: Transformer-based architectures have advanced sequence modeling in language and vision, yet general-purpose representation learning for heterogeneous multivariate time series remains underexplored. We introduce CHARM (Channel-Aware Representation Model), which incorporates channel-level textual descriptions into a Transformer encoder equivariant to channel order. CHARM is trained with a Joint Embedding Predictive Architecture (JEPA) and a novel loss promoting informative, temporally stable embed...

SPECTRA: Synthetic IR Test Collections with Relevance Oracles and Controlled Distractor Diagnostics

Authors: Eric Liang
Published: 2026-05-29
Categories: cs.IR, cs.AI
Summary: Scalable information retrieval testing needs corpora that are large enough to stress index construction, ranking latency, query routing, and evaluation tooling, yet human-judged test collections remain expensive and may be unavailable when documents are private or still under design. This paper introduces SPECTRA, a reproducible framework for generating synthetic text corpora and retrieval test collections through a separation of latent topical structure, surface text realization, metadata contr...

What Gets Unmasked First? Trajectory Analysis of Diffusion Models for Graph-to-Text Generation

Authors: Qing Wang, Jacob Devasier, Chengkai Li
Published: 2026-05-29
Categories: cs.CL, cs.AI
Summary: We present the first systematic study of masked diffusion language models (MDLMs) for graph-to-text generation. We analyze MDLM generation trajectories -- the order in which tokens are unmasked during iterative decoding -- and find that, unlike autoregressive LLMs which generate text linearly, MDLMs naturally prioritize entities first, followed by relational and function words, with structural tokens resolved last. We further identify a previously undocumented failure mode of supervised fine-tun...

Disagreeing Rationales: Rethinking Classification and Explainability Evaluation in Hate Speech Detection

Authors: Benedetta Muscato, Beiduo Chen, Gizem Gezici et al.
Published: 2026-05-29
Categories: cs.CL
Summary: Human disagreement is ubiquitous and well-known in labeling. However, variation in explanations, captured through token-level human rationales, remains far less explored. At the same time, it is unclear how to best evaluate human labels and rationales -- or even how to best aggregate rationales beyond majority vote -- in light of this variation. Yet, rationales may provide additional insights into the richness of human reasoning, that may differ in style, values and interpretations -- especially...

Effective Biological Representation Learning by Masking Gene Expression

Authors: Kian Kenyon-Dean, Alina Selega, Ihab Bendidi et al.
Published: 2026-05-29
Categories: cs.LG
Summary: RNA sequencing produces rich and diverse datasets of gene expression, offering compelling insights into cellular state and function that have many applications in drug discovery. Modeling such data is challenging due to inherent technical noise and experimental batch effects, as evidenced by many existing transcriptomic foundation models (FMs) underperforming relative to linear baselines. Such results raise the question of whether deep representation learning provides a distinct advantage over t...

What Am I Missing? Question-Answering as Hidden State Probing

Authors: Chu Fei Luo, Samuel Dahan, Xiaodan Zhu
Published: 2026-05-29
Categories: cs.CL
Summary: Test-time reasoning has become a significant field of study since the introduction of chain-of-thought reasoning in large language models (LLMs). However, the mechanisms of this reasoning process are still under-explored -- from the same input prompt, and even the same partial solution, LLMs can produce varied answers if sampled multiple times. We propose to leverage question-asking as an inference-time intervention that articulates information about the model's hidden state. To achieve that, we...

Functional Attention: From Pairwise Affinities to Functional Correspondences

Authors: Jiefang Xiao, Maolin Gao, Simon Weber et al.
Published: 2026-05-29
Categories: cs.LG
Summary: Learning mappings between infinite-dimensional function spaces, or operator learning, is essential for many machine learning applications. Although transformer-based operators are popular, they often rely on token-wise attention. These methods treat continuous fields as discrete tokens and usually ignore the global functional structure. We introduce \emph{Functional Attention}, which reinterprets attention as a functional correspondence between adaptive bases. Inspired by geometric functional ma...