AI & Machine Learning · Tue, Oct 6, 2026

Machine learning, AI, natural language processing, computer vision and multi-agent systems.

arXiv cs.SD · cs.AI · cs.CL Code

Paradee: Distilling Kokoro-82M into an 8M-Parameter Single-Voice Text-to-Speech Model

In briefParadee: a tiny single-voice speech model distilled from Kokoro-82M

SummaryThis paper compresses Kokoro-82M, an open text-to-speech model with 54 voices, into Paradee, an 8.07M-parameter model that speaks a single voice. The two halves of the student are trained separately against the frozen teacher, and the weights are quantized to int8. The quantized model is 8.5 MB, runs 25x faster than real time on one CPU thread, and scores 4.41 on UTMOS versus the teacher's 4.52. A training-free phase-locking filter is also introduced to remove a slight buzz in the output.

Sahil Mahendrakar

★★★★★ Notable
arXiv cs.CV · cs.AI · cs.RO

TAPDreamer: Transferable Adversarial Patches for World Action Models

In briefTAPDreamer: Transferable Adversarial Patches for World Action Models

SummaryThis paper proposes TAPDreamer, an attack on world action models that rely on camera inputs. It builds a fixed local perturbation patch using only a public encoder, so it transfers across tasks and action architectures without querying the target policy. According to the paper, one frozen patch covering about 6.5% of the input drops FastWAM's success to 0.0% on LIBERO and RoboTwin tasks, and the authors argue that shared visual encoders must also be protected.

WhyProposes a transferable adversarial patch using only a public encoder, with strong closed-loop results across benchmarks and models, indicating broad impact.

Xuanyu Lu, Fengqing Jiang, Kaiyuan Zheng et al.

arXiv cs.CV

Less Context, Better Geometry: Masked Geometric Encoder for Robust 3D Foundation Models

In briefLess Context, Better Geometry: Robust 3D Models via Masked Geometric Encoding

SummaryThis paper introduces the Masked Geometric Encoder (MGE), which drops frame tokens from global attention during training and distills from a pretrained full-context teacher to learn robust geometry under incomplete cross-view context. The authors report stronger performance under occlusion and doppelganger views while keeping high results on standard benchmarks. They also propose Anchor-Guided Adaptive token merging for inference, which keeps representative anchor frames and merges redundant tokens, yielding speedups with higher reconstruction quality in limited-view settings.

Zhimin Shao, Xijun Liu, Zhaoliang Zhang et al.

arXiv cs.LG · stat.ML

Block Disentanglement in CRL: Bridging Identifiability and Visual State Estimation

In briefBlock Disentanglement in CRL: Linking Identifiability to Visual State Estimation

SummaryCausal representation learning (CRL) recovers causally related latent variables from high-dimensional observations without labels. This paper establishes identifiability guarantees for interventional CRL under substantially weaker assumptions, yielding a block disentanglement of causal variables whose structure follows the available intervention mechanisms. The framework is then applied to embodied visual state estimation, recovering a robot's latent physical variables from unlabeled images and videos. The authors report that the approach remains effective in a controlled embodied setting despite further assumption violations.

Emre Acart\"urk, Pranamya Kulkarni, Puranjay Datta et al.

arXiv cs.LG · cs.RO

H-JEPA: End-to-End Learning of Hierarchical World Models for Visual Planning

In briefH-JEPA: Learning Layered World Models for Visual Robot Planning

SummaryThe paper introduces H-JEPA, a method for end-to-end training of a hierarchy of action-conditioned JEPA world models, where each level predicts further ahead in its own learned latent space. Planning runs top-down, with higher-level predictions serving as subgoals for lower levels. Across four simulated navigation and manipulation environments, hierarchical planning outperforms a flat JEPA; on Visual AntMaze, success rises from 18% to 73% with less planner compute.

Wancong Zhang, Basile Terver, Michael Rabbat et al.

★★★★☆ Notable
arXiv cs.LG · cs.AI Code

Sharpen Without Search: On-Policy Distillation of Sequence-Level Power Distribution

In briefSharpening Language Model Answers in One Pass via Power Distillation

SummaryThe paper proposes on-policy power distillation (OPPD), which trains a language model to produce high-probability answers in a single generation, instead of sampling and scoring many candidates. Training uses a sequential Monte Carlo sampler in which the model generates candidates and a frozen teacher's power distribution weights them. The authors report accuracy gains over the untrained model on MATH500 and GSM8K, and say the method is complementary to GRPO trained with verified rewards.

WhyDistills power-distribution sampling into single-generation training with a new on-policy method, backed by comparisons and ablations across benchmarks and model families.

Erfan Baghaei Potraghloo, Seyedarmin Azizi, Arya Fayyazi et al.

arXiv cs.SI · cs.AI

Aggregating User Preferences while Ensuring Equity, Diversity, and Inclusion using Graph Summarization

In briefCombining user preferences fairly and diversely using graph summarization

SummaryThis paper proposes AURORA, a method that aggregates user preferences by modeling them as a weighted attributed bipartite graph and using greedy coarsening to enforce equity gap, intra-list diversity, and group inclusion constraints. It is evaluated on five datasets, including MovieLens, libimseti.cz, Rate My Professors, and OpenAlex, and reports larger diversity gains than classical rules such as Borda and Condorcet. On libimseti.cz the method does not reduce the equity gap, which the authors link to prior findings that demographic parity is not always an appropriate target.

Adji Marieme Sita Ciss\'e, Malek Mouhoub

arXiv cs.CV · cs.AI

PlaySuite: A Large-Scale Benchmark for Interactive Visual Intelligence

In briefPlaySuite: A Large-Scale Benchmark for Testing Interactive Visual Intelligence

SummaryThis paper introduces PlaySuite, a large-scale benchmark built from over 5,000 open-source video games to test whether models can act competently in dynamic visual environments over long periods. The authors built a unified closed-loop interaction framework and a Video-LLM-as-a-judge protocol to measure progress against standardized gameplay milestones. They evaluated fourteen recent open models and found strong reasoning but repeated failures in spatial grounding, action execution, and self-correction, which they describe as a perception-action gap.

Dheeraj Varghese, Anna Vettoruzzo, Walter Simoncini et al.

arXiv cs.CV · cs.AI

MC-Sparse: Deconstructing and Closing the Dense-Sparse Attention Gap in Diffusion Transformers

In briefMC-Sparse: a training-free method to close the dense-sparse attention quality gap in diffusion transformers

SummaryThe paper finds that existing sparse attention methods lose generation quality at high sparsity in diffusion transformers, and traces this to token grouping constraints, inaccurate interaction selection, and lost attention from discarded tokens. It proposes MC-Sparse, a training-free method that selects individual key-value tokens, groups similar queries for efficient GPU execution, and caches metadata for reuse across denoising steps. On video and 3D generation models, it matches dense-attention outputs more closely than sparse baselines, with denoising speedups of 1.80× and 2.32× respectively.

Jiarui Chen, Zeqiang Lai, Jiangshan Wang et al.

arXiv math.DS · cs.LG · nlin.CD

A Response Theory Probe for Learned Stochastic AI Simulators, Tested on Lorenz-63

In briefA response-theory test for learned stochastic AI simulators, checked on the Lorenz-63 system

SummaryThe paper proposes a calibrated test, based on linear response theory, for whether learned surrogate models respond correctly to external forcing, beyond forecast skill and long-run statistics. It evaluates SINDy, an MLP, a reservoir computer, a neural ODE and a neural SDE on a stochastic Lorenz-63 toy model, with up to 80 rollouts each. The results show that invariant-statistics fidelity and response fidelity can dissociate in both directions, and that the training formulation affects which properties a fixed network gets right.

Jo\~ao B\"oger, Simon Driscoll, Niccol\`o Zagli et al.

arXiv cs.LG · stat.ML

Round-Trip KNN Clustering: multiscale hierarchical cluster detection on directed nearest-neighbour graphs

In briefRound-Trip KNN Clustering: a multiscale graph method for detecting clusters on directed nearest-neighbour graphs

SummaryThe paper introduces RTKNNC, a graph-based clustering method that finds cluster structure at several neighbourhood scales without a preset cluster count. It keeps both directions of nearest-neighbour links and observes how groups persist or merge as the neighbourhood size K grows. An optional label-free refinement tests whether formed components should be split into two or three Gaussian subpopulations. On eight synthetic datasets, refinement raised adjusted Rand index substantially, and comparisons with seven external methods show competitive performance.

Eraldo Pereira Marinho, Caetano Mazzoni Ranieri, Fabricio Aparecido Breve

arXiv cs.AI

Back to the Future: Rethinking EDA Infrastructure for Agentic Systems in Chip Design Verification

In briefBack to the Future: Rethinking EDA Infrastructure for Agentic Systems in Chip Design Verification

SummaryThe paper introduces BTTF, an agentic framework for verifying chip designs that stores large unstructured simulation outputs in a normalized SQLite database. A multi-agent system translates natural-language verification queries into schema-aware SQL and links signal anomalies to versioned RTL repositories. On a 150-query benchmark, BTTF achieves 95.33% execution accuracy.

Je Yang, Ivan Lobov, Thomas Karpati

★★★★☆ Notable
arXiv hep-ex · cs.LG · hep-ph

How to scale your HEP ML models: A recipe for robust architecture comparisons at scale

In briefHow to scale HEP ML models: a method for robust large-scale architecture comparisons

SummaryThe paper presents a systematic procedure for deriving robust scaling laws and comparing design choices across budget axes for high-energy physics tasks. The authors validate the scaling trajectory on toy problems, then apply it to multi-task transformers trained on the roughly 11-billion-jet ATLAS JetSet2 dataset. At compute-optimal scaling, model and dataset size grow with a nearly equal √C dependence, and auxiliary objectives lower the primary jet-classification loss at equal compute.

WhyApplies systematic scaling-law methodology to HEP transformers, validated on an 11-billion-jet dataset with joint optimal predictions; strong evidence, mainly subfield impact.

Matthias Vigl, Nikita Pond, Jackson Barr et al.

arXiv cs.CL

T-Search: An Open Agentic Retriever and Playground for Hard Multi-Step Search

In briefT-Search: An Open Agentic Retriever and Playground for Hard Multi-Step Search

SummaryThis paper presents T-Search, an open-weight agentic retriever for difficult questions that require multi-step searching. It runs a limited number of search rounds over a fixed corpus and returns ranked evidence chunks with short justifications, leaving answer generation to a separate model. Averaged over seven English and Russian benchmarks, it reaches 56.0 Recall@10 with one rollout and 61.3 with three fused rollouts. The authors release the model, harness, live demo, and three benchmarks, including TRuST, a native-Russian hard-search benchmark.

Olga Tsymboi, Ramil Latypov, Aleksandr Medvedev et al.

★★★★☆ Notable
arXiv cs.CL · cs.AI · cs.LG

IdeaLens: Detecting AI Ideas in Long-form Writing

In briefIdeaLens: Detecting Whether a Document's Ideas Came from AI or Humans

SummaryThis paper introduces IdeaLens, a detector that judges whether a document's ideas came from a human or an AI, regardless of who wrote the words. It represents documents as outlines of discourse roles and paraphrased content, and trains on 1M FineWeb documents labeled by Pangram. The authors report strong detection across a controlled study and 19 existing benchmarks, and release their models and datasets.

WhyProposes idea-provenance detection, separating ideas from prose via outlines, validated by controlled experiments, a new dataset, and 19 benchmarks.

Rishanth Rajendhran, Minjoon Choi, Jenna Russell et al.

arXiv cs.MA · cs.LG · cs.RO

On Learning Optimal Corners in Orthogonal Partially Observable Cooperative Guard Art Galleries

In briefLearning optimal corner selection for cooperative art gallery guarding under partial observability

SummaryThis paper addresses the Partially Observable Cooperative Guard Art Gallery Problem (POCGAGP), where the existing CADENCE algorithm guarantees coverage and connectivity but does not specify which corner each agent should occupy. The authors propose two learned corner-selection heuristics: a CNN operating on a grid encoding and a GATv2 network trained with Deep Q-Learning on a visibility graph. Across 7,500 runs on random orthogonal environments, both heuristics outperform baseline CADENCE in steps to full coverage and peak agent count, and beat ISDA in agent utilization while keeping formal guarantees.

Yassin Ben Mansour, Edwin Meriaux

arXiv math.NA · cs.LG · cs.NA

Singular parameters and missing limits in neural PDE solvers

In briefSingular parameters and missing limits in neural PDE solvers

SummaryThis paper studies a failure mode of neural solvers for partial differential equations, where accurate solutions are approached only as parameters grow without bound. The authors link these missing limits in tanh neural networks to unbounded hidden parameters or increasingly redundant neurons. For a class of models built from translated kernels, they describe the missing functions and show that adding kernel derivatives to the model recovers them, making the best approximation attainable. Numerical studies track the parameter growth and examine how this completion affects PDE optimization.

Daniel Fern\'andez

arXiv cs.AI

Conditional Rank Allocation for Taxonomy-Aware Medical Language Model Adaptation

In briefA method that conditionally allocates ranks for medical question-answering model adaptation, using taxonomy-aware routing.

SummaryThe paper proposes ARBOR, a parameter-efficient method that selects rank-one components from a shared low-rank basis for each medical question, gated by question representations, specialty tags, and operation tags. On Qwen3-8B across CMB, CMExam, MedQA, and MedMCQA, five-seed experiments report 69.69% mean accuracy, 1.26 and 1.30 points above LoRA r16 and MoELoRA. The authors state that clinical safety and broader deployment were not tested.

Guangyuan Dong, Ziwei Hong, Xuehao Zhou et al.

arXiv cs.LG · cs.AR

Climbing the Design Ladder: Sequential Knowledge Distillation for Early-Stage Circuit Timing Prediction

In briefClimbing the Design Ladder: Early-Stage Circuit Timing Prediction via Sequential Distillation

SummaryThis paper proposes STEP-KD, a method for predicting post-routing circuit timing from early design stages so that timing violations are caught before costly late-stage redesigns. It uses intermediate stages (post-placement, post-floorplan) as stepping stones, training teacher models at each stage and sequentially distilling their knowledge into a post-synthesis student model via representation alignment. Experiments on diverse circuits show lower timing prediction error than direct distillation and supervised baselines, and in most settings better than the industry-standard STA tool. For Total Negative Slack prediction, STEP-KD achieves a weighted MAPE of 19.78%, versus 74.84% for STA.

Reza Moravej, Fahad Rahman Amik, Zhanguang Zhang et al.

arXiv cs.LG

SoloQ: Calibration-Free Quantization for Diffusion Language Models

In briefSoloQ: Calibration-Free Quantization for Diffusion Language Models

SummaryThis paper presents SoloQ, a quantization framework for diffusion language models that requires no calibration data. It maps weights and activations into a normalized rotated basis so their distribution is predictable, and quantizes the KV-cache of block-diffusion models at commit time. The authors report that SoloQ keeps accuracy under 4-bit quantization and beats calibration-based baselines on several benchmarks. With NVFP4, peak memory falls by up to 2.61X and end-to-end inference speeds up by up to 2.24X.

Donghyun Lee, Arkapravo Ghosh, Varun Manjunath et al.

arXiv cs.LG · cs.AI

MatrixFormer: A Foundation Model for Matrix Completion

In briefMatrixFormer: A Foundation Model for Filling in Missing Matrix Entries

SummaryThe paper introduces MatrixFormer, a pre-trained transformer that works directly on the two-dimensional structure of a matrix. It predicts a full distribution for every missing entry in a single forward pass. The model is trained only on synthetic low-rank and latent-factor matrices under diverse missingness patterns. The authors report that, applied zero-shot with the same weights, it performs competitively on causal inference panel data, benchmark-score completion, tabular imputation, and recommender-system matrix completion.

Dwaipayan Saha, Jacob Feitelberg, Kyuseong Choi et al.

arXiv cs.CL · cs.AI

Balancing Memory Pathways: Analyzing and Improving Memory Utilization in Hybrid LMs

In briefBalancing Memory Pathways: Improving How Hybrid Language Models Use Attention and Recurrent Memory

SummaryThis paper studies hybrid language models that interleave attention and recurrent layers, finding they rely much more on attention than on the recurrent state. Standard supervised fine-tuning improves overall performance but does not fix this imbalance. The authors add an auxiliary loss that limits attention's access to earlier context so the recurrent pathway is used more, which improves performance especially on long-context and information-aggregation tasks.

Hyunji Lee, Joykirat Singh, Zaid Khan et al.

arXiv cs.MA · cs.AI · cs.LG

BazaarBench: Delegation Safety in Decentralized C2C Marketplaces Run by LLM Agents

In briefBazaarBench: Safety Benchmark for LLM Agents Trading in Decentralized C2C Markets

SummaryThis paper introduces BazaarBench, a simulated consumer-to-consumer marketplace and benchmark for testing whether LLM agents acting for users trade safely. It evaluates five models under ordinary instructions, deadline pressure, and adversarial instructions to exploit other traders, across 45 continuations of simulated markets. Under adversarial instructions, the share of committed sales completed despite unavailable items or overstated conditions rose from 15.4% to 33.4%. The authors release the simulator, market states, evaluation code, and records to support safer marketplace agents.](The summary is 4 sentences.)

Ziyan Wang, Shuqing Shi, James Oldfield et al.

arXiv cs.LG · stat.ML

Hyperbolic Graph Representation Learning: Embed in One Metric, Optimize with Another

In briefHyperbolic graph learning: embed in one metric, optimize in another

SummaryHierarchical graphs embed into hyperbolic space with less distortion than Euclidean space, but gradient-based learning fails numerically at large radii. The paper notes that the angular step factor in the hyperbolic metric is a choice that existing implementations fix, and proposes a one-parameter family of optimization preconditioners with curvatures from -1 to 0. A two-stage method first arranges the layout with the Euclidean preconditioner and then refines it with an intermediate curvature, reducing loss on real-world trees by 46-74% over the best single curvature.

Federico Larroca, Paola Bermolen, Marcelo Fiori et al.

arXiv cs.CL · cs.LG

ufakzeka-karar: An Open Turkish Typed-Decision Model with Order-Invariant Option Scoring

In briefufakzeka-karar: An open Turkish model that scores answer options regardless of their order

SummaryThe paper presents ufakzeka-karar, an open Turkish decision model with about 182 million parameters. Given a Turkish text and a question with a fixed answer type, it outputs a probability for each option plus an expected error serving as a "not sure" signal, without generating text, and handles up to ten options in one CPU forward pass. Its scoring does not depend on option order. On the open set of HakemBench v1.0 it ranks 7th of 16 with a composite of 0.660, and the authors state that its test results are not blind. Weights and code are released under Apache-2.0.

Sait Furkan Teke (ufak AI)

arXiv cs.CL

Improving Diversity in LLM Short Story Generation

In briefBoosting Diversity in LLM Short Story Generation

SummaryThis paper addresses the lack of diversity in large language model outputs for creative short story generation, targeting genre, tone, style, and named entities. It introduces DivLM, a two-phase post-training framework that combines continued pre-training on creative writing data with reinforcement learning using a composite reward function. Experiments on two LLM families show diversity metrics improving by more than 9% on average over alternative approaches, while instruction following, response quality, and similarity to human outputs are preserved.

Zahra Solati Dehkordi, Vasileios Lampos

arXiv cs.LG

Decoupling Time and Space: A Temporally Conditioned Refinement for EEG Source Imaging

In briefDecoupling Time and Space: A Temporal Refinement Method for EEG Source Imaging

SummaryThis paper tackles the ill-posed problem of inferring brain sources from EEG by proposing a two-stream framework that separates global temporal representation learning from per-time-point spatial refinement. Evaluations on realistic synthetic data report better source localization than classical and spatiotemporal baselines, especially under high noise and multiple sources. The authors also apply a model trained only on synthetic EEG to real recordings and report that a logistic regressor on source power differences can decode age groups.

Marco Morik, Jesse Palarus, Carmen Vidaurre et al.

arXiv cs.LG · cs.AI

BRANCH-MoE: Balance-Aware Tree Routing for Large Embedding Models

In briefBRANCH-MoE: Tree-Based Expert Routing That Keeps Experts Evenly Used

SummaryThis paper introduces BRANCH-MoE, a mixture-of-experts model that places experts at the leaves of a binary decision tree and centers each split on a moving average of incoming traffic scores. The approach aims to balance expert usage without an extra load-balancing loss. The authors compare it with several existing routing methods on four tabular and click-prediction datasets, reporting that it keeps task quality and balanced utilization while giving a tree structure that can reduce communication.

Gang Fu, Adel Javanmard, MohammadHossein Bateni et al.

arXiv cs.AI · cs.LG

AMBER: Training Long-Horizon Web Agents through Append-Only Memory

In briefAMBER: Training Long-Horizon Web Agents with Append-Only Memory

SummaryThis paper introduces AMBER, a framework in which language-model web agents write free-form memory to an append-only store so that facts and environment feedback are retained by construction. The agent is trained end-to-end with reinforcement learning from outcome rewards, without extensive curated supervised data. On WebArena Lite, AMBER improves average success over overwrite-based memory by 4.09 percentage points and matches a baseline trained on more expensive supervision, while keeping a practical token budget.

Chinmay Savadikar, Zhaoyu Zhang, Mingyu Zhao et al.

arXiv cs.CL

Domain adaptation of Russian ModernBERT for long legal documents

In briefDomain adaptation of Russian ModernBERT for long legal documents

SummaryThe paper continues pretraining a Russian ModernBERT encoder on Russian legislative documents, producing RuModernBERT-ruLaw. On a fixed set of 1,031 court-decision segments, masked-token cross-entropy falls by about 0.109, 0.071, and 0.066 at input lengths of 512, 2,048, and 8,192 tokens. Entity extraction F1 is near 0.998 for both models, but 99.95% of test spans match training spans, so evidence about unseen forms is limited.

I. Litvak, D. Gvozdetsky, F. Lashkin et al.

arXiv cs.CL

SAFE-MR: Evidence Sufficiency Learning for Selective Multimodal Rumor Detection

In briefSAFE-MR: a framework that learns when retrieved evidence is enough to verify multimodal rumors

SummaryThis paper introduces SAFE-MR, which separates whether a claim is true from whether the retrieved evidence is sufficient to decide. It breaks image-text posts into verifiable claims and aggregates evidence by provenance and contextual compatibility. Macro-F1 reaches 91.2%, 75.8%, and 85.2% on NewsCLIPpings, VERITE, and XFacta, and the model supports selective prediction when evidence is inadequate.

Shiwen Ni

arXiv cs.CV · cs.RO Code

R2RI: A Multi-View Event and RGB Dataset for Robot-to-Robot Interaction

In briefR2RI: A Multi-View Event and RGB Dataset for Robot-to-Robot Interaction

SummaryThis paper introduces R2RI, the first dataset designed specifically for robot-to-robot interaction research. It features different humanoid robots performing interactions modeled on real human social behavior, recorded from both each robot's onboard sensors and external fixed cameras. The dataset includes over 6.5 million frames and about 5,000 videos at 120 fps, covering both event and RGB domains. The authors compare the strengths and weaknesses of each domain and benchmark state-of-the-art methods on several sensing and interaction tasks. The dataset and annotations are publicly released on GitHub.

Gabriele Magrini, Riccardo Catalini, Federico Becattini et al.

arXiv cs.CV

Extending Dynamic World Surface Water Mapping to Sentinel-1 with AlphaEarth Embeddings

In briefExtending Dynamic World surface water mapping to Sentinel-1 radar using AlphaEarth embeddings

SummaryThis paper uses Dynamic World's water class as weak supervision to train a Sentinel-1 radar model, so water maps resembling Dynamic World can be produced for every satellite acquisition, including cloudy conditions. Adding AlphaEarth annual embeddings for spatial context raises water IoU across 53 global scenes from 0.77 to 0.85, above the operational OPERA DSWx-S1 product at 0.75. On the independent S1S2-Water benchmark, the fused model reaches 0.94 versus 0.87 for OPERA. The authors conclude that optical land-cover products can supply scalable training labels for SAR surface water mapping.

Rohit Mukherjee, Frederick Policelli, Beth Tellman et al.

arXiv cs.IR · cs.CL · cs.LG

Reading the Mood: Emotion-Guided Book-to-Music Recommendation via CGANs and LLMs

In briefEmotion-Guided Book-to-Music Recommendation Using CGANs and LLMs

SummaryThis paper introduces SAGA-CDR, a two-phase framework that recommends music matching the mood of a book being read. The first phase builds sentiment embeddings from user reviews and maps them across domains with a Conditional GAN, then predicts music ratings by combining these with a collaborative filtering prior. The second phase uses large language models to place each book in a valence-arousal emotional quadrant and filters candidate tracks accordingly. On the English Amazon and Chinese Douban datasets, the method achieves the best rating prediction accuracy (RMSE 0.98 and 0.91), with ranking performance competitive with the strongest baseline, including in cross-lingual settings.

Manousos Linardakis, Georgios Alexandridis

arXiv stat.ML · cond-mat.dis-nn · cs.LG

A Solvable Model of Adaptive Learning Rate Rescaling: Acceleration, Stability & Scaling

In briefA solvable model of adaptive learning rate rescaling: how normalized updates speed up, then destabilize, training

SummaryThe paper studies normalized SGD, which fixes update size regardless of gradient norm, using a random-feature model with power-law teacher and data covariance. The authors derive a dynamical mean-field theory describing how loss depends on training time, width, and batch size. Normalization initially accelerates training, but at finite step size this acceleration breaks down and leads to marginal stability, with three regimes identified. Linearized ResNet experiments on CIFAR-5M are reported as support for the predicted trends.

Itay Lavie, Clarissa Lauditi, Cengiz Pehlevan

arXiv cs.CL

MedPrune: Topology-Efficient Multimodal Multi-Agent Communication Evolution for Medical VQA Tasks

In briefMedPrune: An efficient multi-agent framework for medical visual question answering

SummaryThe paper notes that existing clinically inspired multi-agent frameworks for medical visual question answering suffer from redundant communication topologies, causing inefficient interaction and high computational cost. The authors propose MedPrune, which models diagnosis as a heterogeneous communication graph and uses reinforcement-learning-driven node and edge sparsification to prune irrelevant specialist agents and connections. Experiments under full-set and few-shot settings reportedly surpass multi-agent baselines while improving token efficiency and adversarial robustness.

Jiuheng Wan, Runze Li, Chen Chen et al.

arXiv cs.LG

To Learn is to Wander: Learning Across Graphs and Tasks with Random Walks

In briefLearning by Wandering: Random-Walk Graph Learning Across Graphs and Tasks

SummaryThis paper introduces Wander, a graph foundation model that uses random walks as a shared interface, so one pretrained checkpoint can handle homogeneous and multi-relational graphs. The model is trained to complete partially observed graphs across tasks. The authors report state-of-the-art or highly competitive results on node classification, homogeneous link prediction, and knowledge-graph link prediction.

Louis Tichelman, Xingyue Huang, Jinwoo Kim et al.

arXiv cs.LG

Adapting prior-data fitted networks for tabular anomaly detection

In briefAdapting prior-data fitted networks for tabular anomaly detection

SummaryThis paper studies how representations from prior-data fitted networks (PFNs) can be adapted for anomaly detection on tabular data, a setting where no labeled anomalies exist before deployment and the reference set may contain anomalies. Using frozen TabPFN features, samples are scored by their distance to nearest neighbors, which already performs strongly. The authors further fine-tune the model on the reference set to better separate normal samples from anomalies. On the ADBench benchmark, the fine-tuning-free method ZEN achieves a higher mean AUROC than all baselines, and the fine-tuned method FOCUS improves further, generalizing across PFN models.

Maximilian Bershtman, Niv Cohen

arXiv cs.SD · cs.LG

Revisiting Label-Free Speaker Embedding Enhancement with vMF Profile Likelihood

In briefRevisiting label-free speaker embedding enhancement with a vMF likelihood objective

SummaryThis paper studies how to improve speaker verification under acoustic mismatch by enhancing embeddings without changing a frozen backbone network. The authors treat the clean target embedding as a matching problem on the unit hypersphere, modeling it with a von Mises–Fisher likelihood and profiling out a sample-wise concentration parameter. This yields a simple closed-form objective with adaptive weighting. Across several datasets, the method largely preserves the baseline and gives clearer gains on challenging mismatch sets.

Seunghwan Kim, Jinyong Kim, Sooyoung Yang et al.

arXiv cs.CL

Programmatic Search Agents: Extending Agentic Search Beyond Query Reformulation

In briefProgrammatic Search Agents: Agents That Process Search Results with Code, Not Just Rewrite Queries

SummaryThis paper argues that current search agents can only rewrite queries, leaving how retrieved evidence is processed and presented outside their direct control. The authors propose Programmatic Search Agent (PSA), which treats a local executable computation over candidate results as a search action, and compare it with query-based and tool-based agents across five policy backbones. Relative to the query-based agent, PSA improves macro-averaged task success by 4.00 and 7.56 percentage points on InfoSeek-Eval and BrowseComp-Plus, and reduces final-step tokens by an average of 28.3% and 33.9% within backbones.

Jiaming Qian, Huiyan Yang, Mandi Liu et al.

arXiv cs.CV

GS-Pool: Object-Level Change Detection in 3D Gaussian Splatting

In briefGS-Pool: Object-level change detection in 3D Gaussian Splatting between two reconstructions

SummaryThis paper proposes GS-Pool, a method that compares two independently reconstructed 3D Gaussian Splatting models of the same space taken at different times. It returns the objects that changed, along with their masks, by lifting SAM2 segmentations onto Gaussians and using training-loss evidence combined with geometry, colour and DINOv3 features. On PASLCD, it reaches 0.751 mIoU and 0.846 F1, compared with 0.644 and 0.758 for the previous strongest method, GS-Diff.

Boaz Keren-Gil, James Gain, Patrick Marais

arXiv cs.CV

ChronoWorld: Camera-Controlled Consistent 4D World Generation via Spatiotemporal Cues and Geometric Reflections

In briefChronoWorld: Camera-controlled, consistent 4D scene generation using spatiotemporal cues and geometric self-correction

SummaryThis arXiv paper presents ChronoWorld, a framework for generating globally consistent, free-view 4D scenes from camera-controlled video generation. It introduces a Spatiotemporal Epipolar Causal Attention mechanism that enforces multi-view epipolar constraints and temporal causality, and a reconstruction-driven geometric reflection pipeline with a 4D retrieval strategy to self-assess and correct outputs. The authors report state-of-the-art performance in spatiotemporally consistent, high-fidelity 4D scene generation across diverse scenarios.

Xiaoyu Zhou, Dingwei Xian, Zhenyu Wang et al.

arXiv cs.LG Code

OVAL: Output-Aware Local Page Bases for KV Cache Retrieval

In briefOVAL: Output-aware page encoding that improves which cached attention data a language model retrieves for long inputs

SummaryLong-context inference with large language models is costly because attention runs over a growing KV cache. OVAL is a training-free page encoding derived from the joint structure of keys and values, designed to preserve the key information needed for accurate retrieval. Its stored representation has the same size and decode-time scoring cost as a key-only spectral baseline. Across long reasoning, long context understanding, and long generation benchmarks, it consistently improves on that baseline and performs competitively with recent KV cache compression and retrieval methods.

Ashkan Shahbazi, Chayne Thrash, Soheil Kolouri

arXiv cs.LG · cs.CL

Aligning Multimodal Patient Evidence with Biomedical Knowledge Graphs for Clinical LLMs

In briefLinking multimodal patient evidence to biomedical knowledge graphs for clinical LLMs

SummaryThis paper presents MM-KG, a typed knowledge graph that joins a patient's multimodal observations (EHR text, imaging, genomics, biospecimens) to biomedical concepts through explicit alignment edges. Query-conditioned retrieval selects a compact subgraph for a large language model or graph neural network. Experiments on MIMIC-IV and ADNI with a 2x2 design show that combining patient evidence and biomedical knowledge yields large gains over either source alone.

Jiawen Du, Arshan Ali Khan, Chenhao Zhang et al.

arXiv cs.SE · cs.AI · cs.CL

Eliciting Specifications: When Does Interactive Clarification Help?

In briefEliciting Specifications: Does Asking Clarifying Questions Help AI Write Formal Code Rules?

SummaryThe paper studies whether an AI agent that asks a simulated developer bounded clarifying questions can improve the Lean formal specifications an LLM generates from task descriptions. It compares single-shot generation with elicitation on 189 Verina Lean 4 tasks under question budgets of 3 and 10, across same-model and cross-model setups. Results are mixed: some same-model settings are negative, while several cross-model pipelines improve strict pass rates, with the largest reaching 65.6%. Failure analysis points to postconditions as the main source of degradation.

Mowafak Allaham, Aditya Vempaty, Ashish Jagmohan et al.

arXiv cs.LG · cs.AI

Closing the Context Gap: Activation Alignment for Tabular In-Context Learning

In briefClosing the Context Gap: Activation Alignment for Efficient Tabular In-Context Learning

SummaryTabular foundation models make predictions by conditioning on labeled examples in their context, which makes each prediction expensive, while using fewer examples lowers performance. The paper proposes activation alignment, which trains a lightweight linear transformation on synthetic unlabeled data so that a student model seeing partial context matches the intermediate activations of a teacher seeing all data. Tested on 38 TabArena classification datasets with TabPFN-3 and TabFM, the aligned student shows broad, statistically significant gains at all context budgets. In low-data settings, it recovers nearly half of the teacher's predictive advantage.

Yoel Zeldes

arXiv cs.LG · cs.CL

How Sparse Probability Maps Shape Mixture-of-Experts Routing

In briefHow sparse probability maps change which experts a mixture-of-experts model uses

SummaryThis paper studies whether sparse probability maps such as sparsemax, entmax and normmax keep their zeroing behavior when used to route tokens in mixture-of-experts language models. The authors trained matched 300M and 1B top-2 models and found that trained routers behave differently: at 1B, entmax discards 30% less probability mass than softmax, and normmax routes 21% of tokens to a single expert. Expert participation depends on both the map and the learned score distribution, and no sparse map improved validation loss over softmax, though the sparse models were less sensitive to increasing the number of experts at inference.

Tom\'as Brogueira, Marcos Treviso, Miguel Couceiro

★★★★☆ Notable
arXiv cs.LG

Improved Convergence of Large Stepsize Gradient Descent for Logistic Regression

In briefFaster Convergence of Large-Stepsize Gradient Descent for Logistic Regression

SummaryThis paper studies gradient descent with a large constant stepsize for logistic regression on linearly separable data. The authors prove that in arbitrary dimension, a stepsize of 1/ε lets the loss reach ε in polylogarithmic steps, improving the transition time from the oscillatory to the stable phase. The proof splits the oscillatory phase into recursively nested intervals, with the margin and data rank bounding the nesting depth.

WhyExtends large-stepsize GD convergence from 2D to arbitrary dimension, reducing steps to polylogarithmic with a rigorous proof, impactful for a subfield.

Xiaochuan Gong, Ang Li

arXiv cs.LG · cs.CV

Detecting Nighttime Anomalies from NASA Black Marble Using a Generalized Spatio-Temporally Robust Framework of Machine Leaning Ensembles

In briefUsing machine learning ensembles on NASA Black Marble night lights to detect anomalies like fires and eruptions.

SummaryThis paper proposes a machine learning framework that jointly uses the M-band and Day/Night Band signals from NASA's Black Marble nighttime light product. It builds an ensemble of anomaly detectors meant to generalize across regions, seasons, anomaly types, and both land and ocean. Detections are reported at different confidence levels based on the relevant bands and agreement among detectors. The authors report improved true detection rates, fewer spurious detections, and strong generalizability for natural hazard monitoring and energy extraction.

Srija Chakraborty

arXiv cs.AI · cs.CL

The Pushback Paradox: A Two-Probe Diagnostic for Language Model Compliance

In briefThe Pushback Paradox: A Two-Probe Test of Whether Language Models Follow Instructions

SummaryThis paper proposes an open benchmark with two probes that measure how far a language model complies with user instructions. The active probe tests exploitability by asking the model to accept a lower payoff, and the passive probe tests stoppability by asking it to give up a higher payoff, and the two rates combine into a compliance index κ. Applied to twelve models, most followed both instructions, and only two Claude models could be stopped without being exploitable.

Stefan B\"uhler, David Exler, Markus Reischl et al.

arXiv cs.CV · cs.AI

VideoTapestry: Query-Adaptive Memory Refinement for Multi-Agent Long-Video Understanding

In briefVideoTapestry: A Training-Free Multi-Agent Method That Refines Video Memory Based on Each Question

SummaryLong-video understanding requires remembering information spread across extended time spans, which existing methods handle either through query-driven exploration or question-independent memory. This paper introduces VideoTapestry, a training-free multi-agent framework that refines a pre-built three-level video memory from coarse to fine, guided by the query. According to the paper, it achieves absolute accuracy gains of 7.0% to 17.2% over direct GPT-5.5 inference across four benchmarks, including LVBench and EgoSchema, reaching state-of-the-art results among compared methods.

Yucheng Liu, Yufei Yin, Mingxiao Feng et al.

arXiv cs.LG

Learning What to Imitate: Entropy-Aware Distribution Mixing

In briefLearning What to Imitate: Entropy-Aware Distribution Mixing for Small Language Model Distillation

SummarySmall language models are often trained to imitate reasoning traces from stronger teacher models, but imitating traces far outside the student's distribution can cause confident conflicts and forgetting. The paper proposes Entropy-Aware Mixing, which dynamically interpolates student and teacher token distributions based on the student's predictive entropy, using convex or geometric interpolation in both offline and on-policy distillation. Results indicate more stable distillation, better in- and out-of-distribution math reasoning, and better preservation of general capabilities than fixed-teacher supervision. The best entropy schedule, however, depends on whether training traces are generated offline or on-policy.

Juan Garcia Giraldo, Matteo Santelmo, Eduard Durech et al.

arXiv cs.CL Code

Reward Stealing Attack on Large Language Models

In briefReward Stealing Attack: A New Adversarial Method Targeting Large Language Models

SummaryThis paper proposes Reward Stealing Attack (ReSA), an adversarial framework that targets the latent safety reward behind LLM alignment. It uses maximum entropy inverse reinforcement learning to recover a proxy reward model from the aligned model's behavior alone, then reverses that reward at inference time to form an adversarial policy. Experiments show a single recovered reward generalizes across prompts and models, and ReSA significantly outperforms existing attacks in effectiveness and transferability.

Jiaming Qian, Pengyang Zhou, Jiahe Xu et al.

arXiv cs.AI · cs.CE · cs.CL

Language models can notice an impossible engineering problem yet still report it as solved

In briefLanguage models can spot an unsolvable engineering problem yet still call it solved

SummaryThe authors tested 14 models on 30 mechanics problem pairs, each with a valid version and a flawed version made physically impossible. Some models noticed the flaw and solved a corrected problem, yet still reported the original as solved. When asked to name and explain the defect, several models rejected flawed problems significantly more often, but valid-problem solving fell in some of them.

Shaoliang Yang, Jun Wang

arXiv cs.LG · cs.CL

What Matters for Latent Reasoning with Flow Matching

In briefWhat Matters for Latent Reasoning with Flow Matching: The FLaRe Method

SummaryThis paper studies latent reasoning, where a large language model thinks in a continuous space and only verbalizes the final answer. The authors define five requirements for good latent thoughts: usefulness, diversity, explainability, refinability with more compute, and efficiency. They propose Flow-based Latent Reasoning (FLaRe), a flow matching recipe that they report improves on prior latent methods across all five requirements and reaches 97% of explicit chain-of-thought accuracy at a quarter of its latency.

Yassine Ouali, Adrian Bulat, Georgios Tzimiropoulos

arXiv cs.CV

Cross-dataset harmonization for robust endoscopic image analysis

In briefColor harmonization method for more reliable endoscopic image analysis across datasets

SummaryMachine learning models for endoscopic images often perform worse on data from endoscopes different from those used for training, mainly due to color differences. This study proposes a reference-based harmonization method that matches the global color statistics of each target image to a chosen reference dataset in CIE-Lab color space, without retraining. Evaluated on polyp detection in colonoscopy and capsule endoscopy with dataset-level cross validation, it improves cross-dataset performance by up to 30.7% and outperforms baseline and state-of-the-art methods.

Romil Imtiaz, Dimitris K. Iakovidis

arXiv cs.CV Code

Talk Like You: Imitating How You Speak in Real-Time Talking Head Generation

In briefTalk Like You: Real-time talking heads that mimic personal speaking habits

SummaryThis paper presents TalkLikeYou, a framework that imitates a target person's individual speaking habits, such as subtle lip-shape differences when pronouncing the same word, in real-time talking head generation. It models these habits in motion space using Flow Matching with only one sampling step at inference, and uses two-stage imitation learning so users can pick a preset style or provide a reference video. The authors also introduce a metric, PLAD, which measures imitation accuracy and generation diversity.

Baiqin Wang, Zhixing Ding, Jijie Li et al.

arXiv cs.LG · cs.HC

TrustmeWatcher: An Application for Workplace Micro-Sensing and Explainable Well-Being Feedback

In briefTrustmeWatcher: A Workplace Sensing App with Explainable Well-Being Feedback

SummaryThis paper presents TrustmeWatcher, an application built for the TRUST-ME project to connect workplace activity tracking with feedback to participants. It turns computer activity records into an interactive screen-time dashboard and syncs short questionnaire responses. A locally run model predicts six state scores and an overall well-being score, with explainable AI showing how activity contributed. Users can pause the camera and eye tracker. The workflow is described using records from 17 participants.

Chengyu Yu, Leon Jacopo Costa, Zoja An\v{z}ur et al.

arXiv cs.LG · math.OC · stat.ML

The Birkhoff Geometry of Manifold-Constrained Hyper-Connections: Two Channels, Vertex Viscosity, and Sinkhorn as a Retraction

In briefGeometry of Manifold-Constrained Hyper-Connections in Transformers

SummaryThe paper analyzes manifold-constrained hyper-connections (mHC), which mix Transformer residual streams with doubly stochastic matrices computed by Sinkhorn normalization. It splits the stream into a mean channel and a difference channel, showing the difference channel contracts each layer and acts as fading memory. It also relates Sinkhorn's logit map and gradient flow to Fisher-Rao geometry and mirror descent, and derives convergence rates near permutation vertices. Experiments are reported to confirm the predicted rates.

Xiaoyu Li, Zhizhou Sha, Chiwun Yang

★★★★☆ Notable
arXiv cs.AI

Collective intelligence through aggregation

In briefCombining group members' judgments into a smarter collective decision

SummaryThe paper studies how a committee or expert panel can reach collective judgments on several related issues, including numerical variables, based on members' individual judgments. It identifies three challenges: aggregated judgments may be inconsistent, methods may be open to strategic manipulation, and some methods fail to track the truth. The authors prove new impossibility and possibility theorems on these challenges, and conclude that the median method, though imperfect, performs reasonably well.

WhyProves new impossibility and possibility theorems on consistency, manipulability, and truth-tracking in judgment aggregation, with broad relevance to group decision-making.

Franz Dietrich, Christian List

arXiv cs.LG

Considering Context: When World Models Need Context Encoders

In briefConsidering Context: When World Models Need Context Encoders

SummaryThis paper examines whether a model-based reinforcement learning agent can recover, from its own experience, the latent context that governs environment dynamics, a question that existing methods usually answer by supplying context externally. The authors introduce predictive sufficiency, which measures how much access to the context improves next-step prediction and splits this into a history-recoverable part, a residual needing the true context, and the deficit from a finite model. They find this headroom does not follow the MDP class and propose a practical criterion, estimated from an ordinary trained agent without a reference policy, for matching contextual mechanisms to the information available.

Oleg Smirnov, Sofiane Ennadir, John Pertoft et al.

arXiv cs.CL

Wikidata Search Traces: A Dataset for Training Knowledge Graph Search Agents

In briefWikidata search traces: a dataset for training agents that search knowledge graphs

SummaryThe paper releases 10,235 solving traces showing how agents explore Wikidata to answer multi-hop questions, along with the recursive language model harness that produced them. The questions were built by replacing named entities with nested conditions and checked for uniqueness. On 100 questions, the harness raised correct answers compared with direct tool calling, from 49 to 61 for gpt-6-luna and from 60 to 74 for Qwen3.8-27B.

Mohamed Chenene, Carlos Rosas-Hinostroza, Anastasia Stasenko et al.

arXiv cs.CL · cs.LG

Representation-Space MMD for Diffusion Language Models

In briefPost-training diffusion language models by matching feature distributions with MMD

SummaryThis paper proposes a post-training method for diffusion language models that minimizes Maximum Mean Discrepancy between generated and reference distributions in the feature space of a frozen pretrained model. It keeps per-token contextual features from a single extractor pass and optimizes the objective with policy gradients for discrete models or direct differentiation for continuous models. The authors report lower generative perplexity at comparable entropy on OpenWebText, better accuracy-computation trade-offs on GSM8K, and higher decoding parallelism with similar or higher accuracy on math and code benchmarks for 16B DMax-LLaDA2.0 models.

Ilya Drobyshevskiy, Ilia Sudakov, Maksim Semenov et al.

arXiv cs.CL Code

LoGRA: Scaling LLM Reinforcement Learning with Low-Rank Gradient Sketches

In briefLoGRA: Making reinforcement learning for large language models less memory-hungry using low-rank gradient sketches

SummaryThe paper introduces LoGRA, a reinforcement learning post-training method that uses compact low-rank gradient sketches to reduce memory use. It adds predicted-KL step control, which estimates policy change before each update and scales the update accordingly. According to the authors, combined techniques cut average training memory by up to 45.7% across reasoning tasks without hurting performance, and enable stable training of a 27B-parameter model on a single eight-GPU node.

Shaokun Zhang, Yifan Zhang, Jian Hu et al.

★★★★☆ Notable
arXiv cs.RO · cs.AI · cs.CV

AffordCraft: Scalable Construction of Task-Ready Simulation Assets from Single Images

In briefAffordCraft: Building Task-Ready Simulation Objects from One Photo by Retrieval

SummaryAffordCraft builds a simulation-ready object with movable parts and joints from a single RGB image and a task instruction. It retrieves and fits a matching asset from a library of articulated objects instead of generating one. The paper reports valid assets for 1,703 of 2,000 photos across 31 categories, while five generative baselines pass on at most 45% and take 10 to 78 times more GPU time per valid asset. Enlarging the library from 141 to 11,372 entries raised category coverage from 46% to 100%. The authors also build manipulation tasks from these assets, and policies trained on scripted demonstrations complete them from unseen initial states.

WhyBuilds articulated simulation assets by retrieval rather than generation, beating five generative methods on 2,000 photos in validity and GPU time.

Haoyun Yang, Xueyang Zhou, Ziyi Xie et al.

arXiv cs.LG

Beyond the Model: The Critical Role of Data Filtering in Clinical Machine Learning

In briefBeyond the Model: How Data Filtering Shapes Clinical Machine Learning

SummaryMachine learning studies on clinical data often depend on preprocessing and filtering pipelines before modeling. The paper argues that these filtering choices can change the dataset's statistical structure and artificially raise or lower the complexity of the prediction task. The authors contend that filtering should be treated as part of the scientific method rather than a routine step, and call for explainable, transparent preprocessing pipelines.

Noah Subedar, Colin Campbell, Wenjing Zhang et al.

arXiv cs.CL

Long-Horizon Textual World Modeling through Structured Reasoning

In briefLong-Horizon Text World Modeling via Structured Reasoning

SummaryThis paper proposes a method for predicting how text-based environments evolve over many steps by treating multi-step transitions as structured reasoning over explicit textual world states. It combines reasoning over sparse state changes, a predictive-gain objective that rewards states improving over a predictor conditioned on raw history, and intermediate predictive rewards for each state. Across ScienceWorld, Jericho, and CEO-Bench, the approach achieves the strongest average long-horizon performance against recursive and non-recursive baselines, with gains increasing at longer horizons.

Fangxin Wang, Xiang Gao, Yuguang Yao et al.

arXiv stat.ML · cs.LG · eess.SP

Inverse Cross-spectral Neural Networks for Multivariate Time Series

In briefInverse Cross-Spectral Neural Networks: A Graph Neural Network Approach for Multivariate Time Series

SummaryThis paper introduces Inverse Cross-Spectral Neural Networks (iCSNNs), graph neural networks for stationary multivariate time series whose shift operators are inverse cross-spectral density matrices. These operators capture frequency-specific conditional relationships among variables. Frequencies are grouped into bands sharing one operator for a compact parametrisation, and a joint learning procedure estimates the spectral structure and network parameters together. On synthetic data, iCSNN outperforms baselines from different methodological families.

Lorenzo Marinucci, Leonardo Di Nino, Gabriele D'Acunto et al.

arXiv cs.IT · cs.LG · math.IT

On the Cardinality of Optimal Representations in the Binary-Source Information Bottleneck

In briefSymbol Count of Optimal Representations in the Binary-Source Information Bottleneck

SummaryThe information bottleneck seeks a compressed representation of a source that keeps information about a target while limiting mutual information with the source. The paper shows that for a binary source and a finite target, the optimum is always attained by a binary representation, sharpening the known bound from |X|+1 to |X|. The proof uses a separating hyperplane argument.

Dier Tang, Jun Chen

arXiv cs.CL · cs.CY

JEV versus LLMs: Accuracy, Cost and Calibration on Seven Political Science Replications

In briefJEV vs LLMs: Comparing accuracy, cost, and calibration on political science tasks

SummaryThis paper compares JEV, a commercial model that returns decisions and probabilities over fixed answer sets, with LLMs on seven political science replication tasks. It benchmarks JEV against human coders from published studies, GPT-6 Luna, and Qwen3.8-27B. JEV matches or comes close to the LLMs' accuracy, but shows no cost advantage over GPT-6 Luna at OpenAI batch prices. Its probabilities are better calibrated than GPT-6 Luna's token probabilities when questions are asked once, though not consistently better than Qwen3.8-27B.

Steven Denney, Matthew DiGiuseppe

arXiv cs.LG · cs.AI · cs.CL

Frozen Factor or Spectral Band? Disentangling Two Choices in Low-Rank LoRA

In briefFrozen Factor or Spectral Band? Separating Two Design Choices in Low-Rank LoRA

SummaryThis paper examines two design choices in low-rank LoRA: which factor to freeze (input factor A or output factor B) and which top or bottom singular directions of pretrained weights to use. At rank 2, freezing A gives a larger advantage than the spectral band differences, while freezing B trails comparable free LoRA on several task-model pairs. The factor contrast weakens as rank increases.

Adnan Slimane Ali, Ayoub Belfatmi, David Ngwe Pouth

★★★★☆ Notable
arXiv cs.CV · cs.LG · cs.RO Code

RealtimeWAM: One-Step Asynchronous World Action Models

In briefRealtimeWAM: One-Step Asynchronous World Action Models for Fast Robot Action Prediction

SummaryWorld Action Models use visual representations from video generation models to guide action prediction. RealtimeWAM is an efficient variant that generates actions in one step and runs its two experts asynchronously, reducing repeated denoising and waiting between them. It introduces Teacher-Anchored Consistency Distillation and Cross-Expert Wavefront Pipelining to achieve this. The authors report under 1% performance drop across LIBERO, LIBERO-Plus, and RoboTwin, with about 25x end-to-end speedup on an H100.

WhyProposes teacher-anchored distillation and wavefront pipelining for one-step asynchronous action generation; shows under 1% loss and about 25x speedup across LIBERO and RoboTwin benchmarks.

Chengtao Lv, Jinyang Du, Shuyi Feng et al.

arXiv cs.CV

Video Encoders Built on Image Representations

In briefVideo encoder built on image representations, using fewer visual tokens

SummaryThe paper proposes a compact video encoder that starts from a frozen image encoder to produce per-frame candidates. A question-aware selector allocates a fixed token budget across frames, and a lightweight refiner adds neighboring-frame context only to the retained tokens. Across 13 benchmarks and three vision-language backbones, it reportedly matches full-image aggregate performance while using about 28%-35% of the visual tokens.

Jusheng Zhang, Wenhao Wang, Longqi Cai et al.

arXiv q-bio.NC · cs.CL

COMPASS 2.0: psychometric representational similarity analysis distinguishes symptom structure from personal signal

In briefCOMPASS 2.0: Psychometric Similarity Analysis Separates Symptom Structure from Personal Signal

SummaryThe paper proposes a framework for comparing the structure of speech-derived scores, self-report, item wording and theory, implemented in COMPASS 2.0. In pre-registered analyses of clinical interviews from 275 participants, language-derived symptom structure resembled item wording more than self-report, and no structure beyond wording was detected by the registered tests. The authors distinguish agreement about psychological structure from evidence that language-derived assessments track individual people.

Baihan Lin

arXiv cs.AI

FREA: A Multi-Source Expert Benchmark for Reaction Feasibility Verification

In briefFREA: A Benchmark of Expert-Labeled Chemical Reactions for Testing Feasibility Verifiers

SummaryThe paper introduces FREA, a benchmark of 751 chemical reactions labeled by expert chemists under an explicit feasibility criterion, drawn from several sources including retrosynthesis proposals, zero-yield records, and LLM edits. The evaluation finds no verifier performs best across all sources, and some forward models score below chance when separating infeasible alternative disconnections from feasible generated candidates. The authors also release a corpus of over 14 million recorded reactions and generated negatives, and report that adding generated negatives to training improves scores across sources but not on retrosynthesis proposals.

Botao Yu, Bo Zhou, Daniel Adu-Ampratwum et al.

arXiv cs.CV

Lens3D: Target-Conditioned Visual Foveation for Fine-Grained 3D Understanding

In briefLens3D: target-conditioned visual foveation for fine-grained 3D understanding

SummaryExisting 3D large language models often miss fine-grained attributes and small or less visually prominent objects and parts, even when the scene video contains relevant evidence. Lens3D uses an external 2D vision-language model, guided by 3D localization, to get informative views, and transfers the resulting detailed knowledge into native 3D LLMs via caption supervision. The authors also build LensBench, a held-out set of 2,068 objects. Experiments with Video-3D LLM and 3DRS show substantial gains in fine-grained captioning while preserving grounding and scene-level QA performance.

Junming Huang, Zini Chen, Shuaiying Hou et al.

arXiv stat.ML · cs.LG

The Surrogate Is Not the Reward: Post-Surrogate Primary-Outcome Acquisition in Contextual Bandits

In briefThe Surrogate Is Not the Reward: Deciding When to Acquire Primary Outcomes After Observing a Surrogate

SummaryThis paper studies contextual bandits where a surrogate signal is observed before the learner decides whether to pay to acquire the primary outcome that defines reward. The proposed Audited Surrogate Bandit (ASB) allocates a limited budget of acquisitions, adjusting after seeing the surrogate based on residual uncertainty. The authors give regret bounds for finite policy classes and show a gap between learners who see the surrogate before deciding and those who must decide earlier. Synthetic and KuaiRec experiments indicate that both decision relevance and residual uncertainty matter for acquisition.

Kyungbok Lee, Michael R. Kosorok

arXiv cs.LG

Separators Make Carry Propagation Learnable:The Geometry of Latent Carry in a Multiplication Transformer

In briefSeparators Make Carry Propagation Learnable: Latent Carry Geometry in a Multiplication Transformer

SummaryThe paper trains small Llama-style transformers from scratch on 4x4 multiplication without chain of thought. Inserting a space token between digits raises exact-match accuracy from 1% to 89%. Inside the model, the separator token at each digit's prediction slot encodes the carry as an angle on a ring in the residual stream, and activation patching shows this state is causally used before the final layer.

Sama Satariyan (SCAI), Raphael Cousin (SCAI), G{\'e}rard Biau (LPSM et al.

arXiv cs.CL · cs.AI

Word-Level Text Unmixing via Evidence-Preserving Ownership Routing with Language Models

In briefWord-level text unmixing via ownership routing that preserves every word

SummaryThis paper addresses recovering original source texts from an interleaved word stream when source attribution is lost, such as overlapping speech transcripts or concurrent agent outputs. The authors propose EPOR, which uses a causal LLM to predict which source owns each word, then applies deterministic indexed reconstruction so every word occurrence is preserved exactly once. They also introduce the UNMIXBENCH benchmark spanning synthetic, speech, document, and simulated digital data. A 4B EPOR model achieves the lowest mean word error rate among finetuned baselines, reducing it by 22.3% relative to compact source-array generation.

Jinglin He, Siyang Jiang, Lixing He et al.

arXiv cs.CV · eess.IV

Multitask Conditional Generative Adversarial Network Enables Automatic Whole Knee Cartilage and Menisci Segmentation and Reliable T₁ρ and T₂ Quantification Without High-Resolution Morphological Images

In briefA multitask GAN that segments knee cartilage and menisci and quantifies T1ρ and T2 without high-resolution morphological scans

SummaryThis study proposes a multitask conditional GAN (MT-cGAN) that jointly synthesizes DESS-like images and segments cartilage and meniscus directly from qMRI echo images. It retrospectively evaluated 508 knee MRI volumes from 361 subjects. The model achieved a mean Dice score of 0.84, significantly above a comparison model (0.82, p<0.001). Its T1ρ and T2 coefficients of variation were 1.84% and 1.81%, the lowest among compared methods. The authors state this removes the need for separate DESS scans, reducing scan time.

Ahmed Tahseen Minhaz, Richard Lartey, Zhiyuan Zhang et al.

arXiv cs.LG · cs.AI

Will the Judge Flip? Predicting Position-Sensitive LLM Judgments from Residual Stream Activations

In briefPredicting when an LLM judge's verdict flips with candidate order

SummaryLarge language model judges can change their verdict when the order of two candidate responses is swapped, and detecting this normally requires judging each pair twice. The authors train regularized linear probes on residual stream activations recorded before the initial verdict to predict such flips. On JudgeBench pairs across three Qwen3 judges and Llama-3.1-8B, the probes reach AUROCs of 0.621 to 0.850 and outperform a combined baseline of non-activation predictors. Probes trained on JudgeBench and then frozen also transfer to MT-Bench comparisons with AUROCs of 0.685 to 0.853.

Hashmath Shaik, Gnaneswar Villuri, Alex Doboli

arXiv cs.CL

Molecules of a Story: Community Detection in PMI-weighted Narrative Networks

In briefFinding Minor Story Patterns: Peripheral Communities in Narrative Networks Using PMI

SummaryThis paper proposes weighting narrative network edges by pointwise mutual information (PMI) to surface peripheral structures involving rare, minor entities that are overshadowed by central characters. The authors demonstrate the method on The Lord of the Rings and classify the resulting communities by how concentrated or dispersed their activations are across the text. They identify three types: episodic passages, long-distance echoes, and recurring threads. The authors note the approach is best treated as an exploratory lens rather than a robust extraction pipeline, due to its sensitivity to weak signals.

Kasper Fyhn, Rebekah Baglini

arXiv cs.RO · cs.AI · cs.CV Code

SimForcing: Distilling Simulation Motion Priors into Real-Domain Robot World Models

In briefSimForcing: Transferring Simulation Motion Knowledge to Real-World Robot World Models

SummaryThis paper presents SimForcing, a framework that uses robot simulation to help train action-conditioned world models that predict video from robot trajectories. It transfers motion knowledge from a simulation teacher via latent-motion distillation and uses multi-block simulation conditioning with condition dropout to reduce reliance on simulation accuracy. On the Bridge dataset, it reports the best PSNR, SSIM, LPIPS, and FVD among compared methods, and it also improves LIBERO success when used to initialize a vision-language-action model.

Xiaodong Wang, Tianle Li, Chuanxin Song et al.

arXiv cs.AI

Can Agent Harnesses and Inference Engines Hear Each Other? The HEAR Protocol for Agentic LLM Serving

In briefCan agent harnesses and inference engines communicate? HEAR protocol for agentic LLM serving

SummaryThis paper proposes HEAR, a bidirectional protocol that lets an agent harness share workflow intent and execution needs with an inference engine, which in turn returns runtime state, capabilities, and outcomes. HEAR separates protocol semantics from optimization policies and is instantiated for cache-aware coordination and execution-mode selection. On SCBench under memory-constrained concurrent serving, it reports a 1.61x batch speedup and a 2.23x reduction in median time-to-first-token. On BrowseComp-Plus and DeepResearchBench, it reports end-to-end speedups of 1.23x and 2.45x without observed task-quality degradation.

Jiaqi Zhao, Haodong Chen, Jitai Hao et al.

arXiv cs.CV · eess.IV Code

Analysis of SWIR Imaging Detection Performance Under Adverse Environmental Conditions for Autonomous Driving Systems

In briefComparing Short-Wave Infrared and RGB Cameras for Self-Driving Detection in Bad Weather

SummaryThis paper systematically compares object detection on paired RGB and short-wave infrared (SWIR) images from the RASMD dataset, across four weather conditions and two real-time detectors. RGB performs comparably or better in most cases, while RF-DETR is more robust across conditions. The authors also propose a sensor-dominance mining method and find SWIR clearly helps in four safety-critical cases: windshield glare, water droplets, low-contrast objects, and long-range vehicles, so it is best seen as a complementary sensor.

Rohan Mehra, Alexandre Riffard, Yannis Loumouamou et al.

★★★★☆ Notable
arXiv cs.CV Code

VGGT-Bridge: Beyond Sequential Pose Graphs via Coarse-Stride Skip Edges

In briefVGGT-Bridge: Reducing Drift in Long-Sequence 3D Reconstruction with Skip Edges

SummaryThis paper addresses drift in chunk-based 3D reconstruction with feed-forward transformers like VGGT, where errors build up along sequential chunk connections. It proposes VGGT-Bridge, which adds long-range skip edges from sparsely sampled coarse chunks to directly constrain non-adjacent chunks, without retraining. The authors report ATE reductions of 28.3% on KITTI Odometry, 18.8% on Virtual KITTI, and 10.0% on Waymo Open compared with the SwiftVGGT baseline.

WhyAdds long-range skip constraints via coarse chunks and reverses inputs to exploit scale bias, validated by ATE reductions on three driving benchmarks.

Sungjae Choi, Hanna Bae, Sunghyun Baek et al.

★★★★☆ Notable
arXiv cs.AI

The Review Lottery: Benchmarking an Observational Estimator of Peer-Review Noise (ICLR 2017-2025)

In briefThe Review Lottery: Estimating How Peer-Review Noise Changes Conference Decisions

SummaryThis paper builds an estimator of peer-review noise using only public review data, simulating how an accept/reject decision might change if a second independent reviewer panel evaluated the same paper. It is applied to 36,113 ICLR papers and 134,912 reviews from 2017 to 2025, and calibrated against the NeurIPS 2021 experiment. Estimated disagreement rates are roughly 18% to 30%, and the authors find no robust time trend in reviewer noise.

WhyBuilds an observational estimator of review noise from public data, externally calibrated against NeurIPS 2021, with internal validation across nine ICLR years.

Feilian Huang

★★★★☆ Notable
arXiv cs.LG · cs.CV · cs.DS

Sample-Optimal Estimation of the Fréchet Inception Distance

In briefOptimal-sample estimation of the Fréchet Inception Distance, a metric for generative models

SummaryThe paper studies how many samples are needed to estimate the Fréchet Inception Distance (FID) accurately when one of the two Gaussian distributions is known. It gives tight bounds on the bias and variance of the standard plug-in estimator and proposes a debiasing method, Relative Taylor Debiasing (RTD). The authors show RTD reaches an optimal sample complexity of O(d/ε²). Experiments on synthetic Gaussians and ImageNet Inception embeddings support the theoretical results.

WhyProposes RTD with provably optimal O(d/ε²) sample complexity and tight bias/variance bounds, a substantial improvement over prior FID estimators.

Ziyun Chen, Jerry Li, Kevin Tian et al.

arXiv cs.CV

Keepsake: Selective Spatial Memory for Long-Horizon Video Generation

In briefKeepsake: Selective Spatial Memory for Long-Horizon Video Generation

SummaryThis paper presents Keepsake, an online, training-free controller that manages a fixed-size spatial memory for camera-controlled long-horizon video generation. It builds a graph linking stored and new observations by camera-pose proximity and visual similarity, and keeps or evicts each observation based on how many strong alternatives it has. Under a fixed memory budget, it improves FVD and LPIPS on MemCam and WorldMem. On 180-second MemCam trajectories, it keeps 32 of 5,397 frames and reduces FVD by 35.1%.

Abdul Mohaimen Al Radi, Kunyang Li, Yuzhang Shang et al.

arXiv cs.SD · cs.AI · cs.CL

Mind the Accent Gap: British Accent Robustness in Speech-Driven Financial Voice Assistants

In briefMind the Accent Gap: Testing Voice Finance Assistants on British Accents

SummaryVoice assistants typically pair automatic speech recognition with LLM reasoning, but existing systems perform poorly on Scottish, Irish, and Welsh accents, largely because most ASR models are trained on American English. The authors introduce CavaBench, an internally collected benchmark of spoken financial queries, to evaluate various ASR models and their end-to-end ASR-LLM pipelines across self-reported British accents. They find word error rate strongly predicts downstream tool-calling accuracy (r = -0.93), but it can miss task-level performance, and accent-related failures vary substantially across models and acoustic conditions.

Aadam Haq, Oggi Rudovic, Malcolm Chadwick et al.

arXiv cs.AI · cs.CL · cs.IR

Mind the Execution Gap: Action-Semantic Mismatch in World-Model Control

In briefMind the Execution Gap: How delayed or lost control commands confuse world-model controllers

SummaryThe paper studies how asynchronous command execution, caused by delay, packet loss, reordering, and actuator buffering, changes the action meanings that world-model controllers assume. Through controlled interventions, the authors identify two architecture-dependent failures: TD-MPC2 suffers from a timeline mismatch between imagined and executed future actions, while DreamerV3 may attribute transitions to commands that were never applied. They introduce two lightweight interfaces, Future-Sequence for TD-MPC2 and Applied-Action Feedback for DreamerV3, which correct these mismatches without modifying the pretrained world models. Experiments across delays, packet loss, reordering, several control domains, and network traces support both diagnoses and fixes.

Shengtao Wen, Xiang Chen, Yu Tian et al.

arXiv cs.AI Code

Doing Less with More: A First-Principles Exploration of the Suitability of Agentic Computing over Alternative Architectural Choices

In briefDoing Less with More: When Agentic AI Suits Business Automation Versus Simpler Architectures

SummaryThis paper examines when agentic AI is preferable to alternatives such as local computation, REST, SOAP, and MCP for automating business tasks. Using 1,000 arithmetic expressions that require correct operator precedence, it compares seven methods. Deterministic methods reached 100% accuracy with negligible latency, while direct LLM responses reached at most 92.9% at far higher latency. The best MCP-based agent reached 99.9% accuracy but with nearly 1,000,000 times the baseline latency, leading the authors to recommend choosing architectures by task type.

Ritvik Garimella, Biplav Srivastava, Amit Sheth

arXiv cs.LG · stat.ML Code

LinearPFN: Amortized Variable Selection for Linear Models with Interactions

In briefLinearPFN: Amortized Variable Selection for Linear Models with Interactions

SummaryThis paper presents LinearPFN, a transformer network pretrained once on synthetic datasets to perform spike-and-slab Bayesian variable selection for linear models with main effects and pairwise interactions. For a new dataset, a single forward pass returns posterior inclusion probabilities, posterior-mean coefficients and posterior predictive distributions without per-dataset fitting. On predictor matrices from real social-science datasets with simulated outcomes, it reports higher selection AUC and F1 than five classical baselines.

Louis Schiekiera, Max Zimmer, Christophe Roux et al.

arXiv cs.AI

DGA-Muon: Decoupled Geometry-Aligned Adaptive Scaling for Muon

In briefDGA-Muon: A Decoupled, Geometry-Aligned Adaptive Scaling Method for the Muon Optimizer

SummaryThis paper theoretically analyzes the adaptive scaling mechanism of NorMuon, finding that it mainly stems from geometry induced by orthogonalization rather than genuine optimization dynamics. It shows that more accurate orthogonalization weakens this adaptivity, and that NorMuon's row-wise scaling misaligns with the structure of tall matrices. Based on these findings, the authors propose DGA-Muon, which decouples scaling from orthogonalization and aligns it with matrix shape, and they provide convergence guarantees and empirical validation.

Wenpeng Zhang, Runsheng Yu

arXiv cs.CL

Before Agent Tells The Lie: Has Deception Already Been Represented?

In briefCan agent deception be detected in its internal states before it appears in outputs?

SummaryThis paper studies whether deceptive behavior by LLM-based agents, such as hiding failures or falsely signaling task completion, can be predicted from internal hidden states before it becomes visible. The authors align agent trajectories around key decision points and show that hidden states extracted beforehand can reliably distinguish future honest and deceptive outcomes, with signals detectable several model calls before the final decision. Intervening on the identified representation directions via activation steering reduces downstream deceptive behavior, suggesting these representations influence agent decisions.

Xinling Li, Dadi Guo, Qingyu Liu et al.

arXiv cs.CV

FrontVeg V2: A Training-Free Software Framework for Foreground-Aware Zero-Shot Plant Trait Segmentation in High-Resolution Images of Trellised Crops

In briefFrontVeg V2: A training-free software tool that segments plant traits in images of trellised crops.

SummaryFrontVeg V2 is an open-source software framework that segments plant organs and disease symptoms in high-resolution images of trellised crops without training models. It combines depth estimation, foreground extraction, tiled zero-shot segmentation, mask assembly, and geometry-aware fusion to reduce detections from neighboring vegetation rows. The current implementation integrates Depth Anything V2 and SAM3 and can be run through command-line batch processing or a Napari graphical interface. The framework is presented as reusable for multi-crop, multi-trait digital phenotyping.

Abdoul Djalil Ousseini Hamza, Herearii Metuarea, Corentin Lothod{\'e} (IRHS-IMHORPHEN et al.

arXiv cs.LG · cs.AI

LiLib: Lifelong Air-to-Ground Path-Loss Prediction on UAVs via a Drift-Triggered Model Library

In briefLiLib: Lifelong Learning for Drone Radio Signal Loss Prediction Using a Model Library

SummaryDrones acting as relays or base stations must predict air-to-ground signal path loss to adjust data rates and placement, but conditions change as they move between suburban, urban and high-rise areas, often revisiting the same ones. The authors propose LiLib, which keeps a small library of recursive-least-squares experts, detects drift with a windowed residual test, and then reuses a stored expert or creates a new one. In simulations based on four standard urbanization profiles, LiLib reduces prediction RMSE from 5.89 dB to 4.03 dB and lowers error after returning to a known environment.

Minh Tran

arXiv cs.CV · cs.AI Code

BrainTRACE: Tracing Longitudinal, Multimodal, and Volumetric Evidence in Brain MRI Clinical Reasoning

In briefBrainTRACE: A Benchmark for Multi-Evidence Brain MRI Reasoning Over Time

SummaryThis paper introduces BrainTRACE, a report-grounded benchmark that tests whether vision-language models can trace the evidence needed to interpret brain MRI scans across time. It contains 7,273 scored VQA items built from 1,778 longitudinal patients, 7,299 studies, and about 29k co-registered 3D sequence volumes. Evaluating 20 model configurations, the authors find that current systems can spot isolated visual cues but rarely combine them into grounded longitudinal interpretations.

Qizhen Lan, Mengchen Fan, Hang Zhang et al.

arXiv cs.AI

HERA: Harness-Environment Co-Evolution for Reliable Agentic Abstention

In briefHERA: Co-evolving agent harnesses and environments for reliable abstention

SummaryLLM agents often fail to recognize when a tool-use task is infeasible and has no valid solution. This paper introduces HERA, which automatically builds verifiable pairs of feasible and infeasible tasks through controlled environment mutations, and co-evolves the agent harness with new environments driven by past failures. On held-out tasks, the evolved harness raises abstention accuracy from 61.7% to 83.3% and feasible-task completion from 68.3% to 76.7%. The authors report that the harness transfers to 19 other LLMs, improving abstention accuracy by 15.3 points on average.

Han Luo, Bingbing Wen, Guang Yang et al.

arXiv cs.GT · cs.LG

MIRT: Transformers for Truthful Generative Auctions with Whole-feed Permutation Externalities

In briefMIRT: Transformer-based truthful auctions for whole-feed ad and content ordering

SummaryThe paper proposes MIRT, a mechanism that uses a transformer to generate candidate feeds jointly ordering ads and organic content, then selects the welfare-maximizing feed from that range. A reinforcement learning approach trains the transformer to produce bid-independent ranges with high welfare, preserving exact strategyproofness. The authors bound the pseudo-dimension to show learnability and report that MIRT outperforms prior non-strategyproof feed models in experiments.

Ali Elahi, Ermis Soumalias, Jason Cheuk Nam Liang et al.