每日 arXiv 论文简报

Visual AutoRegressive modeling (VAR) has pioneered a coarse-to-fine multi-scale autoregressive generative paradigm, demonstrating strong capabilities in image generation. However, VAR still suffers from inherent deficiencies in multi-scale representation learning. Specifically, lower scales primarily capture global semantics, while higher scales focus on fine-grained details. Employing a shared architecture across scales induces optimization conflicts. Moreover, due to the causal autoregressive process, inaccurate semantics at early scales can propagate and significantly degrade the final output. To address these issues, we introduce a scale-aware token-routed Mixture of Experts (MoE) architecture, allowing scale-adaptive expert selection, thereby facilitating decoupled representation learning across scales. In addition, we enhance semantic modeling at early scales by incorporating external self-supervised features. Unlike naive alignment, we analyse and design a residual feature aggregation scheme tailored to the VAR paradigm. Extensive experiments show that our method significantly improves both training efficiency and generation quality. On the ImageNet 256*256 benchmark, our model achieves a superior FID compared to the dense baseline while requiring only half of the default training epochs and a smaller parameter budget, with a merely marginal increase in training cost. Moreover, the performance gap further widens with larger training epochs.

视觉自回归建模（VAR）开创了粗到细的多尺度自回归生成范式，在图像生成方面展现出强大的能力。然而，VAR在多尺度表示学习中仍存在固有缺陷。具体而言，低尺度主要捕获全局语义，而高尺度聚焦于细粒度细节。在各尺度采用共享架构会导致优化冲突。此外，由于因果自回归过程，早期尺度的语义不准确会传播并显著降低最终输出质量。为解决这些问题，我们引入了一种尺度感知的token路由混合专家（MoE）架构，允许进行尺度自适应的专家选择，从而促进跨尺度的解耦表示学习。此外，我们通过引入外部自监督特征来增强早期尺度的语义建模。与简单的对齐方式不同，我们分析并设计了一种专门针对VAR范式的残差特征聚合方案。大量实验表明，我们的方法显著提升了训练效率和生成质量。在ImageNet 256×256基准上，我们的模型相较于密集基线实现了更优的FID分数，同时仅需默认训练轮数的一半和更小的参数预算，且训练成本仅略有增加。此外，随着训练轮数的增加，性能差距进一步扩大。

Predicting complex spatiotemporal dynamics in physical processes often demands computationally expensive numerical methods or data-driven neural networks that suffer from high training costs, error accumulation, and limited generalizability to unseen parameters. An effective approach to address these challenges is leveraging physics priors in training neural networks, known as physics-informed deep learning (PiDL). In this work, we introduce the Multi-Resolution Finite-Volume-inspired network, MuRFiV, designed to capitalize on the conservative property of finite volume on the global scale and the expressive power of deep learning on the local scale. We demonstrate the effectiveness of MuRFiV on several spatio-temporal systems governed by partial differential equations (PDEs), including Burgers' equation, shallow water equations, and incompressible Navier-Stokes equations. By embedding PDE information into the deep learning architecture, MuRFiV achieves strong long-term prediction accuracy and remains stable over very long autoregressive rollouts, significantly outperforming data-driven neural network baselines. This result highlights the promise of combining multiresolution learning with finite-volume-inspired inductive bias for accurate and robust long-term prediction of complex dynamics.

预测物理过程中的复杂时空动力学通常需要计算成本高昂的数值方法，或面临高训练成本、误差累积以及对 unseen 参数泛化能力有限的数据驱动神经网络。应对这些挑战的一种有效方法是在神经网络训练中利用物理先验，即物理信息深度学习（PiDL）。本研究提出了多分辨率有限体积启发网络 MuRFiV，旨在利用有限体积法在全局尺度上的守恒特性和深度学习在局部尺度上的表达能力。我们在多个由偏微分方程（PDE）控制的时空系统上验证了 MuRFiV 的有效性，包括 Burgers 方程、浅水方程和不可压缩 Navier-Stokes 方程。通过将 PDE 信息嵌入深度学习架构，MuRFiV 实现了较强的长期预测精度，并在极长的自回归滚动预测中保持稳定，显著优于数据驱动神经网络基线方法。该结果凸显了多分辨率学习与有限体积启发归纳偏置相结合在复杂动力学精确鲁棒长期预测方面的潜力。

End-to-End autonomous driving (E2E-AD) systems face challenges in lifelong learning, including catastrophic forgetting, difficulty in knowledge transfer across diverse scenarios, and spurious correlations between unobservable confounders and true driving intents. To address these issues, we propose DeLL, a Deconfounded Lifelong Learning framework that integrates a Dirichlet process mixture model (DPMM) with the front-door adjustment mechanism from causal inference. The DPMM is employed to construct two dynamic knowledge spaces: a trajectory knowledge space for clustering explicit driving behaviors and an implicit feature knowledge space for discovering latent driving abilities. Leveraging the non-parametric Bayesian nature of DPMM, our framework enables adaptive expansion and incremental updating of knowledge without predefining the number of clusters, thereby mitigating catastrophic forgetting. Meanwhile, the front-door adjustment mechanism utilizes the DPMM-derived knowledge as mediators to deconfound spurious correlations, such as those induced by sensor noise or environmental changes, and enhances the causal expressiveness of the learned representations. Additionally, we introduce an evolutionary trajectory decoder that enables non-autoregressive planning. To evaluate the lifelong learning performance of E2E-AD, we propose new evaluation protocols and metrics based on Bench2Drive. Extensive evaluations in the closed-loop CARLA simulator demonstrate that our framework significantly improves adaptability to new driving scenarios and overall driving performance, while effectively retaining previously acquired knowledge. Code: https://github.com/Mooncakebro/DeLL

端到端自动驾驶（E2E-AD）系统在终身学习中面临诸多挑战，包括灾难性遗忘、跨多样化场景的知识迁移困难，以及不可观测混杂因素与真实驾驶意图之间的虚假相关性问题。为解决这些问题，我们提出了DeLL框架——一种去混杂终身学习框架，该框架将狄利克雷过程混合模型（DPMM）与因果推断中的前门调整机制相结合。DPMM被用于构建两个动态知识空间：用于聚类显式驾驶行为的轨迹知识空间，以及用于发现潜在驾驶能力的隐特征知识空间。利用DPMM的非参数贝叶斯特性，我们的框架能够自适应地扩展和增量更新知识，而无需预先定义聚类数量，从而有效缓解灾难性遗忘。同时，前门调整机制利用DPMM衍生的知识作为中介变量，对由传感器噪声或环境变化等因素引起的虚假相关进行去混杂处理，并增强所学表示的因果表达能力。此外，我们还引入了一种进化轨迹解码器，以实现非自回归规划。为评估E2E-AD的终身学习性能，我们基于Bench2Drive提出了新的评估协议和指标。在CARLA闭环模拟器中的广泛评估表明，我们的框架显著提升了对新驾驶场景的适应能力和整体驾驶性能，同时有效保留了先前获得的知识。代码：https://github.com/Mooncakebro/DeLL

Controllable traffic simulation is critical for testing autonomous driving systems, yet existing approaches often require retraining large generative models with extensive annotated data. We introduce a lightweight control adaptation framework that enables multi-modal controllability (sketch, latent behavior codes, and text) for pretrained state-of-the-art diffusion and autoregressive traffic models. By modulating intermediate features through identity-initialized FiLM layers, our method efficiently adds new control modalities while preserving the base model's generative prior. Evaluated on Waymo Open Sim Agents Challenge, our approach demonstrates strong controllability with less than 1% of the paired control data. Through context-aware condition transfer, our framework enables counterfactual scenario generation and long-tail synthesis while maintaining stable closed-loop driving realism and safety. Our framework unlocks new possibilities for controllable traffic simulation, enabling targeted scenario generation through lightweight adaptation of pretrained generative models. Project page: https://ecosim-web.github.io/

可控交通仿真对于自动驾驶系统测试至关重要，然而现有方法通常需要使用大规模标注数据对大型生成模型进行重新训练。本文提出了一种轻量级控制适配框架，能够为预训练的最先进扩散和自回归交通模型添加多模态可控性（草图、潜在行为编码和文本）。通过使用恒等初始化的FiLM层调制中间特征，本方法在保留基础模型生成先验的同时高效地添加新的控制模态。在Waymo开放模拟智能体挑战上的评估表明，本方法仅使用少于1%的配对控制数据即实现了较强的可控性。通过上下文感知条件迁移，本框架能够在保持稳定的闭环驾驶真实感和安全性的同时，实现反事实场景生成和长尾场景合成。本框架为可控交通仿真开辟了新的可能性，通过对预训练生成模型进行轻量级适配即可实现目标场景生成。项目主页：https://ecosim-web.github.io

Mobile manipulation is a key capability for general-purpose robots, yet remains challenging for current embodied learning methods. VLA policies are typically reactive and lack explicit world modeling, while existing World Action Models (WAMs) are still poorly aligned with the structure of mobile manipulation: they operate on coarse video chunks, model entangled navigation-manipulation actions, and train inverse dynamics under supervision that does not match autoregressive inference. As a result, they often miss fine-grained contact dynamics, suffer from action-distribution conflicts, and accumulate errors over long-horizon rollouts. We propose ABot-M0.5, a new WAM built on the insight that mobile manipulation requires alignment at three levels: temporal granularity, action space, and train-test consistency. To align temporal granularity, we introduce intermediate latent actions that capture local visual state transitions and serve as an bridging action space between video latents and embodiment-specific controls. To align action space, we design a dual-level Mixture-of-Transformers architecture that disentangles both modality representations and heterogeneous action subspaces such as base movement and arm manipulation. To align inference conditions, we propose the dream-forcing training strategy that progressively trains inverse dynamics on model-predicted videos, improving train-test alignment and robustness during autoregressive prediction. Experiments on challenging mobile and fine-grained manipulation benchmarks demonstrate that ABot-M0.5 achieves state-of-the-art performance in both long-horizon task success and finegrained control accuracy. These results highlight the critical importance of granularity-aligned, action-disentangled, and inference-consistent world-action modeling.

移动操作是通用机器人的关键能力，但对于当前的具身学习方法仍具挑战性。视觉-语言-动作（VLA）策略通常具有反应性且缺乏明确的世界建模，而现有世界动作模型（WAMs）与移动操作的结构仍存在较大偏差：它们在粗粒度视频块上操作，建模纠缠的导航-操作动作，并在与自回归推理不匹配的监督下训练逆动力学。因此，它们经常错过细粒度接触动力学，受到动作分布冲突的影响，并在长时域部署中累积误差。我们提出ABot-M0.5，这是一个基于以下洞见构建的新WAM：移动操作需要在三个层面进行对齐——时间粒度、动作空间和训练-测试一致性。为对齐时间粒度，我们引入中间潜在动作来捕捉局部视觉状态转换，并作为视频潜在表示与具体化身控制之间的桥接动作空间。为对齐动作空间，我们设计了双层混合Transformer架构，解离模态表示和异构动作子空间（如底盘移动和机械臂操作）。为对齐推理条件，我们提出梦境强制训练策略，在模型预测的视频上逐步训练逆动力学，提高自回归预测过程中的训练-测试对齐和鲁棒性。在具有挑战性的移动和细粒度操作基准上的实验表明，ABot-M0.5在长时域任务成功率和细粒度控制精度方面均达到了最先进水平。这些结果突出了粒度对齐、动作解离和推理一致的世界-动作建模的关键重要性。

Autoregressive (AR) streaming models have emerged as a powerful paradigm for long video generation. However, the linearly growing Key-Value (KV) cache poses a significant bottleneck, leading to memory overload and degraded inference throughput. A common compression method is to drop redundant KV tokens, which often breaks long-range dependencies, resulting in temporal flickering and identity loss. In this paper, we propose Instance-Specific Parametric Absorption (ISPA), a novel framework that shifts the KV cache compression from discarding to distilling. The core idea is to transit a subset of layers from Full-Attention (F-Layers) to memory-efficient Local-Attention (L-Layers) by "absorbing" historical context into the model's weights. Specifically, during a brief warmup phase, ISPA monitors the output discrepancy between global and local attention. At the transition point, we solve a closed-form least-squares problem to compute an instance-specific weight modulation that compensates for the missing history. Experiments across architectures (1.3B to 14B) demonstrate that ISPA can remove up to 50\% of the KV cache with near-lossless visual quality. We hope this perspective encourages future work to explore parametric memory consolidation beyond external token-level cache management for streaming generative models.

自回归（AR）流式模型已成为长视频生成的有效范式。然而，线性增长的键值（KV）缓存带来了显著瓶颈，导致内存过载和推理吞吐量下降。一种常见的压缩方法是丢弃冗余的KV tokens，但这往往会破坏长程依赖，导致时间闪烁和身份丢失。本文提出实例特定参数吸收（ISPA），这是一种将KV缓存压缩从丢弃向蒸馏转变的新框架。其核心思想是通过将历史上下文“吸收”到模型权重中，将部分层从全注意力（F层）转换为内存高效的局部注意力（L层）。具体而言，在短暂的预热阶段，ISPA监测全局注意力与局部注意力的输出差异。在过渡时刻，我们求解一个闭式最小二乘问题，计算实例特定的权重调制以补偿缺失的历史信息。跨架构（1.3B至14B）的实验表明，ISPA可在视觉质量近乎无损的情况下去除高达50%的KV缓存。我们希望这一视角能促使未来工作探索流式生成模型中超越外部token级缓存管理的参数化内存整合。

Driven by Artificial Intelligence-Generated Content (AIGC), the authenticity of audio-visual content is facing severe challenges. Temporal Forgery Localization (TFL) aims to precisely identify manipulated segments within untrimmed sequences. However, existing methods are limited by CNNs' local receptive fields or Transformers&x27; quadratic complexity, while emerging linear models often struggle to balance global authentic context compression with local abrupt forgery perception. To address this, we propose MG-RWKV, a multi-granularity framework that leverages the data-dependent state evolution of RWKV to achieve efficient full-sequence processing with O(T) complexity. Our framework features three core innovations: (1) a Bidirectional RWKV architecture that captures bidirectional temporal contexts without quadratic overhead; (2) a Multi-Granularity Mixture of Experts (MG-MoE) that performs dynamic routing over explicit temporal receptive fields, adaptively selecting granularities based on forgery duration to significantly enhance decision interpretability; and (3) Cross-Granularity Consistency (CGC), which aligns adjacent feature pyramid levels through hierarchical scale-wise pairing and spatial boundary-aware weighting, effectively reducing false positives in authentic regions. Extensive experiments on Lav-DF, TVIL, and Psynd datasets demonstrate that MG-RWKV achieves state-of-the-art performance with low computational cost.

人工智能生成内容（AIGC）的快速发展使音视频内容的真实性面临严峻挑战。时间篡改定位（TFL）旨在从未裁剪的序列中精确识别被篡改的片段。然而，现有方法受限于卷积神经网络的局部感受野或 Transformer 的二次复杂度限制，而新兴的线性模型往往难以平衡全局真实上下文压缩与局部突然篡改感知。针对这一问题，我们提出了 MG-RWKV，这是一个多粒度框架，利用 RWKV 的数据依赖状态演化实现 O(T) 复杂度的高效全序列处理。我们的框架具有三个核心创新点：（1）双向 RWKV 架构，无需二次复杂度开销即可捕获双向时间上下文；（2）多粒度专家混合（MG-MoE），在显式时间感受野上执行动态路由，根据篡改持续时间自适应选择粒度，显著增强决策可解释性；（3）跨粒度一致性（CGC），通过分层尺度配对和对齐相邻特征金字塔层级，并采用空间边界感知加权，有效减少真实区域的假阳性。在 Lav-DF、TVIL 和 Psynd 数据集上的大量实验表明，MG-RWKV 以较低的計算成本实现了最先进的性能。

Autoregressive video diffusion models hold promise for world simulation but are vulnerable to exposure bias arising from the train-test mismatch. While recent works address this via post-training, they typically rely on a bidirectional teacher model or discriminator. To achieve an end-to-end solution, we introduce Resampling Forcing, a teacher-free framework that enables training autoregressive video models from scratch and at scale. Central to our approach is a self-resampling scheme that simulates inference-time model errors on history frames during training. Conditioned on these degraded histories, a sparse causal mask enforces temporal causality while enabling parallel training with frame-level diffusion loss. To facilitate efficient long-horizon generation, we further introduce history routing, a parameter-free mechanism that dynamically retrieves the top-k most relevant history frames for each query. Experiments demonstrate that our approach achieves performance comparable to distillation-based baselines while exhibiting superior temporal consistency on longer videos owing to native-length training.

自回归视频扩散模型在世界模拟领域具有广阔前景，但容易受到训练-测试不匹配所导致的曝光偏差的影响。尽管现有研究通过后训练来解决这一问题，但它们通常依赖于双向教师模型或判别器。为实现端到端解决方案，我们提出了Resampling Forcing，这是一种无教师的框架，能够从零开始且大规模地训练自回归视频模型。我们的方法核心是一种自重采样方案，能够在训练过程中模拟推理时历史帧的模型误差。以这些降质的历史帧为条件，稀疏因果掩码在实现时间因果性的同时，支持帧级扩散损失的并行训练。为了促进高效的长时序生成，我们进一步引入了历史路由，这是一种无参数机制，能够动态检索每个查询帧最相关的k个历史帧。实验表明，我们的方法达到了与基于蒸馏的基线相当的性能，并且由于采用了原生长度训练，在更长视频的时间一致性方面表现更优。

Handwritten mathematical expression recognition (HMER) requires reasoning over diverse symbols and structures, yet autoregressive models struggle with exposure bias and syntax inconsistency. We present GryphOne, a discrete diffusion framework which reformulates HMER as iterative symbolic refinement instead of sequential generation. GryphOne progressively refines symbols and relations, removing autoregression and improving consistency. Symbol-aware tokenization and random-masking mutual learning further enhance robustness to handwriting diversity. On the MathWriting benchmark, GryphOne achieves 5.51% CER and 59.9% EM (ExpRate), outperforming all reimplemented models in the matched setting as well as the commercial HMER system. Held-out evaluation on CROHME 2014-2023 further shows strong cross-dataset generalization.

手写数学表达式识别（HMER）需要对各种符号和结构进行推理，然而自回归模型在处理曝光偏差和语法不一致方面存在困难。我们提出GryphOne，一个将HMER重新表述为迭代符号精炼而非顺序生成的离散扩散框架。GryphOne逐步精炼符号和关系，消除了自回归并提高了一致性。符号感知分词和随机掩码互学习进一步增强了对手写多样性的鲁棒性。在MathWriting基准测试中，GryphOne实现了5.51%的字符错误率和59.9%的精确匹配率，优于匹配设置下的所有重新实现的模型以及商业HMER系统。在CROHME 2014-2023上的留出评估进一步表明其具有强大的跨数据集泛化能力。

Class-conditional generative models have emerged as accurate and robust classifiers, with diffusion models demonstrating clear advantages over other visual generative paradigms, including autoregressive (AR) models. In this work, we revisit visual AR-based generative classifiers and identify an important limitation of prior approaches: their reliance on a fixed token order, which imposes a restrictive inductive bias for image understanding. We observe that single-order predictions rely more on partial discriminative cues, while averaging over multiple token orders provides a more comprehensive signal. Based on this insight, we leverage recent any-order AR models to estimate order-marginalized predictions, unlocking the high classification potential of AR models. Our approach consistently outperforms diffusion-based classifiers across diverse image classification benchmarks, while being up to 25x more efficient. Compared to state-of-the-art self-supervised discriminative models, our method delivers competitive classification performance - a notable achievement for generative classifiers.

类别条件生成模型已成为准确且鲁棒的分类器，其中扩散模型相比其他视觉生成范式（包括自回归模型）展现出明显优势。在本工作中，我们重新审视了基于视觉的自回归生成式分类器，并识别出先前方法的一个重要局限性：它们依赖于固定的标记顺序，这对图像理解施加了限制性归纳偏置。我们观察到，单一顺序的预测更偏重于部分判别线索，而对多个标记顺序进行平均则能提供更全面的信号。基于这一洞察，我们利用最新的任意顺序自回归模型来估计顺序边缘化预测，从而释放了自回归模型的高分类潜力。我们的方法在各种图像分类基准测试中始终优于基于扩散的分类器，同时效率提升高达25倍。与最先进的自监督判别模型相比，我们的方法实现了具有竞争力的分类性能——对于生成式分类器而言这是一项显著成就。

Distilling video generation models to extremely low inference budgets (e.g., 2--4 NFEs) is crucial for real-time deployment, yet remains challenging. Trajectory-style consistency distillation often becomes conservative under complex video dynamics, yielding an over-smoothed appearance and weak motion. Distribution matching distillation (DMD) can recover sharp, mode-seeking samples, but its local training signals do not explicitly regularize how denoising updates compose across timesteps, making composed rollouts prone to drift. To overcome this challenge, we propose Self-Consistent Distribution Matching Distillation (SC-DMD), which explicitly regularizes the endpoint-consistent composition of consecutive denoising updates. For real-time autoregressive video generation, we further treat the KV cache as a quality parameterized condition and propose Cache-Distribution-Aware training. This training scheme applies SC-DMD over multi-step rollouts and introduces a cache-conditioned feature alignment objective that steers low-quality outputs toward high-quality references. Across extensive experiments on both non-autoregressive backbones (e.g., Wan~2.1) and autoregressive real-time paradigms (e.g., Self Forcing), our method, dubbed \textbf{Salt}, consistently improves low-NFE video generation quality while remaining compatible with diverse KV-cache memory mechanisms. Project page: https://xingtongge.github.io/Salt

将视频生成模型压缩至极低的推理预算（如2-4次噪声函数评估）对于实时部署至关重要，但仍具挑战性。轨迹式一致性蒸馏在复杂视频动态下通常趋于保守，导致过度平滑的外观和薄弱的运动。分布匹配蒸馏（DMD）能够恢复清晰、面向模态的样本，但其局部训练信号并未显式约束去噪更新在时间步之间的组合方式，使得组合展开容易产生漂移。为克服这一挑战，我们提出自一致分布匹配蒸馏（SC-DMD），它显式约束连续去噪更新的端点一致性。对于实时自回归视频生成，我们进一步将KV缓存视为质量参数化条件，并提出缓存分布感知训练。该训练方案在多步展开上应用SC-DMD，并引入缓存条件特征对齐目标，引导低质量输出向高质量参考靠拢。在非自回归主干网络（如Wan 2.1）和自回归实时范式（如Self Forcing）上的大量实验表明，我们的方法命名为Salt，能够持续提升低噪声函数评估次数下的视频生成质量，同时与多种KV缓存内存机制保持兼容。

The generation of production-ready quad-dominant meshes is a cornerstone of modern 3D content creation. Generating anisotropic quad-dominant meshes from point clouds is challenging, as existing methods are typically limited to producing either pure triangular meshes or pure quadrilateral meshes with isotropic densities. In this paper, we present QuadLink, a unified framework consisting of three stages for quad-dominant mesh generation by linking points into structured faces. QuadLink formulates polygonal mesh generation as a hybrid centroid-conditioned vertex linking model: it first predicts a unified set of anchors (vertices and face centroids), then learns centroid-conditioned links that associate vertices with face centroids, and finally assembles polygonal faces with a quad-first strategy guided by robust geometric verification strategies. This link-based formulation enables efficient generation of sparse and anisotropic quad-dominant meshes with coherent edge flow and meanwhile supporting hybrid polygonal topology. To construct training data for this model, we further introduce a Tri-to-Quad Operator that converts artistic triangle meshes into quad-dominant training data via global merge selection. Extensive experiments show that QuadLink produces production-ready quad-dominant meshes from point clouds and achieves improved geometric fidelity and topological quality compared to prior baselines. Our method natively supports hybrid polygonal topology, generalizing to arbitrary n-gon meshes without architectural changes.

生产级四边形主导网格的生成是现代三维内容创作的基石。从点云生成各向异性四边形主导网格具有挑战性，因为现有方法通常仅限于生成纯三角形网格或具有各向同性密度的纯四边形网格。本文提出QuadLink，一个由三个阶段组成的统一框架，用于通过将点链接到结构化面来生成四边形主导网格。QuadLink将多边形网格生成为混合面心条件顶点链接模型：它首先预测统一的锚点集（顶点和面心），然后学习将顶点与面心关联的面心条件链接，最后通过四边形优先策略和稳健的几何验证策略组装多边形面。这种基于链接的公式能够高效生成具有连贯边流的稀疏各向异性四边形主导网格，同时支持混合多边形拓扑。为构建该模型的训练数据，本文进一步引入了Tri-to-Quad算子，通过全局合并选择将艺术三角形网格转换为四边形主导训练数据。大量实验表明，QuadLink能够从点云生成生产级四边形主导网格，并在几何保真度和拓扑质量方面优于现有基线方法。该方法原生支持混合多边形拓扑，无需架构更改即可泛化到任意n边形网格。

Large-scale crowd management requires pedestrian simulations that are both computationally efficient and compatible with feedback-based control. However, most open-source tools are either microscopic or not designed for network-scale closed-loop evaluation. This paper presents PedNStream (Pedestrian Network Flow Simulation), an open-source, Python-native simulator for macroscopic pedestrian network loading based on the Link Transmission Model (LTM). The framework extends LTM-based pedestrian models by incorporating stochastic link dynamics that capture diffusion and activity-induced variability, and replaces dynamic user equilibrium route choice with a utility-based formulation suited to uncertain, intervention-driven settings. PedNStream is implemented as a modular framework with built-in controller interfaces for interventions such as gating, flow separation, and route guidance. We evaluate the framework in a staged manner. Synthetic scenarios verify key mechanisms, including queue formation, spillback, congestion dissipation, and adaptive rerouting. Real-network experiments assess large-scale behavior and consistency with observed pedestrian counts. A closed-loop case study demonstrates controller integration, and a runtime analysis quantifies scalability. These results establish PedNStream as an efficient and practical testbed for large-scale pedestrian network simulation and control.

大规模人群管理需要计算高效且兼容反馈控制的行人仿真。然而，大多数开源工具要么是微观模型，要么未针对网络级闭环评估进行设计。本文提出 PedNStream（行人网络流仿真），一个基于链路传输模型（Link Transmission Model, LTM）的宏观行人网络加载开源 Python 原生仿真器。该框架通过引入捕获扩散和活动诱导变异性的随机链路动力学，拓展了基于 LTM 的行人模型，并用适用于不确定、干预驱动环境的基于效用 formulations 取代了动态用户均衡路径选择。PedNStream 实现为模块化框架，内置干预控制器接口，支持闸门控制、客流分离和路径引导等干预措施。我们采用分阶段方式评估该框架。合成场景验证了关键机制，包括排队形成、回溢、拥堵消散和适应性重新路径选择。真实网络实验评估了大规模行为并与观测到的行人数量进行了对比。闭环案例研究展示了控制器集成，运行时分析量化了可扩展性。这些结果将 PedNStream 确立为大规模行人网络仿真与控制的高效实用测试平台。

Foundation video diffusion models are increasingly viewed as world simulators for embodied agents, yet their pretraining on internet-scale generic video leaves them poorly aligned with real-world deployment domains. We study parameter-efficient adaptation of a pretrained foundation video world model to retail scenes: when synchronized egocentric and exocentric video of the same activity are available, which viewpoint of training data produces the strongest adapted model? We introduce RetailSMV (Retail Synchronized Multi-View), a corpus of 32,105 captioned retail clips from five supermarkets with synchronized ego/exo capture from the store-staff perspective (stocking, arranging, weighing, managing supply carts, scanning at checkout), rather than the customer-centric framing of prior retail video corpora, and train three matched Low-Rank Adaptation (LoRA) configurations of Cosmos3-Nano (egocentric-only, exocentric-only, combined) under identical hyperparameters. On a 200-clip held-out test set evaluated with seven complementary metrics under a strict paired statistical protocol, exocentric-only adaptation matches or exceeds combined adaptation on six of seven point estimates and is significantly better on LPIPS, PSNR, and DreamSim, despite training on only 15,985 exocentric clips (versus 32,105 for combined). A symmetric paired comparison further shows that adding exocentric data to egocentric-only training helps while adding egocentric data to exocentric-only training hurts. The absolute adaptation gap is largest at the shortest rollout time, identifying the near-horizon prediction window as the regime in which adaptation is most beneficial.

基础视频扩散模型日益被视为具身智能体的世界模拟器，然而其基于互联网规模通用视频的预训练导致与真实世界部署领域缺乏对齐。本研究探讨预训练基础视频世界模型向零售场景的参数高效适配问题：当同一活动的同步第一人称和第三人称视频可用时，哪种视角的训练数据能够产生最强的适配模型？我们构建了RetailSMV（零售同步多视角）数据集，包含来自五家超市的32,105条带标注零售片段，采用店员视角（而非先前零售视频数据集的顾客视角）进行自我/外部视角同步采集，涵盖商品上架、排列、称重、购物车管理及收银扫描等行为。在保持完全相同的超参数条件下，我们针对Cosmos3-Nano模型训练了三种匹配的LoRA低秩适配配置：纯自我中心视角、纯外部中心视角以及两者的组合。在200条保留测试片段上采用严格的配对统计协议进行七项互补指标评估，结果显示纯外部中心视角适配在七项点估计中于六项达到或超越组合适配，且在LPIPS、PSNR和DreamSim指标上显著更优，尽管仅使用15,985条外部中心片段（组合配置则使用32,105条）。对称配对比较进一步表明，向纯自我中心训练添加外部中心数据有益，而向纯外部中心训练添加自我中心数据则产生损害。绝对适配差距在最短推演时长时最大，这表明近景预测窗口是适配收益最为显著的范围。

Safety alignment of text-to-image (T2I) diffusion models aims to suppress harmful generations while preserving utility on benign prompts. Recent methods often appear to deliver high safety with high utility, but this conclusion rests largely on coarse global utility metrics (e.g., FID, CLIPScore) that are insensitive to fine-grained semantic correctness, creating an illusion of high utility. We show that when utility is measured with structured evaluation, this illusion breaks: on TIFA (Text-to-Image Faithfulness evaluation with Question Answering), safety-aligned models suffer substantial drops in semantic fidelity, including failures in object counts, attributes, and relationships. To diagnose the source of this gap, we analyze the text-encoder prompt embedding space and uncover semantic collapse, a contraction of embedding spread coupled with distortion of inter-prompt similarity structure, which strongly correlates with structured utility loss. Guided by this insight, we propose StructureAware Geometric Regularization (SAGE), a safety alignment objective that explicitly preserves embedding spread and inter-prompt relational structure during adaptation. Our method restores structured utility (TIFA +5.0% over prior state-of-the-art) while maintaining strong safety performance and competitive coarse-grained utility scores. Our source code and trained models are available at https://adeelyousaf.github.io/SAGE_ECCV26_Project_Page/.

文本到图像(T2I)扩散模型的安全对齐旨在抑制有害生成，同时保留良性提示词的效用。最近的方法似乎同时实现了高安全性和高效用，但这一结论主要建立在对细粒度语义正确性不敏感的粗粒度全局效用指标（如FID、CLIPScore）之上，形成了高效用的幻象。我们研究表明，当用结构化评估来衡量效用时，这一幻象就会破灭：在TIFA（基于问答的文本到图像忠实度评估）上，安全对齐模型在语义保真度上遭受显著下降，包括对象数量、属性和关系方面的失败。为了诊断这一差距的根源，我们分析了文本编码器的提示嵌入空间，发现了语义崩塌——嵌入分布范围的收缩加上提示间相似性结构的扭曲，这与结构化效用损失高度相关。基于这一洞察，我们提出了结构感知几何正则化（SAGE），这是一种在微调过程中明确保留嵌入分布范围和提示间关系结构的安全对齐目标。我们的方法恢复了结构化效用（与之前的最先进方法相比，TIFA提升5.0%），同时保持了强大的安全性能和具有竞争力的粗粒度效用分数。我们的源代码和训练模型已发布于https://adeelyousaf.github.io/SAGE_ECCV26_Project_Page/。

Diffusion models are highly effective at modeling complex data distributions, including images and text. However, in applications like personalized recommender systems, the objective often shifts to modeling specific regions of the distribution that maximize user preferences-initially unknown but gradually uncovered through interactive feedback. This can naturally be framed as a reinforcement learning problem, where the goal is to fine-tune a diffusion model to maximize a reward function based on preferences. However, the main challenge lies in learning a parameterized reward model, which typically requires large-scale preference data-something that is often not feasible in practice. In this work, we introduce Personalized Active Preference Alignment PAPA, a novel method that bypasses the requirement for a parametrized reward model by directly optimizing the diffusion model using real-time user feedback. PAPA enables feedback-efficient preference alignment, drawing inspiration from the variational inference framework. We demonstrate PAPA's effectiveness through extensive experiments and ablation studies across diverse class-conditioned and fine-grained alignment tasks. Additionally, based on theoretical insights, we propose an enhanced fine-tuning strategy, referred to as EPAPA, that requires less computational budget and accelerates the fine-tuning process, further boosting PAPA&x27;s suitability for real-world deployment. Our code is made publicly available at https://github.com/NasikNafi/papa.

扩散模型在建模复杂数据分布（包括图像和文本）方面非常有效。然而，在个性化推荐系统等应用中，目标往往转向建模分布的特定区域以最大化用户偏好——这些偏好最初未知，但通过交互反馈逐渐被发现。这可以自然地构建为一个强化学习问题，目标是基于偏好微调扩散模型以最大化奖励函数。然而，主要挑战在于学习参数化奖励模型，这通常需要大规模偏好数据——在实践中往往不可行。在本工作中，我们引入了个性化主动偏好对齐PAPA，这是一种绕过参数化奖励模型需求的新方法，通过实时用户反馈直接优化扩散模型。PAPA实现了反馈高效的偏好对齐，灵感来自变分推断框架。我们通过广泛的实验和消融研究证明了PAPA在各种类别条件和细粒度对齐任务中的有效性。此外，基于理论洞察，我们提出了一种增强的微调策略，称为EPAPA，需要更少的计算预算并加速微调过程，进一步提高了PAPA对实际部署的适用性。我们的代码已公开发布于 https://github.com/NasikNafi/papa。

A single panorama captures the full visual sphere from one camera center, yet confines users to looking around in place without enabling true scene exploration. Converting a single panorama into a persistent, renderable 3D representation for free-viewpoint navigation has attracted growing interest; existing methods either adopt iterative per-view completion that propagates inpainting results to update the underlying geometry, leading to progressive error accumulation and cumbersome multi-step pipelines, or leverage the temporal consistency priors of video generation models, yet the continuous-trajectory constraint intrinsic to such models limits their flexibility in covering scenes from multiple directions simultaneously. We present Pano2World, which takes a single indoor panorama as input and directly outputs a persistent, explorable 3D Gaussian scene. Given the source panorama, Pano2World first reconstructs a coarse 3D Gaussian proxy and renders it at adaptively sampled nearby poses to obtain geometrically aligned guidance panoramas; a panoramic diffusion model then jointly denoises all target views via View-Aware Attention Routing, where each target view simultaneously receives geometric constraints from its corresponding guidance panorama and global semantic guidance from the source panorama, naturally enforcing cross-view consistency. To avoid the information loss incurred by decoding the multi-view hidden features formed during joint denoising back to the pixel domain via VAE, we introduce Latent Feature Adapter, a geometry-aware bridge module that directly distills these hidden features into a scene latent, subsequently decoded into the final 3D Gaussian scene. Experiments demonstrate that Pano2World significantly outperforms existing methods on the multi-position panoramic novel-view synthesis benchmark.

单张全景图可从单一相机中心捕捉完整视觉球体，但仅允许用户原地环顾，无法实现真正的场景探索。将单张全景图转换为可用于自由视点导航的持久、可渲染3D表示已引起日益增长的关注；现有方法要么采用迭代式单视图补全，将修复结果传播以更新底层几何结构，导致渐进误差累积和繁琐的多步骤流程，要么利用视频生成模型的时间一致性先验，但此类模型固有的连续轨迹约束限制了其同时从多个方向覆盖场景的灵活性。我们提出Pano2World，以单张室内全景图作为输入，直接输出持久、可探索的3D高斯场景。给定源全景图后，Pano2World首先重建粗粒度3D高斯代理，并在自适应采样的邻近姿态对其进行渲染，以获得几何对齐的引导全景图；随后，全景扩散模型通过视图感知注意力路由对所有目标视图进行联合去噪，其中每个目标视图同时接收来自其对应引导全景图的几何约束和来自源全景图的全局语义指导，自然地强制执行跨视图一致性。为避免将联合去噪过程中形成的多视角隐藏特征通过VAE解码回像素域时所产生的信息损失，我们引入潜在特征适配器，这是一个几何感知的桥接模块，能够将这些隐藏特征直接蒸馏到场景潜在表示中，随后解码为最终的3D高斯场景。实验表明，Pano2World在多位置全景新视图合成基准上显著优于现有方法。

World models can enable Model Predictive Control (MPC), but this requires dynamics prediction that is both fast enough for online use and expressive enough to represent uncertain futures. Diffusion models offer a natural mechanism for modeling uncertain dynamics, yet their iterative inference procedure makes them difficult to use for low-latency latent planning. We bridge this gap with Value Diffusion World Models (Valdi), combining end-to-end online training for MPC with a latent diffusion dynamics model. In preliminary experiments on the CarRacing environment, we show that Valdi, using a single diffusion step at both training and inference, matches a deterministic MLP baseline. Our experiments expose a trade-off between predictive multimodality and control performance in this setup. Code is available at https://github.com/Kit115/ValueDiffusionWorldModels.

世界模型可以用于模型预测控制，但这需要动态预测既能满足在线使用的速度要求，又具有足够的表达能力以表示不确定的未来。扩散模型为建模不确定动态提供了自然的机制，然而其迭代推理过程使得低延迟潜在规划难以实现。我们通过值扩散世界模型（Valdi）弥合这一差距，将模型预测控制的端到端在线训练与潜在扩散动力学模型相结合。在CarRacing环境的初步实验中，我们发现Valdi在训练和推理时仅使用单个扩散步骤即可达到与确定性MLP基线相当的性能。我们的实验揭示了在该设置下预测多模态与控制性能之间的权衡。代码可访问https://github.com/Kit115/ValueDiffusionWorldModels获取。

Robot policies inevitably encounter failures when deployed in real environments. Naive retries often repeat the same mistakes, while many existing recovery methods rely on human intervention. In this paper, we propose Failure-Aware Retry (FAR), a framework that enables robots to learn from previous failures at test time, adapt their behavior accordingly, and eventually complete the task autonomously. FAR combines Failure-Contrastive Preference Adaptation, which constructs preference learning data from failures to steer the policy away from previously unsuccessful behaviors, with lightweight action perturbations during retries to encourage local exploration. We further incorporate successful recovery trajectories into a training loop for continual policy improvement. Experiments in both simulation and real-world manipulation tasks show that FAR substantially improves success rates and robustness, with average gains of 17.6% over the standard diffusion policy in simulation and 11.7% in the real world. In addition, FAR significantly improves data efficiency under both reset and timestep budgets during continual policy improvement by exploiting informative failure cases.

机器人策略在实际部署中不可避免地会遇到失败。简单的重试往往会重复同样的错误，而许多现有的恢复方法依赖人工干预。本文提出Failure-Aware Retry (FAR)框架，使机器人能够在测试时从先前失败中学习，相应地调整其行为，并最终自主完成任务。FAR结合了失败对比偏好适应（从失败中构建偏好学习数据，引导策略远离先前不成功的行为）与重试时的轻量动作扰动（以鼓励局部探索）。我们进一步将成功恢复轨迹纳入训练循环，以实现策略的持续改进。模拟环境和真实世界操作任务中的实验表明，FAR显著提高了成功率和鲁棒性，在模拟环境中相比标准扩散策略平均提升17.6%，在真实世界中平均提升11.7%。此外，FAR在利用信息丰富的失败案例进行持续策略改进时，在重置和时间步预算下显著提高了数据效率。

Prior work on imitation learning from suboptimal demonstrations typically relies on compressed supervision signals such as confidence estimates, discriminator scores, or importance weights. These scalar signals are inherently limited, as they cannot explicitly express intermediate reasoning about task progress, failure modes, or corrective actions. We propose a language-critique framework for imitation learning from suboptimal demonstrations that instead leverages natural language as a structured supervision signal, avoiding the collapse of expressive feedback into scalars. Our method first constructs language labels from demonstrations that explicitly describe current progress, identify suboptimal behaviors, and provide fine-grained corrective guidance. We then introduce a language-critique loss that directly trains policies using these structured signals without reducing them to scalars, and instantiate it for both behavior cloning and diffusion policies, yielding LC-BC and LC-DP. We further provide a theoretical result showing that the proposed objective upper-bounds the expert performance gap under standard assumptions. Empirically, we evaluate on diverse continuous control tasks spanning navigation, manipulation, and gameplay, where our methods consistently outperform strong imitation learning and offline reinforcement learning baselines. These results demonstrate that language can serve as a powerful and structured form of supervision for learning robust policies from suboptimal data.

先前关于从次优演示进行模仿学习的研究通常依赖于压缩的监督信号，如置信度估计、判别器分数或重要性权重。这些标量信号存在固有限制，因为它们无法明确表达关于任务进度、失败模式和纠正措施的中间推理过程。我们提出了一种基于语言反馈的次优演示模仿学习框架，该框架利用自然语言作为结构化监督信号，避免将表达性反馈Collapse为标量。我们的方法首先从演示中构建语言标签，明确描述当前进度、识别次优行为并提供细粒度的纠正指导。随后，我们引入了一种语言反馈损失函数，能够直接使用这些结构化信号训练策略，而无需将其降维为标量，并将其分别应用于行为克隆和扩散策略，得到了LC-BC和LC-DP两种方法。我们进一步提供了理论分析，证明在标准假设下，所提出的目标函数对专家性能差距具有上界约束。在涵盖导航、操作和游戏等多种连续控制任务上进行了实验评估，结果表明我们的方法始终优于现有的强基线模仿学习和离线强化学习方法。这些结果表明，语言可以作为从次优数据学习鲁棒策略的一种强大且结构化的监督形式。

Test-time guidance is a widely used mechanism for steering pretrained diffusion models toward outcomes specified by a reward function. Existing approaches, however, focus on maximizing reward rather than sampling from the true Bayesian posterior, leading to miscalibrated inference. In this work, we show that common test-time guidance methods do not recover the correct posterior distribution and identify the structural approximations responsible for this failure. We then propose consistent alternative estimators that enable calibrated sampling from the Bayesian posterior. We significantly outperform previous methods on a set of Bayesian inference tasks, and set a new state-of-the-art PSNR in black hole image reconstruction.

测试时引导是一种广泛使用的机制，用于引导预训练扩散模型朝向奖励函数指定的结果。然而，现有方法专注于最大化奖励而非从真实贝叶斯后验分布进行采样，导致推断校准不当。本工作表明，常见的测试时引导方法无法恢复正确的后验分布，并确定了导致该失败的结构性近似问题。随后，我们提出了一致的替代估计器，能够从贝叶斯后验分布进行校准采样。我们在多项贝叶斯推断任务上显著优于先前方法，并在黑洞图像重建中创下了新的峰值信噪比（PSNR）最佳记录。

Generative models for crystalline materials often rely on equivariant graph neural networks, which capture geometric structure well but are costly to train and slow to sample. We present Crystalite, a lightweight diffusion Transformer for crystal modeling built around two simple inductive biases. The first is Subatomic Tokenization, a compact chemically structured atom representation that replaces high-dimensional one-hot encodings and is better suited to continuous diffusion. The second is the Geometry Enhancement Module (GEM), which injects periodic minimum-image pair geometry directly into attention through additive geometric biases. Together, these components preserve the simplicity and efficiency of a standard Transformer while making it better matched to the structure of crystalline materials. Crystalite achieves state-of-the-art results on crystal structure prediction benchmarks, and de novo generation performance, attaining the best S.U.N. discovery score among the evaluated baselines while sampling substantially faster than geometry-heavy alternatives.

晶体材料的生成模型通常依赖等变图神经网络，这些网络虽能很好地捕捉几何结构，但训练成本高且采样速度慢。我们提出了Crystalite，一种基于两种简单归纳偏置构建的轻量级扩散Transformer晶体建模方法。第一种是亚原子标记化（Subatomic Tokenization），这是一种紧凑的化学结构化原子表示，取代了高维独热编码，更适合连续扩散。第二种是几何增强模块（GEM），它通过加性几何偏置将周期性最小图像对几何直接注入注意力机制。这些组件在保持标准Transformer简洁性的同时，使其更好地匹配晶体材料结构。Crystalite在晶体结构预测基准和全新生成任务上达到了最先进水平，在评估基线中获得了最佳的S.U.N.发现分数，同时采样速度显著优于几何密集型替代方案。

Colored sectors in a microbial range expansion encode more than lineage survival counts. We formulate a computer-vision inverse problem: from one endpoint image of an accretive multi-type expansion, recover the radius-indexed pairwise boundary-flow field and test whether the visual pattern is compatible with a transitive scalar fitness hierarchy. The observable is a geometric signal extracted from sector-boundary curves in log-polar coordinates. We prove endpoint observability and stability for frozen fronts, weighted transitive/cyclic decomposition, contact-complete circular design, physical-clock and mechanism non-identifiability, exact Gaussian cyclicity testing, and Bonferroni-valid interval scanning. The benchmark is deterministic: analytic endpoint images, blurred/noisy pixel round trips, scalar-null stress tests, public-image tracing, multi-resolution mechanistic endpoints, and a non-learning frozen-front simulator. The implementation recovers pairwise edge-flow histories from endpoint images, detects cyclic residuals in a mechanistic four-type expansion, and uses those residuals as forcing signals for a dimensionless active design-control layer covering reaction-diffusion control, phenotype-frontier optimization, protocol synthesis, Monte Carlo robustness, and a downstream population-state bridge.

微生物范围扩张中的彩色扇区编码的信息远不止谱系存活计数。我们提出了一个计算机视觉逆问题：对于一幅累积多类型扩张的端点图像，恢复半径索引的成对边界流场，并检验该视觉模式是否与传递性标量适应度层级相兼容。可观测量是从对数极坐标中扇区边界曲线提取的几何信号。我们证明了冻结前缘的端点可观测性和稳定性、加权传递/循环分解、接触完全圆形设计、物理时钟和机制不可辨识性、精确高斯循环性检验，以及 Bonferroni 有效区间扫描。基准测试是确定性的：解析端点图像、模糊/噪声像素往返、标量零压力测试、公共图像追踪、多尺度机制端点，以及非学习冻结前缘模拟器。该实现从端点图像中恢复成对边缘流历史，检测机制四类型扩张中的循环残差，并利用这些残差作为无量纲主动设计控制层的强迫信号，覆盖反应-扩散控制、表型前缘优化、协议合成、蒙特卡罗鲁棒性，以及下游种群状态桥接。

We propose the first compression approach for image-to-shape Diffusion Transformers (DiTs) that substantially reduces model size while preserving geometric fidelity. Despite remarkable progress in 3D shape generation, large DiT-based models remain computationally prohibitive in resource-constrained settings. Furthermore, it is difficult to directly transfer existing diffusion model compression strategies developed for different domains to 3D generation, and prior 3D efficiency approaches focus primarily on inference speed rather than backbone compression. To address this limitation, we build a geometry-aware compression framework tailored to image-to-shape DiTs. Guided by the observation that 3D DiT layers exhibit non-uniform importance for geometry synthesis, we introduce a vitality-guided framework integrating structured pruning, adaptive quantization, and targeted fine-tuning. Our method achieves up to 66% model-size reduction across state-of-the-art image-to-3D models while maintaining synthesis fidelity comparable to full-sized counterparts. This highlights the potential of our framework as a plug-and-play solution for efficient 3D shape generation across diverse models.

我们提出了一种针对图像到形状扩散变换器（DiT）的压缩方法，该方法能够在保持几何保真度的同时显著减小模型规模。尽管3D形状生成领域取得了显著进展，但大型基于DiT的模型在资源受限环境下仍然面临计算成本高昂的问题。此外，针对其他领域开发的扩散模型压缩策略难以直接迁移到3D生成任务，而现有的3D效率优化方法主要关注推理速度而非骨干网络压缩。为解决这一局限性，我们构建了一个专为图像到形状DiT设计的几何感知压缩框架。基于3D DiT层对几何合成具有非均匀重要性的观察，我们引入了一个活力引导框架，整合了结构化剪枝、自适应量化和针对性微调。我们的方法在最先进的图像到3D模型中实现了高达66%的模型规模压缩，同时保持了与完整模型相当的合成保真度。这凸显了我们框架作为高效3D形状生成即插即用解决方案的潜力，适用于多种模型。

Recent brain decoding studies have made substantial progress in reconstructing externally perceived visual content from neural signals. However, using electroencephalography (EEG) recordings to guide facial expression editing remains largely unexplored and poses a distinct challenge: rather than recovering what a subject sees, it requires identifying facial-action related patterns from noisy EEG signals and grounding them in localized, identity-preserving expression edits. In this paper, we investigate EEG-conditioned facial image editing for fine-grained facial action unit (AU) control and propose MindAU, a unified framework for controlling facial AU edits from EEG signals. MindAU first learns noise-robust and AU-discriminative EEG representations through temporal masked reconstruction and AU classification supervision. It then bridges the modality gap via Dual-Stream Manifold Alignment, aligning EEG features with AU-level text semantics and identity-reduced visual displacement trajectories in the multimodal space of Qwen2.5-VL. Finally, MindAU incorporates EEG-aware Multimodal Rotary Positional Embeddings, landmark-guided reference masking, and AU-aware region supervision into a multimodal diffusion-based editor for high-fidelity identity-preserving editing. We also introduce E-CAFE, a curated benchmark for EEG-Conditioned Action-Unit Facial Editing with paired EEG-face editing samples and standardized evaluation protocols. Extensive experiments demonstrate the effectiveness of MindAU and suggest its potential as a step towards future assistive expression technologies for individuals with facial neuromuscular disorders.

近年来，脑解码研究在从神经信号重建外部感知视觉内容方面取得了实质性进展。然而，利用脑电图（EEG）记录引导面部表情编辑仍基本未被探索，并面临独特挑战：它不是恢复受试者所看到的内容，而是需要从噪声EEG信号中识别面部动作相关模式，并将其锚定在局部化、保持身份的表情编辑中。本文研究用于精细化面部动作单元（AU）控制的EEG条件下面部图像编辑，并提出MindAU——一个从EEG信号控制面部AU编辑的统一框架。MindAU首先通过时间掩码重建和AU分类监督学习噪声鲁棒且AU判别的EEG表示。然后通过双流形对齐桥接模态差距，在Qwen2.5-VL的多模态空间中，将EEG特征与AU级文本语义和去身份化的视觉位移轨迹进行对齐。最后，MindAU将EEG感知多模态旋转位置嵌入、关键点引导的参考掩码和AU区域监督纳入多模态扩散编辑器，实现高保真保持身份的编辑。我们还构建了E-CAFE，这是一个用于EEG条件动作单元面部编辑的精选基准数据集，包含配对的EEG-面部编辑样本和标准化评估协议。大量实验表明了MindAU的有效性，并暗示其在未来用于面部神经肌肉障碍患者的辅助表情技术方面的潜力。

CLIP (Contrastive Language-Image Pre-training) has become a de facto paradigm for image-text alignment, but it struggles with long-context descriptions (>77 tokens) due to absolute positional encoding and pretraining on short captions. In long contexts, sentences are often reordered, summarized, or partially omitted. Although prior works extend CLIP with longer positional encodings, they often suffer from degraded image-text alignment under such text perturbations. We attribute this limitation to the Euclidean contrastive objective, which enforces strict one-to-one matching and lacks explicit mechanisms for modeling hierarchical relationships between global context and its constituent elements. To address this issue, we propose HyFL-CLIP, a hyperbolic fine-tuning framework that distills the well-established text-image alignment learned in Euclidean CLIP into hyperbolic space via cross-manifold similarity distillation, leveraging its geometry to capture hierarchical and entailment relations. Our method models hierarchical semantics by linking summarized token-wise features, long-context descriptions, constituent short textual components, and images, capturing part-whole relationships via hyperbolic entailment with Einstein midpoint aggregation. Experiments on diverse benchmarks, including long-context cross-modal retrieval, cross-modal retrieval with caption perturbations, intra-modality retrieval, and short-text cross-modal retrieval, show that HyFL-CLIP achieves more robust long-context understanding. In particular, it yields up to 19.5% improvement in long-text cross-modal retrieval under textual perturbations over the best prior method. We also show HyFL-CLIP can be seamlessly integrated into other model frameworks by applying it to Stable Diffusion XL (SDXL).

CLIP（对比语言-图像预训练）已成为图像-文本对齐的事实标准范式，但由于其采用绝对位置编码并在短标题上进行预训练，因而在处理长上下文描述（>77个词元）时存在困难。在长上下文中，句子经常被重新排序、摘要化或部分省略。尽管已有研究通过扩展更长的位置编码来延伸CLIP，但这类方法在上述文本扰动下往往面临图像-文本对齐性能下降的问题。我们将这一局限归因于欧几里得对比目标，后者强制执行严格的一对一匹配，且缺乏显式机制来建模全局上下文与其组成元素之间的层级关系。为解决这一问题，我们提出了HyFL-CLIP，一个双曲空间微调框架，通过跨流形相似度蒸馏将欧几里得CLIP中已建立的良好文本-图像对齐知识提炼到双曲空间，利用其几何特性来捕获层级关系和蕴含关系。我们的方法通过连接摘要化的词元级特征、长上下文描述、组成的短文本组件和图像来建模层级语义，利用双曲蕴含与爱因斯坦中点聚合来捕获整体-部分关系。在多样化基准测试上的实验，包括长上下文跨模态检索、带有标题扰动的跨模态检索、模态内检索以及短文本跨模态检索，表明HyFL-CLIP实现了更稳健的长上下文理解。特别地，在文本扰动下，长文本跨模态检索相较于最佳先前方法实现了最高19.5%的性能提升。我们还通过将其应用于Stable Diffusion XL（SDXL）展示了HyFL-CLIP可无缝集成到其他模型框架中。

Controllable traffic simulation is critical for testing autonomous driving systems, yet existing approaches often require retraining large generative models with extensive annotated data. We introduce a lightweight control adaptation framework that enables multi-modal controllability (sketch, latent behavior codes, and text) for pretrained state-of-the-art diffusion and autoregressive traffic models. By modulating intermediate features through identity-initialized FiLM layers, our method efficiently adds new control modalities while preserving the base model's generative prior. Evaluated on Waymo Open Sim Agents Challenge, our approach demonstrates strong controllability with less than 1% of the paired control data. Through context-aware condition transfer, our framework enables counterfactual scenario generation and long-tail synthesis while maintaining stable closed-loop driving realism and safety. Our framework unlocks new possibilities for controllable traffic simulation, enabling targeted scenario generation through lightweight adaptation of pretrained generative models. Project page: https://ecosim-web.github.io/

可控交通仿真对于自动驾驶系统测试至关重要，然而现有方法通常需要使用大规模标注数据对大型生成模型进行重新训练。本文提出了一种轻量级控制适配框架，能够为预训练的最先进扩散和自回归交通模型添加多模态可控性（草图、潜在行为编码和文本）。通过使用恒等初始化的FiLM层调制中间特征，本方法在保留基础模型生成先验的同时高效地添加新的控制模态。在Waymo开放模拟智能体挑战上的评估表明，本方法仅使用少于1%的配对控制数据即实现了较强的可控性。通过上下文感知条件迁移，本框架能够在保持稳定的闭环驾驶真实感和安全性的同时，实现反事实场景生成和长尾场景合成。本框架为可控交通仿真开辟了新的可能性，通过对预训练生成模型进行轻量级适配即可实现目标场景生成。项目主页：https://ecosim-web.github.io

Diffusion MRI probes brain microstructure with particular sensitivity to early cerebrovascular and neurodegenerative changes. Neurite Orientation Dispersion and Density Imaging (NODDI) decomposes the diffusion signal into three biophysically interpretable maps: neurite density index (NDI), orientation dispersion index (ODI), and free water fraction (FWF), capturing neurite packing, fiber coherence, and extracellular fluid. These 3D maps offer a rich substrate for transferable microstructural representations, yet integrating them is challenging: standard representation learning struggles to disentangle the unique information in each map from their shared and synergistic interactions. We present BrainFIBRE, the first foundation model for brain microstructure, pretrained on NODDI-derived maps from 55,592 UK Biobank participants. We propose Self-supervised Partial Information Decomposition (SPID), which extends PID-guided multimodal learning to the self-supervised regime for the first time. A novel Counterfactual Candidate Construction (CCC) paradigm perturbs inter-modality alignment through modality dropping and swapping, providing the contrastive signal for a Mixture-of-Experts architecture to disentangle unique, synergistic, and redundant information without any downstream label. On both Caucasian and Asian cohorts, BrainFIBRE achieves state-of-the-art performance across diverse tasks predicting age, sex, cerebrovascular and neurodegenerative markers, and cognition, while yielding neurobiologically interpretable representations that reveal task- and cohort-specific interaction patterns. BrainFIBRE establishes a versatile foundation for neuroimaging analysis at the microstructural level.

扩散磁共振成像对脑微结构具有特殊敏感性，能够检测早期脑血管和神经退行性变化。神经突取向离散度和密度成像（NODDI）将扩散信号分解为三个具有生物物理学可解释性的映射图：神经突密度指数（NDI）、取向离散度指数（ODI）和自由水分数（FWF），分别捕获神经突排列、纤维一致性和细胞外液。这些三维映射图为可迁移的微结构表征提供了丰富的基质，然而对其进行整合具有挑战性：标准表征学习难以解耦各映射图中的独特信息与其共享和协同相互作用。本研究提出BrainFIBRE，这是首个脑微结构基础模型，基于55,592名英国生物银行参与者的NODDI衍生映射图进行预训练。我们提出了自监督部分信息分解（SPID）方法，首次将PID引导的多模态学习扩展到自监督范式。一种新的反事实候选构建（CCC）范式通过模态丢弃和交换扰动模态间对齐，为专家混合架构提供对比信号，以解耦独特、协同和冗余信息，且无需任何下游标签。在高加索人和亚洲人两个队列中，BrainFIBRE在预测年龄、性别、脑血管和神经退行性标志物以及认知功能的多种任务中均实现了最先进的性能，同时产生了神经生物学可解释的表征，揭示了任务特异性和队列特异性的相互作用模式。BrainFIBRE为微结构层面的神经影像分析建立了通用的基础。

Reconstruction-based generative models offer a natural framework for unsupervised out-of-distribution (OOD) detection, but multi-class normality modelling requires a single detector to capture multiple in-distribution manifolds and produce comparable anomaly scores across classes. We study this problem in copy detection pattern (CDP) authentication, where authentic and counterfeit samples are visually similar but differ in subtle printing-and-digitisation (P\&D) signatures. We propose a diffusion based multi-class normality framework in which a single class-conditional ControlNet is trained exclusively on authentic CDPs from multiple P\&D classes and detects counterfeits through reconstruction error under authentic-class conditioning. We further introduce dual template masking, which hides complementary regions of the input template and scores only withheld pixels, reducing reliance on visible binary structure. On the Indigo 1 x 1 Base dataset, the proposed method outperforms traditional and adapted generative baselines under multi-class authentic-versus-counterfeit evaluation, without using counterfeit samples for training or threshold calibration.

基于重构的生成模型为无监督分布外（OOD）检测提供了自然的框架，但多类正态性建模需要单个检测器捕获多个分布内流形并产生跨类可比的异常分数。本研究在拷贝检测模式（CDP）认证中探讨这一问题，真品与赝品样本在视觉上相似，但存在细微的印刷和数字化（P&D）特征差异。我们提出了一种基于扩散的多类正态性框架，在该框架中，单个类别条件ControlNet仅在来自多个P&D类别的真品CDP上进行训练，并通过真品类别条件下的重构误差来检测赝品。我们进一步引入了双模板掩码技术，该技术隐藏输入模板的互补区域并仅对保留像素进行评分，从而减少对可见二进制结构的依赖。在Indigo 1x1 Base数据集上，所提方法在多类真品与赝品评估中优于传统和适配的生成基线，且未使用赝品样本进行训练或阈值校准。

Training-free guidance (TFG) steers a pretrained diffusion model toward a desired attribute at inference. To be effective, this guidance must be applied from the earliest, high-noise steps of sampling. Because its objective (a classifier or energy) is defined on clean images, $\epsilon$- and $v$-prediction models must first estimate the clean image $\hat{x}$ from the noisy state at each step, and the accuracy of that estimate determines how easily guidance drifts off the data manifold. $x$-prediction, a recent alternative, outputs the clean image directly, removing this source of error even at high noise. This is our motivation. We provide a theoretical analysis of how each prediction target shapes this accuracy, and introduce guided-class FID (Child FID), a metric that exposes the manifold damage standard evaluation misses. Experiments on a new fine-grained bird benchmark and on style transfer confirm that $x$-prediction keeps guided samples on the manifold most reliably, making it the strongest foundation for training-free guidance. Code is available at https://github.com/ManLuML/on-manifold-tfg

无需训练的引导（TFG）在推理阶段将预训练的扩散模型导向期望的属性。要使其有效，这种引导必须从采样最初的高噪声步骤开始应用。由于其目标（分类器或能量函数）定义在干净图像上，ε预测模型和v预测模型必须首先从每一步的含噪状态估计干净图像$\hat{x}$，而该估计的准确性决定了引导偏离数据流形的容易程度。x预测作为一种新近的替代方案，直接输出干净图像，即使在高噪声下也消除了这一误差来源。这正是我们的研究动机。我们提供了关于每种预测目标如何影响该准确性的理论分析，并引入了引导类别FID（Child FID）这一指标，该指标能够揭示标准评估所遗漏的流形损伤。在新的细粒度鸟类基准测试和风格迁移上的实验证实，x预测最能可靠地保持引导样本在流形上，使其成为无需训练引导的最强基础。代码见https://github.com/ManLuML/on-manifold-tfg

Text-to-image personalization aims to generate a user-provided subject in novel scenes described by text. However, most existing methods encode subject identity (fidelity) and context (editability) through the same conditioning pathway, forcing the two to compete for attention-map resources. We refer to this phenomenon as conditioning entanglement and show that it induces a fidelity-editability trade-off. We further provide causal evidence by replacing the target subject token with a generic subject token, which produces shifts in attention allocation and corresponding changes in context adherence. To this end, we propose Decoupled Guidance (DeGu), a plug-and-play framework that routes subject identity and scene context through two independent guidance streams. We further introduce a spatial mixing mechanism that dynamically fuses these streams, ensuring each operates within its semantically relevant region without interference. Furthermore, DeGu can be readily applied to existing personalization methods without modifying the underlying backbone models, consistently improving the overall personalization performance while enabling inference-time control over the fidelity-editability balance, across diverse methods and backbones, including flow-matching Diffusion Transformers (DiTs).

文本到图像个性化旨在生成用户提供的目标主体在文本描述的新场景中的图像。然而，现有大多数方法通过相同的调节路径编码主体身份（保真度）和上下文（可编辑性），迫使两者竞争注意力图资源。我们将这种现象称为条件纠缠，并证明它会导致保真度-可编辑性权衡。我们进一步通过用通用主体token替换目标主体token来提供因果证据，这产生了注意力分配的转变以及相应的上下文遵循变化。为此，我们提出解耦引导（Decoupled Guidance, DeGu），这是一个即插即用的框架，将主体身份和场景上下文通过两个独立的引导流进行路由。我们进一步引入了一种空间混合机制，动态融合这些流，确保每个流在其语义相关区域内操作而不会相互干扰。此外，DeGu可以轻松应用于现有的个性化方法，无需修改底层骨干模型，在包括流匹配扩散变换器（DiTs）在内的多种方法和骨干网络中，始终提升整体个性化性能，同时实现推理时对保真度-可编辑性平衡的控制。

Text-to-image diffusion models achieve impressive visual quality, yet demographic bias remains a challenge, as neutral prompts consistently produce stereotypical representations across gender and race. Existing approaches remain limited by costly retraining or by inference-time interventions that often degrade image quality and semantic alignment. We propose Text Embedding Steering (TES), a training-free framework that mitigates demographic bias by directly optimizing conditional text embeddings during the diffusion process. We show that a two-stage strategy - early-stage global alignment followed by iterative denoising-time refinement with CLIP-based feedback - enables stable and controllable attribute steering without modifying model parameters. Extensive experiments on Stable Diffusion demonstrate that TES outperforms existing training-free baselines in fairness while maintaining competitive image quality. These results highlight that inference-time text embedding optimization is a practical and scalable solution for fairness-aware generation in diffusion models.

文本到图像扩散模型虽已取得令人印象深刻的视觉质量，但人口统计偏见仍是一个严峻挑战，因为中性提示词持续产生跨性别和种族的刻板印象表征。现有方法仍受限于昂贵的模型重训练，或受限于推理时的干预措施，而这些措施往往会导致图像质量下降和语义对齐受损。我们提出了文本嵌入引导（Text Embedding Steering，TES）框架，这是一种无需训练的去偏方法，通过在扩散过程中直接优化条件文本嵌入来缓解人口统计偏见。我们证明，两阶段策略——早期全局对齐后接基于CLIP反馈的迭代去噪时细化——能够实现稳定且可控的属性引导，同时无需修改模型参数。在Stable Diffusion上的大量实验表明，TES在保持竞争力的图像质量的同时，在公平性方面优于现有的无需训练基线方法。这些结果凸显了推理时文本嵌入优化是扩散模型中实现公平感知生成的一种实用且可扩展的解决方案。

Diffusion models have significantly advanced video super-resolution (VSR) but remain largely constrained to fixed upsampling scales. Conversely, while coordinate-based arbitrary-scale VSR methods offer scale flexibility, they inherently suffer from severe over-smoothing at large scaling factors. Integrating generative priors with continuous decoding is promising but currently hindered by severe temporal flickering caused by the stochasticity of diffusion sampling. To address this, we propose AVSR-Diff (Arbitrary-scale Video Super-Resolution with Diffusion), a novel decoupled framework that separates scale-agnostic latent denoising from continuous coordinate rendering, effectively avoiding computationally heavy resolution-specific sampling. Our approach introduces a Temporally-Gated Feature Recurrence (TGFR) module to extract strictly aligned, temporally consistent latent priors. Furthermore, we design a continuous video VAE decoder incorporating a Scale-Aware Fourier Refinement (SAFR) module to dynamically adapt frequency components to any target scale. Extensive experiments demonstrate that AVSR-Diff consistently preserves high-frequency details and strong temporal stability across various scales, surpassing state-of-the-art arbitrary-scale baselines. Remarkably, our framework outperforms recent fixed-scale generative models even on their native resolution.

扩散模型显著推动了视频超分辨率（VSR）的发展，但在很大程度上仍局限于固定的上采样尺度。相反，尽管基于坐标的任意尺度VSR方法提供了尺度灵活性，但在较大放大倍数下本质上存在严重的过度平滑问题。将生成先验与连续解码相结合前景广阔，但目前受到扩散采样的随机性导致的严重时间闪烁的阻碍。为解决这一问题，我们提出了AVSR-Diff（基于扩散的任意尺度视频超分辨率），这是一个新颖的解耦框架，将尺度无关的潜在去噪与连续坐标渲染分离，有效避免了计算量大的分辨率特定采样。我们的方法引入了时间门控特征 recurrence（TGFR）模块，以提取严格对齐的时间一致潜在先验。此外，我们设计了包含尺度感知傅里叶细化（SAFR）模块的连续视频VAE解码器，以动态适应任意目标尺度的频率分量。大量实验表明，AVSR-Diff在各种尺度下始终保持高频细节和强时间稳定性，超越了最先进的任意尺度基线方法。值得注意的是，我们的框架在原生分辨率上甚至优于近期固定尺度生成模型。

Text-to-image diffusion models power everyday creative tasks, but they still reproduce the demographic biases in their training data. On common prompts such as ``a photo of a nurse,'&x27; ``a photo of a CEO'&x27;, they skew their outputs toward one gender, driven by the statistics of training data rather than anything in the text. Existing debiasing methods show promise in narrow settings but require retraining, batch-level control, or prompt-specific tuning, limiting their scalability. We propose \emph{EquiSteer}, a training-free method that works per sample by steering cross-attention (CA) activations at inference time. For each target attribute, EquiSteer precomputes steering vectors from contrastive prompts. Then at generation time, a prompt-aware gate leaves attribute-specific prompts untouched, while for neutral ones it clears existing attribute signals from the CA activations and injects a target attribute. Across SD-1.5, SD-2.1, SDXL, and SANA, EquiSteer reduces the average parity gap by up to $87\%$, with minimal effect on image quality and text-image alignment. Code is available at \href{https://github.com/Atmyre/EquiSteer}{https://github.com/Atmyre/EquiSteer}.%

文本到图像扩散模型为日常创作任务提供了强大动力，但它们仍然会复制训练数据中的人口统计偏见。在诸如“护士的照片”、“首席执行官的照片”等常见提示词下，这些模型倾向于生成某一性别的图像，这是由训练数据的统计特性而非文本内容所驱动的。现有的去偏方法在特定场景下显示出一定前景，但需要重新训练、批量级控制或针对特定提示词的调优，限制了其可扩展性。我们提出了EquiSteer，这是一种无需训练的方法，通过在推理时对交叉注意力（CA）激活进行导向来实现逐样本处理。对于每个目标属性，EquiSteer从对比提示词中预计算导向向量。在生成时，一个提示词感知的门控机制会保持属性特定提示词不变，同时对于中性提示词，它会清除交叉注意力激活中现有的属性信号并注入目标属性。在SD-1.5、SD-2.1、SDXL和SANA上，EquiSteer将平均性别差距降低了高达87%，同时对图像质量和文本-图像对齐的影响微乎其微。代码可访问 https://github.com/Atmyre/EquiSteer。

Magnetic resonance imaging (MRI) reconstruction under realistic acquisition conditions can be fundamentally viewed as estimating the underlying k-space distribution from incomplete and noise-corrupted measurements. While diffusion models have recently shown strong potential as generative prior for inverse problems,existingapproachesstruggletohandlenoisyreconstruction settings, especially when operating directly in k-space domain. In this work, we propose a unified high-dimensional k-space reconstruction framework tailored for noisy inverse problems, whichenhancesdiffusion-based solversthroughrepresentation lifting.Ratherthanmodifyingthe underlying optimization procedures, the proposed framework augments the data representation space, enabling existing diffusion-based solvers to operate on enriched k-space embeddings with improved expressiveness. Extensive experiments on both in-house and public datasets across varying noise levels and undersampled factors demonstrate that the proposed frame work consistently improves reconstruction quality for multiple diffusion-based inverse solvers. Notably, the largest gains are observed in high-noise regimes, which is consistent with our theoretical analysis of error propagation under high-dimensional representation. These results suggest that high-dimensional representation provides a general and model-agnostic mechanism for improving diffusion-based MRI reconstruction in noisy settings, offering a new perspective on robust k-space generative modeling for practical inverse problems. The code will be available at https://github.com/yqx7150/HEP-MRIRec.

在真实采集条件下的磁共振成像（MRI）重建从根本上可视为从不完整且受噪声污染的测量值中估计底层k空间分布。虽然扩散模型最近在逆问题的生成先验方面展现出强大潜力，但现有方法难以处理噪声重建场景，尤其是在直接操作于k空间域时。在本工作中，我们提出了一种针对噪声逆问题统一的高维k空间重建框架，通过表示提升增强基于扩散的求解器。该框架不修改底层优化程序，而是增强数据表示空间，使现有的基于扩散的求解器能够在具有更强表达力的增强k空间嵌入上运行。在多个内部数据集和公共数据集上针对不同噪声水平和欠采样因子进行的广泛实验表明，所提出的框架始终能够提升多种基于扩散的逆问题求解器的重建质量。值得注意的是，在高噪声环境下的增益最为显著，这与我们对高维表示下误差传播的理论分析一致。这些结果表明，高维表示为噪声环境下改进基于扩散的MRI重建提供了一种通用且模型无关的机制，为实际逆问题的鲁棒k空间生成建模提供了新视角。代码将发布于 https://github.com/yqx7150/HEP-MRIRec。

Vertigo Vertigo is a scene-for-scene AI reconstruction of Hitchcock's Vertigo (1958), generated from only 2.78% of the original film&x27;s frames. Using this sparse set of keyframe anchors, we perform first-last frame interpolation via a large video diffusion model to predict the intervening sequences. Vertigo is itself a film about the obsessive reconstruction of an artificial ideal; Vertigo Vertigo extends this logic to the material of the film, treating the canonical text as a probe for the normative conventions of classical cinema encoded within generative systems. Evaluated through computational analysis and critical feedback from media theorists (Lev Manovich, Shane Denson, Kevin L. Ferguson), the artifact demonstrates remarkable structural fidelity: 73.1% of frames are recognizable as plausible renditions of Vertigo and only 3.6% fail catastrophically. This fidelity suggests that cinematic norms are deeply compressed within the model's latent priors. Aesthetically, the reconstruction is rendered as an unstable overlay between the original film and its predictive shadow, fueling a persistent doubt in the viewer&x27;s perception of authenticity -- a 21st-century vertigo. The work argues that generative media is not a paradigm shift from cinema but an acceleration of its logic of desire and false authenticity, extending from classical Hollywood through to the predictive media environments now reshaping contemporary perception.

Vertigo Vertigo 是对希区柯克《迷魂记》(1958)的逐场景AI重建，仅使用了原电影2.78%的帧。利用这一稀疏的关键帧锚点集合，我们通过大型视频扩散模型进行首尾帧插值，以预测中间的序列。《迷魂记》本身是一部关于强迫性重构人工理想的电影；Vertigo Vertigo 将这一逻辑延伸到电影本身，将这部经典文本作为探针，用于探测生成系统中编码的古典电影规范惯例。通过计算分析以及媒体理论家（Lev Manovich、Shane Denson、Kevin L. Ferguson）的批评反馈，该作品展示了显著的结构保真度：73.1%的帧可被识别为《迷魂记》的可信呈现，仅有3.6%出现灾难性失败。这种保真度表明，电影规范被深度压缩在模型的潜在先验中。从美学上而言，重建以原电影与其预测性影子之间的不稳定叠加呈现，激发了观众对真实性认知的持续怀疑——一种21世纪的眩晕感。该作品认为生成媒体并非电影范式的转变，而是其欲望与虚假真实性逻辑的加速，从古典好莱坞延伸至正在重塑当代感知的预测性媒体环境。

The rapid advancement of diffusion models has enabled the generation of high-fidelity images from textual prompts, yet achieving precise, disentangled control over specific attributes remains a significant challenge. A fundamental limitation arises because visual differences between images are often far more descriptive and nuanced than what can be captured through human-crafted text descriptions, which frequently fail to convey fine-grained semantic details. To address this, we introduce ViDiT (Visual Direction Transfer for Diffusion), a framework that expands the editing vocabulary by capturing latent semantics directly from image-edit pairs. ViDiT learns the underlying transformation by optimizing a single, global, and continuous editing direction from a small set of ``before-and-after'&x27; examples. This optimization process transfers visual changes into the diffusion model's conditioning space, allowing for detailed edits that text alone cannot easily describe. ViDiT operates on a ``Learn Once&x27;' principle, which completely eliminates the need for model fine-tuning or expensive per-image optimization during inference. Once learned, these continuous directions enable ``Edit Anywhere&x27;' capabilities, allowing users to apply highly disentangled manipulations, such as changes in facial features, animal attributes, or artistic styles, to any image in a zero-shot manner with granular control over the edit intensity. Quantitative and qualitative evaluations demonstrate that ViDiT outperforms existing text-based editing methods in maintaining input faithfulness while achieving precise, scalable attribute control.

扩散模型的快速发展使得从文本提示生成高保真图像成为可能，然而实现对特定属性的精确解耦控制仍然是一项重大挑战。一个根本性的局限性在于，图像之间的视觉差异通常比人工编写的文本描述所能捕捉的内容更加丰富和微妙，而文本描述往往难以传达细粒度的语义细节。为解决这一问题，我们提出了ViDiT（Visual Direction Transfer for Diffusion，扩散视觉方向迁移）框架，该框架通过直接从图像-编辑对中捕获潜在语义来扩展编辑词汇量。ViDiT通过从少量“前后对照”示例中优化单个全局连续编辑方向来学习底层变换。这一优化过程将视觉变化迁移到扩散模型的条件空间中，从而实现仅凭文本难以描述的精细编辑。ViDiT遵循“一次学习”原则，完全消除了推理过程中对模型微调或逐图像优化的需求。一旦学习完成，这些连续方向即可实现“随处编辑”能力，使用户能够以零样本方式对任意图像进行高度解耦的操控，如面部特征、动物属性或艺术风格的改变，并可对编辑强度进行精细控制。定量和定性评估表明，ViDiT在保持输入保真度的同时实现精确、可扩展的属性控制，其性能优于现有的基于文本的编辑方法。

Ultra-high-resolution text-to-image generation is increasingly vital for applications requiring fine-grained textures and global structural fidelity, yet state-of-the-art text-to-image diffusion models such as FLUX and SD3 remain confined to sub 2MP (< $1K\times2K$) resolutions due to the quadratic complexity of attention mechanisms and the scarcity of high-quality high-resolution training data. We present UltraImageGen, a novel framework that introduces hierarchical local attention with low-resolution global guidance, enabling efficient, scalable, and semantically coherent image synthesis at ultra-high resolutions. Specifically, high-resolution latents are divided into hardware aligned fixed-size local windows to reduce attention complexity from quadratic to near-linear, while a low-resolution latent equipped with scaled positional embeddings injects global semantics as an anchor. A lightweight LoRA adaptation bridges global and local pathways during denoising, ensuring consistency across structure and detail. To maximize inference efficiency and achieve scalable ultra-high-resolution generation, we repermute token sequence in window-first order, so that the GPU-friendly dense local blocks in attention calculation equals to the fixed-size local window in 2D regardless of resolution. Together ourwork reliably scales the pretrained model to resolutions higher than $8K$ with more than $10\times$ speed up and significantly lower memory usage. Extensive experiments demonstrate that ourwork achieves superior quality while maintaining computational efficiency, establishing a practical paradigm for advancing ultra-high-resolution image generation.

超高分辨率文本到图像生成对于需要精细纹理和全局结构保真度的应用变得越来越重要，然而目前最先进的文本到图像扩散模型（如 FLUX 和 SD3）仍局限于 2MP 以下（< 1K×2K）的分辨率，原因在于注意力机制的二次复杂度以及高质量高分辨率训练数据的匮乏。我们提出了 UltraImageGen，这是一种新颖的框架，引入了低分辨率全局引导的分层局部注意力，能够在超高分辨率下实现高效、可扩展且语义一致的图像合成。具体而言，高分辨率潜变量被划分为硬件对齐的固定大小局部窗口，将注意力复杂度从二次降低到近线性，而配备缩放位置嵌入的低分辨率潜变量则作为锚点注入全局语义。轻量级 LoRA 适配器在去噪过程中桥接全局和局部路径，确保结构和细节的一致性。为了最大化推理效率并实现可扩展的超高分辨率生成，我们以窗口优先顺序重排令牌序列，使得注意力计算中 GPU 友好的密集局部块在二维空间中与固定大小的局部窗口相匹配，而与分辨率无关。我们的工作成功将预训练模型扩展到超过 8K 的分辨率，实现了超过 10 倍的加速并显著降低了内存消耗。大量实验表明，我们的工作在保持计算效率的同时实现了卓越的质量，为推动超高分辨率图像生成建立了实用的范式。

Concept erasure methods aim to remove specific unsafe target concepts in diffusion models while preserving image generation utility. To address the vulnerability that erased concepts can be easily recovered under adversarial attacks, adversarial concept erasure methods integrate adversarial optimization into the concept erasure process. However, existing adversarial concept erasure methods face a trade-off between robustness and computational cost. We attribute this to adversarial optimization techniques that use random samples to approximate the adversarial objective function. Adversarial optimization that uses a small number of samples fails to produce adversarial embeddings that accurately capture the target concept space. To mitigate this limitation, we propose Semantic-Guided Adversarial Optimization, which uses a single sample to produce adversarial embeddings that better capture the target concept space. We also propose Semantic-Guided Concept Erasure, which automatically maps the target concept to a semantically similar surrogate. Extensive experiments on not-safe-for-work content, artistic styles, and object-related concepts demonstrate that our method, S-GRACE (Semantic-Guided Robust Adversarial Concept Erasure) achieves state-of-the-art erasure robustness and superior image generation utility, with significantly lower computational cost than existing methods. Our code is available at https://github.com/Qhong-522/S-GRACE.

概念擦除方法旨在移除扩散模型中的特定不安全目标概念，同时保留图像生成能力。为解决被擦除概念在对抗攻击下易于被恢复的脆弱性问题，对抗概念擦除方法将对抗优化集成到概念擦除过程中。然而，现有的对抗概念擦除方法在鲁棒性与计算成本之间存在权衡。我们将此归因于使用随机样本来近似对抗目标函数的对抗优化技术。使用少量样本的对抗优化无法产生准确捕捉目标概念空间的对抗嵌入。为缓解这一局限性，我们提出了语义引导对抗优化方法，该方法使用单个样本来生成更好地捕捉目标概念空间的对抗嵌入。我们还提出了语义引导概念擦除方法，自动将目标概念映射到语义相似的替代概念。在不适合工作内容、艺术风格和物体相关概念方面的大量实验表明，我们的方法S-GRACE（语义引导鲁棒对抗概念擦除）实现了最先进的擦除鲁棒性和卓越的图像生成能力，且计算成本显著低于现有方法。我们的代码可在 https://github.com/Qhong-522/S-GRACE 获取。

Recent progress in text-to-video generation has achieved remarkable realism, yet fine-grained control over camera motion and orientation remains elusive, especially with extreme trajectories (e.g., a 180-degree turnaround, or looking directly up or down). Existing approaches typically encode camera trajectories using relative or ambiguous representations, limiting precise geometric control and offering limited support for large rotations. We introduce GimbalDiffusion, a framework that enables camera control grounded in physical-world coordinates, using gravity as a global reference. Instead of describing motion relative to previous frames, our method defines camera trajectories in an absolute coordinate system, allowing accurate, interpretable control over camera parameters. Using panoramic 360-degree videos for training, we cover the full sphere of possible viewpoints, including combinations of extreme pitch and roll that are out-of-distribution of conventional video data. To improve camera control, we introduce null-pitch conditioning, a strategy that prevents the model from overriding camera specifications in the presence of conflicting prompt content (e.g., generating grass while the camera points toward the sky). Finally, we propose new benchmarks to evaluate gravity-aware camera-controlled video generation, assessing models' ability to generate extreme camera angles and quantify their input prompt entanglement.

文本到视频生成的最新进展已实现显著的真实感，然而在相机运动和方向上的细粒度控制仍然难以实现，特别是对于极端轨迹（如180度翻转，或直接向上或向下看）。现有方法通常使用相对或模糊的表示来编码相机轨迹，限制了精确的几何控制，并对大角度旋转的支持有限。我们提出了GimbalDiffusion，一个基于物理世界坐标系的相机控制框架，以重力作为全局参考。我们的方法不是相对于前一帧描述运动，而是在绝对坐标系中定义相机轨迹，从而实现对相机参数的准确、可解释的控制。我们使用全景360度视频进行训练，覆盖了完整球面的可能视角，包括传统视频数据分布之外的极端俯仰和翻滚的组合。为了改进相机控制，我们引入了零俯仰条件策略，该策略可防止模型在出现冲突的提示内容时覆盖相机规格（例如，当相机指向天空时生成草地）。最后，我们提出了新的基准来评估重力感知的相机控制视频生成，评估模型生成极端相机角度的能力并量化其输入提示纠缠程度。

Autoregressive video diffusion models hold promise for world simulation but are vulnerable to exposure bias arising from the train-test mismatch. While recent works address this via post-training, they typically rely on a bidirectional teacher model or discriminator. To achieve an end-to-end solution, we introduce Resampling Forcing, a teacher-free framework that enables training autoregressive video models from scratch and at scale. Central to our approach is a self-resampling scheme that simulates inference-time model errors on history frames during training. Conditioned on these degraded histories, a sparse causal mask enforces temporal causality while enabling parallel training with frame-level diffusion loss. To facilitate efficient long-horizon generation, we further introduce history routing, a parameter-free mechanism that dynamically retrieves the top-k most relevant history frames for each query. Experiments demonstrate that our approach achieves performance comparable to distillation-based baselines while exhibiting superior temporal consistency on longer videos owing to native-length training.

自回归视频扩散模型在世界模拟领域具有广阔前景，但容易受到训练-测试不匹配所导致的曝光偏差的影响。尽管现有研究通过后训练来解决这一问题，但它们通常依赖于双向教师模型或判别器。为实现端到端解决方案，我们提出了Resampling Forcing，这是一种无教师的框架，能够从零开始且大规模地训练自回归视频模型。我们的方法核心是一种自重采样方案，能够在训练过程中模拟推理时历史帧的模型误差。以这些降质的历史帧为条件，稀疏因果掩码在实现时间因果性的同时，支持帧级扩散损失的并行训练。为了促进高效的长时序生成，我们进一步引入了历史路由，这是一种无参数机制，能够动态检索每个查询帧最相关的k个历史帧。实验表明，我们的方法达到了与基于蒸馏的基线相当的性能，并且由于采用了原生长度训练，在更长视频的时间一致性方面表现更优。

While Diffusion Transformers (DiTs) have achieved notable progress in video generation, this long-sequence generation task remains constrained by the quadratic complexity inherent to self-attention mechanisms, creating significant barriers to practical deployment. Although sparse attention methods attempt to address this challenge, existing approaches either rely on oversimplified static patterns or require computationally expensive sampling operations to achieve dynamic sparsity, resulting in inaccurate pattern predictions and degraded generation quality. To overcome these limitations, we propose a \underline{\textbf{M}}ixture-\underline{\textbf{O}}f-\underline{\textbf{D}}istribution \textbf{DiT} (\textbf{MOD-DiT}), a novel sampling-free dynamic attention framework that accurately models evolving attention patterns through a two-stage process. First, MOD-DiT leverages prior information from early denoising steps and adopts a {distributed mixing approach} to model an efficient linear approximation model, which is then used to predict mask patterns for a specific denoising interval. Second, an online block masking strategy dynamically applies these predicted masks while maintaining historical sparsity information, eliminating the need for repetitive sampling operations. Extensive evaluations demonstrate consistent acceleration and quality improvements across multiple benchmarks and model architectures, validating MOD-DiT's effectiveness for efficient, high-quality video generation while overcoming the computational limitations of traditional sparse attention approaches.

尽管扩散变换器（DiTs）在视频生成领域取得了显著进展，但这种长序列生成任务仍受到自注意力机制固有二次复杂度的制约，这为实际部署带来了重大障碍。虽然稀疏注意力方法试图解决这一挑战，但现有方法要么依赖于过度简化的静态模式，要么需要计算昂贵的采样操作来实现动态稀疏性，导致模式预测不准确且生成质量下降。为了克服这些局限性，我们提出了分布混合扩散变换器（MOD-DiT），一种无需采样的新型动态注意力框架，通过两阶段过程准确建模演变的注意力模式。首先，MOD-DiT利用去噪早期的先验信息，并采用分布式混合方法来建模高效的线性近似模型，然后利用该模型预测特定去噪间隔的掩码模式。其次，在线分块掩码策略在应用这些预测掩码的同时保持历史稀疏信息，无需重复的采样操作。大量评估表明，MOD-DiT在多个基准测试和模型架构上实现了一致的加速和质量提升，验证了其在高效高质量视频生成中的有效性，同时克服了传统稀疏注意力方法的计算局限性。

Handwritten mathematical expression recognition (HMER) requires reasoning over diverse symbols and structures, yet autoregressive models struggle with exposure bias and syntax inconsistency. We present GryphOne, a discrete diffusion framework which reformulates HMER as iterative symbolic refinement instead of sequential generation. GryphOne progressively refines symbols and relations, removing autoregression and improving consistency. Symbol-aware tokenization and random-masking mutual learning further enhance robustness to handwriting diversity. On the MathWriting benchmark, GryphOne achieves 5.51% CER and 59.9% EM (ExpRate), outperforming all reimplemented models in the matched setting as well as the commercial HMER system. Held-out evaluation on CROHME 2014-2023 further shows strong cross-dataset generalization.

手写数学表达式识别（HMER）需要对各种符号和结构进行推理，然而自回归模型在处理曝光偏差和语法不一致方面存在困难。我们提出GryphOne，一个将HMER重新表述为迭代符号精炼而非顺序生成的离散扩散框架。GryphOne逐步精炼符号和关系，消除了自回归并提高了一致性。符号感知分词和随机掩码互学习进一步增强了对手写多样性的鲁棒性。在MathWriting基准测试中，GryphOne实现了5.51%的字符错误率和59.9%的精确匹配率，优于匹配设置下的所有重新实现的模型以及商业HMER系统。在CROHME 2014-2023上的留出评估进一步表明其具有强大的跨数据集泛化能力。

Diffusion model advances have enabled powerful text-guided image editing, but also raise ethical and legal risks such as deepfakes and unauthorized use. To prevent these risks, adversarial attack-based image immunization has emerged as a promising defense against AI-driven semantic manipulation. Yet, most existing approaches require image-specific optimization or additional neural networks at inference time, hindering scalability and practicality. In this paper, we propose the first universal adversarial perturbation-based image immunization framework that generates a single, image-agnostic adversarial perturbation specifically designed for diffusion-based editing pipelines. Inspired by UAP used in targeted attacks, our method aims to generate a UAP that induces diffusion models to misinterpret the input image as a specific semantic target. Simultaneously, it suppresses original content to misdirect the model&#x27;s attention during editing, thereby effectively blocking unauthorized edits by overwriting the image&x27;s original semantics via the UAP. Extensive experiments show that our method, as the first universal immunization approach, significantly outperforms several baselines in the UAP setting. Notably, despite the inherent difficulty of universal perturbations, our method achieves competitive or superior performance compared to image-specific methods under a more restricted perturbation budget, while also exhibiting strong black-box transferability across diverse diffusion models.

扩散模型的进展使得强大的文本引导图像编辑成为可能，但也带来了深度伪造和未经授权使用等伦理和法律风险。为防止这些风险，基于对抗攻击的图像免疫已成为抵御人工智能驱动的语义操纵的一种有前景的防御方式。然而，大多数现有方法需要在推理时进行图像特定的优化或使用额外的神经网络，这阻碍了其可扩展性和实用性。本文提出了首个基于通用对抗扰动的图像免疫框架，该框架生成一种专门为扩散模型编辑流水线设计的通用、对抗扰动。受定向攻击中使用的UAP启发，我们的方法旨在生成一种能够诱导扩散模型将输入图像误解为特定语义目标的UAP。同时，它抑制原始内容以在编辑过程中误导模型的注意力，从而通过UAP覆盖图像的原始语义来有效阻止未经授权的编辑。广泛的实验表明，作为首个通用免疫方法，我们的方法在UAP设置下显著优于多个基线方法。值得注意的是，尽管通用扰动存在固有困难，但我们的方法在更严格的扰动预算约束下，与图像特定方法相比仍具有竞争力或更优的性能，同时在不同的扩散模型中表现出强大的黑盒迁移性。

Diffusion transformer (DiT) architectures show great potential for real-world image super-resolution (Real-ISR). However, their computationally expensive iterative sampling necessitates one-step distillation. Existing one-step distillation methods struggle with Real-ISR on DiT. They suffer from fundamental trajectory mismatch and generate severe grid-like periodic artifacts. To tackle these challenges, we propose StrSR, a novel one-step adversarial distillation framework featuring spectral and trajectory regularization. Specifically, we propose an asymmetric discriminative distillation architecture to bridge the trajectory gap. Additionally, we design a frequency distribution matching strategy to effectively suppress DiT-specific periodic artifacts caused by high-frequency spectral leakage. Extensive experiments demonstrate that StrSR achieves state-of-the-art performance in Real-ISR, across both quantitative metrics and visual perception. The code and models will be released at https://github.com/jkwang28/StrSR .

扩散Transformer（DiT）架构在真实世界图像超分辨率（Real-ISR）任务中展现出巨大潜力。然而，其计算昂贵的迭代采样过程需要一步蒸馏来实现快速推理。现有的DiT一步蒸馏方法在处理Real-ISR时面临挑战。它们存在根本性的轨迹不匹配问题，并产生严重的网格状周期性伪影。针对这些挑战，我们提出了StrSR，一种新颖的具有频谱和轨迹正则化的一步对抗蒸馏框架。具体而言，我们提出了一种非对称判别蒸馏架构来弥合轨迹差距。此外，我们设计了一种频率分布匹配策略，以有效抑制由高频频谱泄漏引起的DiT特定周期性伪影。大量实验表明，StrSR在Real-ISR任务中实现了最先进的性能，无论是在定量指标还是视觉感知方面。代码和模型将在https://github.com/jkwang28/StrSR上发布。

We present a novel paradigm for ultra-low-bitrate image compression (ULB-IC) that exploits the ``temporal&#x27;&x27; evolution in generative image compression. Specifically, we define an explicit intermediate state during decoding: a compact anchor frame, which preserves the scene geometry and semantic layout while discarding high-frequency details. We then reinterpret generative decoding as a virtual temporal transition from this anchor to the final reconstructed image. To model this progression, we leverage a pretrained video diffusion model (VDM) as a temporal prior: the anchor frame serves as the initial frame and the original image as the target frame, transforming the decoding process into a next-frame prediction task. In contrast to image diffusion-based ULB-IC models, our decoding proceeds from a visible, semantically faithful anchor, which improves both fidelity and realism for perceptual image compression. Extensive experiments demonstrate that our method achieves superior rate-distortion performance. On the CLIC2020 test set, our method achieves over 50% bitrate savings across LPIPS, DISTS, FID, and KID compared to DiffC, while also delivering a significant decoding speedup of up to $\times$5. Code will be released at https://github.com/UnoC-727/NeFIC.

我们提出了一种利用生成图像压缩中"时间"演化的超低码率图像压缩新范式。具体而言，我们定义了解码过程中的一个显式中间状态：紧凑锚帧，该锚帧在丢弃高频细节的同时保留场景几何结构和语义布局。随后，我们将生成式解码重新解释为从该锚帧到最终重建图像的虚拟时间转换。为了建模这一演进过程，我们利用预训练的 video diffusion model（VDM）作为时间先验：锚帧作为初始帧，原始图像作为目标帧，将解码过程转化为下一帧预测任务。与基于图像扩散的超低码率图像压缩模型不同，我们的解码从可见的、语义忠实的锚帧开始，提升了感知图像压缩的保真度和真实感。大量实验表明，我们的方法实现了优越的率失真性能。在 CLIC2020 测试集上，我们的方法在 LPIPS、DISTS、FID 和 KID 指标上相比 DiffC 节省了超过 50% 的码率，同时实现了高达 5 倍的解码速度提升。代码将发布于 https://github.com/UnoC-727/NeFIC。

Single image reflection removal (SIRR) is challenging in real scenes, where reflection strength varies spatially and reflection patterns are tightly entangled with transmission structures. This paper presents a diffusion model with prior modulation framework (FUMO) that introduces explicit priors for spatially adaptive conditioning and structurally faithful restoration. Two priors are extracted directly from the mixed image, an intensity prior that estimates spatial reflection severity and a high-frequency prior that captures detail-sensitive responses via multi-scale residual aggregation. We propose a coarse-to-fine training paradigm. In the first stage, these cues are combined to gate the conditional residual injections, focusing the conditioning on regions that are both reflection-dominant and structure-sensitive. In the second stage, a fine-grained refinement network corrects local misalignment and sharpens fine details in the image space. Experiments conducted on both standard benchmarks and challenging images in the wild demonstrate competitive quantitative results and consistently improved perceptual quality. The code is released at https://github.com/Lucious-Desmon/FUMO.

单图像反射去除（SIRR）在实际场景中具有挑战性，因为反射强度在空间上变化各异，且反射模式与传输结构紧密纠缠。本文提出了一种先验调制框架的扩散模型（FUMO），该框架引入显式先验以实现空间自适应调节和结构忠实恢复。两种先验直接从混合图像中提取：强度先验用于估计空间反射严重程度，高频先验通过多尺度残差聚合捕获细节敏感响应。本文提出了一种粗到细的训练范式。在第一阶段，这些线索被结合用于门控条件残差注入，将调节重点聚焦于反射主导且结构敏感的区域。在第二阶段，细粒度细化网络纠正局部对齐并在图像空间中锐化细节。在标准基准测试和具有挑战性的真实图像上进行的实验表明，该方法取得了具有竞争力的定量结果和持续改进的感知质量。代码已发布于 https://github.com/Lucious-Desmon/FUMO。

Class-conditional generative models have emerged as accurate and robust classifiers, with diffusion models demonstrating clear advantages over other visual generative paradigms, including autoregressive (AR) models. In this work, we revisit visual AR-based generative classifiers and identify an important limitation of prior approaches: their reliance on a fixed token order, which imposes a restrictive inductive bias for image understanding. We observe that single-order predictions rely more on partial discriminative cues, while averaging over multiple token orders provides a more comprehensive signal. Based on this insight, we leverage recent any-order AR models to estimate order-marginalized predictions, unlocking the high classification potential of AR models. Our approach consistently outperforms diffusion-based classifiers across diverse image classification benchmarks, while being up to 25x more efficient. Compared to state-of-the-art self-supervised discriminative models, our method delivers competitive classification performance - a notable achievement for generative classifiers.

类别条件生成模型已成为准确且鲁棒的分类器，其中扩散模型相比其他视觉生成范式（包括自回归模型）展现出明显优势。在本工作中，我们重新审视了基于视觉的自回归生成式分类器，并识别出先前方法的一个重要局限性：它们依赖于固定的标记顺序，这对图像理解施加了限制性归纳偏置。我们观察到，单一顺序的预测更偏重于部分判别线索，而对多个标记顺序进行平均则能提供更全面的信号。基于这一洞察，我们利用最新的任意顺序自回归模型来估计顺序边缘化预测，从而释放了自回归模型的高分类潜力。我们的方法在各种图像分类基准测试中始终优于基于扩散的分类器，同时效率提升高达25倍。与最先进的自监督判别模型相比，我们的方法实现了具有竞争力的分类性能——对于生成式分类器而言这是一项显著成就。

Exo-to-Ego video generation aims to synthesize a first-person video from a synchronized third-person view and corresponding camera poses. While paired supervision is available, synchronized exo-ego data inherently introduces substantial spatio-temporal and geometric discontinuities, violating the smooth-motion assumptions of standard video generation benchmarks. We identify this synchronization-induced jump as the central challenge and propose Syn2Seq-Forcing, a sequential formulation that interpolates between the source and target videos to form a single continuous signal. By reframing Exo2Ego as sequential signal modeling rather than a conventional condition-output task, our approach enables diffusion-based sequence models, e.g. Diffusion Forcing Transformers (DFoT), to capture coherent transitions across frames more effectively. Empirically, we show that interpolating only the videos, without performing pose interpolation already produces significant improvements, emphasizing that the dominant difficulty arises from spatio-temporal discontinuities. Beyond immediate performance gains, this formulation establishes a general and flexible framework capable of unifying both Exo2Ego and Ego2Exo generation within a single continuous sequence model, providing a principled foundation for future research in cross-view video synthesis.

外到内视角视频生成旨在根据同步的第三人称视角及相应相机姿态合成第一人称视频。虽然可以使用配对监督，但同步的外内视角数据本身会引入大量时空和几何不连续性，这违反了标准视频生成基准中的平滑运动假设。我们将此同步引发的跳变确定为核心挑战，并提出Syn2Seq-Forcing（同步到序列强制）方法，这是一种序列式公式化，通过在源视频和目标视频之间进行插值来形成单一连续信号。通过将外到内视角（Exo2Ego）重新定义为序列信号建模而非传统条件-输出任务，我们的方法使基于扩散的序列模型（如扩散强制变换器DFoT）能够更有效地捕捉帧之间的连贯过渡。实证研究表明，仅对视频进行插值而不进行姿态插值就已能产生显著提升，这表明主要困难源于时空不连续性。除了直接的性能提升之外，这种公式化方法还建立了一个通用且灵活的框架，能够在外到内视角（Exo2Ego）和内到外视角（Ego2Exo）生成之间实现统一，为跨视角视频合成的未来研究提供了原则性基础。

Emerging multi-modal world models attempt to jointly generate videos across diverse modalities (e.g., RGB, depth, and mask), yet they fail to fully exploit the rich priors of existing foundation models. We propose $M^2$-REPA, the first representation alignment method tailored for multi-modal video generation. Our key insight is that foundation models trained on different modality spaces naturally capture distinct domain-specific priors, acting as complementary "experts." Specifically, we first decouple modality-specific features from the diffusion model's intermediate representations, then align each with its corresponding expert foundation model. To this end, we design two synergistic objectives: a multi-modal representation alignment loss that enforces feature-to-expert matching, and a modality-specific decoupling regularization that encourages complementarity across different modalities. This design enables joint optimization, fully exploiting priors from multiple foundation models. Extensive experiments demonstrate that our method significantly outperforms baselines in visual quality and long-term consistency.

新兴的多模态世界模型尝试跨不同模态（如RGB、深度和掩码）联合生成视频，但它们未能充分利用现有基础模型的丰富先验。我们提出了M^2-REPA，这是首个针对多模态视频生成的表示对齐方法。我们的核心见解是，在不同模态空间上训练的基础模型自然地捕捉到独特的领域特定先验，充当互补的“专家”。具体而言，我们首先从扩散模型的中间表示中解耦出模态特定特征，然后将其与对应的专家基础模型对齐。为此，我们设计了两个协同目标：多模态表示对齐损失强制实现特征到专家的匹配，以及模态特定解耦正则化促进不同模态间的互补性。这种设计实现了联合优化，能够充分利用多个基础模型的先验。大量实验表明，我们的方法在视觉质量和长期一致性方面显著优于基线方法。

Hyperspectral image (HSI) restoration is crucial for reliable analysis, as real-world HSIs suffer from noise, blur, and resolution loss. However, existing models trained on source data often fail on target domains lacking clean references, a common real-world scenario. To address this, we present HIR-ALIGN, a plug-and-play target-adaptive augmentation framework that enhances HSI restoration by augmenting limited training images with synthetic data matching the target distribution, without extra clean target-domain HSI data. It has three stages: (i) proxy generation, where off-the-shelf restoration models are applied to degraded target observations to produce semantics-preserving proxy HSIs that approximate clean target-domain images; (ii) distribution-adaptive synthesis, where a blur-robust unCLIP diffusion model generates target-aligned RGBs from proxy RGBs with prompt conditioning and embedding-space noise initialization. The warp-based spectral transfer module then synthesizes HSIs by aligning each generated RGB with its proxy RGB, estimating soft patch-wise transport weights, and applying these weights and learnable local interpolation kernels to the proxy HSI; and (iii) aligned supervised finetuning, where restoration networks pretrained on the source distribution are finetuned with proxy HSIs and synthesized target-aligned HSIs, then deployed on degraded target images. We also provide theoretical analysis showing that, under stated assumptions, the proposed augmentation-based finetuning obtains a tighter target-domain restoration-risk upper bound by jointly improving target-distribution coverage and controlling spectral bias. Experiments on simulated and real datasets across denoising, super-resolution, and other restoration tasks demonstrate that HIR-ALIGN is superior to proxy-only target-adaptation baselines and outperforms representative unsupervised methods in most cases.

高光谱图像(HSI)恢复对可靠分析至关重要，因为真实世界的高光谱图像常受到噪声、模糊和分辨率损失的困扰。然而，在源数据上训练的模型往往在缺乏干净参考的目标域上失效，这是一个常见的真实场景。为解决这一问题，我们提出了HIR-ALIGN，一个即插即用的目标自适应增强框架，通过用与目标分布匹配的合成数据增强有限的训练图像来增强高光谱图像恢复，而无需额外的干净目标域高光谱图像数据。该框架包含三个阶段：(i) 代理生成阶段，将现成的恢复模型应用于退化的目标观测，生成保留语义的代理高光谱图像以近似干净目标域图像；(ii) 分布自适应合成阶段，一个抗模糊的unCLIP扩散模型通过提示条件化和嵌入空间噪声初始化从代理RGB生成目标对齐的RGB。基于形变的谱传输模块随后通过将每个生成的RGB与其代理RGB对齐，估计柔和的逐斑块传输权重，并将这些权重和可学习的局部插值核应用于代理高光谱图像来合成高光谱图像；(iii) 对齐监督微调阶段，对在源分布上预训练的恢复网络进行微调，使用代理高光谱图像和合成的目标对齐高光谱图像，然后部署在退化的目标图像上。我们还提供了理论分析，表明在所述假设下，所提出的基于增强的微调通过联合改善目标分布覆盖和控制谱偏差，能够获得更严格的目标域恢复风险上界。在去噪、超分辨率及其他恢复任务的模拟和真实数据集上的实验表明，HIR-ALIGN优于仅使用代理的目标自适应基线，并在大多数情况下优于代表性的无监督方法。

While personalizing Image-to-Video (I2V) diffusion models with specific visual effects is increasingly demanded for high-end generation, current practice requires training a separate Low-Rank Adaptation (LoRA) module for each effect, incurring substantial data curation and iterative optimization costs that hinder interactive control. We present Prompt2Effect, a weight-driven hypernetwork that amortizes per-effect training by directly synthesizing effect-specific LoRA weights in a single forward pass. Unlike prior hypernetworks that regress adapter weights purely from semantics, Prompt2Effect is explicitly conditioned on the frozen base model weights, grounding prediction in the structural geometry of each layer. Furthermore, instead of predicting raw LoRA matrices, we introduce an SVD-canonicalized parameterization that resolves factorization ambiguity and stabilizes large-scale synthesis. Extensive experiments demonstrate that Prompt2Effect achieves on-par or superior video quality and effect alignment compared to conventional LoRA fine-tuning, while reducing the computational cost from 56 GPU training hours to 3.3 seconds of hypernetwork inference. When used as initialization for subsequent fine-tuning, our predicted weights further improve final performance and accelerate optimization by approximately 10x.

虽然利用特定视觉特效对图像到视频（Image-to-Video, I2V）扩散模型进行个性化定制的需求日益增长，但当前做法需要为每个特效单独训练一个低秩适配（Low-Rank Adaptation, LoRA）模块，由此产生的数据整理和迭代优化成本阻碍了交互式控制。我们提出Prompt2Effect，这是一个权重驱动的超网络，通过单次前向传播直接合成特定效果的LoRA权重，从而摊销每个特效的训练成本。与先前纯从语义回归适配器权重的超网络不同，Prompt2Effect明确以冻结的基础模型权重为条件进行预测，使预测结果基于各层的结构几何特性。此外，我们引入了一种SVD规范化参数化方法，而非直接预测原始LoRA矩阵，从而解决了分解歧义问题并稳定了大规模合成。大量实验表明，Prompt2Effect在视频质量和效果对齐方面达到了与常规LoRA微调相当或更优的水平，同时将计算成本从56 GPU训练小时降低到3.3秒的超网络推理时间。当用作后续微调的初始化时，我们预测的权重可进一步提升最终性能，并将优化速度加快约10倍。

Human image animation, which aims to generate a video of a reference subject following a provided action sequence, has received increasing research interest. With the development of diffusion-based/flow-based video foundation models, existing animation works have began to upgrade the guidance information from 2D skeleton/pose to 3D modeling conditions. Despite achieving reasonable results, these approaches face challenges in synthesizing trajectory-controllable human motion within natural scene under changed camera views. In this work, we present a scene-adaptive human image animation framework that controls both human motion and camera trajectories within a reconstructed 3D environment for video generation. To achieve this, we first develop a ground-adaptive 3D motion retargeting approach to enable user-friendly motion trajectory control adapting to the changes of elevations of ground and orientations automatically. Then we design a viewpoint-adaptive latent fusion mechanism to inject point-cloud geometric priors through scene-visibility masking into the generative process, providing precise guidance of viewpoint changes under camera control. Experiments on two standard human image animation benchmark datasets demonstrate remarkable improvements of our method over the state of the arts in related video generation metics. Project page: https://robinhood256100.github.io/web-disp

人物图像动画旨在生成一段视频，使参考对象按照给定的动作序列进行表演，近年来受到越来越多的研究关注。随着基于扩散/流匹配的视频基础模型的发展，现有动画工作开始将引导信息从2D骨架/姿态升级到3D建模条件。尽管取得了合理效果，这些方法在改变相机视角的自然场景中合成轨迹可控的人物动作方面仍面临挑战。本工作提出了一个场景自适应人物图像动画框架，在重建的3D环境中同时控制人物动作和相机轨迹以生成视频。为此，我们首先开发了一种地面自适应3D动作重定向方法，使运动轨迹控制能够自动适应地面高度和方向的变化，实现用户友好型控制。然后，我们设计了一种视角自适应潜在融合机制，通过场景可见性掩码将点云几何先验注入生成过程，为相机控制下的视角变化提供精确引导。在两个人物图像动画标准基准数据集上的实验表明，我们的方法在相关视频生成指标上相较于现有最先进方法取得了显著改进。

Multi-modal image matching is essential for visual localization and multi-sensor fusion, but it is hindered by the scarcity of large-scale training data with precise geometric annotations. Existing real-world datasets suffer from prohibitive costs, limited scene diversity, and errors in SfM-MVS pipelines, while synthetic methods struggle to maintain 3D geometric consistency or achieve photorealistic appearance. To address this, we propose AnyMatch, a novel framework that leverages abundant, easily accessible single-view images at minimal cost to generate rich multi-modal training data. AnyMatch integrates monocular depth estimation, 3D reprojection, diffusion-based inpainting, and crossmodal image translation to synthesize multi-view, multi-modal image pairs with 3D geometric fidelity. Crucially, our method provides annotations that strictly adhere to 3D geometric consistency through explicit 3D reprojection, avoiding SfM-MVS error accumulation. Furthermore, AnyMatch offers strong scalability, enabling controllable scene diversity and annotation difficulty via adjustable input and camera parameters. We construct Any-syn, a large-scale synthetic multi-modal dataset using AnyMatch. Experimental results show that matching networks (e.g., LoFTR, EDM, RoMa) fine-tuned on Any-syn achieve substantial performance gains on multi-modal benchmarks, exhibiting superior generalization and robustness compared to models trained on existing data.

多模态图像匹配对于视觉定位和多传感器融合至关重要，但其发展受到带有精确几何标注的大规模训练数据稀缺的阻碍。现有的真实世界数据集存在成本高昂、场景多样性有限以及SfM-MVS流程误差累积等问题，而合成方法则难以保持3D几何一致性或实现照片级真实感外观。针对这一问题，我们提出了AnyMatch，这是一个新颖的框架，能够以极低成本利用丰富且易于获取的单视图图像来生成大量多模态训练数据。AnyMatch集成了单目深度估计、3D重投影、基于扩散的修复以及跨模态图像转换技术，以合成具有3D几何保真度的多视角多模态图像对。关键在于，我们的方法通过显式3D重投影提供了严格遵循3D几何一致性的标注，避免了SfM-MVS误差累积。此外，AnyMatch具有强大的可扩展性，能够通过可调的输入和相机参数实现可控的场景多样性和标注难度。我们使用AnyMatch构建了Any-syn，这是一个大规模合成多模态数据集。实验结果表明，在Any-syn上微调的匹配网络（如LoFTR、EDM、RoMa）在多模态基准测试中实现了显著的性能提升，与在现有数据上训练的模型相比，展现出更强的泛化能力和鲁棒性。

Camera pose estimation from image streams is a critical component of spatial world models that integrate perception into planning and decision-making. Nearly all Visual Odometry (VO) and Simultaneous Localization and Mapping (V-SLAM) systems have focused on datasets containing raw, uncompressed videos. Many working systems instead use ubiquitous hardware units to efficiently compress and decode video streams, saving orders of magnitude in storage and bandwidth. However, this lossy compression introduces visual artifacts that hinder the performance of traditional tracking systems. We present VOCA, a causal stereo visual-odometry method that exploits codec information to improve tracking performance. We achieve state-of-the-art performance on causal VO for relative trajectory error, efficiency, and absolute trajectory error on compressed streams. This work highlights the potential of leveraging widely available video codec information for vision tasks.

来自图像流的相机位姿估计是整合感知与规划和决策的空间世界模型的关键组件。几乎所有的视觉里程计（VO）和同时定位与建图（V-SLAM）系统都专注于包含原始未压缩视频的数据集。然而，许多实际工作的系统使用普遍存在的硬件单元来高效压缩和解码视频流，从而节省数量级的存储和带宽。但是，这种有损压缩会引入视觉伪影，阻碍传统跟踪系统的性能。我们提出了VOCA，一种因果立体视觉里程计方法，利用编解码器信息来提升跟踪性能。我们在因果VO领域取得了相对轨迹误差、效率和绝对轨迹误差方面的最优性能，特别是在压缩视频流上。本工作揭示了利用广泛可用的视频编解码器信息进行视觉任务的潜力。

We propose the first compression approach for image-to-shape Diffusion Transformers (DiTs) that substantially reduces model size while preserving geometric fidelity. Despite remarkable progress in 3D shape generation, large DiT-based models remain computationally prohibitive in resource-constrained settings. Furthermore, it is difficult to directly transfer existing diffusion model compression strategies developed for different domains to 3D generation, and prior 3D efficiency approaches focus primarily on inference speed rather than backbone compression. To address this limitation, we build a geometry-aware compression framework tailored to image-to-shape DiTs. Guided by the observation that 3D DiT layers exhibit non-uniform importance for geometry synthesis, we introduce a vitality-guided framework integrating structured pruning, adaptive quantization, and targeted fine-tuning. Our method achieves up to 66% model-size reduction across state-of-the-art image-to-3D models while maintaining synthesis fidelity comparable to full-sized counterparts. This highlights the potential of our framework as a plug-and-play solution for efficient 3D shape generation across diverse models.

我们提出了一种针对图像到形状扩散变换器（DiT）的压缩方法，该方法能够在保持几何保真度的同时显著减小模型规模。尽管3D形状生成领域取得了显著进展，但大型基于DiT的模型在资源受限环境下仍然面临计算成本高昂的问题。此外，针对其他领域开发的扩散模型压缩策略难以直接迁移到3D生成任务，而现有的3D效率优化方法主要关注推理速度而非骨干网络压缩。为解决这一局限性，我们构建了一个专为图像到形状DiT设计的几何感知压缩框架。基于3D DiT层对几何合成具有非均匀重要性的观察，我们引入了一个活力引导框架，整合了结构化剪枝、自适应量化和针对性微调。我们的方法在最先进的图像到3D模型中实现了高达66%的模型规模压缩，同时保持了与完整模型相当的合成保真度。这凸显了我们框架作为高效3D形状生成即插即用解决方案的潜力，适用于多种模型。

Recent advancements in scaling dataset distillation rely heavily on decoupled information extraction pipelines, comprising SQUEEZE, RECOVER, and RELABEL stages. Despite their scalability to large-scale datasets, these methods suffer from prohibitive computational overhead and poor cross-architecture generalization. In this paper, we reveal the root cause of these bottlenecks: the implicit dual-compression process, from data to model and back to images, inherently induces severe information loss. Crucially, we empirically and theoretically demonstrate that this loss creates a distribution shift that fundamentally compromises the widely adopted RELABEL strategy, transforming the pre-trained model into an unreliable labeler that yields sub-optimal labels. To overcome these critical flaws, we propose CIM, a novel, metric-driven framework that abandons the flawed dual-compression paradigm. Instead, CIM explicitly quantifies and minimizes the information gap between the original and synthetic datasets. By directly aligning the data distributions, our approach ensures high-fidelity information condensation and inherently satisfies the prerequisites for effective relabeling. Extensive experiments demonstrate that CIM establishes a new state-of-the-art. Notably, it distills ImageNet-1K at an IPC=10 in merely 80 minutes on a single RTX-4090 GPU, achieving an unprecedented 48.7% Top-1 accuracy on ResNet-18 and significantly outperforming previous SOTA approaches, such as NRR-DD and DELT, by 2.6% and 2.9%, respectively. Our code is available at https://github.com/LINs-lab/CIM.

近年来，数据集蒸馏的规模化扩展严重依赖于解耦信息提取流水线，该流水线包含SQUEEZE、RECOVER和RELABEL三个阶段。尽管这些方法能够扩展到大规模数据集，但其计算开销巨大且跨架构泛化性能较差。本文揭示了这些瓶颈的根本原因：隐式的双重压缩过程，即从数据到模型再回到图像的压缩，本质上会引入严重的信息损失。关键在于，我们通过实验和理论证明，这种损失造成了分布偏移从根本上破坏了广泛采用的RELABEL策略，使预训练模型变成了不可靠的标注器，从而产生次优的标签。为了克服这些关键缺陷，我们提出了CIM，这是一种新颖的度量驱动框架，摒弃了有缺陷的双重压缩范式。CIM显式地量化和最小化原始数据集与合成数据集之间的信息gap。通过直接对齐数据分布，我们的方法确保了高保真的信息压缩，并内在地满足了有效重标注的前提条件。大量实验表明，CIM建立了新的最先进水平。值得注意的是，它在单张RTX-4090 GPU上仅用80分钟就完成了ImageNet-1K在IPC=10下的蒸馏，在ResNet-18上实现了前所未有的48.7% Top-1准确率，分别比之前的SOTA方法NRR-DD和DELT高出2.6%和2.9%。我们的代码开源于 https://github.com/LINs-lab/CIM。

We present a novel paradigm for ultra-low-bitrate image compression (ULB-IC) that exploits the ``temporal&#x27;&x27; evolution in generative image compression. Specifically, we define an explicit intermediate state during decoding: a compact anchor frame, which preserves the scene geometry and semantic layout while discarding high-frequency details. We then reinterpret generative decoding as a virtual temporal transition from this anchor to the final reconstructed image. To model this progression, we leverage a pretrained video diffusion model (VDM) as a temporal prior: the anchor frame serves as the initial frame and the original image as the target frame, transforming the decoding process into a next-frame prediction task. In contrast to image diffusion-based ULB-IC models, our decoding proceeds from a visible, semantically faithful anchor, which improves both fidelity and realism for perceptual image compression. Extensive experiments demonstrate that our method achieves superior rate-distortion performance. On the CLIC2020 test set, our method achieves over 50% bitrate savings across LPIPS, DISTS, FID, and KID compared to DiffC, while also delivering a significant decoding speedup of up to $\times$5. Code will be released at https://github.com/UnoC-727/NeFIC.

我们提出了一种利用生成图像压缩中"时间"演化的超低码率图像压缩新范式。具体而言，我们定义了解码过程中的一个显式中间状态：紧凑锚帧，该锚帧在丢弃高频细节的同时保留场景几何结构和语义布局。随后，我们将生成式解码重新解释为从该锚帧到最终重建图像的虚拟时间转换。为了建模这一演进过程，我们利用预训练的 video diffusion model（VDM）作为时间先验：锚帧作为初始帧，原始图像作为目标帧，将解码过程转化为下一帧预测任务。与基于图像扩散的超低码率图像压缩模型不同，我们的解码从可见的、语义忠实的锚帧开始，提升了感知图像压缩的保真度和真实感。大量实验表明，我们的方法实现了优越的率失真性能。在 CLIC2020 测试集上，我们的方法在 LPIPS、DISTS、FID 和 KID 指标上相比 DiffC 节省了超过 50% 的码率，同时实现了高达 5 倍的解码速度提升。代码将发布于 https://github.com/UnoC-727/NeFIC。