每日 arXiv 论文简报

Speculative decoding accelerates autoregressive generation by drafting a block of tokens that the target model verifies left-to-right, committing only the longest accepted prefix. Block (DLM-style) drafters predict the whole block in parallel, which is fast but trained with a full-block cross-entropy that supervises every position against the gold continuation -- even though inference discards every token after the first rejection. Recent acceptance-aware objectives patch this by reweighting the full-block loss; we instead use teacher-forced learning as a motivation for how supervision should concentrate on the accepted prefix. A mask-only block drafter has no input-side channel for gold-prefix conditioning, so AUF approximates that prefix-sensitive supervision on the loss side by keeping the cross-entropy support only through the drafter's first predicted failure. AUF is a single, detached change to the CE support -- no auxiliary objective, no verifier rollouts, and no change to the inference pipeline or the exactness contract. Within fixed drafter backbones and serving settings on Qwen3-8B, AUF raises the DFlash drafter&x27;s average emitted length $\tau$, averaged over six benchmarks, from 2.40 to 2.61, with a gain on every benchmark, and transfers to Domino's two-branch head (2.56 to 2.68). Two findings sharpen the picture: the decay-only baseline reaches higher token accuracy on the shared block mask yet decodes worse, and on DFlash, once AUF truncates the support, the standard exponential position-decay weighting becomes empirically inert.

推测解码通过起草一段token来加速自回归生成，目标模型从左到右验证这些token，仅提交最长接受的前缀。块级（DLM风格）起草器并行预测整个块，速度快但使用全块交叉熵进行训练，对每个位置都监督金标准延续——尽管推理会在首次拒绝后丢弃每个token。最近的接受感知目标通过重新加权全块损失来修补这一问题；相反，我们使用教师强制学习作为动机，说明监督应该如何集中在接受的前缀上。纯掩码块起草器没有用于金标准前缀条件的输入端通道，因此AUF通过仅保留从起草器首次预测失败开始的交叉熵支持，在损失侧近似这种前缀敏感监督。AUF是对交叉熵支持的单一、分离修改——无需辅助目标、无需验证器rollout，也无需改变推理管道或精确性契约。在Qwen3-8B上使用固定的起草器骨干网络和服务设置时，AUF将DFlash起草器在六个基准测试上平均发射长度τ从2.40提升至2.61，每个基准测试都有增益，并可迁移到Domino的双分支头（从2.56到2.68）。两个发现使图景更加清晰：仅衰减基线在共享块掩码上达到更高的token准确率，但解码效果更差；而且在DFlash上，一旦AUF截断支持，标准的指数位置衰减加权变得经验上无效。

We present Spanning Tree Autoregressive (STAR) modeling, which can incorporate prior knowledge of images, such as center bias and locality, to maintain sampling performance while also providing sufficiently flexible sequence orders to accommodate image editing at inference time. Approaches that expose conventional autoregressive (AR) models in visual generation to arbitrary sequence orders via random permutation suffer from degraded sampling performance or compromise the flexibility in sequence order choice at inference time. Instead, STAR utilizes traversal orders of uniform spanning trees in a lattice defined by the positions of image patches. Traversal orders are obtained via breadth-first search, allowing us to efficiently construct a spanning tree via rejection sampling whose traversal order ensures that the connected partial observation of the image appears as a prefix for native image inpainting support. Through the tailored yet structured sequence order randomization strategy, STAR preserves the capability of postfix completion while maintaining sampling performance, without any significant changes to the model architecture widely adopted in language AR modeling.

我们提出了生成树自回归（STAR）建模方法，该方法能够融合图像的先验知识（如中心偏置和局部性），从而在维持采样性能的同时，提供足够灵活的序列顺序以支持推理时的图像编辑。现有的方法通过随机排列将传统自回归（AR）模型暴露于任意序列顺序，但这种方法会导致采样性能下降或在推理时牺牲序列顺序选择的灵活性。相反，STAR利用由图像块位置定义的网格上均匀生成树的遍历顺序。遍历顺序通过广度优先搜索获得，使我们能够通过拒绝采样高效构建生成树，其遍历顺序确保图像的部分观测能够作为原生图像修复的前缀呈现。通过这种定制化但结构化的序列顺序随机化策略，STAR在保持后缀补全能力的同时维持了采样性能，而无需对语言AR建模中广泛采用的模型架构进行重大改动。

Visual AutoRegressive modeling (VAR) has pioneered a coarse-to-fine multi-scale autoregressive generative paradigm, demonstrating strong capabilities in image generation. However, VAR still suffers from inherent deficiencies in multi-scale representation learning. Specifically, lower scales primarily capture global semantics, while higher scales focus on fine-grained details. Employing a shared architecture across scales induces optimization conflicts. Moreover, due to the causal autoregressive process, inaccurate semantics at early scales can propagate and significantly degrade the final output. To address these issues, we introduce a scale-aware token-routed Mixture of Experts (MoE) architecture, allowing scale-adaptive expert selection, thereby facilitating decoupled representation learning across scales. In addition, we enhance semantic modeling at early scales by incorporating external self-supervised features. Unlike naive alignment, we analyse and design a residual feature aggregation scheme tailored to the VAR paradigm. Extensive experiments show that our method significantly improves both training efficiency and generation quality. On the ImageNet 256*256 benchmark, our model achieves a superior FID compared to the dense baseline while requiring only half of the default training epochs and a smaller parameter budget, with a merely marginal increase in training cost. Moreover, the performance gap further widens with larger training epochs.

视觉自回归建模（VAR）开创了粗到细的多尺度自回归生成范式，在图像生成方面展现出强大的能力。然而，VAR在多尺度表示学习方面仍存在固有缺陷。具体而言，低尺度主要捕获全局语义，而高尺度聚焦于细粒度细节。在各尺度采用共享架构会导致优化冲突。此外，由于因果自回归过程，早期尺度的语义不准确可能会传播并显著降低最终输出质量。为解决这些问题，我们引入了尺度感知的token路由专家混合（MoE）架构，实现尺度自适应的专家选择，从而促进跨尺度的解耦表示学习。此外，我们通过引入外部自监督特征来增强早期尺度的语义建模。不同于简单的对齐方式，我们分析并设计了一种针对VAR范式量身定制的残差特征聚合方案。大量实验表明，我们的方法显著提升了训练效率和生成质量。在ImageNet 256×256基准上，我们的模型实现了更优的FID分数，同时仅需默认训练轮数的一半和更少的参数预算，且训练成本仅有轻微增加。此外，随着训练轮数的增加，性能差距进一步扩大。

Controllable traffic simulation is critical for testing autonomous driving systems, yet existing approaches often require retraining large generative models with extensive annotated data. We introduce a lightweight control adaptation framework that enables multi-modal controllability (sketch, latent behavior codes, and text) for pretrained state-of-the-art diffusion and autoregressive traffic models. By modulating intermediate features through identity-initialized FiLM layers, our method efficiently adds new control modalities while preserving the base model's generative prior. Evaluated on Waymo Open Sim Agents Challenge, our approach demonstrates strong controllability with less than 1% of the paired control data. Through context-aware condition transfer, our framework enables counterfactual scenario generation and long-tail synthesis while maintaining stable closed-loop driving realism and safety. Our framework unlocks new possibilities for controllable traffic simulation, enabling targeted scenario generation through lightweight adaptation of pretrained generative models. Project page: https://ecosim-web.github.io/

可控交通仿真对于自动驾驶系统的测试至关重要，但现有方法通常需要使用大规模标注数据对大型生成模型进行重新训练。我们引入了一个轻量级控制适配框架，能够对预训练的最先进的扩散模型和自回归交通模型实现多模态可控性（草图、潜在行为编码和文本）。通过使用恒等初始化的FiLM层调制中间特征，我们的方法能够高效地添加新的控制模态，同时保留基础模型的生成先验。在Waymo开放仿真智能体挑战赛上的评估表明，我们的方法仅使用不到1%的配对控制数据即可实现较强的可控性。通过上下文感知条件迁移，我们的框架能够实现反事实场景生成和长尾场景合成，同时保持稳定的闭环驾驶真实感和安全性。我们的框架为可控交通仿真开辟了新的可能性，使通过预训练生成模型的轻量级适配实现目标场景生成成为可能。项目主页：https://ecosim-web.github.io

Mobile manipulation is a key capability for general-purpose robots, yet remains challenging for current embodied learning methods. VLA policies are typically reactive and lack explicit world modeling, while existing World Action Models (WAMs) are still poorly aligned with the structure of mobile manipulation: they operate on coarse video chunks, model entangled navigation-manipulation actions, and train inverse dynamics under supervision that does not match autoregressive inference. As a result, they often miss fine-grained contact dynamics, suffer from action-distribution conflicts, and accumulate errors over long-horizon rollouts. We propose ABot-M0.5, a new WAM built on the insight that mobile manipulation requires alignment at three levels: temporal granularity, action space, and train-test consistency. To align temporal granularity, we introduce intermediate latent actions that capture local visual state transitions and serve as an bridging action space between video latents and embodiment-specific controls. To align action space, we design a dual-level Mixture-of-Transformers architecture that disentangles both modality representations and heterogeneous action subspaces such as base movement and arm manipulation. To align inference conditions, we propose the dream-forcing training strategy that progressively trains inverse dynamics on model-predicted videos, improving train-test alignment and robustness during autoregressive prediction. Experiments on challenging mobile and fine-grained manipulation benchmarks demonstrate that ABot-M0.5 achieves state-of-the-art performance in both long-horizon task success and finegrained control accuracy. These results highlight the critical importance of granularity-aligned, action-disentangled, and inference-consistent world-action modeling.

移动操作是通用机器人的关键能力，但对于当前的具身学习方法来说仍然具有挑战性。视觉语言动作（VLA）策略通常是被动的，缺乏明确的世界建模；而现有的世界动作模型（WAMs）与移动操作的结构仍存在较大偏差：它们在粗粒度的视频块上操作，对导航-操作动作进行联合建模，并在与自回归推理不匹配的监督下训练逆动力学。因此，这些模型常常忽略细粒度接触动力学，遭受动作分布冲突的困扰，并在长时域部署中累积误差。我们提出ABot-M0.5，这是一种新的世界动作模型，基于以下洞察构建：移动操作需要在三个层面进行对齐——时间粒度、动作空间和训练-测试一致性。为对齐时间粒度，我们引入中间潜在动作来捕捉局部视觉状态转换，并作为连接视频潜在空间与具体化控制之间的桥梁动作空间。为对齐动作空间，我们设计了双层Transformer混合（Mixture-of-Transformers）架构，以分离模态表征和异构动作子空间，如底座移动和臂部操作。为对齐推理条件，我们提出梦境强迫（dream-forcing）训练策略，在模型预测的视频上逐步训练逆动力学，从而改善训练-测试一致性并提升自回归预测的鲁棒性。在具有挑战性的移动操作和细粒度操作基准上的实验表明，ABot-M0.5在长时域任务成功率和细粒度控制精度方面均达到了最优性能。这些结果凸显了粒度对齐、动作解耦和推理一致性的世界动作建模的关键重要性。

Autoregressive (AR) streaming models have emerged as a powerful paradigm for long video generation. However, the linearly growing Key-Value (KV) cache poses a significant bottleneck, leading to memory overload and degraded inference throughput. A common compression method is to drop redundant KV tokens, which often breaks long-range dependencies, resulting in temporal flickering and identity loss. In this paper, we propose Instance-Specific Parametric Absorption (ISPA), a novel framework that shifts the KV cache compression from discarding to distilling. The core idea is to transit a subset of layers from Full-Attention (F-Layers) to memory-efficient Local-Attention (L-Layers) by "absorbing" historical context into the model's weights. Specifically, during a brief warmup phase, ISPA monitors the output discrepancy between global and local attention. At the transition point, we solve a closed-form least-squares problem to compute an instance-specific weight modulation that compensates for the missing history. Experiments across architectures (1.3B to 14B) demonstrate that ISPA can remove up to 50\% of the KV cache with near-lossless visual quality. We hope this perspective encourages future work to explore parametric memory consolidation beyond external token-level cache management for streaming generative models.

自回归流式模型已成为长视频生成的强大范式。然而，线性增长的键值缓存带来了显著的瓶颈，导致内存过载和推理吞吐量下降。一种常见的压缩方法是丢弃冗余的键值标记，但这往往会破坏长距离依赖，导致时间闪烁和身份丢失。本文提出实例特定参数吸收(ISPA)，这是一个将键值缓存压缩从丢弃转向蒸馏的新颖框架。其核心思想是通过将历史上下文“吸收”到模型权重中，将部分层从全注意力层转换为内存高效的局部注意力层。具体而言，在短暂的预热阶段，ISPA监测全局注意力和局部注意力之间的输出差异。在转换点，我们求解一个封闭形式的最小二乘问题，以计算实例特定的权重调制，从而补偿缺失的历史信息。在1.3B到14B不同规模的架构上进行的实验表明，ISPA可以移除高达50%的键值缓存，同时保持几乎无损的视觉质量。我们希望这一视角能够鼓励未来工作探索超越外部标记级缓存管理的流式生成模型参数化内存整合。

Driven by Artificial Intelligence-Generated Content (AIGC), the authenticity of audio-visual content is facing severe challenges. Temporal Forgery Localization (TFL) aims to precisely identify manipulated segments within untrimmed sequences. However, existing methods are limited by CNNs' local receptive fields or Transformers&x27; quadratic complexity, while emerging linear models often struggle to balance global authentic context compression with local abrupt forgery perception. To address this, we propose MG-RWKV, a multi-granularity framework that leverages the data-dependent state evolution of RWKV to achieve efficient full-sequence processing with O(T) complexity. Our framework features three core innovations: (1) a Bidirectional RWKV architecture that captures bidirectional temporal contexts without quadratic overhead; (2) a Multi-Granularity Mixture of Experts (MG-MoE) that performs dynamic routing over explicit temporal receptive fields, adaptively selecting granularities based on forgery duration to significantly enhance decision interpretability; and (3) Cross-Granularity Consistency (CGC), which aligns adjacent feature pyramid levels through hierarchical scale-wise pairing and spatial boundary-aware weighting, effectively reducing false positives in authentic regions. Extensive experiments on Lav-DF, TVIL, and Psynd datasets demonstrate that MG-RWKV achieves state-of-the-art performance with low computational cost.

人工智能生成内容（AIGC）的快速发展使音视频内容的真实性面临严峻挑战。时间篡改定位（TFL）旨在精确识别未剪辑序列中的篡改片段。然而，现有方法受限于卷积神经网络的局部感受野或变换器的二次复杂度，而新兴的线性模型往往难以平衡全局真实上下文压缩与局部突发篡改感知。针对这一问题，我们提出了MG-RWKV，这是一种多粒度框架，利用RWKV的数据依赖状态演化实现O(T)复杂度的全序列处理。我们的框架具有三个核心创新点：（1）双向RWKV架构，可在无二次开销的情况下捕获双向时间上下文；（2）多粒度专家混合（MG-MoE），通过对显式时间感受野进行动态路由，根据篡改时长自适应选择粒度，显著增强决策可解释性；（3）跨粒度一致性（CGC），通过层级尺度配对和空间边界感知加权对齐相邻特征金字塔层级，有效降低真实区域的误报率。在Lav-DF、TVIL和Psynd数据集上的大量实验表明，MG-RWKV以较低的计算成本实现了最先进的性能。

Autoregressive video diffusion models hold promise for world simulation but are vulnerable to exposure bias arising from the train-test mismatch. While recent works address this via post-training, they typically rely on a bidirectional teacher model or discriminator. To achieve an end-to-end solution, we introduce Resampling Forcing, a teacher-free framework that enables training autoregressive video models from scratch and at scale. Central to our approach is a self-resampling scheme that simulates inference-time model errors on history frames during training. Conditioned on these degraded histories, a sparse causal mask enforces temporal causality while enabling parallel training with frame-level diffusion loss. To facilitate efficient long-horizon generation, we further introduce history routing, a parameter-free mechanism that dynamically retrieves the top-k most relevant history frames for each query. Experiments demonstrate that our approach achieves performance comparable to distillation-based baselines while exhibiting superior temporal consistency on longer videos owing to native-length training.

自回归视频扩散模型在世界模拟领域具有广阔的应用前景，但容易受到训练-测试不匹配所导致的曝光偏差的影响。尽管现有工作通过后训练方式来解决这一问题，但它们通常依赖于双向教师模型或判别器。为实现端到端解决方案，我们提出了Resampling Forcing，一种无教师的框架，能够从零开始大规模训练自回归视频模型。我们方法的核心是一种自重采样方案，在训练过程中模拟推理时历史帧的模型误差。以这些降质的历史帧为条件，稀疏因果掩码强制执行时间因果性，同时支持基于帧级扩散损失的并行训练。为了促进高效的长时序生成，我们进一步引入了历史路由，这是一种无参数的机制，可动态检索每个查询最相关的top-k个历史帧。实验表明，我们的方法实现了与基于蒸馏的基线相当的性能，同时由于原生长度训练，在更长视频上展现出更优的时间一致性。

Handwritten mathematical expression recognition (HMER) requires reasoning over diverse symbols and structures, yet autoregressive models struggle with exposure bias and syntax inconsistency. We present GryphOne, a discrete diffusion framework which reformulates HMER as iterative symbolic refinement instead of sequential generation. GryphOne progressively refines symbols and relations, removing autoregression and improving consistency. Symbol-aware tokenization and random-masking mutual learning further enhance robustness to handwriting diversity. On the MathWriting benchmark, GryphOne achieves 5.51% CER and 59.9% EM (ExpRate), outperforming all reimplemented models in the matched setting as well as the commercial HMER system. Held-out evaluation on CROHME 2014-2023 further shows strong cross-dataset generalization.

手写数学表达式识别（HMER）需要对多样化的符号和结构进行推理，然而自回归模型在处理曝光偏差和语法不一致方面存在不足。我们提出了GryphOne，这是一个离散扩散框架，将HMER重新表述为迭代符号细化而非序列生成。GryphOne逐步细化符号和关系，消除自回归并提高一致性。符号感知分词和随机掩码互学习进一步增强了对手写多样性的鲁棒性。在MathWriting基准上，GryphOne实现了5.51%的CER和59.9%的EM（ExpRate），在相同设置下优于所有复现模型以及商业HMER系统。在CROHME 2014-2023上的留出评估进一步表明其具有较强的跨数据集泛化能力。

Class-conditional generative models have emerged as accurate and robust classifiers, with diffusion models demonstrating clear advantages over other visual generative paradigms, including autoregressive (AR) models. In this work, we revisit visual AR-based generative classifiers and identify an important limitation of prior approaches: their reliance on a fixed token order, which imposes a restrictive inductive bias for image understanding. We observe that single-order predictions rely more on partial discriminative cues, while averaging over multiple token orders provides a more comprehensive signal. Based on this insight, we leverage recent any-order AR models to estimate order-marginalized predictions, unlocking the high classification potential of AR models. Our approach consistently outperforms diffusion-based classifiers across diverse image classification benchmarks, while being up to 25x more efficient. Compared to state-of-the-art self-supervised discriminative models, our method delivers competitive classification performance - a notable achievement for generative classifiers.

类别条件生成模型已展现出作为精确且鲁棒的分类器的潜力，其中扩散模型相比其他视觉生成范式（包括自回归模型）具有明显优势。在本工作中，我们重新审视了基于视觉自回归的生成式分类器，并指出先前方法的一个重要局限性：它们依赖于固定的 token 顺序，这对图像理解施加了限制性的归纳偏置。我们观察到，单一顺序的预测更依赖部分判别线索，而对多个 token 顺序进行平均则能提供更全面的信号。基于这一洞察，我们利用任意顺序自回归模型来估计顺序边缘化预测，从而释放自回归模型的高分类潜力。我们的方法在各种图像分类基准测试中始终优于基于扩散模型的分类器，同时效率提升高达 25 倍。与最先进的自监督判别模型相比，我们的方法实现了具有竞争力的分类性能——这对于生成式分类器而言是一项显著成就。

Distilling video generation models to extremely low inference budgets (e.g., 2--4 NFEs) is crucial for real-time deployment, yet remains challenging. Trajectory-style consistency distillation often becomes conservative under complex video dynamics, yielding an over-smoothed appearance and weak motion. Distribution matching distillation (DMD) can recover sharp, mode-seeking samples, but its local training signals do not explicitly regularize how denoising updates compose across timesteps, making composed rollouts prone to drift. To overcome this challenge, we propose Self-Consistent Distribution Matching Distillation (SC-DMD), which explicitly regularizes the endpoint-consistent composition of consecutive denoising updates. For real-time autoregressive video generation, we further treat the KV cache as a quality parameterized condition and propose Cache-Distribution-Aware training. This training scheme applies SC-DMD over multi-step rollouts and introduces a cache-conditioned feature alignment objective that steers low-quality outputs toward high-quality references. Across extensive experiments on both non-autoregressive backbones (e.g., Wan~2.1) and autoregressive real-time paradigms (e.g., Self Forcing), our method, dubbed \textbf{Salt}, consistently improves low-NFE video generation quality while remaining compatible with diverse KV-cache memory mechanisms. Project page: https://xingtongge.github.io/Salt

将视频生成模型压缩至极低的推理预算（如2-4次函数评估）对于实时部署至关重要，但仍具挑战性。轨迹式一致性蒸馏在复杂视频动态下往往趋于保守，产生过度平滑的外观和较弱的运动。分布匹配蒸馏（DMD）能够恢复清晰、寻求多模态的样本，但其局部训练信号并未显式正则化去噪更新在跨时间步长时的组合方式，使得组合展开容易产生漂移。为克服这一挑战，我们提出了自一致分布匹配蒸馏（SC-DMD），它显式正则化了连续去噪更新的端点一致组合。针对实时自回归视频生成，我们进一步将键值缓存（KV Cache）作为质量参数化条件，并提出缓存分布感知训练。该训练方案在多步展开上应用SC-DMD，并引入缓存条件特征对齐目标，将低质量输出导向高质量参考。在非自回归主干网络（如Wan 2.1）和自回归实时范式（如Self Forcing）上的广泛实验表明，我们的方法被称为Salt，在保持与多种KV缓存内存机制兼容性的同时，持续提升了低函数评估次数下的视频生成质量。项目主页：https://xingtongge.github.io/Salt

The generation of production-ready quad-dominant meshes is a cornerstone of modern 3D content creation. Generating anisotropic quad-dominant meshes from point clouds is challenging, as existing methods are typically limited to producing either pure triangular meshes or pure quadrilateral meshes with isotropic densities. In this paper, we present QuadLink, a unified framework consisting of three stages for quad-dominant mesh generation by linking points into structured faces. QuadLink formulates polygonal mesh generation as a hybrid centroid-conditioned vertex linking model: it first predicts a unified set of anchors (vertices and face centroids), then learns centroid-conditioned links that associate vertices with face centroids, and finally assembles polygonal faces with a quad-first strategy guided by robust geometric verification strategies. This link-based formulation enables efficient generation of sparse and anisotropic quad-dominant meshes with coherent edge flow and meanwhile supporting hybrid polygonal topology. To construct training data for this model, we further introduce a Tri-to-Quad Operator that converts artistic triangle meshes into quad-dominant training data via global merge selection. Extensive experiments show that QuadLink produces production-ready quad-dominant meshes from point clouds and achieves improved geometric fidelity and topological quality compared to prior baselines. Our method natively supports hybrid polygonal topology, generalizing to arbitrary n-gon meshes without architectural changes.

生成可投入生产的四边形主导网格是现代3D内容创作的基石。从点云生成各向异性四边形主导网格具有挑战性，因为现有方法通常仅限于生成纯三角形网格或具有各向同性密度的纯四边形网格。本文提出了QuadLink，一个由三个阶段组成的统一框架，通过将点链接到结构化面来生成四边形主导网格。QuadLink将多边形网格生成表述为一种混合心条件顶点链接模型：首先预测一组统一的锚点（顶点和面心），然后学习将顶点与面心关联的心条件链接，最后在稳健的几何验证策略指导下使用四边形优先策略组装多边形面。这种基于链接的公式能够高效生成具有连贯边流的稀疏和各向异性四边形主导网格，同时支持混合多边形拓扑。为构建该模型的训练数据，我们进一步引入了Tri-to-Quad算子，通过全局合并选择将艺术三角形网格转换为四边形主导训练数据。大量实验表明，QuadLink能够从点云生成可投入生产的四边形主导网格，并在几何保真度和拓扑质量方面相比先前基线方法有所提升。本方法原生支持混合多边形拓扑，可泛化到任意n边形网格而无需更改架构。

Radio frequency (RF) maps provide a compact representation of multipath propagation characteristics and are fundamental to channel modeling, coverage analysis, and environment-aware wireless optimization. This paper proposes a unified RF map construction framework based on a physics-informed neural network (PINN) and a graph neural network (GNN), supporting both cross-scene generation and in-scene completion with 2D and 2.5D environmental representations. The PINN embeds electromagnetic propagation constraints to establish a physically consistent mapping from receiver locations to multipath parameters, including path gain, time of arrival, and angles, while the GNN enforces spatial consistency by modeling correlations among neighboring receivers. To comprehensively evaluate multipath reconstruction quality, we propose a peak-weighted dynamic time warping metric that jointly accounts for amplitude errors and peak delay misalignment in channel impulse responses. Extensive experiments demonstrate that the proposed method consistently outperforms image-based, diffusion-based, and interpolation baselines across both map-level and multipath-level metrics, achieving robust generalization and high-fidelity RF map construction under sparse observations.

射频（RF）地图提供了多径传播特性的紧凑表示，是信道建模、覆盖分析和环境感知无线优化的基础。本文提出了一种基于物理信息神经网络（PINN）和图神经网络（GNN）的统一RF地图构建框架，支持2D和2.5D环境表示下的跨场景生成和场景内补全。PINN嵌入电磁传播约束，建立从接收机位置到多径参数（包括路径增益、到达时间和角度）的物理一致映射，而GNN则通过建模相邻接收机之间的相关性来强化空间一致性。为全面评估多径重建质量，本文提出了一种峰值加权动态时间规整度量方法，可同时考虑信道脉冲响应中的幅度误差和峰值延迟偏差。大量实验表明，在地图级和多径级指标上，所提方法均一致优于基于图像、基于扩散和插值的基线方法，在稀疏观测条件下实现了鲁棒泛化和高保真RF地图构建。

We study timestep allocation for score-based diffusion sampling, where a learned reverse-time dynamics is discretized on a finite grid. Uniform and hand-crafted schedules are standard choices, but they rely on fixed prescriptions and can therefore be suboptimal. To address this limitation, we propose Adaptive Reparameterized Time (ART), a continuous-time control formulation that learns a time change by treating the speed of the sampling clock as the control, so that a uniform grid on the learned clock induces adaptive timesteps in the original diffusion time. Based on a leading-order Euler error surrogate, ART provides a principled objective for allocating timesteps along the sampling trajectory. To solve this deterministic control problem, we introduce ART-RL, an auxiliary randomized formulation with Gaussian policies that turns schedule learning into a continuous-time reinforcement learning problem. We prove that the randomized ART-RL formulation is equivalent to ART at the optimizer level, in the sense that its optimal Gaussian policy recovers the optimal ART time-warping rate through its mean. We further establish policy evaluation and policy improvement characterizations and derive trajectory-based moment identities that yield implementable actor--critic updates for learning the schedule. Across experiments ranging from controlled low-dimensional settings to image generation, ART-RL can be plugged into existing diffusion samplers by changing only the timestep grid, consistently improving sample quality over strong baseline schedules at matched budgets while leaving the rest of the sampling pipeline unchanged. The learned schedules also exhibit broad generalization, transferring without retraining across sampling budgets, datasets, solvers, pipelines, and representation spaces.

我们研究基于分数的扩散采样中的时间步分配问题，其中学习的逆时间动力学在有限网格上离散化。均匀调度和手工设计的调度是标准选择，但它们依赖于固定方案，因此可能不是最优的。为解决这一局限性，我们提出了自适应重参数化时间（ART），这是一种连续时间控制公式，通过将采样时钟的速度作为控制变量来学习时间变换，使得在学习的时钟上的均匀网格在原始扩散时间中产生自适应时间步。基于主导阶欧拉误差代理，ART为沿采样轨迹分配时间步提供了一个原则性目标。为解决这一确定性控制问题，我们引入了ART-RL，这是一种辅助随机化公式，采用高斯策略将调度学习转化为连续时间强化学习问题。我们证明，随机化的ART-RL公式在优化器层面与ART等价，因为其最优高斯策略通过其均值恢复最优ART时间扭曲率。我们进一步建立了策略评估和策略改进特征，并推导出基于轨迹的矩恒等式，从而实现可执行的演员-批评家更新来学习调度。从受控低维设置到图像生成的实验中，ART-RL只需更改时间步网格即可插入现有的扩散采样器，在匹配预算下始终比强基线调度提高样本质量，同时保持采样流程其余部分不变。学习的调度还表现出广泛的泛化能力，可在无重新训练的情况下跨采样预算、数据集、解算器、流程和表示空间迁移。

Diffusion transformers (DiTs) achieve state-of-the-art image and video generation, but their multi-step sampling and growing parameter count make inference expensive. Post-training quantization (PTQ) is the natural remedy, yet DiT activations shift across timesteps, prompts, and guidance branches, forcing prior methods to re-fit calibration data for every new checkpoint or modality. We present OrbitQuant, a data-agnostic weight-activation quantizer that bypasses range estimation by quantizing in a normalized, rotated basis. In this basis, a randomized permuted block-Hadamard (RPBH) rotation concentrates each coordinate around one fixed, known marginal regardless of the input, so a single Lloyd-Max codebook serves all timesteps, prompts, and layers of a given input dimension. We extend the same quantizer to weight rows offline, absorbing the rotation into the weights so that it cancels inside each linear layer and only a forward rotation on the activations remains at runtime. The same recipe transfers from image to video with no per-modality tuning. Across FLUX.1, Z-Image-Turbo, Wan 2.1, and CogVideoX, it sets the state of the art for PTQ at several low-bit settings. It also pushes PTQ of image diffusion transformers to W2A4 with usable generation quality.

扩散变换器（Diffusion Transformers, DiTs）在图像和视频生成方面实现了最先进的性能，但其多步采样机制和不断增长的参数量使得推理成本高昂。训练后量化（Post-training Quantization, PTQ）是自然的解决方案，然而DiT的激活值在不同时间步、提示词和引导分支之间发生偏移，迫使现有方法对每个新的检查点或模态重新拟合校准数据。我们提出OrbitQuant，一种数据无关的权重-激活量化器，通过在归一化旋转基中进行量化来绕过范围估计。在该基中，随机置换块Hadamard（Randomized Permuted Block-Hadamard, RPBH）旋转将每个坐标聚焦到固定的已知边缘分布上，而与输入无关，因此单个Lloyd-Max码本可以服务于给定输入维度的所有时间步、提示词和层。我们将该量化器离线扩展到权重行，将旋转吸收到权重中，使其在每个线性层内部相互抵消，运行时仅需对激活值进行一次前向旋转。同样的方法无需针对不同模态进行调优即可从图像迁移到视频。在FLUX.1、Z-Image-Turbo、Wan 2.1和CogVideoX上，它在多个低比特设置下实现了PTQ的最先进性能，还将图像扩散变换器的PTQ推进到W2A4（权重2比特、激活4比特）配置，并保持了可用的生成质量。

Multimodal emotion and intent recognition is essential for automated human-computer interaction, It aims to analyze users' speech, text, and visual information to predict their emotions or intent. One of the significant challenges is that missing modalities due to sensor malfunctions or incomplete data. Traditional methods that attempt to reconstruct missing information often suffer from over-coupling and imprecise generation processes, leading to suboptimal outcomes. To address these issues, we introduce an Attention-based Diffusion model for Missing Modalities feature Completion (ADMC). Our framework independently trains feature extraction networks for each modality, preserving their unique characteristics and avoiding over-coupling. The Attention-based Diffusion Network (ADN) generates missing modality features that closely align with authentic multimodal distribution, enhancing performance across all missing-modality scenarios. Moreover, ADN&x27;s cross-modal generation offers improved recognition even in full-modality contexts. Our approach achieves state-of-the-art results on the IEMOCAP and MIntRec benchmarks, demonstrating its effectiveness in both missing and complete modality scenarios.

多模态情感与意图识别对于自动人机交互至关重要，其旨在分析用户的语音、文本和视觉信息以预测其情感或意图。其中一个重要挑战是因传感器故障或数据不完整而导致的模态缺失。传统试图重建缺失信息的方法往往存在过度耦合和生成过程不精确的问题，导致结果不理想。为解决这些问题，我们提出了一种基于注意力的缺失模态特征补全扩散模型（ADMC）。我们的框架为每个模态独立训练特征提取网络，保留其独特特征并避免过度耦合。基于注意力的扩散网络（ADN）生成的缺失模态特征与真实多模态分布高度一致，增强了所有缺失模态场景下的性能。此外，ADN的跨模态生成即使在完整模态场景下也能提供更好的识别效果。我们的方法在IEMOCAP和MIntRec基准数据集上取得了最先进的结果，证明了其在缺失模态和完整模态场景中的有效性。

Real-world deployment of text-to-image diffusion models requires continual concept removal as new privacy, copyright, or safety obligations arise over time. Existing unlearning methods, however, are designed for single-step deletion and collapse after only 3-5 sequential applications. We trace this instability to two compounding factors: (i) coarse mapping targets that cause degradation to accumulate unnecessarily across steps, and (ii) the absence of local protection for semantically neighboring concepts, whose shared internal representations make them the first to suffer collateral damage. Because this damage is strongest in the local semantic neighborhood of the forget concept, global replay alone cannot prevent it. Building on this analysis, we propose Locality-Aware Continual Unlearning (LACU), a framework with two complementary mechanisms. Locality-Aware Target Selection chooses, for each forget prompt, the context-preserving mapping prompt that the diffusion model itself treats as most similar to the original prompt, measured by score-prediction distance (how differently the model denoises the same noisy image under two text conditions), ensuring each update is as small and targeted as possible. Locality-Aware Replay uses the same metric to identify the retain concepts closest to the forget concept in the model's own representation and replays them as a local functional regularizer, directly shielding the most vulnerable neighborhood. Combined with teacher-student distillation and lightweight $\ell_2$ parameter regularization, LACU maintains stable unlearning over 10 sequential steps, preserving significantly higher related retention ($RR_{\text{acc}}$) and general retention ($GR_{\text{acc}}$) than recent baselines.

现实世界中部署文生图扩散模型需要持续移除概念，以应对随时间推移出现的新隐私、版权或安全合规要求。然而，现有的反学习方法专为单步删除设计，在仅3-5次顺序应用后就会失效。我们将这种不稳定性追溯为两个累积因素：(i) 粗粒度映射目标导致退化在不必要的步骤间累积；(ii) 缺乏对语义邻近概念的保护，这些概念因共享内部表示而最先受到附带损伤。由于这种损伤在遗忘概念的局部语义邻域最为严重，仅靠全局回放无法防止。基于这一分析，我们提出局部感知持续反学习方法（LACU），该框架包含两个互补机制。局部感知目标选择为每个遗忘提示选择上下文保持的映射提示，该提示是扩散模型本身认为与原始提示最相似的，通过分数预测距离（模型在同一噪声图像在两种文本条件下去噪方式的差异）来衡量，确保每次更新尽可能小且精准。局部感知回放使用同一指标识别模型自身表示中与遗忘概念最接近的保留概念，并将其作为局部功能正则化器回放，直接保护最脆弱的邻域。结合师生蒸馏和轻量级ℓ2参数正则化，LACU在10个连续步骤中保持稳定的反学习性能，在相关保留率（RR_acc）和一般保留率（GR_acc）方面显著优于现有基线方法。

Audio editing aims to modify specific content in an existing audio clip according to a natural language instruction while preserving the remaining acoustic content. Despite the remarkable progress of diffusion models, existing training-based editing methods mainly rely on the local inductive biases and cross-attention interaction in convolutional U-Net backbones, which often hinder long-range semantic alignment and precise understanding and localization of instructions. In contrast, diffusion transformers provide stronger global modeling and multimodal fusion, but existing editing architectures usually adopt a simple stack of MMDiT and DiT blocks. Applying joint attention over concatenated audio and text tokens in all blocks results in quadratic complexity with respect to token length. To balance editing performance and efficiency, we propose a hybrid two-stage diffusion transformer architecture for instruction-guided audio editing based on rectified flow matching. It performs joint attention over audio and text tokens to establish coarse semantic alignment at low-resolution stage, then switches to alternating joint-attention and cross-attention blocks to refine editing details at high-resolution stage. This coarse-to-fine strategy enables efficient and accurate instruction-guided audio editing. Experiments show that the proposed framework achieves notable performance gains on challenging editing tasks involving overlapping audio events and complex instructions, while substantially improving editing efficiency with a compact model.

音频编辑旨在根据自然语言指令修改现有音频片段中的特定内容，同时保留其余声学内容。尽管扩散模型取得了显著进展，但现有基于训练的编辑方法主要依赖于卷积U-Net骨干网络中的局部归纳偏置和交叉注意力交互，这往往阻碍了长距离语义对齐以及对指令的精确理解和定位。相比之下，扩散Transformer提供了更强的全局建模和多模态融合能力，但现有编辑架构通常采用MMDiT和DiT块的简单堆叠。在所有块中对连接的音频和文本token应用联合注意力会导致关于token长度的二次复杂度。为了平衡编辑性能和效率，我们提出了一种基于整流流匹配的混合两阶段扩散Transformer架构，用于指令引导的音频编辑。它在低分辨率阶段对音频和文本token执行联合注意力以建立粗粒度语义对齐，然后切换到交替的联合注意力块和交叉注意力块以在高分辨率阶段细化编辑细节。这种粗到细的策略能够实现高效且准确的指令引导音频编辑。实验表明，我们提出的框架在涉及重叠音频事件和复杂指令的挑战性编辑任务中取得了显著的性能提升，同时通过紧凑的模型显著提高了编辑效率。

Sparse autoencoders (SAEs) have recently been proposed as interpretable tools for concept-level manipulation, under the assumption that isolated features can serve as controllable intervention points. In this work, we systematically evaluate this assumption in the context of object erasure and steering in diffusion models. We show that while SAEs reliably detect and localize semantic concepts within diffusion model activations, direct intervention in their latent space frequently induces out-of-distribution activations, resulting in severe visual artifacts. To disentangle detection from intervention, we use SAE activations purely as semantic detectors to identify image regions containing the target object, and replace those patch embeddings with the ones that do not contain it. This detection-based replacement preserves the diffusion model's activation statistics and produces significantly cleaner erasure results than latent steering. Our findings reveal a fundamental gap between concept detection and concept intervention in diffusion models: monosemantic or sparse features are not inherently suitable as control knobs for steering. These results position SAEs as powerful interpretability tools for analyzing generative models, but highlight important limitations when used for direct manipulation, such as unlearning.

稀疏自编码器（SAEs）近期被提出作为可解释性工具，用于概念层面的操控，其假设是分离的特征可用作可控的干预点。本工作系统地评估了这一假设在扩散模型中对象擦除和引导任务中的适用性。研究表明，尽管SAEs能够可靠地检测和定位扩散模型激活中的语义概念，但其潜在空间中的直接干预频繁诱导分布外激活，导致严重的视觉伪影。为将检测与干预解耦，我们仅将SAE激活作为语义检测器，用于识别包含目标对象的图像区域，并用不包含该对象的补丁嵌入替换这些区域。这种基于检测的替换方式保留了扩散模型的激活统计特性，比潜在空间引导产生了明显更干净的擦除结果。我们的发现揭示了扩散模型中概念检测与概念干预之间的根本差距：单语义性或稀疏特征并不天然适合作为引导的控制旋钮。这些结果将SAEs定位为分析生成模型强大的可解释性工具，但同时也凸显了将其用于直接操控（如反学习）时的重大局限。

Foundation video diffusion models are increasingly viewed as world simulators for embodied agents, yet their pretraining on internet-scale generic video leaves them poorly aligned with real-world deployment domains. We study parameter-efficient adaptation of a pretrained foundation video world model to retail scenes: when synchronized egocentric and exocentric video of the same activity are available, which viewpoint of training data produces the strongest adapted model? We introduce RetailSMV (Retail Synchronized Multi-View), a corpus of 32,105 captioned retail clips from five supermarkets with synchronized ego/exo capture from the store-staff perspective (stocking, arranging, weighing, managing supply carts, scanning at checkout), rather than the customer-centric framing of prior retail video corpora, and train three matched Low-Rank Adaptation (LoRA) configurations of Cosmos3-Nano (egocentric-only, exocentric-only, combined) under identical hyperparameters. On a 200-clip held-out test set evaluated with seven complementary metrics under a strict paired statistical protocol, exocentric-only adaptation matches or exceeds combined adaptation on six of seven point estimates and is significantly better on LPIPS, PSNR, and DreamSim, despite training on only 15,985 exocentric clips (versus 32,105 for combined). A symmetric paired comparison further shows that adding exocentric data to egocentric-only training helps while adding egocentric data to exocentric-only training hurts. The absolute adaptation gap is largest at the shortest rollout time, identifying the near-horizon prediction window as the regime in which adaptation is most beneficial.

基础视频扩散模型日益被视为具身智能体的世界模拟器，但其预训练所使用的是互联网规模的通用视频，与真实部署场景的契合度较差。本文研究预训练基础视频世界模型向零售场景的参数高效适配问题：当同一活动的同步自我中心视角和离体视角视频均可获取时，哪种视角的训练数据能够产生最强适配模型？ 我们构建了RetailSMV（零售同步多视角）数据集，包含来自五家超市的32,105个带标注的零售片段，采用店员视角的同步自我/离体视角捕获（涵盖补货、摆放、称重、管理补货车、收银扫描等任务），区别于以往以顾客为中心的零售视频数据集。我们在相同超参数下训练了三个Cosmos3-Nano的低秩适配（LoRA）配置（仅自我中心视角、仅离体视角、两者结合）。在200个片段的保留测试集上，采用严格的配对统计协议和七个互补指标进行评估，结果显示：尽管仅使用15,985个离体视角片段进行训练（远少于结合方式的32,105个），但仅离体视角适配在七个点估计中有六个达到或超过结合方式，且在LPIPS、PSNR和DreamSim指标上显著更优。进一步的对称配对比较表明，向仅自我中心视角训练添加离体数据有所助益，而向仅离体视角训练添加自我中心数据反而产生损害。绝对适配差距在最短 rollout 时间内最大，表明近期预测窗口是适配收益最显著的区间。

Colored sectors in a microbial range expansion encode more than lineage survival counts. We formulate a computer-vision inverse problem: from one endpoint image of an accretive multi-type expansion, recover the radius-indexed pairwise boundary-flow field and test whether the visual pattern is compatible with a transitive scalar fitness hierarchy. The observable is a geometric signal extracted from sector-boundary curves in log-polar coordinates. We prove endpoint observability and stability for frozen fronts, weighted transitive/cyclic decomposition, contact-complete circular design, physical-clock and mechanism non-identifiability, exact Gaussian cyclicity testing, and Bonferroni-valid interval scanning. The benchmark is deterministic: analytic endpoint images, blurred/noisy pixel round trips, scalar-null stress tests, public-image tracing, multi-resolution mechanistic endpoints, and a non-learning frozen-front simulator. The implementation recovers pairwise edge-flow histories from endpoint images, detects cyclic residuals in a mechanistic four-type expansion, and uses those residuals as forcing signals for a dimensionless active design-control layer covering reaction-diffusion control, phenotype-frontier optimization, protocol synthesis, Monte Carlo robustness, and a downstream population-state bridge.

微生物范围扩张中的彩色扇区编码的信息远超谱系存活计数。我们提出一个计算机视觉逆问题：从一幅累积多类型扩张的端点图像，恢复径向索引的成对边界流场，并检验该视觉模式是否与传递性标量适应度层次结构相容。可观测几何信号是从对数极坐标中扇区边界曲线提取的。我们证明了冻结前缘的端点可观测性和稳定性、加权传递/循环分解、接触完全圆形设计、物理时钟和机制不可辨识性、精确高斯循环性检验以及Bonferroni有效区间扫描。基准测试是确定性的：解析端点图像、模糊/噪声像素往返、标量零应力测试、公共图像追踪、多分辨率机制端点以及无学习冻结前缘模拟器。该实现从端点图像恢复成对边缘流历史，检测机制四类型扩张中的循环残差，并利用这些残差作为无量纲主动设计控制层的强迫信号，覆盖反应-扩散控制、表型-前沿优化、协议合成、蒙特卡罗鲁棒性以及下游种群状态桥接。

We propose the first compression approach for image-to-shape Diffusion Transformers (DiTs) that substantially reduces model size while preserving geometric fidelity. Despite remarkable progress in 3D shape generation, large DiT-based models remain computationally prohibitive in resource-constrained settings. Furthermore, it is difficult to directly transfer existing diffusion model compression strategies developed for different domains to 3D generation, and prior 3D efficiency approaches focus primarily on inference speed rather than backbone compression. To address this limitation, we build a geometry-aware compression framework tailored to image-to-shape DiTs. Guided by the observation that 3D DiT layers exhibit non-uniform importance for geometry synthesis, we introduce a vitality-guided framework integrating structured pruning, adaptive quantization, and targeted fine-tuning. Our method achieves up to 66% model-size reduction across state-of-the-art image-to-3D models while maintaining synthesis fidelity comparable to full-sized counterparts. This highlights the potential of our framework as a plug-and-play solution for efficient 3D shape generation across diverse models.

我们提出了第一种针对图像到形状扩散变换器（DiTs）的压缩方法，该方法在保持几何保真度的同时大幅缩减模型尺寸。尽管3D形状生成取得了显著进展，但在资源受限的环境中，大型基于DiT的模型仍然计算成本高昂。此外，将其他领域开发的现有扩散模型压缩策略直接转移到3D生成领域存在困难，而现有的3D效率方法主要关注推理速度而非骨干网络压缩。为解决这一限制，我们构建了一个针对图像到形状DiT定制的几何感知压缩框架。基于3D DiT层对几何合成具有非均匀重要性这一观察，我们引入了一种活力感知框架，整合了结构化剪枝、自适应量化和针对性微调。我们的方法在最先进的图像到3D模型中实现了高达66%的模型尺寸缩减，同时保持与完整模型相当的合成保真度。这凸显了我们框架作为适用于多种模型的高效3D形状生成即插即用解决方案的潜力。

Safety alignment of text-to-image (T2I) diffusion models aims to suppress harmful generations while preserving utility on benign prompts. Recent methods often appear to deliver high safety with high utility, but this conclusion rests largely on coarse global utility metrics (e.g., FID, CLIPScore) that are insensitive to fine-grained semantic correctness, creating an illusion of high utility. We show that when utility is measured with structured evaluation, this illusion breaks: on TIFA (Text-to-Image Faithfulness evaluation with Question Answering), safety-aligned models suffer substantial drops in semantic fidelity, including failures in object counts, attributes, and relationships. To diagnose the source of this gap, we analyze the text-encoder prompt embedding space and uncover semantic collapse, a contraction of embedding spread coupled with distortion of inter-prompt similarity structure, which strongly correlates with structured utility loss. Guided by this insight, we propose StructureAware Geometric Regularization (SAGE), a safety alignment objective that explicitly preserves embedding spread and inter-prompt relational structure during adaptation. Our method restores structured utility (TIFA +5.0% over prior state-of-the-art) while maintaining strong safety performance and competitive coarse-grained utility scores. Our source code and trained models are available at https://adeelyousaf.github.io/SAGE_ECCV26_Project_Page/.

文本到图像（T2I）扩散模型的安全对齐旨在抑制有害生成，同时保留良性提示的效用。当前方法通常呈现出高安全性与高效用并存的表象，但这一结论主要基于粗粒度的全局效用指标（如FID、CLIPScore），这些指标对细粒度语义正确性不敏感，从而制造了高效用的幻象。我们表明，当使用结构化评估来衡量效用时，这种幻象便会被打破：在TIFA（基于问答的文本到图像忠实度评估）上，安全对齐后的模型在语义保真度方面出现了显著下降，包括物体数量、属性和关系方面的失败。为了诊断这一差距的根源，我们分析了文本编码器的提示嵌入空间，并发现了语义崩溃现象——嵌入分布的收缩加上提示间相似性结构的扭曲，这与结构化效用的损失高度相关。基于这一洞察，我们提出了结构感知几何正则化（SAGE），这是一种在微调过程中明确保留嵌入分布和提示间关系结构的安全对齐目标。我们的方法恢复了结构化效用（在TIFA上比之前的最新方法提升5.0%），同时保持了强大的安全性并具有竞争力的粗粒度效用分数。我们的源代码和训练好的模型可在https://adeelyousaf.github.io/SAGE_ECCV26_Project_Page/获取。

Recent brain decoding studies have made substantial progress in reconstructing externally perceived visual content from neural signals. However, using electroencephalography (EEG) recordings to guide facial expression editing remains largely unexplored and poses a distinct challenge: rather than recovering what a subject sees, it requires identifying facial-action related patterns from noisy EEG signals and grounding them in localized, identity-preserving expression edits. In this paper, we investigate EEG-conditioned facial image editing for fine-grained facial action unit (AU) control and propose MindAU, a unified framework for controlling facial AU edits from EEG signals. MindAU first learns noise-robust and AU-discriminative EEG representations through temporal masked reconstruction and AU classification supervision. It then bridges the modality gap via Dual-Stream Manifold Alignment, aligning EEG features with AU-level text semantics and identity-reduced visual displacement trajectories in the multimodal space of Qwen2.5-VL. Finally, MindAU incorporates EEG-aware Multimodal Rotary Positional Embeddings, landmark-guided reference masking, and AU-aware region supervision into a multimodal diffusion-based editor for high-fidelity identity-preserving editing. We also introduce E-CAFE, a curated benchmark for EEG-Conditioned Action-Unit Facial Editing with paired EEG-face editing samples and standardized evaluation protocols. Extensive experiments demonstrate the effectiveness of MindAU and suggest its potential as a step towards future assistive expression technologies for individuals with facial neuromuscular disorders.

近年来的脑解码研究在从神经信号重建外部感知视觉内容方面取得了实质性进展。然而，利用脑电图（EEG）记录来引导面部表情编辑仍基本未被探索，且面临独特挑战：不同于恢复受试者所看到的视觉内容，该任务需要从噪声EEG信号中识别面部动作相关模式，并将其锚定在局部化、保持身份一致的表情编辑中。本文研究用于精细化面部动作单元（AU）控制的EEG条件面部图像编辑，并提出MindAU，一个从EEG信号控制面部AU编辑的统一框架。MindAU首先通过时间掩码重建和AU分类监督学习噪声鲁棒且AU判别的EEG表示。随后通过双流流形对齐桥接模态间隙，将EEG特征与AU级文本语义以及Qwen2.5-VL多模态空间中身份归一化的视觉位移轨迹进行对齐。最终，MindAU将EEG感知的多模态旋转位置嵌入、地标引导的参考掩码和AU感知区域监督整合到基于多模态扩散的编辑器中，实现高保真保持身份的编辑。我们还提出E-CAFE，一个用于EEG条件动作单元面部编辑的精选基准数据集，包含配对的EEG-面部编辑样本及标准化评估协议。大量实验验证了MindAU的有效性，并表明其在助力面部神经肌肉障碍患者的辅助表情技术方面具有潜在应用价值。

CLIP (Contrastive Language-Image Pre-training) has become a de facto paradigm for image-text alignment, but it struggles with long-context descriptions (>77 tokens) due to absolute positional encoding and pretraining on short captions. In long contexts, sentences are often reordered, summarized, or partially omitted. Although prior works extend CLIP with longer positional encodings, they often suffer from degraded image-text alignment under such text perturbations. We attribute this limitation to the Euclidean contrastive objective, which enforces strict one-to-one matching and lacks explicit mechanisms for modeling hierarchical relationships between global context and its constituent elements. To address this issue, we propose HyFL-CLIP, a hyperbolic fine-tuning framework that distills the well-established text-image alignment learned in Euclidean CLIP into hyperbolic space via cross-manifold similarity distillation, leveraging its geometry to capture hierarchical and entailment relations. Our method models hierarchical semantics by linking summarized token-wise features, long-context descriptions, constituent short textual components, and images, capturing part-whole relationships via hyperbolic entailment with Einstein midpoint aggregation. Experiments on diverse benchmarks, including long-context cross-modal retrieval, cross-modal retrieval with caption perturbations, intra-modality retrieval, and short-text cross-modal retrieval, show that HyFL-CLIP achieves more robust long-context understanding. In particular, it yields up to 19.5% improvement in long-text cross-modal retrieval under textual perturbations over the best prior method. We also show HyFL-CLIP can be seamlessly integrated into other model frameworks by applying it to Stable Diffusion XL (SDXL).

CLIP（对比语言-图像预训练）已成为图像-文本对齐的事实范式，但由于绝对位置编码和基于短caption的预训练，其在处理长上下文描述（>77个token）时存在困难。在长上下文中，句子常被重新排序、总结或部分省略。尽管先前研究通过扩展更长的位置编码来改进CLIP，但在这种文本扰动下，图像-文本对齐性能往往下降。我们将这一局限性归因于欧几里得对比目标，该目标强制严格的一对一匹配，且缺乏显式机制来建模全局上下文与其组成元素之间的层级关系。为解决此问题，我们提出了HyFL-CLIP——一种双曲空间微调框架，通过跨流形相似性蒸馏将欧几里得CLIP中已建立的良好文本-图像对齐知识蒸馏到双曲空间，利用其几何性质来捕获层级和蕴含关系。我们的方法通过链接总结的token级特征、长上下文描述、组成短文本组件和图像来建模层级语义，并通过爱因斯坦中点聚合的双曲蕴含来捕获部分-整体关系。在多种基准数据集上进行的实验，包括长上下文跨模态检索、带caption扰动的跨模态检索、模态内检索和短文本跨模态检索，表明HyFL-CLIP实现了更鲁棒的长上下文理解。特别是在文本扰动下，其在长文本跨模态检索中相较于最佳先前方法实现了高达19.5%的性能提升。我们还展示了HyFL-CLIP可无缝集成到其他模型框架中，通过将其应用于Stable Diffusion XL（SDXL）。

Controllable traffic simulation is critical for testing autonomous driving systems, yet existing approaches often require retraining large generative models with extensive annotated data. We introduce a lightweight control adaptation framework that enables multi-modal controllability (sketch, latent behavior codes, and text) for pretrained state-of-the-art diffusion and autoregressive traffic models. By modulating intermediate features through identity-initialized FiLM layers, our method efficiently adds new control modalities while preserving the base model's generative prior. Evaluated on Waymo Open Sim Agents Challenge, our approach demonstrates strong controllability with less than 1% of the paired control data. Through context-aware condition transfer, our framework enables counterfactual scenario generation and long-tail synthesis while maintaining stable closed-loop driving realism and safety. Our framework unlocks new possibilities for controllable traffic simulation, enabling targeted scenario generation through lightweight adaptation of pretrained generative models. Project page: https://ecosim-web.github.io/

可控交通仿真对于自动驾驶系统的测试至关重要，但现有方法通常需要使用大规模标注数据对大型生成模型进行重新训练。我们引入了一个轻量级控制适配框架，能够对预训练的最先进的扩散模型和自回归交通模型实现多模态可控性（草图、潜在行为编码和文本）。通过使用恒等初始化的FiLM层调制中间特征，我们的方法能够高效地添加新的控制模态，同时保留基础模型的生成先验。在Waymo开放仿真智能体挑战赛上的评估表明，我们的方法仅使用不到1%的配对控制数据即可实现较强的可控性。通过上下文感知条件迁移，我们的框架能够实现反事实场景生成和长尾场景合成，同时保持稳定的闭环驾驶真实感和安全性。我们的框架为可控交通仿真开辟了新的可能性，使通过预训练生成模型的轻量级适配实现目标场景生成成为可能。项目主页：https://ecosim-web.github.io

Diffusion MRI probes brain microstructure with particular sensitivity to early cerebrovascular and neurodegenerative changes. Neurite Orientation Dispersion and Density Imaging (NODDI) decomposes the diffusion signal into three biophysically interpretable maps: neurite density index (NDI), orientation dispersion index (ODI), and free water fraction (FWF), capturing neurite packing, fiber coherence, and extracellular fluid. These 3D maps offer a rich substrate for transferable microstructural representations, yet integrating them is challenging: standard representation learning struggles to disentangle the unique information in each map from their shared and synergistic interactions. We present BrainFIBRE, the first foundation model for brain microstructure, pretrained on NODDI-derived maps from 55,592 UK Biobank participants. We propose Self-supervised Partial Information Decomposition (SPID), which extends PID-guided multimodal learning to the self-supervised regime for the first time. A novel Counterfactual Candidate Construction (CCC) paradigm perturbs inter-modality alignment through modality dropping and swapping, providing the contrastive signal for a Mixture-of-Experts architecture to disentangle unique, synergistic, and redundant information without any downstream label. On both Caucasian and Asian cohorts, BrainFIBRE achieves state-of-the-art performance across diverse tasks predicting age, sex, cerebrovascular and neurodegenerative markers, and cognition, while yielding neurobiologically interpretable representations that reveal task- and cohort-specific interaction patterns. BrainFIBRE establishes a versatile foundation for neuroimaging analysis at the microstructural level.

扩散磁共振成像对脑微观结构具有特殊敏感性，能够检测早期脑血管和神经退行性变化。神经突取向分散度和密度成像（NODDI）将扩散信号分解为三个生物物理学可解释的图谱：神经突密度指数（NDI）、取向分散指数（ODI）和自由水分数（FWF），分别捕捉神经突密度、纤维连贯性和细胞外液。这些三维图谱为可迁移的微观结构表征提供了丰富的基质，但将其整合具有挑战性：标准表征学习难以将每张图谱中的独特信息从其共享和协同的相互作用中解耦出来。我们提出了BrainFIBRE，这是首个脑微观结构基础模型，在来自55,592名英国生物银行参与者的NODDI衍生图谱上进行预训练。我们提出了自监督部分信息分解（SPID），首次将部分信息分解引导的多模态学习扩展到自监督范式。一种新颖的反事实候选构建（CCC）范式通过模态丢弃和交换来扰动模态间对齐，为专家混合架构提供对比信号，从而无需任何下游标签即可解耦独特、协同和冗余信息。在高加索和亚洲两个队列中，BrainFIBRE在预测年龄、性别、脑血管和神经退行性标志物以及认知等多样化任务中均实现了最先进的性能，同时产生神经生物学可解释的表征，揭示了任务和队列特异性的相互作用模式。BrainFIBRE为微观层面的神经影像分析建立了一个多功能的通用基础模型。

Reconstruction-based generative models offer a natural framework for unsupervised out-of-distribution (OOD) detection, but multi-class normality modelling requires a single detector to capture multiple in-distribution manifolds and produce comparable anomaly scores across classes. We study this problem in copy detection pattern (CDP) authentication, where authentic and counterfeit samples are visually similar but differ in subtle printing-and-digitisation (P\&D) signatures. We propose a diffusion based multi-class normality framework in which a single class-conditional ControlNet is trained exclusively on authentic CDPs from multiple P\&D classes and detects counterfeits through reconstruction error under authentic-class conditioning. We further introduce dual template masking, which hides complementary regions of the input template and scores only withheld pixels, reducing reliance on visible binary structure. On the Indigo 1 x 1 Base dataset, the proposed method outperforms traditional and adapted generative baselines under multi-class authentic-versus-counterfeit evaluation, without using counterfeit samples for training or threshold calibration.

基于重建的生成模型为无监督分布外（OOD）检测提供了自然的框架，但多类正态性建模需要单个检测器捕获多个类内流形并在各类别间产生可比较的异常分数。我们在复制检测模式（CDP）认证中研究这一问题，其中真实样本与伪造样本视觉上相似，但在细微的印刷和数字化（P&D）签名上存在差异。我们提出了一种基于扩散的多类正态性框架，其中单个类别条件ControlNet仅在来自多个P&D类别的真实CDP上进行训练，并通过真实类条件下的重建误差来检测伪造样本。我们进一步引入双模板掩码技术，隐藏输入模板的互补区域并仅对保留像素进行评分，从而降低对可见二进制结构的依赖。在Indigo 1×1 Base数据集上，所提方法在多类真实样本与伪造样本评估中优于传统和适配的生成基线，且未使用伪造样本进行训练或阈值校准。

Training-free guidance (TFG) steers a pretrained diffusion model toward a desired attribute at inference. To be effective, this guidance must be applied from the earliest, high-noise steps of sampling. Because its objective (a classifier or energy) is defined on clean images, $\epsilon$- and $v$-prediction models must first estimate the clean image $\hat{x}$ from the noisy state at each step, and the accuracy of that estimate determines how easily guidance drifts off the data manifold. $x$-prediction, a recent alternative, outputs the clean image directly, removing this source of error even at high noise. This is our motivation. We provide a theoretical analysis of how each prediction target shapes this accuracy, and introduce guided-class FID (Child FID), a metric that exposes the manifold damage standard evaluation misses. Experiments on a new fine-grained bird benchmark and on style transfer confirm that $x$-prediction keeps guided samples on the manifold most reliably, making it the strongest foundation for training-free guidance. Code is available at https://github.com/ManLuML/on-manifold-tfg

无训练引导（TFG）在推理阶段将预训练扩散模型导向期望属性。为使其有效，该引导必须从采样最早的高噪声步骤开始。由于其目标（分类器或能量函数）定义在干净图像上，ε预测模型和v预测模型必须首先从每一步的噪声状态估计干净图像x̂，而该估计的准确度决定了引导偏离数据流形的容易程度。x预测作为最近的替代方案，直接输出干净图像，即使在高噪声下也消除了这一误差来源。这是我们的动机。我们提供了理论分析，说明每种预测目标如何影响这种准确度，并引入引导类别FID（Child FID）这一指标，该指标能够揭示标准评估所遗漏的流形损伤。在新的细粒度鸟类基准测试和风格迁移上的实验证实，x预测最能保持引导样本在流形上，使其成为无训练引导的最强基础。代码可访问https://github.com/ManLuML/on-manifold-tfg。

Text-to-image personalization aims to generate a user-provided subject in novel scenes described by text. However, most existing methods encode subject identity (fidelity) and context (editability) through the same conditioning pathway, forcing the two to compete for attention-map resources. We refer to this phenomenon as conditioning entanglement and show that it induces a fidelity-editability trade-off. We further provide causal evidence by replacing the target subject token with a generic subject token, which produces shifts in attention allocation and corresponding changes in context adherence. To this end, we propose Decoupled Guidance (DeGu), a plug-and-play framework that routes subject identity and scene context through two independent guidance streams. We further introduce a spatial mixing mechanism that dynamically fuses these streams, ensuring each operates within its semantically relevant region without interference. Furthermore, DeGu can be readily applied to existing personalization methods without modifying the underlying backbone models, consistently improving the overall personalization performance while enabling inference-time control over the fidelity-editability balance, across diverse methods and backbones, including flow-matching Diffusion Transformers (DiTs).

文本到图像个性化旨在生成用户提供的图像主体在新场景中的呈现，该场景由文本描述。然而，大多数现有方法通过相同的信息传递路径编码主体身份（保真度）和上下文（可编辑性），迫使两者竞争注意力图资源。我们将这种现象称为条件纠缠，并证明它导致了保真度-可编辑性之间的权衡。我们进一步通过将目标主体标记替换为通用主体标记来提供因果证据，这导致了注意力分配的转移和相应的上下文遵循变化。为此，我们提出了解耦引导（Decoupled Guidance，DeGu），这是一个即插即用的框架，将主体身份和场景上下文通过两个独立的引导流进行路由。我们进一步引入了一种空间混合机制，动态融合这些流，确保每个流在其语义相关区域内无干扰地运行。此外，DeGu可以轻松应用于现有的个性化方法，无需修改底层骨干模型，在包括流匹配扩散变换器（flow-matching DiTs）在内的多种方法和骨干网络中，持续提升整体个性化性能，同时实现推理时对保真度-可编辑性平衡的控制。

Text-to-image diffusion models achieve impressive visual quality, yet demographic bias remains a challenge, as neutral prompts consistently produce stereotypical representations across gender and race. Existing approaches remain limited by costly retraining or by inference-time interventions that often degrade image quality and semantic alignment. We propose Text Embedding Steering (TES), a training-free framework that mitigates demographic bias by directly optimizing conditional text embeddings during the diffusion process. We show that a two-stage strategy - early-stage global alignment followed by iterative denoising-time refinement with CLIP-based feedback - enables stable and controllable attribute steering without modifying model parameters. Extensive experiments on Stable Diffusion demonstrate that TES outperforms existing training-free baselines in fairness while maintaining competitive image quality. These results highlight that inference-time text embedding optimization is a practical and scalable solution for fairness-aware generation in diffusion models.

文生图扩散模型虽已取得出色的视觉质量，但人口统计偏见仍是一个严峻挑战，因为中性提示词在性别和种族方面持续产生刻板印象表征。现有方法仍受限于高成本的模型重训练或推理时干预，而这些干预往往会降低图像质量和语义对齐程度。我们提出文本嵌入导向（Text Embedding Steering, TES）框架，这是一种无需训练的去偏方法，通过在扩散过程中直接优化条件文本嵌入来减轻人口统计偏见。研究表明，两阶段策略——早期全局对齐 followed by 基于CLIP反馈的迭代去噪时细化——可实现稳定可控的属性导向，且无需修改模型参数。在Stable Diffusion上的大量实验表明，TES在保持竞争力的图像质量的同时，在公平性方面优于现有的无需训练基线方法。这些结果表明，推理时文本嵌入优化是扩散模型中公平感知生成的一种实用且可扩展的解决方案。

A single panorama captures the full visual sphere from one camera center, yet confines users to looking around in place without enabling true scene exploration. Converting a single panorama into a persistent, renderable 3D representation for free-viewpoint navigation has attracted growing interest; existing methods either adopt iterative per-view completion that propagates inpainting results to update the underlying geometry, leading to progressive error accumulation and cumbersome multi-step pipelines, or leverage the temporal consistency priors of video generation models, yet the continuous-trajectory constraint intrinsic to such models limits their flexibility in covering scenes from multiple directions simultaneously. We present Pano2World, which takes a single indoor panorama as input and directly outputs a persistent, explorable 3D Gaussian scene. Given the source panorama, Pano2World first reconstructs a coarse 3D Gaussian proxy and renders it at adaptively sampled nearby poses to obtain geometrically aligned guidance panoramas; a panoramic diffusion model then jointly denoises all target views via View-Aware Attention Routing, where each target view simultaneously receives geometric constraints from its corresponding guidance panorama and global semantic guidance from the source panorama, naturally enforcing cross-view consistency. To avoid the information loss incurred by decoding the multi-view hidden features formed during joint denoising back to the pixel domain via VAE, we introduce Latent Feature Adapter, a geometry-aware bridge module that directly distills these hidden features into a scene latent, subsequently decoded into the final 3D Gaussian scene. Experiments demonstrate that Pano2World significantly outperforms existing methods on the multi-position panoramic novel-view synthesis benchmark.

单张全景图能够从单一相机中心捕获完整的视觉球体，但仅能让用户在原地环顾，无法实现真正的场景探索。将单张全景图转换为持久的、可渲染的3D表示以支持自由视点导航这一问题日益受到关注；现有方法要么采用迭代式单视角补全，将修复结果传播以更新底层几何结构，导致渐进式误差累积和繁琐的多步骤流程，要么利用视频生成模型的时间一致性先验，然而此类模型固有的连续轨迹约束限制了其同时覆盖多方向场景的灵活性。我们提出Pano2World，以单张室内全景图作为输入，直接输出持久的、可探索的3D高斯场景。给定源全景图后，Pano2World首先重建一个粗糙的3D高斯代理，并在自适应采样的邻近位姿上对其进行渲染，以获得几何对齐的引导全景图；随后，全景扩散模型通过视图感知注意力路由对所有目标视图进行联合去噪，每个目标视图同时接收来自其对应引导全景图的几何约束和来自源全景图的全局语义引导，自然地实现了跨视图一致性。为避免将联合去噪过程中形成的多视角隐藏特征通过VAE解码回像素域时所造成的信息损失，我们引入了潜在特征适配器，这是一种几何感知的桥接模块，能够将这些隐藏特征直接提炼为场景潜在表示，随后解码为最终的3D高斯场景。实验表明，Pano2World在多位置全景新视角合成基准测试上显著优于现有方法。

Diffusion models have significantly advanced video super-resolution (VSR) but remain largely constrained to fixed upsampling scales. Conversely, while coordinate-based arbitrary-scale VSR methods offer scale flexibility, they inherently suffer from severe over-smoothing at large scaling factors. Integrating generative priors with continuous decoding is promising but currently hindered by severe temporal flickering caused by the stochasticity of diffusion sampling. To address this, we propose AVSR-Diff (Arbitrary-scale Video Super-Resolution with Diffusion), a novel decoupled framework that separates scale-agnostic latent denoising from continuous coordinate rendering, effectively avoiding computationally heavy resolution-specific sampling. Our approach introduces a Temporally-Gated Feature Recurrence (TGFR) module to extract strictly aligned, temporally consistent latent priors. Furthermore, we design a continuous video VAE decoder incorporating a Scale-Aware Fourier Refinement (SAFR) module to dynamically adapt frequency components to any target scale. Extensive experiments demonstrate that AVSR-Diff consistently preserves high-frequency details and strong temporal stability across various scales, surpassing state-of-the-art arbitrary-scale baselines. Remarkably, our framework outperforms recent fixed-scale generative models even on their native resolution.

扩散模型虽显著推动了视频超分辨率（VSR）的发展，但仍主要受限于固定的上采样尺度。相反，尽管基于坐标的任意尺度VSR方法提供了尺度灵活性，但在较大放大倍数下会遭受严重的过度平滑问题。将生成先验与连续解码相结合虽具有前景，但目前仍受扩散采样随机性导致的严重时间闪烁问题的阻碍。为此，我们提出了AVSR-Diff（基于扩散的任意尺度视频超分辨率），这是一种新颖的解耦框架，将尺度无关的潜在空间去噪与连续坐标渲染分离，有效避免了计算量大的分辨率特定采样。我们的方法引入了时间门控特征 recurrence（TGFR）模块，以提取严格对齐的时间一致性潜在先验。此外，我们设计了连续视频VAE解码器，包含尺度感知傅里叶细化（SAFR）模块，以动态调整任何目标尺度的频率分量。大量实验表明，AVSR-Diff在各种尺度下始终保持高频细节和强时间稳定性，超越了最先进的任意尺度基线方法。值得注意的是，我们的框架在原始分辨率上甚至优于最近的固定尺度生成模型。

Text-to-image diffusion models power everyday creative tasks, but they still reproduce the demographic biases in their training data. On common prompts such as ``a photo of a nurse,'&x27; ``a photo of a CEO'&x27;, they skew their outputs toward one gender, driven by the statistics of training data rather than anything in the text. Existing debiasing methods show promise in narrow settings but require retraining, batch-level control, or prompt-specific tuning, limiting their scalability. We propose \emph{EquiSteer}, a training-free method that works per sample by steering cross-attention (CA) activations at inference time. For each target attribute, EquiSteer precomputes steering vectors from contrastive prompts. Then at generation time, a prompt-aware gate leaves attribute-specific prompts untouched, while for neutral ones it clears existing attribute signals from the CA activations and injects a target attribute. Across SD-1.5, SD-2.1, SDXL, and SANA, EquiSteer reduces the average parity gap by up to $87\%$, with minimal effect on image quality and text-image alignment. Code is available at \href{https://github.com/Atmyre/EquiSteer}{https://github.com/Atmyre/EquiSteer}.%

文本到图像扩散模型为日常创作任务提供了强大动力，但其训练数据中仍存在人口统计偏见，模型会重现这些偏见。对于常见提示词（如“护士的照片”、“CEO的照片”），模型倾向于生成特定性别的图像，这是由训练数据的统计特征而非文本内容所驱动的。现有去偏方法在特定场景下展现出了一定效果，但需要重新训练、批量控制或针对特定提示词进行调优，限制了其可扩展性。我们提出了EquiSteer，这是一种无需训练的方法，通过在推理时引导交叉注意力（CA）激活来对每个样本进行独立处理。对于每个目标属性，EquiSteer使用对比提示词预计算引导向量。在生成时，提示词感知门机制会保留属性特定提示词不受影响，而对于中性提示词，则清除交叉注意力激活中现有的属性信号并注入目标属性。在SD-1.5、SD-2.1、SDXL和SANA上，EquiSteer将平均均等性差距降低高达87%，同时对图像质量和文本-图像对齐的影响微乎其微。代码已开源于https://github.com/Atmyre/EquiSteer。

Magnetic resonance imaging (MRI) reconstruction under realistic acquisition conditions can be fundamentally viewed as estimating the underlying k-space distribution from incomplete and noise-corrupted measurements. While diffusion models have recently shown strong potential as generative prior for inverse problems,existingapproachesstruggletohandlenoisyreconstruction settings, especially when operating directly in k-space domain. In this work, we propose a unified high-dimensional k-space reconstruction framework tailored for noisy inverse problems, whichenhancesdiffusion-based solversthroughrepresentation lifting.Ratherthanmodifyingthe underlying optimization procedures, the proposed framework augments the data representation space, enabling existing diffusion-based solvers to operate on enriched k-space embeddings with improved expressiveness. Extensive experiments on both in-house and public datasets across varying noise levels and undersampled factors demonstrate that the proposed frame work consistently improves reconstruction quality for multiple diffusion-based inverse solvers. Notably, the largest gains are observed in high-noise regimes, which is consistent with our theoretical analysis of error propagation under high-dimensional representation. These results suggest that high-dimensional representation provides a general and model-agnostic mechanism for improving diffusion-based MRI reconstruction in noisy settings, offering a new perspective on robust k-space generative modeling for practical inverse problems. The code will be available at https://github.com/yqx7150/HEP-MRIRec.

在现实采集条件下的磁共振成像（MRI）重建本质上可视为从不完整且受噪声污染的测量中估计底层K空间分布。尽管扩散模型作为生成先验在逆问题中展现出强大潜力，但现有方法难以处理噪声重建场景，特别是在K空间域直接操作时。本研究提出了一种针对噪声逆问题统一的高维K空间重建框架，该框架通过表示提升增强基于扩散的求解器。本框架并非修改底层优化程序，而是增强数据表示空间，使现有的基于扩散的求解器能够在具有更优表达能力的高维K空间嵌入上运行。在多个内部数据集和公共数据集上针对不同噪声水平和欠采样因子的大量实验表明，所提框架持续提升了多种基于扩散的逆问题求解器的重建质量。值得注意的是，在高噪声场景下观察到了最大的性能增益，这与我们对高维表示下误差传播的理论分析一致。这些结果表明，高维表示为噪声环境下改进基于扩散的MRI重建提供了通用且模型无关的机制，为实际逆问题中的鲁棒K空间生成建模提供了新视角。代码将发布于 https://github.com/yqx7150/HEP-MRIRec。

Vertigo Vertigo is a scene-for-scene AI reconstruction of Hitchcock's Vertigo (1958), generated from only 2.78% of the original film&x27;s frames. Using this sparse set of keyframe anchors, we perform first-last frame interpolation via a large video diffusion model to predict the intervening sequences. Vertigo is itself a film about the obsessive reconstruction of an artificial ideal; Vertigo Vertigo extends this logic to the material of the film, treating the canonical text as a probe for the normative conventions of classical cinema encoded within generative systems. Evaluated through computational analysis and critical feedback from media theorists (Lev Manovich, Shane Denson, Kevin L. Ferguson), the artifact demonstrates remarkable structural fidelity: 73.1% of frames are recognizable as plausible renditions of Vertigo and only 3.6% fail catastrophically. This fidelity suggests that cinematic norms are deeply compressed within the model's latent priors. Aesthetically, the reconstruction is rendered as an unstable overlay between the original film and its predictive shadow, fueling a persistent doubt in the viewer&x27;s perception of authenticity -- a 21st-century vertigo. The work argues that generative media is not a paradigm shift from cinema but an acceleration of its logic of desire and false authenticity, extending from classical Hollywood through to the predictive media environments now reshaping contemporary perception.

《眩晕眩晕》是一部逐场景的AI重建作品，基于希区柯克1958年电影《眩晕》仅2.78%的原始帧生成。利用这一稀疏的关键帧锚点集，我们通过大型视频扩散模型进行首尾帧插值，以预测中间的序列。《眩晕》本身是一部关于强迫性重建人工理想的电影；《眩晕眩晕》将这一逻辑延伸至电影本体，将经典文本作为探针，探测生成系统内编码的古典电影规范惯例。通过计算分析以及媒体理论家（Lev Manovich、Shane Denson、Kevin L. Ferguson）的批评反馈，该作品展现出显著的结构保真度：73.1%的帧被识别为《眩晕》的可信呈现，仅有3.6%完全失败。这种保真度表明电影规范被深度压缩在模型的潜在先验中。在美学上，重建被呈现为原电影与其预测阴影之间的不稳定叠加，激发观众对真实性认知的持续怀疑——一种21世纪的眩晕。该作品论证生成式媒体并非电影的范式转变，而是其欲望与虚假真实性逻辑的加速，从古典好莱坞延伸至正在重塑当代感知的前瞻性媒体环境。

Diffusion models are highly effective at modeling complex data distributions, including images and text. However, in applications like personalized recommender systems, the objective often shifts to modeling specific regions of the distribution that maximize user preferences-initially unknown but gradually uncovered through interactive feedback. This can naturally be framed as a reinforcement learning problem, where the goal is to fine-tune a diffusion model to maximize a reward function based on preferences. However, the main challenge lies in learning a parameterized reward model, which typically requires large-scale preference data-something that is often not feasible in practice. In this work, we introduce Personalized Active Preference Alignment PAPA, a novel method that bypasses the requirement for a parametrized reward model by directly optimizing the diffusion model using real-time user feedback. PAPA enables feedback-efficient preference alignment, drawing inspiration from the variational inference framework. We demonstrate PAPA's effectiveness through extensive experiments and ablation studies across diverse class-conditioned and fine-grained alignment tasks. Additionally, based on theoretical insights, we propose an enhanced fine-tuning strategy, referred to as EPAPA, that requires less computational budget and accelerates the fine-tuning process, further boosting PAPA&x27;s suitability for real-world deployment. Our code is made publicly available at https://github.com/NasikNafi/papa.

扩散模型在建模复杂数据分布（包括图像和文本）方面表现出色。然而，在个性化推荐系统等应用中，目标通常转向对分布的特定区域进行建模，以最大化用户偏好——这些偏好在初始阶段未知，但通过交互反馈逐渐被揭示。这可以自然地形式化为一个强化学习问题，目标是根据偏好微调扩散模型以最大化奖励函数。然而，主要挑战在于学习一个参数化的奖励模型，这通常需要大规模偏好数据，而在实际中往往难以实现。在本工作中，我们提出了个性化主动偏好对齐（PAPA），一种通过直接使用实时用户反馈优化扩散模型来绕过参数化奖励模型需求的新方法。PAPA 借鉴变分推断框架，实现了高效的偏好对齐。我们通过在各种类别条件任务和细粒度对齐任务上的大量实验和消融研究证明了 PAPA 的有效性。此外，基于理论洞察，我们提出了一种增强的微调策略，称为 EPAPA，它需要更少的计算预算并加速了微调过程，进一步提升了 PAPA 在实际部署中的适用性。

The rapid advancement of diffusion models has enabled the generation of high-fidelity images from textual prompts, yet achieving precise, disentangled control over specific attributes remains a significant challenge. A fundamental limitation arises because visual differences between images are often far more descriptive and nuanced than what can be captured through human-crafted text descriptions, which frequently fail to convey fine-grained semantic details. To address this, we introduce ViDiT (Visual Direction Transfer for Diffusion), a framework that expands the editing vocabulary by capturing latent semantics directly from image-edit pairs. ViDiT learns the underlying transformation by optimizing a single, global, and continuous editing direction from a small set of ``before-and-after'&x27; examples. This optimization process transfers visual changes into the diffusion model's conditioning space, allowing for detailed edits that text alone cannot easily describe. ViDiT operates on a ``Learn Once&x27;' principle, which completely eliminates the need for model fine-tuning or expensive per-image optimization during inference. Once learned, these continuous directions enable ``Edit Anywhere&x27;' capabilities, allowing users to apply highly disentangled manipulations, such as changes in facial features, animal attributes, or artistic styles, to any image in a zero-shot manner with granular control over the edit intensity. Quantitative and qualitative evaluations demonstrate that ViDiT outperforms existing text-based editing methods in maintaining input faithfulness while achieving precise, scalable attribute control.

扩散模型的快速发展使得根据文本提示生成高保真图像成为可能，然而实现对特定属性的精确解耦控制仍是一项重大挑战。一个根本性的局限在于图像之间的视觉差异往往比人工编写的文本描述所能捕捉的更为描述性和细致入微，而文本描述往往难以传达细粒度的语义细节。为此，我们提出了ViDiT（Visual Direction Transfer for Diffusion，扩散视觉方向迁移）框架，该框架通过直接从图像-编辑对中捕获潜在语义来扩展编辑词汇量。ViDiT通过从少量“前后”示例中优化单个全局连续编辑方向来学习底层变换。这一优化过程将视觉变化迁移到扩散模型的条件空间中，从而实现仅靠文本难以描述的详细编辑。ViDiT遵循“一次学习”原则，完全消除了推理过程中模型微调或每图像优化的需求。一旦学习完成，这些连续方向即可实现“任意编辑”能力，允许用户以零样本方式对任何图像进行高度解耦的操控，如面部特征、动物属性或艺术风格的改变，并可对编辑强度进行精细控制。定量和定性评估表明，ViDiT在保持输入保真度的同时实现了精确、可扩展的属性控制，其性能优于现有的基于文本的编辑方法。

Ultra-high-resolution text-to-image generation is increasingly vital for applications requiring fine-grained textures and global structural fidelity, yet state-of-the-art text-to-image diffusion models such as FLUX and SD3 remain confined to sub 2MP (< $1K\times2K$) resolutions due to the quadratic complexity of attention mechanisms and the scarcity of high-quality high-resolution training data. We present UltraImageGen, a novel framework that introduces hierarchical local attention with low-resolution global guidance, enabling efficient, scalable, and semantically coherent image synthesis at ultra-high resolutions. Specifically, high-resolution latents are divided into hardware aligned fixed-size local windows to reduce attention complexity from quadratic to near-linear, while a low-resolution latent equipped with scaled positional embeddings injects global semantics as an anchor. A lightweight LoRA adaptation bridges global and local pathways during denoising, ensuring consistency across structure and detail. To maximize inference efficiency and achieve scalable ultra-high-resolution generation, we repermute token sequence in window-first order, so that the GPU-friendly dense local blocks in attention calculation equals to the fixed-size local window in 2D regardless of resolution. Together ourwork reliably scales the pretrained model to resolutions higher than $8K$ with more than $10\times$ speed up and significantly lower memory usage. Extensive experiments demonstrate that ourwork achieves superior quality while maintaining computational efficiency, establishing a practical paradigm for advancing ultra-high-resolution image generation.

超高分辨率文生图生成对于需要精细纹理和全局结构保真度的应用日益重要，然而目前最先进的文生图扩散模型（如FLUX和SD3）仍局限于200万像素以下（<1K×2K）的分辨率，原因在于注意力机制的二次复杂度以及高质量高分辨率训练数据的匮乏。本文提出UltraImageGen框架，该框架引入带低分辨率全局引导的分层局部注意力机制，可在超高分辨率下实现高效、可扩展且语义一致的图像合成。具体而言，将高分辨率潜在表示划分为硬件对齐的固定大小局部窗口，将注意力复杂度从二次降低至近线性；而配备缩放位置嵌入的低分辨率潜在表示则作为锚点注入全局语义。在去噪过程中，轻量级LoRA适配器桥接全局与局部路径，确保结构和细节的一致性。为最大化推理效率并实现可扩展的超高分辨率生成，本文采用窗口优先顺序重排令牌序列，使得注意力计算中GPU友好的密集局部块在二维空间中等同于固定大小的局部窗口，与分辨率无关。综上所述，本工作将预训练模型可靠地扩展至8K以上分辨率，实现超过10倍的加速并显著降低内存消耗。大量实验表明，本工作在保持计算效率的同时达到了卓越的质量水平，为推动超高分辨率图像生成建立了实用的范式。

Concept erasure methods aim to remove specific unsafe target concepts in diffusion models while preserving image generation utility. To address the vulnerability that erased concepts can be easily recovered under adversarial attacks, adversarial concept erasure methods integrate adversarial optimization into the concept erasure process. However, existing adversarial concept erasure methods face a trade-off between robustness and computational cost. We attribute this to adversarial optimization techniques that use random samples to approximate the adversarial objective function. Adversarial optimization that uses a small number of samples fails to produce adversarial embeddings that accurately capture the target concept space. To mitigate this limitation, we propose Semantic-Guided Adversarial Optimization, which uses a single sample to produce adversarial embeddings that better capture the target concept space. We also propose Semantic-Guided Concept Erasure, which automatically maps the target concept to a semantically similar surrogate. Extensive experiments on not-safe-for-work content, artistic styles, and object-related concepts demonstrate that our method, S-GRACE (Semantic-Guided Robust Adversarial Concept Erasure) achieves state-of-the-art erasure robustness and superior image generation utility, with significantly lower computational cost than existing methods. Our code is available at https://github.com/Qhong-522/S-GRACE.

概念擦除方法旨在移除扩散模型中的特定不安全目标概念，同时保留图像生成效用。为了解决被擦除的概念在对抗攻击下容易被恢复的脆弱性，对抗性概念擦除方法将对抗优化整合到概念擦除过程中。然而，现有的对抗性概念擦除方法在鲁棒性和计算成本之间存在权衡。我们将此归因于使用随机样本近似对抗目标函数的对抗优化技术。使用少量样本的对抗优化无法产生准确捕捉目标概念空间的对抗嵌入。为缓解这一局限性，我们提出了语义引导对抗优化，它使用单个样本产生更好捕捉目标概念空间的对抗嵌入。我们还提出了语义引导概念擦除，它自动将目标概念映射到语义相似的代理。在不安全内容、艺术风格和物体相关概念上的大量实验表明，我们的方法S-GRACE（语义引导鲁棒对抗性概念擦除）实现了最先进的擦除鲁棒性和卓越的图像生成效用，且计算成本显著低于现有方法。我们的代码可见于 https://github.com/Qhong-522/S-GRACE。

Recent progress in text-to-video generation has achieved remarkable realism, yet fine-grained control over camera motion and orientation remains elusive, especially with extreme trajectories (e.g., a 180-degree turnaround, or looking directly up or down). Existing approaches typically encode camera trajectories using relative or ambiguous representations, limiting precise geometric control and offering limited support for large rotations. We introduce GimbalDiffusion, a framework that enables camera control grounded in physical-world coordinates, using gravity as a global reference. Instead of describing motion relative to previous frames, our method defines camera trajectories in an absolute coordinate system, allowing accurate, interpretable control over camera parameters. Using panoramic 360-degree videos for training, we cover the full sphere of possible viewpoints, including combinations of extreme pitch and roll that are out-of-distribution of conventional video data. To improve camera control, we introduce null-pitch conditioning, a strategy that prevents the model from overriding camera specifications in the presence of conflicting prompt content (e.g., generating grass while the camera points toward the sky). Finally, we propose new benchmarks to evaluate gravity-aware camera-controlled video generation, assessing models' ability to generate extreme camera angles and quantify their input prompt entanglement.

尽管文本到视频生成技术已取得显著进展，但在摄像机运动和方向层面的精细控制仍难以实现，特别是对于极端轨迹（如180度环绕转身或直接向上/向下观看）。现有方法通常使用相对或模糊的表示来编码摄像机轨迹，这限制了几何控制的精确性，并对大幅旋转的支持有限。我们提出了GimbalDiffusion框架，该框架使摄像机控制基于物理世界坐标，以重力作为全局参考。我们的方法不再描述相对于前一帧的运动，而是在绝对坐标系中定义摄像机轨迹，从而实现准确且可解释的摄像机参数控制。在训练中，我们使用全景360度视频，覆盖了全部球面视角范围，包括传统视频数据中分布外的极端俯仰和横滚组合。为增强摄像机控制能力，我们提出了零俯仰条件化策略，该策略可防止模型在存在冲突的提示内容时覆盖摄像机规格（例如，当摄像机指向天空时生成草地）。最后，我们提出了新的基准测试来评估重力感知的摄像机控制视频生成，评估模型生成极端摄像机角度的能力并量化其输入提示纠缠程度。

Autoregressive video diffusion models hold promise for world simulation but are vulnerable to exposure bias arising from the train-test mismatch. While recent works address this via post-training, they typically rely on a bidirectional teacher model or discriminator. To achieve an end-to-end solution, we introduce Resampling Forcing, a teacher-free framework that enables training autoregressive video models from scratch and at scale. Central to our approach is a self-resampling scheme that simulates inference-time model errors on history frames during training. Conditioned on these degraded histories, a sparse causal mask enforces temporal causality while enabling parallel training with frame-level diffusion loss. To facilitate efficient long-horizon generation, we further introduce history routing, a parameter-free mechanism that dynamically retrieves the top-k most relevant history frames for each query. Experiments demonstrate that our approach achieves performance comparable to distillation-based baselines while exhibiting superior temporal consistency on longer videos owing to native-length training.

自回归视频扩散模型在世界模拟领域具有广阔的应用前景，但容易受到训练-测试不匹配所导致的曝光偏差的影响。尽管现有工作通过后训练方式来解决这一问题，但它们通常依赖于双向教师模型或判别器。为实现端到端解决方案，我们提出了Resampling Forcing，一种无教师的框架，能够从零开始大规模训练自回归视频模型。我们方法的核心是一种自重采样方案，在训练过程中模拟推理时历史帧的模型误差。以这些降质的历史帧为条件，稀疏因果掩码强制执行时间因果性，同时支持基于帧级扩散损失的并行训练。为了促进高效的长时序生成，我们进一步引入了历史路由，这是一种无参数的机制，可动态检索每个查询最相关的top-k个历史帧。实验表明，我们的方法实现了与基于蒸馏的基线相当的性能，同时由于原生长度训练，在更长视频上展现出更优的时间一致性。

While Diffusion Transformers (DiTs) have achieved notable progress in video generation, this long-sequence generation task remains constrained by the quadratic complexity inherent to self-attention mechanisms, creating significant barriers to practical deployment. Although sparse attention methods attempt to address this challenge, existing approaches either rely on oversimplified static patterns or require computationally expensive sampling operations to achieve dynamic sparsity, resulting in inaccurate pattern predictions and degraded generation quality. To overcome these limitations, we propose a \underline{\textbf{M}}ixture-\underline{\textbf{O}}f-\underline{\textbf{D}}istribution \textbf{DiT} (\textbf{MOD-DiT}), a novel sampling-free dynamic attention framework that accurately models evolving attention patterns through a two-stage process. First, MOD-DiT leverages prior information from early denoising steps and adopts a {distributed mixing approach} to model an efficient linear approximation model, which is then used to predict mask patterns for a specific denoising interval. Second, an online block masking strategy dynamically applies these predicted masks while maintaining historical sparsity information, eliminating the need for repetitive sampling operations. Extensive evaluations demonstrate consistent acceleration and quality improvements across multiple benchmarks and model architectures, validating MOD-DiT's effectiveness for efficient, high-quality video generation while overcoming the computational limitations of traditional sparse attention approaches.

尽管扩散Transformer（DiTs）在视频生成方面取得了显著进展，但这种长序列生成任务仍然受到自注意力机制固有二次复杂度的制约，这为实际部署带来了重大障碍。虽然稀疏注意力方法试图解决这一挑战，但现有方法要么依赖于过度简化的静态模式，要么需要计算昂贵的采样操作来实现动态稀疏性，导致模式预测不准确和生成质量下降。为克服这些局限性，我们提出了分布混合DiT（MOD-DiT），一种无需采样的动态注意力框架，通过两阶段过程准确建模演变的注意力模式。首先，MOD-DiT利用早期去噪步骤的先验信息，并采用分布式混合方法来建模一个高效的线性近似模型，然后利用该模型预测特定去噪间隔的掩码模式。其次，在线块掩码策略在保持历史稀疏信息的同时动态应用这些预测掩码，无需重复采样操作。广泛的评估表明，在多个基准和模型架构上实现了一致的加速和质量提升，验证了MOD-DiT在高效、高质量视频生成中的有效性，同时克服了传统稀疏注意力方法的计算限制。

Handwritten mathematical expression recognition (HMER) requires reasoning over diverse symbols and structures, yet autoregressive models struggle with exposure bias and syntax inconsistency. We present GryphOne, a discrete diffusion framework which reformulates HMER as iterative symbolic refinement instead of sequential generation. GryphOne progressively refines symbols and relations, removing autoregression and improving consistency. Symbol-aware tokenization and random-masking mutual learning further enhance robustness to handwriting diversity. On the MathWriting benchmark, GryphOne achieves 5.51% CER and 59.9% EM (ExpRate), outperforming all reimplemented models in the matched setting as well as the commercial HMER system. Held-out evaluation on CROHME 2014-2023 further shows strong cross-dataset generalization.

手写数学表达式识别（HMER）需要对多样化的符号和结构进行推理，然而自回归模型在处理曝光偏差和语法不一致方面存在不足。我们提出了GryphOne，这是一个离散扩散框架，将HMER重新表述为迭代符号细化而非序列生成。GryphOne逐步细化符号和关系，消除自回归并提高一致性。符号感知分词和随机掩码互学习进一步增强了对手写多样性的鲁棒性。在MathWriting基准上，GryphOne实现了5.51%的CER和59.9%的EM（ExpRate），在相同设置下优于所有复现模型以及商业HMER系统。在CROHME 2014-2023上的留出评估进一步表明其具有较强的跨数据集泛化能力。

Diffusion model advances have enabled powerful text-guided image editing, but also raise ethical and legal risks such as deepfakes and unauthorized use. To prevent these risks, adversarial attack-based image immunization has emerged as a promising defense against AI-driven semantic manipulation. Yet, most existing approaches require image-specific optimization or additional neural networks at inference time, hindering scalability and practicality. In this paper, we propose the first universal adversarial perturbation-based image immunization framework that generates a single, image-agnostic adversarial perturbation specifically designed for diffusion-based editing pipelines. Inspired by UAP used in targeted attacks, our method aims to generate a UAP that induces diffusion models to misinterpret the input image as a specific semantic target. Simultaneously, it suppresses original content to misdirect the model&#x27;s attention during editing, thereby effectively blocking unauthorized edits by overwriting the image&x27;s original semantics via the UAP. Extensive experiments show that our method, as the first universal immunization approach, significantly outperforms several baselines in the UAP setting. Notably, despite the inherent difficulty of universal perturbations, our method achieves competitive or superior performance compared to image-specific methods under a more restricted perturbation budget, while also exhibiting strong black-box transferability across diverse diffusion models.

扩散模型的进展使得强大的文本引导图像编辑成为可能，但也带来了深度伪造和未经授权使用等伦理和法律风险。为防止这些风险，基于对抗攻击的图像免疫作为一种有前景的防御方法应运而生，用于抵御AI驱动的语义操作。然而，现有大多数方法需要针对特定图像进行优化或在推理时使用额外的神经网络，这阻碍了其可扩展性和实用性。本文提出了首个基于通用对抗扰动的图像免疫框架，该框架生成一个专门为扩散模型编辑流程设计的、图像无关的通用对抗扰动。受到靶向攻击中使用的UAP的启发，我们的方法旨在生成一种UAP，促使扩散模型将输入图像误解为特定的语义目标。同时，它抑制原始内容以误导模型在编辑过程中的注意力，从而通过UAP覆盖图像原始语义来有效阻止未经授权的编辑。大量实验表明，作为首个通用免疫方法，我们的方法在UAP设置下显著优于多个基线方法。值得注意的是，尽管通用扰动存在固有困难，但我们的方法在更严格的扰动预算限制下仍取得了与图像特定方法相当或更优的性能，同时在不同的扩散模型中展现出强大的黑盒迁移性。

Diffusion transformer (DiT) architectures show great potential for real-world image super-resolution (Real-ISR). However, their computationally expensive iterative sampling necessitates one-step distillation. Existing one-step distillation methods struggle with Real-ISR on DiT. They suffer from fundamental trajectory mismatch and generate severe grid-like periodic artifacts. To tackle these challenges, we propose StrSR, a novel one-step adversarial distillation framework featuring spectral and trajectory regularization. Specifically, we propose an asymmetric discriminative distillation architecture to bridge the trajectory gap. Additionally, we design a frequency distribution matching strategy to effectively suppress DiT-specific periodic artifacts caused by high-frequency spectral leakage. Extensive experiments demonstrate that StrSR achieves state-of-the-art performance in Real-ISR, across both quantitative metrics and visual perception. The code and models will be released at https://github.com/jkwang28/StrSR .

扩散Transformer（DiT）架构在真实世界图像超分辨率（Real-ISR）任务中展现出巨大潜力。然而，其计算昂贵的迭代采样过程需要一步蒸馏才能实现实时应用。现有的一步蒸馏方法在DiT上处理Real-ISR时面临困境，存在根本性的轨迹不匹配问题，并产生严重的网格状周期伪影。为解决这些挑战，我们提出了StrSR，一种具有光谱和轨迹正则化的一步对抗蒸馏框架。具体而言，我们提出了一种非对称判别蒸馏架构来弥合轨迹差距。此外，我们设计了一种频率分布匹配策略，以有效抑制由高频光谱泄漏引起的DiT特定周期伪影。大量实验表明，StrSR在Real-ISR任务中实现了最先进的性能，无论是在定量指标还是视觉感知方面。代码和模型将发布于https://github.com/jkwang28/StrSR。

We present a novel paradigm for ultra-low-bitrate image compression (ULB-IC) that exploits the ``temporal&#x27;&x27; evolution in generative image compression. Specifically, we define an explicit intermediate state during decoding: a compact anchor frame, which preserves the scene geometry and semantic layout while discarding high-frequency details. We then reinterpret generative decoding as a virtual temporal transition from this anchor to the final reconstructed image. To model this progression, we leverage a pretrained video diffusion model (VDM) as a temporal prior: the anchor frame serves as the initial frame and the original image as the target frame, transforming the decoding process into a next-frame prediction task. In contrast to image diffusion-based ULB-IC models, our decoding proceeds from a visible, semantically faithful anchor, which improves both fidelity and realism for perceptual image compression. Extensive experiments demonstrate that our method achieves superior rate-distortion performance. On the CLIC2020 test set, our method achieves over 50% bitrate savings across LPIPS, DISTS, FID, and KID compared to DiffC, while also delivering a significant decoding speedup of up to $\times$5. Code will be released at https://github.com/UnoC-727/NeFIC.

本文提出了一种利用生成式图像压缩中时序演化特性的超低码率图像压缩（ULB-IC）新范式。具体而言，我们在解码过程中定义了一个显式的中间状态：紧凑锚帧，该锚帧在保留场景几何结构和语义布局的同时丢弃了高频细节。随后，我们将生成式解码重新解释为从该锚帧到最终重建图像的虚拟时序转换。为建模这一演化过程，我们利用预训练的视频扩散模型（VDM）作为时序先验：以锚帧作为起始帧，以原始图像作为目标帧，将解码过程转化为下一帧预测任务。与基于图像扩散的ULB-IC模型不同，我们的解码从可见的、语义保真的锚帧开始，这提升了感知图像压缩的保真度和真实感。大量实验表明，我们的方法在率失真性能上取得了优异表现。在CLIC2020测试集上，我们的方法在LPIPS、DISTS、FID和KID指标上相比DiffC实现了超过50%的码率节省，同时带来了最高达5倍的解码加速。代码将发布于 https://github.com/UnoC-727/NeFIC。

Single image reflection removal (SIRR) is challenging in real scenes, where reflection strength varies spatially and reflection patterns are tightly entangled with transmission structures. This paper presents a diffusion model with prior modulation framework (FUMO) that introduces explicit priors for spatially adaptive conditioning and structurally faithful restoration. Two priors are extracted directly from the mixed image, an intensity prior that estimates spatial reflection severity and a high-frequency prior that captures detail-sensitive responses via multi-scale residual aggregation. We propose a coarse-to-fine training paradigm. In the first stage, these cues are combined to gate the conditional residual injections, focusing the conditioning on regions that are both reflection-dominant and structure-sensitive. In the second stage, a fine-grained refinement network corrects local misalignment and sharpens fine details in the image space. Experiments conducted on both standard benchmarks and challenging images in the wild demonstrate competitive quantitative results and consistently improved perceptual quality. The code is released at https://github.com/Lucious-Desmon/FUMO.

单图像反射去除（SIRR）在实际场景中具有挑战性，反射强度在空间上呈现不同变化，且反射模式与透射结构紧密耦合。本文提出了一种先验调制扩散模型框架（FUMO），该框架引入显式先验以实现空间自适应条件调节和结构保真恢复。两种先验直接从混合图像中提取：强度先验用于估计空间反射严重程度，高频先验通过多尺度残差聚合捕获细节敏感响应。本文提出了粗到细的训练范式。在第一阶段，这些线索被组合用于门控条件残差注入，将条件调节聚焦于反射占主导且结构敏感的区域。在第二阶段，细粒度细化网络校正局部错位并锐化图像空间中的精细细节。在标准基准测试和具有挑战性的自然图像上进行的实验表明，本方法取得了具有竞争力的定量结果和持续提升的感知质量。代码已发布于 https://github.com/Lucious-Desmon/FUMO。

Class-conditional generative models have emerged as accurate and robust classifiers, with diffusion models demonstrating clear advantages over other visual generative paradigms, including autoregressive (AR) models. In this work, we revisit visual AR-based generative classifiers and identify an important limitation of prior approaches: their reliance on a fixed token order, which imposes a restrictive inductive bias for image understanding. We observe that single-order predictions rely more on partial discriminative cues, while averaging over multiple token orders provides a more comprehensive signal. Based on this insight, we leverage recent any-order AR models to estimate order-marginalized predictions, unlocking the high classification potential of AR models. Our approach consistently outperforms diffusion-based classifiers across diverse image classification benchmarks, while being up to 25x more efficient. Compared to state-of-the-art self-supervised discriminative models, our method delivers competitive classification performance - a notable achievement for generative classifiers.

类别条件生成模型已展现出作为精确且鲁棒的分类器的潜力，其中扩散模型相比其他视觉生成范式（包括自回归模型）具有明显优势。在本工作中，我们重新审视了基于视觉自回归的生成式分类器，并指出先前方法的一个重要局限性：它们依赖于固定的 token 顺序，这对图像理解施加了限制性的归纳偏置。我们观察到，单一顺序的预测更依赖部分判别线索，而对多个 token 顺序进行平均则能提供更全面的信号。基于这一洞察，我们利用任意顺序自回归模型来估计顺序边缘化预测，从而释放自回归模型的高分类潜力。我们的方法在各种图像分类基准测试中始终优于基于扩散模型的分类器，同时效率提升高达 25 倍。与最先进的自监督判别模型相比，我们的方法实现了具有竞争力的分类性能——这对于生成式分类器而言是一项显著成就。

Exo-to-Ego video generation aims to synthesize a first-person video from a synchronized third-person view and corresponding camera poses. While paired supervision is available, synchronized exo-ego data inherently introduces substantial spatio-temporal and geometric discontinuities, violating the smooth-motion assumptions of standard video generation benchmarks. We identify this synchronization-induced jump as the central challenge and propose Syn2Seq-Forcing, a sequential formulation that interpolates between the source and target videos to form a single continuous signal. By reframing Exo2Ego as sequential signal modeling rather than a conventional condition-output task, our approach enables diffusion-based sequence models, e.g. Diffusion Forcing Transformers (DFoT), to capture coherent transitions across frames more effectively. Empirically, we show that interpolating only the videos, without performing pose interpolation already produces significant improvements, emphasizing that the dominant difficulty arises from spatio-temporal discontinuities. Beyond immediate performance gains, this formulation establishes a general and flexible framework capable of unifying both Exo2Ego and Ego2Exo generation within a single continuous sequence model, providing a principled foundation for future research in cross-view video synthesis.

外视角到内视角视频生成旨在从同步的第三人称视角及对应的相机位姿合成第一人称视频。虽然可以获取配对监督信号，但同步的外内视角数据本身引入了大量的时空和几何不连续性，这违反了标准视频生成基准中的平滑运动假设。我们将这种同步诱导的跳跃识别为核心挑战，并提出Syn2Seq-Forcing，这是一种序贯式表述方法，通过在源视频和目标视频之间进行插值来形成单一连续信号。通过将Exo2Ego重新定义为序贯信号建模而非传统的条件-输出任务，我们的方法使得基于扩散的序列模型（如Diffusion Forcing Transformers，DFoT）能够更有效地捕捉帧间的连贯转换。实验表明，仅对视频进行插值而不进行位姿插值 already能产生显著提升，这强调指出主要困难源于时空不连续性。除了直接的性能提升之外，该表述还建立了一个通用且灵活的框架，能够在同一连续序列模型中统一外视角到内视角和内视角到外视角的生成，为跨视角视频合成的未来研究提供了原则性基础。

Emerging multi-modal world models attempt to jointly generate videos across diverse modalities (e.g., RGB, depth, and mask), yet they fail to fully exploit the rich priors of existing foundation models. We propose $M^2$-REPA, the first representation alignment method tailored for multi-modal video generation. Our key insight is that foundation models trained on different modality spaces naturally capture distinct domain-specific priors, acting as complementary "experts." Specifically, we first decouple modality-specific features from the diffusion model's intermediate representations, then align each with its corresponding expert foundation model. To this end, we design two synergistic objectives: a multi-modal representation alignment loss that enforces feature-to-expert matching, and a modality-specific decoupling regularization that encourages complementarity across different modalities. This design enables joint optimization, fully exploiting priors from multiple foundation models. Extensive experiments demonstrate that our method significantly outperforms baselines in visual quality and long-term consistency.

新兴的多模态世界模型尝试在不同模态（如RGB、深度和掩码）下联合生成视频，但它们未能充分利用现有基础模型的丰富先验。我们提出M²-REPA，这是首个针对多模态视频生成的定制表示对齐方法。我们的关键洞察是：在不同模态空间上训练的基础模型自然地捕获了独特的领域特定先验，作为互补的“专家”。具体而言，我们首先从扩散模型的中间表示中解耦模态特定特征，然后将其与相应的专家基础模型对齐。为此，我们设计了两个协同目标：多模态表示对齐损失强制执行特征到专家的匹配，以及模态特定解耦正则化促进不同模态间的互补性。这种设计实现了联合优化，充分利用了多个基础模型的先验知识。大量实验表明，我们的方法在视觉质量和长期一致性方面显著优于基线方法。

Hyperspectral image (HSI) restoration is crucial for reliable analysis, as real-world HSIs suffer from noise, blur, and resolution loss. However, existing models trained on source data often fail on target domains lacking clean references, a common real-world scenario. To address this, we present HIR-ALIGN, a plug-and-play target-adaptive augmentation framework that enhances HSI restoration by augmenting limited training images with synthetic data matching the target distribution, without extra clean target-domain HSI data. It has three stages: (i) proxy generation, where off-the-shelf restoration models are applied to degraded target observations to produce semantics-preserving proxy HSIs that approximate clean target-domain images; (ii) distribution-adaptive synthesis, where a blur-robust unCLIP diffusion model generates target-aligned RGBs from proxy RGBs with prompt conditioning and embedding-space noise initialization. The warp-based spectral transfer module then synthesizes HSIs by aligning each generated RGB with its proxy RGB, estimating soft patch-wise transport weights, and applying these weights and learnable local interpolation kernels to the proxy HSI; and (iii) aligned supervised finetuning, where restoration networks pretrained on the source distribution are finetuned with proxy HSIs and synthesized target-aligned HSIs, then deployed on degraded target images. We also provide theoretical analysis showing that, under stated assumptions, the proposed augmentation-based finetuning obtains a tighter target-domain restoration-risk upper bound by jointly improving target-distribution coverage and controlling spectral bias. Experiments on simulated and real datasets across denoising, super-resolution, and other restoration tasks demonstrate that HIR-ALIGN is superior to proxy-only target-adaptation baselines and outperforms representative unsupervised methods in most cases.

高光谱图像重建对于可靠分析至关重要，因为真实世界的高光谱图像存在噪声、模糊和分辨率损失等问题。然而，在缺乏干净参考数据的目标域上，现有模型通常表现不佳，而这正是常见的真实场景。为解决此问题，我们提出了HIR-ALIGN，这是一种即插即用的目标自适应增强框架，通过使用与目标分布相匹配的合成数据来扩充有限的训练图像，从而增强高光谱图像重建性能，且无需额外的干净目标域高光谱图像数据。该框架包含三个阶段：（i）代理生成阶段，将现成的重建模型应用于降质目标观测，生成保留语义的代理高光谱图像，以近似干净目标域图像；（ii）分布自适应合成阶段，使用抗模糊的unCLIP扩散模型，从代理RGB图像生成具有目标对齐特性的RGB图像，并进行提示条件化和嵌入空间噪声初始化。随后，基于扭曲的谱转移模块通过将每个生成的RGB与其代理RGB对齐，估计软逐块传输权重，并将这些权重及可学习的局部插值核应用于代理高光谱图像，从而合成高光谱图像；（iii）对齐监督微调阶段，对在源分布上预训练的重建网络进行微调，使用代理高光谱图像和合成的目标对齐高光谱图像，然后部署于降质目标图像上。我们还提供了理论分析，表明在所述假设下，基于增强的微调方法通过共同改善目标分布覆盖和控制谱偏差，能够获得更紧的目标域重建风险上界。在去噪、超分辨率及其他重建任务的模拟和真实数据集上的实验表明，HIR-ALIGN优于仅使用代理的目标自适应基线方法，并在大多数情况下优于代表性的无监督方法。

While personalizing Image-to-Video (I2V) diffusion models with specific visual effects is increasingly demanded for high-end generation, current practice requires training a separate Low-Rank Adaptation (LoRA) module for each effect, incurring substantial data curation and iterative optimization costs that hinder interactive control. We present Prompt2Effect, a weight-driven hypernetwork that amortizes per-effect training by directly synthesizing effect-specific LoRA weights in a single forward pass. Unlike prior hypernetworks that regress adapter weights purely from semantics, Prompt2Effect is explicitly conditioned on the frozen base model weights, grounding prediction in the structural geometry of each layer. Furthermore, instead of predicting raw LoRA matrices, we introduce an SVD-canonicalized parameterization that resolves factorization ambiguity and stabilizes large-scale synthesis. Extensive experiments demonstrate that Prompt2Effect achieves on-par or superior video quality and effect alignment compared to conventional LoRA fine-tuning, while reducing the computational cost from 56 GPU training hours to 3.3 seconds of hypernetwork inference. When used as initialization for subsequent fine-tuning, our predicted weights further improve final performance and accelerate optimization by approximately 10x.

虽然利用特定视觉效果对图像到视频（I2V）扩散模型进行个性化定制在高端生成领域的需求日益增长，但现有方法需要为每个效果训练独立的低秩适应（LoRA）模块，导致数据整理和迭代优化成本高昂，阻碍了交互式控制。我们提出了Prompt2Effect，一个权重驱动的超网络，通过单次前向传播直接合成效果特定的LoRA权重，从而分摊每个效果的训练成本。与先前纯粹从语义回归适配器权重的超网络不同，Prompt2Effect明确以冻结的基础模型权重为条件，将预测锚定于每层的结构几何。此外，我们引入了一种SVD规范化参数化方法，取代直接预测原始LoRA矩阵，从而解决分解歧义并稳定大规模合成。大量实验表明，Prompt2Effect在视频质量和效果对齐方面与常规LoRA微调相当或更优，同时将计算成本从56 GPU训练小时降低到超网络推理的3.3秒。当用作后续微调的初始化时，我们预测的权重进一步提升了最终性能，并将优化速度提高约10倍。

Human image animation, which aims to generate a video of a reference subject following a provided action sequence, has received increasing research interest. With the development of diffusion-based/flow-based video foundation models, existing animation works have began to upgrade the guidance information from 2D skeleton/pose to 3D modeling conditions. Despite achieving reasonable results, these approaches face challenges in synthesizing trajectory-controllable human motion within natural scene under changed camera views. In this work, we present a scene-adaptive human image animation framework that controls both human motion and camera trajectories within a reconstructed 3D environment for video generation. To achieve this, we first develop a ground-adaptive 3D motion retargeting approach to enable user-friendly motion trajectory control adapting to the changes of elevations of ground and orientations automatically. Then we design a viewpoint-adaptive latent fusion mechanism to inject point-cloud geometric priors through scene-visibility masking into the generative process, providing precise guidance of viewpoint changes under camera control. Experiments on two standard human image animation benchmark datasets demonstrate remarkable improvements of our method over the state of the arts in related video generation metics. Project page: https://robinhood256100.github.io/web-disp

人体图像动画旨在根据给定的动作序列生成目标人物的视频，近年来受到越来越多的研究关注。随着基于扩散/流的基础视频模型的发展，现有动画方法开始将引导信息从2D骨架/姿态升级为3D建模条件。尽管取得了不错的成果，但这些方法在变化相机视角下自然场景中合成轨迹可控的人体运动方面仍面临挑战。本研究提出了一种场景自适应人体图像动画框架，可在重构的3D环境中同时控制人体运动和相机轨迹以生成视频。为此，我们首先开发了一种地面自适应3D动作重定向方法，使用户能够轻松控制运动轨迹，并自动适应地面高度和朝向的变化。然后，我们设计了视角自适应潜在融合机制，通过场景可见性掩码将点云几何先验注入生成过程，从而在相机控制下提供视角变化的精确引导。在两个人体图像动画标准基准数据集上的实验表明，我们的方法在相关视频生成指标上相较于现有最先进方法取得了显著提升。项目主页：https://robinhood256100.github.io/web-disp

Multi-modal image matching is essential for visual localization and multi-sensor fusion, but it is hindered by the scarcity of large-scale training data with precise geometric annotations. Existing real-world datasets suffer from prohibitive costs, limited scene diversity, and errors in SfM-MVS pipelines, while synthetic methods struggle to maintain 3D geometric consistency or achieve photorealistic appearance. To address this, we propose AnyMatch, a novel framework that leverages abundant, easily accessible single-view images at minimal cost to generate rich multi-modal training data. AnyMatch integrates monocular depth estimation, 3D reprojection, diffusion-based inpainting, and crossmodal image translation to synthesize multi-view, multi-modal image pairs with 3D geometric fidelity. Crucially, our method provides annotations that strictly adhere to 3D geometric consistency through explicit 3D reprojection, avoiding SfM-MVS error accumulation. Furthermore, AnyMatch offers strong scalability, enabling controllable scene diversity and annotation difficulty via adjustable input and camera parameters. We construct Any-syn, a large-scale synthetic multi-modal dataset using AnyMatch. Experimental results show that matching networks (e.g., LoFTR, EDM, RoMa) fine-tuned on Any-syn achieve substantial performance gains on multi-modal benchmarks, exhibiting superior generalization and robustness compared to models trained on existing data.

多模态图像匹配对于视觉定位和多传感器融合至关重要，但其发展受到缺乏具有精确几何标注的大规模训练数据的严重制约。现有的真实世界数据集存在标注成本高昂、场景多样性有限以及运动恢复结构-多视角立体管道误差累积等问题，而合成方法则难以保持三维几何一致性或实现逼真的外观表现。为解决这一问题，我们提出了AnyMatch，这是一种创新框架，能够以极低的成本利用丰富且易于获取的单视图图像来生成大规模多模态训练数据。AnyMatch整合了单目深度估计、三维重投影、基于扩散的修复以及跨模态图像翻译技术，以合成具有三维几何保真度的多视角、多模态图像对。关键在于，我们的方法通过显式三维重投影提供了严格遵循三维几何一致性的标注，避免了运动恢复结构-多视角立体误差的累积。此外，AnyMatch具有强大的可扩展性，能够通过可调整的输入和相机参数实现可控的场景多样性和标注难度。我们使用AnyMatch构建了Any-syn，这是一个大规模合成多模态数据集。实验结果表明，在Any-syn上微调的匹配网络（如LoFTR、EDM、RoMa）在多模态基准测试上取得了显著的性能提升，与在现有数据上训练的模型相比，表现出更强的泛化能力和鲁棒性。

Communication systems designed for reliable data reconstruction, rather than task-oriented communication, typically rely on separate source and channel coding and incur high latency under limited spectrum availability and fading channels. To address this, we propose a transmission framework with opportunistic spectrum access, in which the transmitter sends discrete latent representations learned via a vector-quantized variational autoencoder (VQ-VAE) over idle licensed channels using standard digital modulation. The AI-powered receiver is still able to reconstruct task-related information from the heavily compressed data. We develop a cross-layer latency model that accounts for compression, block errors, retransmissions, and stochastic channel access. Results on latency-accuracy trade-offs show that the proposed scheme achieves at least 79- and 3.3-fold latency reductions with only 5.7% and 2.4% drops in classification accuracy compared to benchmarks using conventional source and channel coding. The framework enables low-latency communication and reliable task execution even under limited spectrum availability and challenging channel conditions.

为可靠数据重建而设计的通信系统（而非任务导向通信）通常依赖分离的源信道编码，在频谱受限和衰落信道条件下会产生较高延迟。针对这一问题，我们提出了一种机会式频谱接入传输框架，其中发射机通过向量量化变分自编码器（VQ-VAE）学习离散潜在表示，并使用标准数字调制通过空闲授权信道进行发送。人工智能驱动的接收机仍能从高度压缩的数据中重建任务相关信息。我们开发了一种跨层延迟模型，考虑了压缩、块错误、重传和随机信道接入等因素。延迟-精度权衡结果表明，与使用传统源信道编码的基准方案相比，所提方案仅分别下降5.7%和2.4%的分类精度，即可实现至少79倍和3.3倍的延迟降低。该框架即使在频谱受限和信道条件恶劣的情况下也能实现低延迟通信和可靠的任务执行。

Visual token pruning is a crucial strategy for accelerating VLMs by compressing redundant image patches, yet existing methods often fail to preserve critical cues under dense instructions and fine-grained queries. In this paper, we investigate this failure and identify two underlying bottlenecks: the widespread dispersion of textual noise that corrupts dense cross-modal scoring, and the feature fragmentation inherent to standard token selection. To address these issues, we propose Entropy-Aware Dense Pruning (EADP), a framework that reformulates pruning as a structured compression problem. EADP first leverages statistical entropy to quantify and filter out textual noise, yielding a robust, fine-grained instruction relevance score. Subsequently, instead of naive Top-K selection, EADP casts token selection as a submodular maximization problem with a spatial prior, explicitly ensuring a holistic and non-redundant visual representation. Extensive experiments demonstrate that EADP improves the accuracy-efficiency trade-off of VLMs, robustly preserving fine-grained visual cues under strict token budgets while achieving SoTA performance on challenging multimodal benchmarks.

视觉token剪枝是压缩冗余图像块以加速视觉语言模型的关键策略，然而现有方法在密集指令和细粒度查询下往往无法保留关键信息。本文深入分析这一失效问题，识别出两个潜在瓶颈：文本噪声的广泛散布污染了密集跨模态评分，以及标准token选择中固有的特征碎片化。为解决这些问题，本文提出熵感知密集剪枝（EADP）框架，将剪枝问题重新表述为结构化压缩问题。EADP首先利用统计熵对文本噪声进行量化并过滤，从而获得稳健的细粒度指令相关性分数。随后，EADP不再进行简单的Top-K选择，而是将token选择建模为带空间先验的子模最大化问题，明确确保整体且非冗余的视觉表示。大量实验表明，EADP提升了视觉语言模型的精度-效率权衡，在严格的token预算下稳健保留细粒度视觉线索，并在具有挑战性的多模态基准测试上实现了最先进的性能。

Camera pose estimation from image streams is a critical component of spatial world models that integrate perception into planning and decision-making. Nearly all Visual Odometry (VO) and Simultaneous Localization and Mapping (V-SLAM) systems have focused on datasets containing raw, uncompressed videos. Many working systems instead use ubiquitous hardware units to efficiently compress and decode video streams, saving orders of magnitude in storage and bandwidth. However, this lossy compression introduces visual artifacts that hinder the performance of traditional tracking systems. We present VOCA, a causal stereo visual-odometry method that exploits codec information to improve tracking performance. We achieve state-of-the-art performance on causal VO for relative trajectory error, efficiency, and absolute trajectory error on compressed streams. This work highlights the potential of leveraging widely available video codec information for vision tasks.

从图像流中估计相机位姿是空间世界模型的关键组成部分，这些模型将感知整合到规划和决策中。几乎所有的视觉里程计(VO)和同步定位与地图构建(V-SLAM)系统都专注于包含原始未压缩视频的数据集。许多实际工作的系统转而使用常见的硬件单元来高效压缩和解码视频流，从而在存储和带宽方面节省数量级的资源。然而，这种有损压缩会引入视觉伪影，从而阻碍传统跟踪系统的性能。我们提出了VOCA，一种利用编解码器信息来提高跟踪性能的因果性立体视觉里程计方法。我们在压缩视频流上实现了因果视觉里程计的相对轨迹误差、效率和绝对轨迹误差的最先进性能。这项工作揭示了利用广泛可用的视频编解码器信息进行视觉任务的潜力。

We propose the first compression approach for image-to-shape Diffusion Transformers (DiTs) that substantially reduces model size while preserving geometric fidelity. Despite remarkable progress in 3D shape generation, large DiT-based models remain computationally prohibitive in resource-constrained settings. Furthermore, it is difficult to directly transfer existing diffusion model compression strategies developed for different domains to 3D generation, and prior 3D efficiency approaches focus primarily on inference speed rather than backbone compression. To address this limitation, we build a geometry-aware compression framework tailored to image-to-shape DiTs. Guided by the observation that 3D DiT layers exhibit non-uniform importance for geometry synthesis, we introduce a vitality-guided framework integrating structured pruning, adaptive quantization, and targeted fine-tuning. Our method achieves up to 66% model-size reduction across state-of-the-art image-to-3D models while maintaining synthesis fidelity comparable to full-sized counterparts. This highlights the potential of our framework as a plug-and-play solution for efficient 3D shape generation across diverse models.

我们提出了第一种针对图像到形状扩散变换器（DiTs）的压缩方法，该方法在保持几何保真度的同时大幅缩减模型尺寸。尽管3D形状生成取得了显著进展，但在资源受限的环境中，大型基于DiT的模型仍然计算成本高昂。此外，将其他领域开发的现有扩散模型压缩策略直接转移到3D生成领域存在困难，而现有的3D效率方法主要关注推理速度而非骨干网络压缩。为解决这一限制，我们构建了一个针对图像到形状DiT定制的几何感知压缩框架。基于3D DiT层对几何合成具有非均匀重要性这一观察，我们引入了一种活力感知框架，整合了结构化剪枝、自适应量化和针对性微调。我们的方法在最先进的图像到3D模型中实现了高达66%的模型尺寸缩减，同时保持与完整模型相当的合成保真度。这凸显了我们框架作为适用于多种模型的高效3D形状生成即插即用解决方案的潜力。

Recent advancements in scaling dataset distillation rely heavily on decoupled information extraction pipelines, comprising SQUEEZE, RECOVER, and RELABEL stages. Despite their scalability to large-scale datasets, these methods suffer from prohibitive computational overhead and poor cross-architecture generalization. In this paper, we reveal the root cause of these bottlenecks: the implicit dual-compression process, from data to model and back to images, inherently induces severe information loss. Crucially, we empirically and theoretically demonstrate that this loss creates a distribution shift that fundamentally compromises the widely adopted RELABEL strategy, transforming the pre-trained model into an unreliable labeler that yields sub-optimal labels. To overcome these critical flaws, we propose CIM, a novel, metric-driven framework that abandons the flawed dual-compression paradigm. Instead, CIM explicitly quantifies and minimizes the information gap between the original and synthetic datasets. By directly aligning the data distributions, our approach ensures high-fidelity information condensation and inherently satisfies the prerequisites for effective relabeling. Extensive experiments demonstrate that CIM establishes a new state-of-the-art. Notably, it distills ImageNet-1K at an IPC=10 in merely 80 minutes on a single RTX-4090 GPU, achieving an unprecedented 48.7% Top-1 accuracy on ResNet-18 and significantly outperforming previous SOTA approaches, such as NRR-DD and DELT, by 2.6% and 2.9%, respectively. Our code is available at https://github.com/LINs-lab/CIM.

近年来，数据集蒸馏的规模化扩展严重依赖于解耦的信息提取流水线，包括SQUEEZE、RECOVER和RELABEL阶段。尽管这些方法能够扩展到大规模数据集，但它们存在计算开销过大和跨架构泛化能力差的问题。本文揭示了这些瓶颈的根本原因：从数据到模型再回到图像的隐式双重压缩过程本质上会导致严重的信息损失。关键在于，我们通过实证和理论证明了这种损失会造成分布偏移，从而从根本上损害了广泛采用的RELABEL策略，使预训练模型变成不可靠的标注器，产生次优的标签。为了克服这些关键缺陷，我们提出了CIM，这是一个新颖的度量驱动框架，摒弃了有缺陷的双重压缩范式。相反，CIM显式地量化和最小化了原始数据集与合成数据集之间的信息差距。通过直接对齐数据分布，我们的方法确保了高保真的信息凝结，并内在地满足了有效重标注的前提条件。大量实验表明，CIM建立了新的最先进水平。值得注意的是，它在单个RTX-4090 GPU上仅用80分钟就完成了ImageNet-1K在IPC=10下的蒸馏，在ResNet-18上实现了前所未有的48.7%的Top-1准确率，分别比之前的SOTA方法NRR-DD和DELT高出2.6%和2.9%。我们的代码可在https://github.com/LINs-lab/CIM获取。

We present a novel paradigm for ultra-low-bitrate image compression (ULB-IC) that exploits the ``temporal&#x27;&x27; evolution in generative image compression. Specifically, we define an explicit intermediate state during decoding: a compact anchor frame, which preserves the scene geometry and semantic layout while discarding high-frequency details. We then reinterpret generative decoding as a virtual temporal transition from this anchor to the final reconstructed image. To model this progression, we leverage a pretrained video diffusion model (VDM) as a temporal prior: the anchor frame serves as the initial frame and the original image as the target frame, transforming the decoding process into a next-frame prediction task. In contrast to image diffusion-based ULB-IC models, our decoding proceeds from a visible, semantically faithful anchor, which improves both fidelity and realism for perceptual image compression. Extensive experiments demonstrate that our method achieves superior rate-distortion performance. On the CLIC2020 test set, our method achieves over 50% bitrate savings across LPIPS, DISTS, FID, and KID compared to DiffC, while also delivering a significant decoding speedup of up to $\times$5. Code will be released at https://github.com/UnoC-727/NeFIC.

本文提出了一种利用生成式图像压缩中时序演化特性的超低码率图像压缩（ULB-IC）新范式。具体而言，我们在解码过程中定义了一个显式的中间状态：紧凑锚帧，该锚帧在保留场景几何结构和语义布局的同时丢弃了高频细节。随后，我们将生成式解码重新解释为从该锚帧到最终重建图像的虚拟时序转换。为建模这一演化过程，我们利用预训练的视频扩散模型（VDM）作为时序先验：以锚帧作为起始帧，以原始图像作为目标帧，将解码过程转化为下一帧预测任务。与基于图像扩散的ULB-IC模型不同，我们的解码从可见的、语义保真的锚帧开始，这提升了感知图像压缩的保真度和真实感。大量实验表明，我们的方法在率失真性能上取得了优异表现。在CLIC2020测试集上，我们的方法在LPIPS、DISTS、FID和KID指标上相比DiffC实现了超过50%的码率节省，同时带来了最高达5倍的解码加速。代码将发布于 https://github.com/UnoC-727/NeFIC。