每日 arXiv 论文简报

Vision-language-action (VLA) models often expose spatial grounding through autoregressive text coordinates or opaque action tokens, creating brittle interfaces between multimodal reasoning and robot execution. We present Pointing-VLA, a typed hidden-state spatial readout built on Embodied-R1. Geometry-specific heads predict normalized points, object-functional grounding (OFG) heatmaps, and visual trajectories without serializing geometry as text. For the evaluated Bridge/WidowX and physical pick-place deployments, an explicit execution contract assigns PICK to source-conditioned OFG and PLACE to Pointing, providing direct stage-aligned spatial targets. Pointing-VLA achieves SOTA performance on Bridge/WidowX, averaging 72.9\% across the evaluated four-task set without Bridge-specific finetuning under collision-enabled CuRobo execution. Pointing and OFG show complementary strengths across native and cross-dataset evaluations. The OFG/contact readout transfers to NORA-1.5, preserving or improving success while reducing recorded controller time by more than 20$\times$; typed heads are also 6.68--6.90$\times$ faster than Embodied-R1 text decoding on a shared external suite. When integrated as spatial guidance for a $\pi_{0.5}$ action policy, Pointing-VLA raises autonomous real-robot success from 52.7\% to 80.7\% across three visual contexts. These results establish typed spatial readouts as an efficient, inspectable interface between embodied reasoning and robot execution.

视觉-语言-动作（VLA）模型通常通过自回归文本坐标或不透明的动作令牌来暴露空间接地，从而在多模态推理与机器人执行之间形成脆弱的接口。我们提出了Pointing-VLA，这是一种基于Embodied-R1构建的类型化隐藏状态空间读出方法。几何特定的头部预测归一化点、对象功能接地（OFG）热图和视觉轨迹，而无需将几何信息序列化为文本。在评估的Bridge/WidowX和物理抓取-放置部署中，显式执行契约为PICK分配源条件化OFG，为PLACE分配Pointing，提供直接阶段对齐的空间目标。Pointing-VLA在Bridge/WidowX上实现了最先进的性能，在启用碰撞的CuRobo执行下，于评估的四任务集上平均达到72.9%，且未进行Bridge特定的微调。Pointing和OFG在原生和跨数据集评估中展现出互补的优势。OFG/接触读出可迁移至NORA-1.5，在保持或提升成功的同时，将记录的控制器时间减少超过20倍；类型化头部在共享外部测试套件上也比Embodied-R1文本解码快6.68至6.90倍。当集成为π₀.₅动作策略的空间引导时，Pointing-VLA将三个视觉上下文下的自主实机器人成功率从52.7%提升至80.7%。这些结果确立了类型化空间读出作为具身推理与机器人执行之间高效、可检验接口的地位。

Interactive video generation and editing are becoming increasingly important for creative design. In this report, we introduce EditStream: a unified framework for interactive video generation and editing. EditStream unifies multiple video creation and manipulation tasks within a single DiT-based model through flexible task-specific conditioning, and further transforms it into a fast, few-step autoregressive model for efficient streaming. It supports Text-to-Video, Image-to-Video, Video-to-Video, Editing Propagation, Reference-guided Video Editing, and Camera Pose Change, enabling flexible control over video generation, transformation, and editing within one system. To make the unified model practical for interactive use, we develop a two-stage distillation approach that combines Velocity Moment Matching (VMM) with autoregressive unrolling. VMM matches conditional velocity moments at student-reached intermediate states to preserve generation quality and motion, while unrolling exposes the student to its own autoregressive predictions to improve temporal stability. Together, they alleviate common challenges in few-step autoregressive video generation, including over-saturation, degraded motion, temporal instability, and complex training. EditStream provides a practical and scalable solution that bridges high-quality diffusion-based video models with interactive creative workflows.

交互式视频生成与编辑在创意设计中日益重要。本报告介绍了EditStream：一个用于交互式视频生成与编辑的统一框架。EditStream通过灵活的任务特定条件化，将多种视频创建和操作任务统一到单一的基于DiT的模型中，并进一步将其转化为快速、少步骤的自回归模型以实现高效流式处理。该框架支持文生视频、图生视频、视频生视频、编辑传播、参考引导的视频编辑以及相机姿态变化，使得在一个系统内对视频生成、转换和编辑进行灵活控制成为可能。为了使统一模型适用于交互式使用，我们开发了一种两阶段蒸馏方法，将速度矩匹配（VMM）与自回归展开相结合。VMM在学生模型达到的中间状态匹配条件速度矩，以保留生成质量和运动特性；而展开过程使学生模型能够接触自身的自回归预测，从而提高时间稳定性。两者共同缓解了少步骤自回归视频生成中的常见挑战，包括过度饱和、运动退化、时间不稳定性和复杂训练问题。EditStream提供了一个实用且可扩展的解决方案，将高质量的基于扩散的视频模型与交互式创意工作流程连接起来。

While linear attention is a compelling mechanism for high-resolution object detection due to its reduced cost for global token mixing, converting the Softmax-attention ViT backbone of a trained detector into a linear-attention one is not a trivial drop-in replacement. Directly swapping the attention operator leads to severe performance degradation, and generic label-free distillation, though effective for classification, often fails on detection tasks. We argue that the central challenge is \textit{detector-interface preservation}: the converted backbone must reproduce the exact feature tensors expected by the fixed downstream detector, rather than merely imitating internal Softmax hidden states. To address this, we introduce Detector-Interface Distillation (DiD), a label-free conversion method that exclusively trains the linear-attention backbone by aligning detector-facing interface tensors with those of a frozen Softmax teacher. On DOTA-v1.5, DiD substantially outperforms established baselines and matches supervised, fully trained linear models. Adaptation completes in roughly 87 minutes on 4 GPUs, and the linearized backbone cuts inference latency by ~62% and peak memory by ~49%. We hope our findings offer the community a simple, label-free route to reusing trained Softmax detectors as efficient linear ones, and encourage interface-aware objectives in future architecture-conversion work.

线性注意力因其降低全局token混合成本的优势，成为高分辨率目标检测的一种引人关注的机制。然而，将训练好的检测器中的Softmax注意力ViT骨干网络转换为线性注意力网络并非简单的即插即用替换。直接替换注意力算子会导致严重的性能下降，而通用的无标签蒸馏方法虽对分类任务有效，但在检测任务上往往表现不佳。本文认为核心挑战在于检测器接口保护：转换后的骨干网络必须准确复现固定下游检测器所期望的特征张量，而非仅仅模仿内部Softmax隐藏状态。为此，本文提出检测器接口蒸馏（DiD），一种无标签转换方法，仅通过将面向检测器的接口张量与冻结的Softmax教师网络对齐来训练线性注意力骨干网络。在DOTA-v1.5数据集上，DiD显著优于现有基线方法，并与监督训练的线性模型性能相当。适配过程在4块GPU上约需87分钟完成，线性化后的骨干网络将推理延迟降低约62%，峰值内存减少约49%。本文希望为社区提供一种简单、无标签的方法，将训练好的Softmax检测器重用作高效的线性检测器，并鼓励未来架构转换工作中采用接口感知的目标函数。

Visual autoregressive (VAR) models have emerged as a fast, high-quality alternative to diffusion for text-to-image generation, but like diffusion models they exhibit persistent compositional failures, producing images that violate the attribute bindings and spatial relations specified in the prompt. While a rich line of test-time alignment methods has developed for diffusion, no comparable approach exists for next-scale VAR generation, whose stateful, discrete, multi-resolution sampling process makes existing techniques inapplicable. We close this gap with \textbf{VISTA} (\textbf{Vi}sual Autoregressive \textbf{S}emantic \textbf{T}est-time \textbf{A}lignment), the first gradient-based test-time alignment framework for next-scale autoregressive image generation. Built on Infinity, VISTA intervenes directly in the generation process, optimizing intermediate representations through the frozen transformer to steer visual predictions toward compositional constraints, without modifying model parameters or requiring additional training. VISTA introduces the mechanisms needed to make such optimization stable across scales, together with an extensible objective space that any differentiable constraint on cross-attention can plug into. Across two benchmarks and two model scales, VISTA improves every targeted compositional category, raising the mean targeted score by nearly 20\% on a 2B backbone and almost 6\% on an 8B backbone, with the largest gains on spatial relations. Image quality is preserved: an independent preference model VISTA never optimizes scores its outputs nearly 20\% higher. Notably, the 2B model with VISTA surpasses a backbone four times its size, indicating that a substantial part of the compositional gap between model scales is recoverable at test time.

视觉自回归（VAR）模型作为文本到图像生成的替代方案，在速度和图像质量方面可与扩散模型相媲美，但与扩散模型类似，它们也存在持续的组合失败问题，生成的图像会违反提示词中指定的属性绑定和空间关系。丰富的测试时对齐方法已针对扩散模型发展起来，但对于下一代尺度（next-scale）的VAR生成，尚无类似方法可用，因为其有状态的、离散的、多分辨率采样过程使得现有技术无法适用。我们通过VISTA（Visual Autoregressive Semantic Test-time Alignment，视觉自回归语义测试时对齐）填补了这一空白，这是首个针对下一代自回归图像生成的基于梯度的测试时对齐框架。VISTA基于Infinity构建，直接干预生成过程，通过冻结的Transformer优化中间表征，以将视觉预测引导至组合约束，而无需修改模型参数或进行额外训练。VISTA引入了在跨尺度优化中保持稳定所需的机制，以及一个可扩展的目标空间，任何可微分的交叉注意力约束都可以接入其中。在两个基准测试和两个模型规模上，VISTA改善了每个目标组合类别，使2B骨干网络的平均目标得分提高近20%，8B骨干网络提高近6%，其中空间关系的提升幅度最大。图像质量得到保持：VISTA从未优化其输出的独立偏好模型得分几乎高出20%。值得注意的是，采用VISTA的2B模型超越了其四倍规模的骨干网络，表明模型规模之间的组合差距有很大一部分可以在测试时恢复。

We present EchoWM, an omnimodal world model for enterable generative media that responds to continuous navigation while jointly generating 720p video, environmental sound, music and speech. We organize interaction around camera intent: in first-person scenes, it specifies observer motion, while in third-person scenes, camera--character dynamics are learned from data without view-specific controllers. Discrete commands and continuous poses are mapped to a shared metric-scale relative 6-DoF trajectory, with dataset-level calibration preserving motion magnitude across heterogeneous data. To jointly learn audio-visual generation and trajectory control, we construct a complementary data engine and adopt progressive training followed by autoregressive post-training for long-horizon generation. Extensive evaluations show that \model achieves strong trajectory following and high visual quality on public world-model benchmarks, supporting both first- and third-person interaction across varied subjects, and maintaining synchronized environmental sound and speech over long-horizon generation.

我们提出EchoWM，一个用于可进入生成媒体的全模态世界模型，它在响应连续导航的同时联合生成720p视频、环境声音、音乐和语音。我们围绕相机意图组织交互：在第一人称场景中，它指定观察者运动；而在第三人称场景中，相机-角色动态从数据中学习，无需视角特定控制器。离散命令和连续姿态被映射到共享的公制尺度相对6自由度轨迹，数据集级校准在不同数据间保持运动幅度。为了联合学习视听生成和轨迹控制，我们构建了一个补充数据引擎，并采用渐进式训练，随后进行自回归后训练以实现长时序生成。广泛评估表明，EchoWM在公开世界模型基准上实现了强大的轨迹跟随和高视觉质量，支持各种主体的第一和第三人称交互，并在长时序生成中保持同步的环境声音和语音。

Text-driven human motion synthesis has made substantial development with two core modules of motion representation and generative architecture. For representation, Vector Quantization (VQ)-based methods compress motion data into discrete tokens while latent-based models operate directly in continuous space. However, both of these representations exhibit significant limitations. VQ-based methods suffer from inherent information loss, which compromises the quality, diversity, and generalization of generated motions, while continuous representation on holistic whole-body motion hinders part-level flexibility. For architecture, diffusion and autoregressive diffusion models have demonstrated their superiority, yet the fine-grained controllability over individual body parts is also limited. Thus, we propose a unified spatiotemporally decoupled framework named DeMoDiff, which jointly redesigns representation and architecture. To enhance representation extraction capabilities and offer greater part-level controllability, we present a spatial-temporal VAE that encodes each body joint rather than compressing the whole-body motion into a single latent space. Then, we incorporate spatial-temporal masking and attention mechanisms into an autoregressive diffusion generator, achieving both generative capability and controllable editability. Extensive experiments on the HumanML3D and KIT-ML datasets demonstrate that our model achieves state-of-the-art reconstruction performance and compelling motion generation results. Moreover, our framework demonstrates strong temporal and spatial editing capabilities, further validating its effectiveness. Our project page: https://rex0191.github.io/DeMoDiff/

文本驱动的人体动作合成在动作表示和生成架构两个核心模块上取得了实质性发展。在表示层面，基于矢量量化（VQ）的方法将动作数据压缩为离散标记，而基于潜在空间的模型则在连续空间中运作。然而，这两种表示方法都存在显著的局限性。基于VQ的方法遭受固有信息损失的困扰，这损害了生成动作的质量、多样性和泛化能力；而整体全身动作的连续表示则阻碍了部位级别的灵活性。在架构层面，扩散模型和自回归扩散模型已展现出其优越性，但对各个身体部位的细粒度可控性同样有限。因此，我们提出了一个统一的时空解耦框架DeMoDiff，同时重新设计表示方法和架构。为了增强表示提取能力并提供更强的部位级可控性，我们提出了一种时空变分自编码器（VAE），它对每个身体关节进行编码，而非将全身动作压缩到单一潜在空间中。随后，我们将时空掩码和注意力机制融入自回归扩散生成器中，实现了生成能力和可控编辑性。在HumanML3D和KIT-ML数据集上的大量实验表明，我们的模型实现了最先进的重建性能，并获得了令人信服的动作生成结果。此外，我们的框架展现了强大的时间和空间编辑能力，进一步验证了其有效性。项目主页：https://rex0191.github.io/DeMoDiff/

Photorealistic novel view synthesis of people remains challenging at high spatial resolutions and across multiple target cameras, where preserving identity, fine appearance details, and geometric coherence is critical. We build on the next-scale autoregressive paradigm and adapt it for human-centric view synthesis by enabling higher image resolutions, multi-view outputs and stronger cross-view consistency in a single forward pass. We train on a synthetic dataset of human faces spanning diverse identities and apparel. Contrary to diffusion models, this paradigm does not need 2D pre-training and, thanks to its next-scale architecture, it benefits from lower-resolution, general-purpose pre-trainings, with the full-sized purpose-specific images being used only in the last training stages. This enables our architecture to converge with a smaller amount of purpose-specific training data, allowing us to use a smaller but more realistic training dataset. The resulting model produces sharp and realistic views, with the option to synthesize multiple novel viewpoints simultaneously for improved agreement across views. Empirically, we observe gains in perceptual fidelity and cross-view coherence on human subjects, demonstrating that next-scale autoregression is an effective backbone for scalable, multi-output human view synthesis. We also couple our pipeline with an existing transformer-based model for pixel-aligned 3D gaussian lifting from multi-view facial inputs, resulting in accurate and photorealistic 3D models of human faces.

在高的空间分辨率和多个目标相机条件下实现人物的逼真新视角合成仍然具有挑战性，其中保持身份特征、细微外观细节和几何一致性至关重要。我们基于下一代自回归范式进行构建，通过在单次前向传播中实现更高的图像分辨率、多视角输出和更强的跨视角一致性，使其适用于以人为中心的视角合成。我们在包含多样身份和服装的人脸合成数据集上进行训练。与扩散模型不同，该范式不需要2D预训练，并且得益于其跨尺度架构，可以从低分辨率的通用预训练中获益，完整尺寸的专用图像仅在最后训练阶段使用。这使得我们的架构能够使用更少量的专用训练数据实现收敛，从而可以使用更小但更逼真的训练数据集。生成的模型能够产生清晰逼真的视角，并可以选择同时合成多个新视角以提高视角间的一致性。根据实验结果，我们观察到在人体对象上感知保真度和跨视角一致性的提升，证明了下一代自回归是用于可扩展多输出人体视角合成的有效骨干网络。我们还将我们的流程与现有的基于Transformer的模型相结合，用于从多视角人脸输入进行像素对齐的3D高斯提升，从而实现了准确且逼真的人脸3D模型。

Observing certain patches in an image reduces the uncertainty of others. Their realization lowers the distribution entropy of each remaining patch feature, analogous to collapsing a particle's wave function in quantum mechanics. This phenomenon can intuitively be called patch collapse. To identify which patches are most relied on during a target region&x27;s collapse, we learn an autoencoder that softly selects a subset of informative patches during reconstruction. Graphing these learned dependencies for each patch's PageRank score reveals the optimal patch order to realize an image. We show that respecting this order benefits various masked image modeling methods. First, autoregressive image generation can be boosted by finetuning with the ordered generation sequence. Second, we introduce a new setup for image classification by exposing Vision Transformers only to high-rank patches in the collapse order. Seeing 22% of such patches is sufficient to achieve high accuracy. With these experiments, we propose patch collapse as a novel image modeling perspective that promotes vision efficiency.

观察图像中的某些块会降低其他块的不确定性。它们的确定会降低每个剩余块特征的分布熵，类似于量子力学中粒子波函数的坍缩。这种现象可以直观地称为块坍缩。为了识别在目标区域坍缩过程中最依赖哪些块，我们学习了一个在重建过程中软选择信息块子集的自编码器。计算每个块的PageRank分数并绘制这些学习到的依赖关系，揭示了实现图像的最佳块顺序。我们表明，遵守这一顺序对各种掩码图像建模方法都有益处。首先，可以通过使用有序生成序列进行微调来提升自回归图像生成。其次，我们引入了一种新的图像分类设置，仅向Vision Transformers展示坍缩顺序中的高排名块。只需观察22%的此类块即可达到高精度。通过这些实验，我们提出块坍缩作为一种促进视觉效率的新型图像建模视角。

Text-to-motion generation has advanced with larger corpora and stronger generators, yet many models still rely on holistic frame- or clip-level latents that entangle trajectory, orientation, and articulation. This entanglement obscures body topology and forces the generator to recover kinematic structure implicitly. We present \name, a SMPL motion generation framework that factorizes motion into continuous kinematic-unit latents. A causal Motion VAE maps motion to a time-by-kinematic-unit latent manifold, and a Kinematic-Unit Flow Transformer performs text-conditioned flow matching in this structured space. Because each latent coordinate remains tied to a physical body unit, \name can use kinematic-tree rotary position encoding and kinematic-adaptive flow scheduling. We further train the generator with per-token timesteps over clean-context/noisy-target masks, enabling frame-conditioned continuation and autoregressive segment chaining within one model. Experiments first validate the representation: the kinematic-unit VAE achieves lower geometry, rotation, and feature errors than existing motion tokenizers, showing that the latent space preserves articulated structure rather than merely compressing frames. With a 1.4B-parameter generator trained only on publicly available academic motion--text data, \name outperforms all evaluated academic-data text-to-motion baselines and remains competitive with systems trained on much larger non-public motion corpora. Without task-specific retraining, the same formulation also improves prefix-conditioned generation, BABEL sequential rollout, and narrative motion composition. These results indicate that kinematic-unit latent factorization provides an effective generation substrate for controllable SMPL motion synthesis. Code will be released at https://github.com/ZeyuLing/PRISM.

文本到动作生成随着更大规模的语料库和更强的生成器而取得了进展，然而许多模型仍然依赖整体帧级或片段级的潜在变量，这些变量将轨迹、方向和关节运动纠缠在一起。这种纠缠模糊了身体拓扑结构，并迫使生成器隐式地恢复运动学结构。我们提出了PRISM，一个将运动分解为连续关节单元潜在变量的SMPL动作生成框架。一个因果运动VAE将运动映射到时间×关节单元的潜在流形上，一个关节单元流Transformer在该结构化空间中执行文本条件流匹配。由于每个潜在坐标都与物理身体单元绑定，PRISM可以使用运动树旋转位置编码和关节自适应流调度。我们进一步通过逐令牌时间步对清洁上下文/噪声目标掩码进行训练，使模型能够在一个模型内实现帧条件延续和自回归片段链接。实验首先验证了表示方法：关节单元VAE在几何、旋转和特征误差方面均优于现有的动作分词器，表明潜在空间保留了关节结构而不仅仅是压缩帧。在仅使用公开学术动作-文本数据训练的1.4B参数生成器上，PRISM在所有评估的学术数据文本到动作基线中表现最优，并与在更大非公开运动语料库上训练的系统保持竞争力。相同的公式无需针对任务的重新训练即可改进前缀条件生成、BABEL顺序展开和叙事动作合成。这些结果表明，关节单元潜在分解为可控SMPL动作合成提供了有效的生成基础。代码将发布于 https://github.com/ZeyuLing/PRISM。

This paper addresses the problem of image denoising for grayscale images. We propose a probabilistic image generative model that combines a quadtree region-partitioning model with a mixture autoregressive model, and propose a framework that reduces MAP (maximum a posteriori)-estimation-based denoising to the maximization of a variational lower bound. To maximize this lower bound, we develop an algorithm that alternately applies variational Bayes and gradient methods. We particularly demonstrate that the gradient-based update rule can be computed analytically without numerical computation or approximation. We carried out some experiments to verify that the proposed algorithm actually removes image noise and to identify directions for future improvement.

本文针对灰度图像的去噪问题进行研究。我们提出了一种结合四叉树区域划分模型与混合自回归模型的概率图像生成模型，并提出了一个将基于最大后验概率（MAP）估计的去噪问题转化为变分下界最大化问题的框架。为最大化该变分下界，我们设计了一种交替使用变分贝叶斯与梯度方法的算法。特别地，我们证明了基于梯度的更新规则可以进行解析计算，无需数值计算或近似。我们开展了一系列实验以验证所提算法确实能够去除图像噪声，并指出了未来改进的方向。

While text-to-3D generation has advanced rapidly, achieving high geometric fidelity at low inference cost remains challenging. Existing text-to-3D methods either decode discrete shape tokens autoregressively or iteratively refine global 3D representations with diffusion or flow models. However, autoregressive decoding is sequential and cannot revise errors, whereas diffusion and flow-matching models repeatedly process the full representation, making high-quality generation increasingly expensive. In this paper, we propose Block3D, a block-wise diffusion framework that partitions the discrete shape-token sequence into contiguous blocks, generates the blocks autoregressively, and jointly denoises all tokens within the current block. To alleviate error accumulation, we introduce confidence-guided intra-block correction, which revises low-confidence tokens before each block is finalized. On a held-out set from TRELLIS-500K, Block3D reduces mean end-to-end generation time from 25.71 seconds to 4.99 seconds, achieving a $5.15\times$ speedup over the fine-tuned autoregressive baseline without sacrificing geometric fidelity.

虽然文本到3D生成发展迅速，但在低推理成本下实现高几何保真度仍然具有挑战性。现有的文本到3D方法要么通过自回归方式解码离散形状标记，要么使用扩散或流模型迭代优化全局3D表示。然而，自回归解码是顺序执行的，无法修正错误；而扩散和流匹配模型则反复处理整个表示，使得高质量生成的成本越来越高。在本文中，我们提出了Block3D，这是一种分块扩散框架，它将离散形状标记序列划分为连续块，自回归地生成这些块，并在当前块内联合去噪所有标记。为了减轻错误累积，我们引入了置信度引导的块内校正机制，在每个块最终确定之前修正低置信度标记。在TRELLIS-500K的保留测试集上，Block3D将平均端到端生成时间从25.71秒减少到4.99秒，相比微调后的自回归基线实现了5.15倍的加速，同时不牺牲几何保真度。

With the rapid progress of diffusion models and large-scale video generation, generative world models are increasingly expected to replace traditional simulators, including physics engines, game engines, and reinforcement-learning environments. Yet the remaining distance from generation to simulation lacks a systematic assessment. We present a capability-based study using an external yardstick: eight capabilities of a traditional simulator, namely asset construction, physics engine, interaction, controllability, stability, state feedback, diversity, and evaluation metrics. We trace three main technical routes--latent dynamics, video generation, and joint-embedding prediction--and map exactly 200 representative works published from 2018 to June 2026 onto these capabilities. Our analysis shows that world models have achieved functional substitution in interaction and controllability for specific scenarios, but remain short of traditional simulators in formal guarantees of physical laws, structured state feedback, and reproducible long-horizon evolution. State feedback is the most neglected cross-route shortcoming: only 6 of 163 implementation papers expose a runtime interface for querying entity states or physical parameters. We identify six research directions: formalized physics, a unified action interface, first-class state feedback, long-horizon stability, downstream-utility evaluation, and cross-route hybridization. Project page: https://github.com/AtongWang/world-model-simulators

随着扩散模型和大规模视频生成的快速发展，生成式世界模型越来越有望取代传统模拟器，包括物理引擎、游戏引擎和强化学习环境。然而，从生成到模拟之间的差距仍缺乏系统性评估。我们采用外部标准进行了一项基于能力的研究：传统模拟器的八项能力，即资产构建、物理引擎、交互性、可控性、稳定性、状态反馈、多样性和评估指标。我们追溯了三条主要技术路线——潜动力学、视频生成和联合嵌入预测——并将2018年至2026年6月间发表的200篇代表性论文精确映射到这些能力上。我们的分析表明，世界模型已在特定场景下实现了交互性和可控性的功能替代，但在物理定律的形式化保证、结构化状态反馈和可复现的长时域演化方面仍不及传统模拟器。状态反馈是被忽视的最严重的跨路线缺陷：163篇实现论文中仅有6篇提供了用于查询实体状态或物理参数的运行时接口。我们识别出六个研究方向：形式化物理、统一动作接口、原生长时域稳定性、下游效用评估和跨路线混合。项目主页：https://github.com/AtongWang/world-model-simulators

NoMaD [31] is a learned vision-navigation policy that unifies goal-conditioned navigation and exploration in a single goal-masked diffusion policy. In an unseen environment, however - where neither a goal image nor a topological map is available - it can only explore undirectedly, wandering without global awareness. We present ODG-NoMaD, which gives NoMaD's exploration mode a global sense of where to proceed, without retraining the policy. An overhead depth camera is used once on deployment to build an occupancy map and plan a global path, which is segmented to yield a desired heading; a per-frame traversability map from the robot&x27;s onboard depth then refines this into a collision-free direction. The gradient of a cosine direction cost is injected into the final denoising steps, rotating sampled trajectories toward this direction while preserving the multimodality of exploration. In simulated office environments with and without random obstacles, ODG-NoMaD reduces the residual distance to the target by up to an order of magnitude over unguided exploration, outperforms the point-goal cost guidance of NaviDiffusor [37], and is the only configuration that remains collision-free on every trial.

NoMaD是一种学习的视觉导航策略，将目标条件导航和探索统一在单一的目标掩码扩散策略中。然而，在未见环境中——既没有目标图像也没有拓扑地图可用——它只能无方向地探索，缺乏全局感知。我们提出了ODG-NoMaD，它赋予NoMaD的探索模式全局的方向感，而无需重新训练策略。在部署时使用一次俯视深度摄像头构建占用地图并规划全局路径，然后分割该路径得到期望航向；来自机器人车载深度的逐帧可通行性地图进一步将其精炼为无碰撞方向。余弦方向成本的梯度被注入到最终的降噪步骤中，将采样轨迹转向该方向，同时保持探索的多模态性。在有无随机障碍物的模拟办公环境中，ODG-NoMaD将目标的残余距离比无引导探索减少了一个数量级，优于NaviDiffuror的点目标成本引导，并且是唯一在每次试验中保持无碰撞的配置。

Continuous-time flow and diffusion models are widely used across many application domains, from large-scale deployment in computer vision and protein folding to emerging adoption for modeling language, time series, and quantum states. After training, inferring statistical properties from continuous-time models is costly. Wavefunction flows target this cost by recasting learned transport as unitary evolution, whose final Born distribution approximates the target distribution. This prepares a coherent amplitude encoding (a qsample) that can be post-processed by quantum algorithms offering a quadratic advantage over Monte Carlo sampling. We present the first numerical study of these flows, in which we represent time-dependent potentials and states as tensor networks. At spatial dimension $d=8$, storage falls by $\sim 10^7\times$ relative to the dense grid of $N^d$ points, and evolution wall-clock time falls by $\gtrsim 10^3\times$ against a baseline extrapolated from the measured $d\le 5$ scaling. We validate our pipeline by reproducing the $O(1/\sqrt{p_{\rm rare}})$ scaling of rare-event sampling.

连续时间流模型和扩散模型广泛应用于诸多领域，从计算机视觉和蛋白质折叠的大规模部署，到新兴的语言、时间序列和量子态建模。训练后，从连续时间模型推断统计性质代价高昂。波函数流模型通过将学习到的传输重新诠释为酉演化来解决这一成本问题，其最终玻恩分布近似目标分布。这制备了一种相干振幅编码（qsample），可由量子算法进行后处理，相较于蒙特卡洛采样具有二次加速优势。我们首次实现了这些流模型的数值研究，其中将含时势和态表示为张量网络。在空间维度d=8时，相对于包含N^d个点的密集网格，存储需求降低约10^7倍，且演化实际运行时间相较于从测量到的d≤5 scaling外推的基线降低超过10^3倍。我们通过复现稀有事件采样的O(1/√p_rare)标度行为来验证我们的流程。

Text-to-image (T2I) diffusion models offer powerful visual generation, but their controllability creates a critical safety challenge: adversarial prompts can steer the denoising trajectory toward policy-violating content such as explicit nudity or graphic violence. Existing safeguards mostly act before generation through prompt filtering or after generation through image classification, leaving the diffusion process itself unguarded and often yielding only refusal rather than safe visual repair. We introduce GuardPaint, a speculative decoding framework for safe T2I generation that intervenes inside the diffusion trajectory without modifying the base model. A lightweight auditor monitors intermediate images, localizes unsafe regions, and triggers surgical inpainting repair only where needed. Candidate repairs are generated by a policy-aligned inpainter and selected through a guarded tournament that accepts edits only when they improve policy compliance while preserving prompt fidelity and perceptual quality. Across five jailbreak families SneakPrompt, MMA, PGJ, DACA, and RABell and UNet/flow-matching models including SD~1.5, SDXL, SD~3.5, and FLUX.1-dev. GuardPaint reduces attack success and harmful generations with minimal degradation to image quality, prompt fidelity, and benign behavior. Content warning: This paper contains examples involving nudity and violence that some readers may find disturbing, distressing, or offensive.

文本到图像（T2I）扩散模型提供了强大的视觉生成能力，但其可控性带来了关键的安全挑战：对抗性提示词可以引导去噪轨迹趋向于违反策略的内容，如裸露画面或暴力场景。现有防护措施主要在生成前通过提示词过滤或在生成后通过图像分类来实施，而扩散过程本身缺乏保护，且通常仅能产生拒绝响应而无法实现安全的视觉修复。 我们提出了GuardPaint，这是一种用于安全T2I生成的推测性解码框架，它在无需修改基础模型的情况下介入扩散轨迹。轻量级审计器监控中间图像，定位不安全区域，并仅在必要时触发精准修复。候选修复由策略对齐的修复器生成，并通过守护选拔机制进行筛选——仅当编辑能够提升策略合规性同时保持提示词保真度和感知质量时才会被采纳。 在五个越狱攻击家族（SneakPrompt、MMA、PGJ、DACA和RABell）以及UNet/流匹配模型（包括SD 1.5、SDXL、SD 3.5和FLUX.1-dev）上的实验表明，GuardPaint在将攻击成功率和有害生成降至最低的同时，对图像质量、提示词保真度和良性行为的影响微乎其微。 内容警告：本文包含可能令部分读者感到不安、困扰或反感的身体裸露及暴力示例。

Generative adversarial networks (GANs) can provide efficient image generation, while diffusion models offer high-quality image restoration but require iterative sampling. This paper presents a hybrid GAN-guided diffusion framework that uses a pretrained Wasserstein GAN with gradient penalty (WGAN-GP) as a feature prior for conditional diffusion-based image restoration. Intermediate features from the frozen WGAN-GP generator are incorporated into a diffusion U-Net through cross-attention and remain fixed during the DDIM sampling process. The framework is evaluated on two restoration tasks, Gaussian denoising and 2Xsuper-resolution, using CelebA face images. During development, several sources of instability were identified and addressed, including adversarial learning-rate imbalance, inappropriate diffusion initialization, excessive corruption, and insufficient parameter averaging. The resulting framework consistently improves the quality of both degraded and low-resolution images. In particular, it improves denoising performance by 4.40 dB in PSNR and super-resolution performance by 3.70 dB over their respective input baselines. These results demonstrate the potential of a frozen GAN feature prior to guide diffusion models toward stable and effective image restoration.

生成对抗网络（GAN）能够提供高效的图像生成，而扩散模型可实现高质量的图像修复但需要迭代采样。本文提出了一种混合GAN引导扩散框架，该框架使用预训练的带梯度惩罚的Wasserstein GAN（WGAN-GP）作为特征先验，用于基于条件扩散的图像修复。冻结的WGAN-GP生成器的中间特征通过交叉注意力机制嵌入到扩散U-Net中，并在DDIM采样过程中保持固定。该框架在CelebA人脸图像上针对高斯去噪和2倍超分辨率两项修复任务进行了评估。在开发过程中，我们识别并解决了多个不稳定因素，包括对抗性学习率失衡、不恰当的扩散初始化、过度损坏以及参数平均不足等问题。最终，该框架持续提升了退化图像和低分辨率图像的质量。具体而言，相较于各自的输入基线，去噪性能提升了4.40 dB的峰值信噪比（PSNR），超分辨率性能提升了3.70 dB。这些结果表明，冻结的GAN特征先验能够引导扩散模型实现稳定且有效的图像修复。

Discrete Diffusion Models (DDMs) have recently been introduced to recommendation systems, modeling user history as a token generation process via iterative denoising. However, while effective at capturing user-level sequential patterns, these methods often fail to explicitly integrate item-based collaborative filtering information, a critical component for accurate recommendation. This deficiency manifests in two key aspects: (1) the item representation is often semantic-focused, lacking collaborative priors for diffusion training; and (2) the denoising process employs a uniform noise schedule, treating all tokens indiscriminately and ignoring item-level adaptive structural dependencies. To bridge this gap, we propose ANR-DiffRec, a unified framework designed to encode item-based collaborative structures into discrete diffusion for generative recommendation. First, we explicitly incorporate an item co-occurrence matrix to guide semantic ID generation, providing a structured collaborative prior for discrete diffusion training. Second, we introduce an item-based adaptive noise rescheduling mechanism that dynamically adjusts denoising weights according to both local contextual recoverability and behavior-aware item dependencies. Specifically, the proposed strategy jointly models intra-item structural context and inter-item collaborative signals, enabling structure-aware denoising during diffusion training. Extensive experiments on multiple benchmarks demonstrate that our method consistently outperforms state-of-the-art generative recommendation models. Code: https://github.com/CalmaQi/ANR-DiffRec.

离散扩散模型（DDMs）已被引入推荐系统，通过迭代去噪将用户历史建模为令牌生成过程。然而，虽然这些方法在捕捉用户级序列模式方面有效，但往往无法明确整合基于项目的协作过滤信息，而这是精确推荐的关键组件。这种不足主要体现在两个方面：（1）项目表示通常侧重于语义，缺乏扩散训练的协作先验；（2）去噪过程采用统一噪声调度，不加区分地对待所有令牌，忽略了项目级的自适应结构依赖。为弥补这一差距，我们提出了ANR-DiffRec，这是一个将基于项目的协作结构编码到离散扩散生成式推荐中的统一框架。首先，我们明确引入项目共现矩阵来引导语义ID生成，为离散扩散训练提供结构化协作先验。其次，我们引入了一种基于项目的自适应噪声重调度机制，根据局部上下文可恢复性和行为感知的项目依赖动态调整去噪权重。具体而言，所提出的策略联合建模项目内结构上下文和项目间协作信号，使扩散训练能够进行结构感知的去噪。在多个基准数据集上的大量实验表明，我们的方法始终优于最先进的生成式推荐模型。代码：https://github.com/CalmaQi/ANR-DiffRec

Diffusion Transformers (DiTs) have shown strong performance in high-fidelity image generation, but their sampling process remains computationally intensive due to full model execution at every timestep. While cache-based acceleration has been explored to mitigate inference cost, naive reuse schemes suffer from low accuracy over long intervals, and Taylor-series-based extrapolation methods often face instability caused by Runge oscillations. In this paper, we propose ChebBooster, a training-free extrapolation framework based on Chebyshev polynomial theory that achieves stable and efficient acceleration for DiTs. Specifically, we adopt the Barycentric formulation to evaluate Chebyshev approximants with high numerical stability and minimal overhead, and further decouple the extrapolation into an offline weight precomputation phase and a lightweight online application stage. Extensive experiments across three representative DiT-based models, including DiT-XL/2, PixArt-$\Sigma$, and FLUX.1-dev, demonstrate that ChebBooster achieves consistent improvements in visual quality and inference efficiency, reaching up to $3.68\times$ latency speedup and $5.12\times$ FLOPs reduction, outperforming existing training-free baselines under diverse generation tasks and resolutions.

扩散变换器（Diffusion Transformers，DiTs）在高保真图像生成方面表现出色，但由于每个时间步都需要完整运行模型，其采样过程计算成本较高。虽然基于缓存的加速方法已被探索以降低推理成本，但简单的重用方案在长间隔情况下精度较低，而基于泰勒级数的外推方法常面临由龙格振荡引起的稳定性问题。本论文提出ChebBooster，这是一个基于切比雪夫多项式理论的训练无关外推框架，能够实现稳定且高效的多步推理加速。具体而言，我们采用重心公式来评估切比雪夫近似值，以确保高数值稳定性和最小开销，并进一步将外推解耦为离线权重预计算阶段和轻量级在线应用阶段。在三个具有代表性的DiT模型上进行了大量实验，包括DiT-XL/2、PixArt-Σ和FLUX.1-dev，结果表明ChebBooster在视觉质量和推理效率方面实现了显著提升，延迟加速最高达3.68倍，FLOPs降低最高达5.12倍，在不同的生成任务和分辨率下均优于现有的训练无关基线方法。

Underwater image enhancement (UIE) has attracted much attention owing to its importance for underwater operation and marine engineering. Motivated by the recent advance in generative models, we propose a novel UIE method based on image-conditional diffusion transformer (ICDT). Our method takes the degraded underwater image as the conditional input and converts it into latent space where ICDT is applied. ICDT replaces the conventional U-Net backbone in a denoising diffusion probabilistic model (DDPM) with a transformer, and thus inherits favorable properties such as scalability from transformers. Furthermore, we train ICDT with a hybrid loss function involving variances to achieve better log-likelihoods, which meanwhile significantly accelerates the sampling process. We experimentally assess the scalability of ICDTs and compare with prior works in UIE on the Underwater ImageNet dataset. Besides good scaling properties, our largest model, ICDT-XL/2, outperforms all comparison methods, achieving state-of-the-art (SOTA) quality of image enhancement.

水下图像增强（UIE）由于其在水下作业和海洋工程中的重要性而受到广泛关注。受生成模型最新进展的启发，我们提出了一种基于图像条件扩散变换器（ICDT）的新型UIE方法。我们的方法将退化的水下图像作为条件输入，并将其转换到潜在空间，在该空间中应用ICDT。ICDT用变换器取代了去噪扩散概率模型（DDPM）中传统的U-Net骨干网络，从而继承了变换器的可扩展性等优良特性。此外，我们使用涉及方差的混合损失函数训练ICDT，以实现更好的对数似然，同时显著加速采样过程。我们在Underwater ImageNet数据集上评估了ICDT的可扩展性，并与现有的UIE方法进行了比较。除了良好的扩展特性外，我们最大的模型ICDT-XL/2优于所有比较方法，实现了图像增强的先进水平（SOTA）质量。

Seismic acoustic impedance plays a crucial role in lithological identification and subsurface structure interpretation. However, due to the inherently ill-posed nature of the inversion problem, directly estimating impedance from post-stack seismic data remains highly challenging. Recently, diffusion models have shown great potential in addressing such inverse problems due to their strong prior learning and generative capabilities. Nevertheless, most existing methods operate in the pixel domain and require multiple iterations, limiting their applicability to field data. To alleviate these limitations, we propose a novel seismic acoustic impedance inversion framework based on a conditional latent generative diffusion model, where the inversion process is made in latent space. To avoid introducing additional training overhead when embedding conditional inputs, we design a lightweight wavelet-based module into the framework to project seismic data and reuse an encoder trained on impedance to embed low-frequency impedance into the latent space. Furthermore, we propose a model-driven sampling strategy during the inversion process of this framework to enhance accuracy and reduce the number of required diffusion steps. Numerical experiments on a synthetic model demonstrate that the proposed method achieves high inversion accuracy and strong generalization capability within only a few diffusion steps. Moreover, application to field data reveals enhanced geological detail and higher consistency with well-log measurements, validating the effectiveness and practicality of the proposed approach.

地震声阻抗在岩性识别和地下结构解释中起着至关重要的作用。然而，由于反演问题本身具有病态性质，直接从叠加后地震数据估算阻抗仍然极具挑战性。近年来，扩散模型因其强大的先验学习和生成能力，在解决此类逆问题方面展现出巨大潜力。然而，现有大多数方法在像素域中运作，需要多次迭代，限制了其对实际数据的适用性。为缓解这些局限性，我们提出了一种基于条件潜在生成扩散模型的新型地震声阻抗反演框架，其中反演过程在潜在空间中完成。为避免在嵌入条件输入时引入额外的训练开销，我们设计了一个轻量级的小波模块来投影地震数据，并复用了一个在阻抗数据上训练的编码器，将低频阻抗嵌入到潜在空间中。此外，我们在该框架的反演过程中提出了一种模型驱动的采样策略，以提高精度并减少所需的扩散步数。合成模型上的数值实验表明，所提方法仅需少量扩散步数即可获得较高的反演精度和较强的泛化能力。实际数据的应用结果显示增强的地质细节和与井测测量更高的一致性，验证了所提方法的有效性和实用性。

Motivated by challenges in conditional generative modeling, where the target conditional density takes the form of a ratio f1 over f2, this paper develops a theoretical framework for approximating such ratio-type functionals. Here, f1 and f2 are kernel-based marginal densities that capture structured interactions, a setting central to diffusion-based generative models. We provide a concise proof for approximating these ratio-type functionals using deep neural networks with the SignReLU activation function, leveraging the activation's piecewise structure. Under standard regularity assumptions, we establish L^p(Omega) approximation bounds and convergence rates. Specializing to Denoising Diffusion Probabilistic Models (DDPMs), we construct a SignReLU-based neural estimator for the reverse process and derive bounds on the excess Kullback-Leibler (KL) risk between the generated and true data distributions. Our analysis decomposes this excess risk into approximation and estimation error components. These results provide generalization guarantees for finite-sample training of diffusion-based generative models.

针对条件生成建模中目标条件密度呈f1/f2比值形式这一挑战，本文构建了逼近此类比值泛函的理论框架。其中f1和f2是基于核的边缘密度，用于捕捉结构化交互，是扩散生成模型的核心设定。本文利用SignReLU激活函数的分段结构特性，给出了使用深度神经网络逼近比值泛函的简洁证明。在标准正则性假设下，建立了L^p(Ω)逼近界和收敛率。针对去噪扩散概率模型（DDPMs），构建了基于SignReLU的神经估计器以逼近逆向过程，并推导了生成分布与真实数据分布之间额外Kullback-Leibler（KL）风险的界。本文分析将该额外风险分解为逼近误差和估计误差两个分量，为扩散生成模型的有限样本训练提供了泛化保证。

Diffusion models have been widely deployed in AIGC services, but their reliance on opaque training data exposes them to backdoor attacks. In practical auditing scenarios, auditors are typically unable to access model parameters due to intellectual property protection, making white-box or query-intensive detection impractical. After detection, existing detoxification approaches are trapped in a dilemma between detoxification effectiveness and generation quality for service providers. We reveal Temporal Noise Consistency (TNC), a previously unreported phenomenon in which backdoor activation disrupts the consistency of noise predictions between adjacent diffusion timesteps within specific temporal segments, while clean inputs remain stable. Based on this finding, we propose TNC-Defense, a closed-loop framework for gray-box backdoor detection and model repair. Specifically, TNC-Detect (for auditors) uses inference-stage adjacent-noise statistics to detect backdoors and precisely localize anomalous timesteps without model-weight access. TNC-Detox (for service providers) utilizes these locations to perform trigger-agnostic, timestep-aware correction of the generation path, suppressing backdoor behavior while reducing detoxification cost. Across five representative backdoor attacks and state-of-the-art defenses, TNC-Defense improves the average detection accuracy by $11\%$ with negligible additional overhead, and invalidates an average of $98.5\%$ of triggered samples with only a mild degradation in generation quality. Our code is publicly available at: https://github.com/binzhwang/TNC-Defense.

扩散模型已广泛部署于AIGC服务，但其对不透明训练数据的依赖使其易受后门攻击。在实际审计场景中，由于知识产权保护，审计员通常无法访问模型参数，使得白盒或查询密集型检测方法难以实施。现有的检测后清除方法在清除效果和服务提供商的生成质量之间面临两难境地。我们发现了时间噪声一致性（Temporal Noise Consistency，TNC）这一先前未报道的现象：后门激活会破坏特定时间段内相邻扩散时间步之间的噪声预测一致性，而干净输入保持稳定。基于这一发现，我们提出了TNC-Defense，一个用于灰盒后门检测和模型修复的闭环框架。具体而言，TNC-Detect（面向审计员）利用推理阶段相邻噪声统计信息来检测后门并精确定位异常时间步，无需访问模型权重。TNC-Detox（面向服务提供商）利用这些位置信息对生成路径进行与触发器无关、时间步感知的校正，从而抑制后门行为，同时降低清除成本。在五种代表性后门攻击和最先进的防御方法中，TNC-Defense将平均检测准确率提升了11%，且仅产生可忽略不计的额外开销，并使98.5%的触发样本失效，同时仅造成轻微的生成质量下降。我们的代码已公开于：https://github.com/binzhwang/TNC-Defense

Studies of semantic drift report heterogeneous signals, including embedding displacement, neighbor change, distributional divergence, and recursive trajectory instability, without a shared account that relates them. Semantic Substrate Dynamics Theory (SSDT) treats these signals as observables of one time-indexed substrate, St = (X, dt, Pt), that couples embedding geometry to a local diffusion kernel. The contribution is commensurability with a mechanism layer: the substrate separates within-basin churn from basin crossing, recursion-induced instability, and intervention-order effects, distinctions that a single detection score does not recover. Coarse Ricci curvature functions as a dense structural descriptor of basin and bridge geometry across the graph, and bridge mass, a node-level aggregate of incident negative curvature, functions as a sparse descriptor of the genuine bridge structure that is typically uncommon in embedding graphs. For recursive generation, node displacement relative to an origin decomposes into a radial component and a tangential component, which separates bounded departure from continuing reinterpretation. The predictions are stated in falsifiable form with a pre-declared rejection rule, and the predicted leading indicator of future rewiring is a local density statistic rather than the curvature aggregate. This manuscript provides the formal model, the assumptions, the observable roles, and the test contracts; empirical performance is deferred.

语义漂移研究呈现多种异质信号，包括嵌入位移、邻居变化、分布散度及递归轨迹不稳定性，但缺乏统一的理论框架将它们联系起来。语义基底动力学理论（SSDT）将这些信号视为单一时间索引基底 St = (X, dt, Pt) 的可观测量，该基底将嵌入几何与局部扩散核相耦合。其贡献在于与机制层的一致性：該基底将盆内翻转、盆地穿越、递归诱发性不稳定及干预顺序效应区分开来，而这些区别是单一检测分数无法恢复的。粗糙里奇曲率作为跨越图的盆地与桥梁几何的密集结构描述子，而桥质量（作为负曲率的节点级聚合）则作为嵌入图中通常罕见的真实桥梁结构的稀疏描述子。对于递归生成，相对于原点的节点位移可分解为径向分量和切向分量，从而将有界偏离与持续重新解释区分开来。这些预测以可证伪形式陈述，并附有预先声明的拒绝规则，预测的未来重连的领先指标是局部密度统计量而非曲率聚合物。本论文提供了形式模型、假设、可观测量角色及测试契约；实证性能将另文阐述。

Multi-modal recommenders fuse user-item interaction signals with item modalities such as text, images, and audio, but the usefulness of each drifts over time and at different rates. For example, around Valentine's Day, chocolate purchases become less driven by textual ingredient cues and more by visual packaging and ambient audio. This \emph{modality time-scale mismatch} gives rise to two coupled challenges: (1) users with different temporal behavior profiles require different modality proportions, and (2) less relevant modalities are more likely to introduce outdated or misleading signals into the recommender. We address both challenges within a unified diffusion-based recommender, \textbf{TimeRoute}. A temporal-aware modal router maps each user&x27;s aggregated temporal profile to a personalized modality distribution, replacing the globally shared fusion weights used in prior work. The diffusion-based graph reconstructor is conditioned on the same profile through Feature-wise Linear Modulation (FiLM) with dual-stream long- and short-term denoising heads. This design captures both slowly and rapidly evolving temporal dynamics to suppress outdated modality edges before they enter the propagation graph. Experiments on TikTok, Amazon-Baby, and Amazon-Sports, averaged over 10 seeds, demonstrate consistent improvements over strong baselines across Recall@K, Precision@K, and NDCG@K, reaching up to 9.8\% (P@20 on Amazon-Baby). Controlled attribution studies further show that these gains require both the proposed mechanisms and temporal input: naively granting the backbone the same temporal profile yields no benefit, and feeding the router random noise performs no better than removing the router entirely. Code is available at https://anonymous.4open.science/r/TimeRoute.

多模态推荐系统融合了用户-物品交互信号与物品的模态信息（如文本、图像和音频），但每种模态的实用性会随时间推移而变化，且变化速率各不相同。例如，在情人节前后，巧克力购买决策较少受文本成分描述影响，而更多地受到视觉包装和环境音频的影响。这种模态-时间尺度不匹配导致两个相互关联的挑战：（1）具有不同时间行为模式的用户需要不同的模态配比；（2）相关性较低的模态更可能向推荐系统引入过时或误导性信号。我们在统一的基于扩散的推荐系统 TimeRoute 中解决这两个挑战。时间感知模态路由器将每个用户的聚合时间画像映射到个性化模态分布，取代了先前研究中采用的全局共享融合权重。基于扩散的图重构器通过特征级线性调制（FiLM）以及双流长期和短期去噪头来 Condition 于同一画像。该设计能够同时捕捉缓慢和快速演变的时间动态，从而在进入传播图之前抑制过时的模态边。在 TikTok、Amazon-Baby 和 Amazon-Sports 数据集上进行的10次随机种子实验表明，Recall@K、Precision@K 和 NDCG@K 指标均持续优于强基线，在 Amazon-Baby 数据集上 P@20 提升高达 9.8%。可控归因研究进一步表明，这些收益需要所提出的机制和时间输入：简单地让骨干网络使用相同的时间画像无法带来收益，而向路由器输入随机噪声的性能并不优于完全移除路由器。代码可访问 https://anonymous.4open.science/r/TimeRoute 获取。

Interactive video generation and editing are becoming increasingly important for creative design. In this report, we introduce EditStream: a unified framework for interactive video generation and editing. EditStream unifies multiple video creation and manipulation tasks within a single DiT-based model through flexible task-specific conditioning, and further transforms it into a fast, few-step autoregressive model for efficient streaming. It supports Text-to-Video, Image-to-Video, Video-to-Video, Editing Propagation, Reference-guided Video Editing, and Camera Pose Change, enabling flexible control over video generation, transformation, and editing within one system. To make the unified model practical for interactive use, we develop a two-stage distillation approach that combines Velocity Moment Matching (VMM) with autoregressive unrolling. VMM matches conditional velocity moments at student-reached intermediate states to preserve generation quality and motion, while unrolling exposes the student to its own autoregressive predictions to improve temporal stability. Together, they alleviate common challenges in few-step autoregressive video generation, including over-saturation, degraded motion, temporal instability, and complex training. EditStream provides a practical and scalable solution that bridges high-quality diffusion-based video models with interactive creative workflows.

交互式视频生成与编辑在创意设计中日益重要。本报告介绍了EditStream：一个用于交互式视频生成与编辑的统一框架。EditStream通过灵活的任务特定条件化，将多种视频创建和操作任务统一到单一的基于DiT的模型中，并进一步将其转化为快速、少步骤的自回归模型以实现高效流式处理。该框架支持文生视频、图生视频、视频生视频、编辑传播、参考引导的视频编辑以及相机姿态变化，使得在一个系统内对视频生成、转换和编辑进行灵活控制成为可能。为了使统一模型适用于交互式使用，我们开发了一种两阶段蒸馏方法，将速度矩匹配（VMM）与自回归展开相结合。VMM在学生模型达到的中间状态匹配条件速度矩，以保留生成质量和运动特性；而展开过程使学生模型能够接触自身的自回归预测，从而提高时间稳定性。两者共同缓解了少步骤自回归视频生成中的常见挑战，包括过度饱和、运动退化、时间不稳定性和复杂训练问题。EditStream提供了一个实用且可扩展的解决方案，将高质量的基于扩散的视频模型与交互式创意工作流程连接起来。

Vector sketches remain one of the most concise and immediate mediums for abstract human expression. However, generating high-quality vector strokes that exhibit human-like drawing styles remains an open challenge due to the severe scarcity of fine-grained, high-quality text-to-sketch paired data. Existing text-conditioned generation methods often rely on unstable, time-consuming optimization or struggle to generalize to unseen categories in a zero-shot manner. To address these limitations, we present SketchFlow, a novel generative framework rooted in Optimal Transport (OT) theory and flow matching. By leveraging pre-trained CLIP models to bypass labor-intensive image-level text annotations, we formulate cross-modal alignment as a continuous mapping problem directly within the CLIP latent space. To bridge the inevitable modality gap between discrete text concepts and continuous sketch features, we first inject noise into discrete category embeddings to construct a continuous Gaussian Mixture Model (GMM) prior. We then utilize an Optimal Transport Conditional Flow Matching (OT-CFM) model to learn a deterministic vector field mapping from this continuous GMM prior to the target sketch feature distribution. Finally, a Hybrid Diffusion Decoder, fusing 1D U-Net and Transformer architectures, is designed to decode these features into fast and high-fidelity stroke trajectories. Extensive experiments demonstrate that SketchFlow substantially outperforms existing baselines in visual quality and adherence to natural human drawing styles. Furthermore, our geometry-preserving framework demonstrates promising local zero-shot synthesis for prompts beyond the QuickDraw training vocabulary, including unseen concept labels and semantic modifiers, while enabling smooth, continuous semantic interpolation between distinct concepts. Source code is available at: https://github.com/QiuHong-1202/SketchFlow.

矢量草图是人类抽象表达最简洁、最直接的媒介之一。然而，由于细粒度、高质量的文本-草图配对数据严重匮乏，生成具有类人绘画风格的高质量矢量笔触仍然是一个开放性挑战。现有的文本条件生成方法通常依赖于不稳定且耗时的优化过程，或难以以零样本方式泛化到未见类别。为解决这些局限性，我们提出了SketchFlow，一个基于最优传输(OT)理论和流匹配的新型生成框架。通过利用预训练的CLIP模型绕过劳动密集型的图像级文本标注，我们将跨模态对齐问题表述为CLIP潜在空间内的连续映射问题。为弥合离散文本概念与连续草图特征之间的模态差距，我们首先向离散类别嵌入注入噪声以构建连续高斯混合模型(GMM)先验。随后，我们使用最优传输条件流匹配(OT-CFM)模型学习从该连续GMM先验到目标草图特征分布的确定性向量场映射。最后，设计了一个融合1D U-Net和Transformer架构的混合扩散解码器，将这些特征解码为快速、高保真的笔触轨迹。大量实验表明，SketchFlow在视觉质量和自然人类绘画风格遵循方面显著优于现有基线。此外，我们，几何保持框架在超出QuickDraw训练词汇的提示（包括未见概念标签和语义修饰符）上展现出有前景的局部零样本合成能力，同时能够实现不同概念之间平滑、连续的语义插值。源代码可见于：https://github.com/QiuHong-1202/SketchFlow

With the advance of deep neural networks, the quality of disparity maps obtained through stereo matching has steadily improved. However, existing stereo matching methods still struggle to preserve fine-grained geometric details, resulting in blurred edges and over-smoothed predictions in challenging regions. To address these limitations, we propose StereoDiffuer, an iterative diffusion-based stereo matching framework that explicitly models geometric details and progressively refines disparity estimates. The framework incorporates a Saliency Attention Perception (SAP) module to extract salient geometric cues, including object boundaries, thin structures, and sharp edges. Confidence-guided SAP features are combined with the initial disparity estimate to condition an iterative denoising diffusion process, which corrects residual disparity errors and restores geometric details suppressed during cost-volume regularization and upsampling. Experimental results on the Scene Flow and KITTI benchmarks demonstrate the effectiveness of the proposed framework and its competitive performance relative to the compared stereo matching methods.

随着深度神经网络的发展，通过立体匹配获取的视差图质量稳步提升。然而，现有立体匹配方法在保留细粒度几何细节方面仍存在不足，导致在挑战性区域出现边缘模糊和过度平滑的预测结果。为解决这些局限性，我们提出了StereoDiffuer，一种迭代式基于扩散的立体匹配框架，能够显式建模几何细节并逐步细化视差估计。该框架引入了一个显著注意力感知（Saliency Attention Perception, SAP）模块，用于提取显著的几何线索，包括目标边界、细小结构和锐利边缘。置信度引导的SAP特征与初始视差估计相结合，用于调节迭代去噪扩散过程，从而修正残差视差误差并恢复在代价体正则化和上采样过程中被抑制的几何细节。在Scene Flow和KITTI基准数据集上的实验结果验证了所提框架的有效性及其与对比立体匹配方法的竞争力。

General image fusion seeks to integrate complementary information from multiple source images, yet real-world applications often require a single system to support heterogeneous fusion, degradation restoration, and task-oriented perception simultaneously. Existing unified frameworks struggle with these orthogonal objectives, resulting in entangled representations and degraded performance across subtasks. We propose HP-UniIF, a unified vision framework that leverages diffusion priors to bridge heterogeneous fusion, visual restoration, and downstream perception. To address the limited adaptability of diffusion models to domain-, degradation-, and task-level objectives within one pipeline, HP-UniIF introduces a depth-wise hierarchical conditional modulation strategy that decouples these objectives across network stages. Task prompt modulation at bottleneck layers adapts the backbone to different fusion paradigms, the degradation prompt router at shallow layers injects degradation-aware constraints for local restoration, and the application prompt bank at decoding stages aligns generation with downstream tasks. This hierarchical design enables HP-UniIF to produce visually faithful results while preserving task-relevant semantics. Extensive experiments across multiple fusion tasks, diverse degradations, and various downstream applications demonstrate the superior performance of HP-UniIF.

通用图像融合旨在整合来自多个源图像的互补信息，然而现实应用通常要求单个系统同时支持异构融合、退化恢复和任务导向感知。现有的统一框架难以应对这些正交目标，导致特征表示纠缠且子任务性能下降。我们提出HP-UniIF，一个利用扩散先验来桥接异构融合、视觉恢复和下游感知的统一视觉框架。为了解决扩散模型在单一管道中对域级、退化级和任务级目标适应性有限的问题，HP-UniIF引入了一种深度层级条件调制策略，在网络不同阶段解耦这些目标。瓶颈层的任务提示调制使主干网络适应不同的融合范式，浅层的退化提示路由器注入退化感知约束以实现局部恢复，解码阶段的应用提示库将生成结果与下游任务对齐。这种层级设计使HP-UniIF能够在保留任务相关语义的同时产生视觉上逼真的结果。在多种融合任务、不同退化类型以及各种下游应用上的广泛实验证明了HP-UniIF的优越性能。

3D Gaussian Splatting (3DGS) has achieved remarkable success in novel view synthesis; however, reconstructions under sparse views often exhibit noticeable artifacts. While recent video diffusion models provide strong spatio-temporal priors for 3DGS restoration, directly fine-tuning them for restoration is suboptimal, as they lack awareness of the underlying multi-camera geometry, resulting in multi-view inconsistencies. In this work, we propose a novel 3D-aware video restoration framework designed to enhance the quality of sparse 3DGS reconstruction. Specifically, we construct a large-scale 3DGS video dataset to enable specialized fine-tuning. To bridge the gap between 2D video generation and 3D multi-view constraints, we introduce a camera-conditioned geometric prior. By using the first and last frames as boundary anchors and encoding the corresponding camera relationships, we explicitly inject spatial structure into the video generation pipeline. This boundary-anchored, camera-aware prior guides the network toward geometrically grounded restoration that remains coherent across viewpoints. Extensive experiments show that, among video-prior restoration methods, our approach attains the best pixel- and structure-level fidelity (PSNR/SSIM) and improves multi-view consistency, while remaining competitive in perceptual quality (LPIPS).

3D高斯溅射（3DGS）在新视角合成方面取得了显著成就，但稀疏视角下的重建结果常常出现明显的伪影。尽管最新的视频扩散模型为3DGS修复提供了强大的时空先验，但直接对其进行微调并非最优方案，因为这些模型缺乏对底层多相机几何结构的感知，导致多视角不一致性问题。本工作提出了一种新颖的3D感知视频修复框架，旨在提升稀疏3DGS重建的质量。具体而言，我们构建了一个大规模的3DGS视频数据集以支持专门微调。为了弥合2D视频生成与3D多视角约束之间的差距，我们引入了相机条件几何先验。通过使用首帧和末帧作为边界锚点并编码相应的相机关系，我们将空间结构显式注入视频生成流程。这种边界锚定、相机感知的先验引导网络实现几何一致的多视角修复。大量实验表明，在视频先验修复方法中，我们的方法达到了最佳的像素级和结构级保真度（PSNR/SSIM），并提升了多视角一致性，同时在感知质量（LPIPS）方面也保持竞争力。

Pixel-space diffusion models directly model image distributions but remain difficult to optimize. Recent methods alleviate this challenge through target reparameterization, while still relying on a fixed clean-image target throughout denoising. Through empirical analysis, we identify a scale-time mismatch: image structures become predictable from coarse to fine as noise decreases, whereas existing models are forced to predict the full image even under high noise, resulting in low-SNR gradients that hinder optimization. To resolve this mismatch, we propose Observation Operator Diffusion, a unified framework that aligns both the supervision trajectory and feature refinement with the intrinsic recovery order of image structures. Specifically, we replace fixed full-image supervision along the standard flow path with a time-indexed observation trajectory that evolves from coarse structures to the full image during denoising. This trajectory is instantiated with a family of Gaussian-Lanczos operators at varying observation scales, yielding a path-consistent training objective. We further introduce GL-CoDA, a decoder that injects scale-specific Gaussian-Lanczos observations across decoding stages for coarse-to-fine feature refinement. Extensive experiments show that the proposed approach converges substantially faster while consistently improving generation quality, achieving an FID of 1.52 on ImageNet-256.

像素空间扩散模型直接对图像分布进行建模，但优化难度较大。近期方法通过目标重参数化缓解了这一挑战，但去噪过程中仍依赖固定的干净图像目标。通过实证分析，本文发现了一个尺度-时间不匹配问题：随着噪声减少，图像结构可从粗到细逐步预测，而现有模型即使在高噪声条件下也被迫预测完整图像，导致低信噪比梯度阻碍优化。为解决这一不匹配问题，本文提出了观测算子扩散框架，该框架将监督轨迹和特征精炼与图像结构的内在恢复顺序对齐。具体而言，本文用时间索引的观测轨迹替代标准流程中的固定全图像监督，该轨迹在去噪过程中从粗结构逐步演化到完整图像。该轨迹通过一系列不同观测尺度的高斯-兰克zos算子实现，形成路径一致的训练目标。本文进一步提出了GL-CoDA解码器，在各解码阶段注入尺度特定的高斯-兰克zos观测，实现从粗到精的特征精炼。大量实验表明，所提方法收敛速度显著提升，同时持续提升生成质量，在ImageNet-256上达到了1.52的FID分数。

Automated visual inspection in manufacturing aims to replace slow and inconsistent manual checks, but its economic value depends on whether its decisions can be trusted enough to automate routine inspection while reserving human expertise for ambiguous cases. In production-line settings, defective samples are scarce, since the process is optimized to produce good parts, which limits any learning-based inspector trained on real data alone. Compounding this, defect decisions emitted as hard labels with no confidence estimate carry an asymmetric cost: a false reject wastes a good product, while a false accept may increase the risk of undetected defects progressing through the production process. We address both problems by mitigating data scarcity through the generation of synthetic defective samples with a diffusion model, and meeting the need for confidence-aware decisions with a Bayesian classifier that defers ambiguous units to human review rather than misclassifying them. These components are embedded in a staged pipeline of successive, complementary checks. We evaluate how synthetic augmentation affects classification and localization on a test set of real defects, and examine the system's trustworthiness at three points: the decision, the synthetic data, and the pipeline structure. This work-in-progress reports preliminary results suggesting that diffusion-generated defects, combined with uncertainty-aware classification, can lower the cost of reaching a trustworthy, deployable inspection model under data scarcity.

制造业中的自动视觉检测旨在取代缓慢且不一致的人工检查，但其经济价值取决于其决策是否足够值得信赖，以便将常规检测自动化，同时将需要专业知识的模糊案例保留给人工审核。在生产线上，由于工艺优化旨在生产合格零件，缺陷样本非常稀缺，这限制了仅基于真实数据训练的任何学习型检测器。此外，输出为硬标签且无置信度估计的缺陷决策会产生不对称成本：误拒会浪费合格产品，而误收可能会增加缺陷品流入生产过程的风险。我们通过使用扩散模型生成合成缺陷样本来缓解数据稀缺问题，并使用贝叶叶分类器满足置信度感知决策的需求，将模糊单元交给人工审核而非错误分类，从而解决这两个问题。这些组件嵌入于连续互补检查的分阶段管道中。我们评估了合成数据增强对真实缺陷测试集上的分类和定位的影响，并在三个层面检验系统的可信度：决策层面、合成数据和管道结构。本研究进展报告了初步结果表明，结合不确定性感知分类的扩散生成缺陷可以在数据稀缺条件下降低构建可信、可部署检测模型的成本。

The sampling process of Denoising Diffusion Probabilistic Models (DDPMs) can be accelerated by leveraging second-order information in the form of approximations to the denoising posterior covariance -- allowing samples of acceptable quality to be produced in fewer but larger sampling steps. Previous attempts at using such information have used drastic (e.g.\ diagonal) simplifications of the covariance. These do not do justice to the peculiar statistical structure of natural images, which exhibit strong non-diagonal correlations between pixels and color channels, and a slow-decaying power-law frequency spectrum. Here, we develop a novel covariance model that captures these features. Our Kronecker-DCT (K-DCT) model uses a Kronecker-factored decomposition of inter-color covariances and spatial covariances modeled in the frequency domain using the Discrete Cosine Transform (DCT). The use of the DCT reduces the computational complexity from quadratic to log-linear, resulting in negligible computational and memory overhead in each denoising step. By learning K-DCT-structured amortizations of the denoising posterior covariance using pre-trained score models on CIFAR-10, Celeb-A, ImageNet and LSUN datasets, we show improved performance compared to previous SOTA denoising samplers, both in terms of FID and likelihoods, especially in the regime of few denoising steps.

去噪扩散概率模型（DDPMs）的采样过程可以通过利用二阶信息（即对去噪后验协方差的近似）来加速，从而能够用更少但更大的采样步骤生成可接受质量的样本。之前使用此类信息的尝试采用了急剧简化（如对角化）的协方差建模方式，未能充分体现自然图像独特的统计结构——即像素与颜色通道之间强烈的非对角相关性，以及缓慢衰减的幂律频谱。本研究提出了一种能够捕捉这些特征的新型协方差模型。我们的Kronecker-DCT（K-DCT）模型采用Kronecker因式分解来建模颜色间协方差，并利用离散余弦变换（DCT）在频域中建模空间协方差。DCT的使用将计算复杂度从二次降低到对数线性，使得每个去噪步骤的计算和内存开销几乎可以忽略不计。通过使用预训练的分数模型在CIFAR-10、Celeb-A、ImageNet和LSUN数据集上学习去噪后验协方差的K-DCT结构化摊销，我们展示了与之前最先进的去噪采样器相比更优的性能，特别是在FID和似然性方面，尤其是在少量去噪步骤的条件下。

Visual autoregressive (VAR) models have emerged as a fast, high-quality alternative to diffusion for text-to-image generation, but like diffusion models they exhibit persistent compositional failures, producing images that violate the attribute bindings and spatial relations specified in the prompt. While a rich line of test-time alignment methods has developed for diffusion, no comparable approach exists for next-scale VAR generation, whose stateful, discrete, multi-resolution sampling process makes existing techniques inapplicable. We close this gap with \textbf{VISTA} (\textbf{Vi}sual Autoregressive \textbf{S}emantic \textbf{T}est-time \textbf{A}lignment), the first gradient-based test-time alignment framework for next-scale autoregressive image generation. Built on Infinity, VISTA intervenes directly in the generation process, optimizing intermediate representations through the frozen transformer to steer visual predictions toward compositional constraints, without modifying model parameters or requiring additional training. VISTA introduces the mechanisms needed to make such optimization stable across scales, together with an extensible objective space that any differentiable constraint on cross-attention can plug into. Across two benchmarks and two model scales, VISTA improves every targeted compositional category, raising the mean targeted score by nearly 20\% on a 2B backbone and almost 6\% on an 8B backbone, with the largest gains on spatial relations. Image quality is preserved: an independent preference model VISTA never optimizes scores its outputs nearly 20\% higher. Notably, the 2B model with VISTA surpasses a backbone four times its size, indicating that a substantial part of the compositional gap between model scales is recoverable at test time.

视觉自回归（VAR）模型作为文本到图像生成的替代方案，在速度和图像质量方面可与扩散模型相媲美，但与扩散模型类似，它们也存在持续的组合失败问题，生成的图像会违反提示词中指定的属性绑定和空间关系。丰富的测试时对齐方法已针对扩散模型发展起来，但对于下一代尺度（next-scale）的VAR生成，尚无类似方法可用，因为其有状态的、离散的、多分辨率采样过程使得现有技术无法适用。我们通过VISTA（Visual Autoregressive Semantic Test-time Alignment，视觉自回归语义测试时对齐）填补了这一空白，这是首个针对下一代自回归图像生成的基于梯度的测试时对齐框架。VISTA基于Infinity构建，直接干预生成过程，通过冻结的Transformer优化中间表征，以将视觉预测引导至组合约束，而无需修改模型参数或进行额外训练。VISTA引入了在跨尺度优化中保持稳定所需的机制，以及一个可扩展的目标空间，任何可微分的交叉注意力约束都可以接入其中。在两个基准测试和两个模型规模上，VISTA改善了每个目标组合类别，使2B骨干网络的平均目标得分提高近20%，8B骨干网络提高近6%，其中空间关系的提升幅度最大。图像质量得到保持：VISTA从未优化其输出的独立偏好模型得分几乎高出20%。值得注意的是，采用VISTA的2B模型超越了其四倍规模的骨干网络，表明模型规模之间的组合差距有很大一部分可以在测试时恢复。

Computer vision applications for 3D scene understanding in underwater environments remain challenging due to the lack of high-quality 3D data and the inability of surface-trained models to generalize to underwater scenes. To address this challenge, an emerging trend is to employ generative models to close the data domain gap. However, existing methods assemble large scenes by stitching independently generated tiles post hoc with separately trained models, while demonstrating heterogeneous landscapes only within individual survey sites. We introduce BenthicFlow, a unified framework based on a single conditional flow-matching model that jointly generates aligned textures and depth maps. A MultiDiffusion-inspired sampling procedure reconciles overlapping windows throughout the generative trajectory, enabling spatially extensible RGBD mosaics without a separate stitching model. The generated mosaics are subsequently lifted into explicit 3D benthic environments using surface-aligned Gaussian surfels. Experiments across geographically distinct survey sites demonstrate that BenthicFlow preserves site-specific appearance while generating coherent, large-scale 3D scenes that closely match the target distributions. Code and trained models are available at https://github.com/jacomof/BenthicFlow.

由于高质量3D数据的缺乏以及在水面训练的模型无法泛化到水下场景，水下环境中3D场景理解的计算机视觉应用仍然具有挑战性。为解决这一挑战，一个新兴趋势是采用生成模型来弥合数据域差距。然而，现有方法使用单独训练的模型后处理独立生成的图块来拼接大场景，而仅在单个调查站点内展示异质景观。我们提出了BenthicFlow，一个基于单一条件流匹配模型的统一框架，可联合生成对齐的纹理和深度图。受MultiDiffusion启发的采样程序在生成轨迹过程中协调重叠窗口，无需单独的拼接模型即可实现空间可扩展的RGBD镶嵌图。随后使用与水面对齐的高斯面元将生成的镶嵌图提升为显式的3D底栖环境。跨地理上不同调查站点的实验表明，BenthicFlow在保留站点特定外观的同时，生成了与目标分布高度匹配的一致性大规模3D场景。代码和训练模型可访问 https://github.com/jacomof/BenthicFlow。

Computed tomography (CT) throughput is limited by scan time, which grows with both the number of projections acquired and the detector integration time for each. Reconstructing high-quality volumes from sparse-view or low-dose measurements therefore depends on an informative prior, typically a neural network trained for one specific scan setting and retrained whenever the modality, geometry, or material changes. We investigate whether a single diffusion model trained across several imaging domains can instead serve as a prior for many CT problems simultaneously. We evaluate the proposed method using the same frozen model on three datasets that differ in modality, beam geometry, material, and degradation type, spanning flaw analysis in additively manufactured metal parts imaged with cone-beam X-ray CT and concrete microstructure imaged with parallel-beam neutron CT. Our proposed method out-performs analytic reconstructions in all three cases, providing a step toward a reusable foundation prior for heterogeneous CT reconstruction problems.

计算机断层扫描（CT）的吞吐量受限于扫描时间，而扫描时间随采集的投影数量和每次探测器积分时间而增加。因此，从稀疏视图或低剂量测量重建高质量体积依赖于信息丰富的先验，通常是针对特定扫描设置训练的神经网络，并在模态、几何结构或材料发生变化时需要重新训练。我们研究是否可以采用在多个成像域上训练的单一扩散模型来同时作为多种CT问题的先验。我们使用相同的冻结模型在三种不同数据集上评估了所提方法，这些数据集在模态、束流几何结构、材料和退化类型上存在差异，涵盖增材制造金属零件的锥束X射线CT缺陷分析以及混凝土微观结构的平行束中子CT成像。所提方法在所有三种情况下均优于解析重建，为异构CT重建问题提供了可复用的基础先验方法。

We study spherical occupancy profiles-the ray-wise occupancy probability profiles P(r) = T(r) o(r) distilled from multi-view 3D Gaussian reconstructions-as a unified intermediate representation for both discriminative and generative 3D reconstruction from images. On a 999-object subset of Google Scanned Objects with 48 turntable views each, we train (i) a discriminative per-ray decoder that injects global view-averaged and ray-specific image evidence into a FiLM-conditioned profile head, reaching median soft depth error 0.035 (normalized) on an independent 90-object test split, and (ii) a generative pipeline built on a profile VAE and a latent diffusion model, which supports unconditional sampling that matches the reconstruction manifold and image-conditioned multi-solution reconstruction whose per-object solution spread is quantifiable and tunable via classifier-free guidance. We further analyze the morphology of predicted profiles: post-hoc power sharpening and a learned sharpening target both recover ground-truth profile width without degrading depth, exposing a monotonic width-peak frontier in the L1-per-ray loss family and motivating a principled redefinition of morphology gates. Real-photo validation on two DTU scenes confirms the pipeline transfers to non-synthetic input. Our results suggest that ray-wise occupancy profiles offer a compact, learned, and uncertainty-aware interface between multi-view reconstruction and generative priors.

本文研究球面占用概率分布——即从多视角3D Gaussian重建中提取的逐射线占用概率分布P(r)=T(r)o(r)——作为图像3D判别式重建和生成式重建的统一中间表示。在Google Scanned Objects数据集的999个对象子集（每个对象48个转台视图）上，我们训练了(i)一个判别式逐射线解码器，将全局视图平均和射线特定的图像特征注入FiLM条件的分布头，在独立的90个对象测试集上达到了0.035（归一化）中位数软深度误差；以及(ii)一个基于分布VAE和潜在扩散模型的生成式流程，该流程支持与重建流形匹配的无条件采样，以及可通过无分类器引导量化并调节的逐对象解空间扩散的图像条件多解重建。我们进一步分析了预测分布的形态：后处理幂锐化和学习到的锐化目标均能在不降低深度精度的前提下恢复真实分布宽度，揭示了L1逐射线损失族中存在的单调宽度-峰值前沿，并促使我们对形态门控进行原则性的重新定义。在两个DTU场景的真实照片验证确认了该流程可迁移至非合成输入。我们的结果表明，逐射线占用概率分布为多视角重建与生成先验之间提供了一个紧凑、学习式且不确定性感知的接口。

We present Mover360, a controllable object manipulation framework for 360{\deg} images. Unlike perspective images, 360{\deg} images in equirectangular projection (ERP) exhibit horizontal wrap-around, latitude-dependent distortion, and global scene continuity, which makes object-level edits difficult for existing perspective editors to produce and for users to specify. To address this, Mover360 centers on object Translation (relocating a specified object within an existing panorama) while supporting reference-guided Insert and Remove as auxiliary tasks. Its interface unifies point-, bbox-, and mask-guided control by encoding each task into a fixed prompt and a compact, ERP-aligned instruction map. In the default point mode, a single click relocates an object, allowing the model to infer a plausible size, support, and illumination using panoramic context and an auxiliary depth condition. Structurally, Mover360 is a lightweight adaptation of a pretrained diffusion transformer. To generate paired supervision, we construct a UE5 data-generation pipeline with surface-aware object placement and randomized illumination, yielding large-scale paired data and a dual-domain benchmark of synthetic and real panoramas with ground truth for all three tasks. Across both test domains and two evaluation protocols, Mover360 outperforms strong baselines for perspective editing, insertion, and inpainting in reconstruction fidelity, semantic consistency, and distributional quality. Code and our benchmark dataset are available at https://zhonghaoyi.github.io/Mover360/.

我们提出Mover360，一个用于360°图像的可控物体操作框架。与透视图像不同，等距矩形投影（ERP）中的360°图像呈现出水平环绕、纬度相关畸变和全局场景连续性等特点，这使得现有透视编辑器难以实现物体级编辑，用户也难以指定编辑目标。为解决此问题，Mover360以物体平移（在同一全景图内重定位指定物体）为核心，同时支持参考引导的插入和删除作为辅助任务。其界面通过将每种任务编码为固定提示和紧凑的ERP对齐指令图，统一了点、边界框和掩码引导的控制方式。在默认点模式下，单次点击即可重定位物体，模型可利用全景上下文和辅助深度条件推断出合理的尺寸、支撑和光照。在结构上，Mover360是对预训练扩散变换器的轻量级适配。为生成配对监督数据，我们构建了具有表面感知物体放置和随机光照的UE5数据生成管道，获得了大规模配对数据及包含全部三项任务真值的合成与真实全景图双域基准。在两个测试域和两种评估协议中，Mover360在重建保真度、语义一致性和分布质量方面均优于透视编辑、插入和修复的强基线方法。代码和基准数据集可访问 https://zhonghaoyi.github.io/Mover360/。

Text-driven human motion synthesis has made substantial development with two core modules of motion representation and generative architecture. For representation, Vector Quantization (VQ)-based methods compress motion data into discrete tokens while latent-based models operate directly in continuous space. However, both of these representations exhibit significant limitations. VQ-based methods suffer from inherent information loss, which compromises the quality, diversity, and generalization of generated motions, while continuous representation on holistic whole-body motion hinders part-level flexibility. For architecture, diffusion and autoregressive diffusion models have demonstrated their superiority, yet the fine-grained controllability over individual body parts is also limited. Thus, we propose a unified spatiotemporally decoupled framework named DeMoDiff, which jointly redesigns representation and architecture. To enhance representation extraction capabilities and offer greater part-level controllability, we present a spatial-temporal VAE that encodes each body joint rather than compressing the whole-body motion into a single latent space. Then, we incorporate spatial-temporal masking and attention mechanisms into an autoregressive diffusion generator, achieving both generative capability and controllable editability. Extensive experiments on the HumanML3D and KIT-ML datasets demonstrate that our model achieves state-of-the-art reconstruction performance and compelling motion generation results. Moreover, our framework demonstrates strong temporal and spatial editing capabilities, further validating its effectiveness. Our project page: https://rex0191.github.io/DeMoDiff/

文本驱动的人体动作合成在动作表示和生成架构两个核心模块上取得了实质性发展。在表示层面，基于矢量量化（VQ）的方法将动作数据压缩为离散标记，而基于潜在空间的模型则在连续空间中运作。然而，这两种表示方法都存在显著的局限性。基于VQ的方法遭受固有信息损失的困扰，这损害了生成动作的质量、多样性和泛化能力；而整体全身动作的连续表示则阻碍了部位级别的灵活性。在架构层面，扩散模型和自回归扩散模型已展现出其优越性，但对各个身体部位的细粒度可控性同样有限。因此，我们提出了一个统一的时空解耦框架DeMoDiff，同时重新设计表示方法和架构。为了增强表示提取能力并提供更强的部位级可控性，我们提出了一种时空变分自编码器（VAE），它对每个身体关节进行编码，而非将全身动作压缩到单一潜在空间中。随后，我们将时空掩码和注意力机制融入自回归扩散生成器中，实现了生成能力和可控编辑性。在HumanML3D和KIT-ML数据集上的大量实验表明，我们的模型实现了最先进的重建性能，并获得了令人信服的动作生成结果。此外，我们的框架展现了强大的时间和空间编辑能力，进一步验证了其有效性。项目主页：https://rex0191.github.io/DeMoDiff/

Image acquisition with a camera involves several degradations due to the optical system, sensor, or low-level processing steps. We address blind deblurring in professional photography: we aim to invert unknown isotropic blur without knowledge of the degradation kernel.For such inverse problems,where some high-frequency information is lost, it is challenging to use generative models to produce details that are both photo-realistic and faithful to the input. We propose SuperSharpen, a diffusion-based blind deblurring method offering explicit control over restoration strength through a blur measure. We compare two conditioning strategies: a ControlNet-style adapter on a frozen backbone, and full finetuning of the diffusion prior. Our experiments show that finetuning achieves better fidelity with fewer hallucinated details. We validate our approach on synthetic and real-world blur, demonstrating improved perceptual quality and controllable restoration strength.

相机图像采集涉及光学系统、传感器或底层处理步骤导致的多种退化。我们专注于专业摄影中的盲去模糊：我们的目标是逆转未知的各向同性模糊，且不依赖退化核的先验知识。对于这类逆问题，由于部分高频信息丢失，使用生成模型产生既照片级真实又忠实于输入的细节具有挑战性。我们提出了SuperSharpen，这是一种基于扩散的盲去模糊方法，通过模糊度量提供对恢复强度的显式控制。我们比较了两种条件化策略：冻结骨干网上的ControlNet风格适配器，以及对扩散先验的完全微调。我们的实验表明，微调能够以更少的幻觉细节获得更好的保真度。我们在合成和真实世界模糊数据上验证了我们的方法，展示了改进的感知质量和可控的恢复强度。

Photorealistic novel view synthesis of people remains challenging at high spatial resolutions and across multiple target cameras, where preserving identity, fine appearance details, and geometric coherence is critical. We build on the next-scale autoregressive paradigm and adapt it for human-centric view synthesis by enabling higher image resolutions, multi-view outputs and stronger cross-view consistency in a single forward pass. We train on a synthetic dataset of human faces spanning diverse identities and apparel. Contrary to diffusion models, this paradigm does not need 2D pre-training and, thanks to its next-scale architecture, it benefits from lower-resolution, general-purpose pre-trainings, with the full-sized purpose-specific images being used only in the last training stages. This enables our architecture to converge with a smaller amount of purpose-specific training data, allowing us to use a smaller but more realistic training dataset. The resulting model produces sharp and realistic views, with the option to synthesize multiple novel viewpoints simultaneously for improved agreement across views. Empirically, we observe gains in perceptual fidelity and cross-view coherence on human subjects, demonstrating that next-scale autoregression is an effective backbone for scalable, multi-output human view synthesis. We also couple our pipeline with an existing transformer-based model for pixel-aligned 3D gaussian lifting from multi-view facial inputs, resulting in accurate and photorealistic 3D models of human faces.

在高的空间分辨率和多个目标相机条件下实现人物的逼真新视角合成仍然具有挑战性，其中保持身份特征、细微外观细节和几何一致性至关重要。我们基于下一代自回归范式进行构建，通过在单次前向传播中实现更高的图像分辨率、多视角输出和更强的跨视角一致性，使其适用于以人为中心的视角合成。我们在包含多样身份和服装的人脸合成数据集上进行训练。与扩散模型不同，该范式不需要2D预训练，并且得益于其跨尺度架构，可以从低分辨率的通用预训练中获益，完整尺寸的专用图像仅在最后训练阶段使用。这使得我们的架构能够使用更少量的专用训练数据实现收敛，从而可以使用更小但更逼真的训练数据集。生成的模型能够产生清晰逼真的视角，并可以选择同时合成多个新视角以提高视角间的一致性。根据实验结果，我们观察到在人体对象上感知保真度和跨视角一致性的提升，证明了下一代自回归是用于可扩展多输出人体视角合成的有效骨干网络。我们还将我们的流程与现有的基于Transformer的模型相结合，用于从多视角人脸输入进行像素对齐的3D高斯提升，从而实现了准确且逼真的人脸3D模型。

Rendering views using 3D scene representations such as Gaussian Splatting (3DGS), Neural Radiance Fields (NeRF), meshes, or even point clouds produces artifacts when input views are sparse or target views lie far from the input. Recent work mitigates these artifacts using diffusion-based generative priors, but is specialized to individual representations and require custom architectures or extensive retraining. We present FixAnything, a single model for fixing a wide range of rendering artifacts. It does so by repurposing a pretrained video generative model, leveraging its implicit multi-view priors with only minimal modification and lightweight finetuning. Our key insight is that even noisily-rendered sequences preserve camera motion and coarse scene structure, allowing cleanup to be formulated as video-to-video translation. To control what scene structure should be preserved, we introduce a binary mask denoting the clean pixels, enabling the model to anchor its output to high-quality inputs (e.g. training views) while refining the rest. To encourage FixAnything to produce 3D-consistent renderings that support downstream reconstruction, we use camera pose accuracy (recovered via structure-from-motion) as a reward signal for direct preference optimization (DPO). Across four distinct 3D representations, FixAnything consistently improves rendering quality with lightweight finetuning, demonstrating that a single generalist video prior can replace multiple specialist refinement pipelines. The simplicity of the framework enables immediate adoption of stronger future video models without architectural redesign.

使用高斯溅射（3DGS）、神经辐射场（NeRF）、网格或点云等3D场景表示进行视图渲染时，当输入视角稀疏或目标视角远离输入视角时会产生伪影。近期工作利用基于扩散的生成先验来减轻这些伪影，但这些方法专门针对特定表示方法，且需要定制架构或大规模重新训练。我们提出FixAnything，一个用于修复各类渲染伪影的单一模型。该方法通过改造预训练视频生成模型来实现，仅需最小的修改和轻量级微调即可利用其隐式多视角先验。我们的关键洞察是，即使是噪声渲染的序列也保留了相机运动和粗略场景结构，因此可以将优化表述为视频到视频的转换。为了控制应保留的场景结构，我们引入了一个表示干净像素的二值掩码，使模型能够锚定高质量输入（如训练视角）的输出，同时优化其余部分。为了促使FixAnything生成支持下游重建的3D一致性渲染，我们使用通过运动恢复结构获取的相机位姿精度作为直接偏好优化（DPO）的奖励信号。在四种不同的3D表示上，FixAnything持续以轻量级微调提升渲染质量，证明了一个通用的视频先验可以取代多个专门的优化流程。该框架的简洁性使得无需重新设计架构即可直接采用更强的未来视频模型。

Recent video depth estimation methods achieve great performance by following the paradigm of image depth estimation, i.e., typically fine-tuning pre-trained video diffusion models with massive data. However, we argue that video depth estimation is not a naive extension of image depth estimation. The temporal consistency requirements for dynamic and static regions in videos are fundamentally different. Consistent video depth in static regions, typically backgrounds, can be more effectively achieved via stereo matching across all frames, which provides much stronger global 3D cues. While the consistency for dynamic regions still should be learned from large-scale video depth data to ensure smooth transitions, due to the violation of triangulation constraints. Based on these insights, we introduce StereoDiff, a two-stage video depth estimator that synergizes stereo matching for mainly the static areas with video depth diffusion for maintaining consistent depth transitions in dynamic areas. We mathematically demonstrate how stereo matching and video depth diffusion offer complementary strengths through frequency domain analysis, highlighting the effectiveness of their synergy in capturing the advantages of both. Experimental results on zero-shot, real-world, dynamic video depth benchmarks, both indoor and outdoor, demonstrate StereoDiff's SoTA performance, showcasing its superior consistency and accuracy in video depth estimation.

最近的视频深度估计方法遵循图像深度估计的范式，即通常使用大规模数据对预训练的视频扩散模型进行微调，从而取得了优异的性能。然而，我们认为视频深度估计并非图像深度估计的简单扩展。视频中动态区域和静态区域的时间一致性要求存在根本差异。静态区域（通常是背景）中的一致视频深度可以通过跨所有帧的立体匹配更有效地实现，这提供了更强的全局三维线索。而动态区域的一致性仍应从大规模视频深度数据中学习以确保平滑过渡，因为这些区域违反了三角测量约束。基于这些见解，我们提出了 StereoDiff，这是一种两阶段视频深度估计器，将立体匹配主要应用于静态区域，同时利用视频深度扩散维持动态区域的一致深度过渡。我们通过频域分析数学论证了立体匹配和视频深度扩散如何提供互补优势，突出了它们协同捕获双方优点的有效性。在零样本、真实场景、动态视频深度基准（涵盖室内和室外环境）上的实验结果表明 StereoDiff 达到了当前最优性能，展示了其在视频深度估计中卓越的一致性和准确性。

Diffusion-based approaches have recently achieved strong results in face swapping, offering improved visual quality over traditional GAN-based methods. However, even state-of-the-art models often suffer from fine-grained artifacts and poor identity preservation, particularly under challenging poses and expressions. A key limitation of existing approaches is their failure to meaningfully leverage 3D facial structure, which is crucial for disentangling identity from pose and expression. In this work, we propose DiffSwap++, a novel diffusion-based face-swapping pipeline that incorporates 3D facial latent features during training. By guiding the generation process with 3D-aware representations, our method enhances geometric consistency and improves the disentanglement of facial identity from appearance attributes. We further design a diffusion architecture that conditions the denoising process on both identity embeddings and facial landmarks, enabling high-fidelity and identity-preserving face swaps. Extensive experiments on CelebA, FFHQ, and CelebV-Text demonstrate that DiffSwap++ outperforms prior methods in preserving source identity while maintaining target pose and expression. Additionally, we introduce a biometric-style evaluation and conduct a user study to further validate the realism and effectiveness of our approach. Code will be made publicly available at https://github.com/WestonBond/DiffSwapPP

基于扩散模型的方法在换脸任务中取得了优异的成果，相比传统基于GAN的方法具有更好的视觉效果。然而，即使是最先进的模型也常常存在细粒度伪影和身份保持不佳的问题，特别是在具有挑战性的姿态和表情条件下。现有方法的一个关键局限性在于未能有效利用3D面部结构，而3D结构对于将身份与姿态和表情解耦至关重要。在本工作中，我们提出了DiffSwap++，一种新型的基于扩散模型的换脸 pipeline，在训练过程中融入了3D面部潜在特征。通过使用3D感知表征引导生成过程，我们的方法增强了几何一致性，并改善了面部身份与外观属性的解耦。我们进一步设计了一种扩散架构，使去噪过程同时以身份嵌入和面部关键点为条件，从而实现高保真且身份保持的换脸效果。在CelebA、FFHQ和CelebV-Text数据集上的大量实验表明，DiffSwap++在保持源身份的同时维持目标姿态和表情方面优于现有方法。此外，我们引入了一种生物特征风格的评估方式并进行了用户研究，以进一步验证我们方法的真实感和有效性。代码将开源发布于 https://github.com/WestonBond/DiffSwapPP

Emerging video diffusion models achieve high visual fidelity but fundamentally couple scene dynamics with camera motion, limiting their ability to provide precise spatial and temporal control. We introduce a 4D-controllable video diffusion framework that explicitly decouples scene dynamics from camera pose, enabling fine-grained manipulation of both scene dynamics and camera viewpoint. Our framework takes continuous world-time sequences and camera trajectories as conditioning inputs, injecting them into the video diffusion model through a 4D positional encoding in the attention layer and adaptive normalizations for feature modulation. To train this model, we curate a unique dataset in which temporal and camera variations are independently parameterized; this dataset will be made public. Experiments show that our model achieves robust real-world 4D control across diverse timing patterns and camera trajectories, while preserving high generation quality and outperforming prior work in controllability. See our website for codes and video results: https://19reborn.github.io/Bullet4D/

新兴的视频扩散模型虽然实现了高视觉保真度，但从根本上将场景动态与相机运动耦合在一起，限制了其提供精确时空控制的能力。我们引入了一个4D可控视频扩散框架，明确解耦场景动态与相机姿态，实现对场景动态和相机视角的细粒度操控。我们的框架以连续的世界时间序列和相机轨迹作为条件输入，通过注意力层中的4D位置编码和自适应归一化进行特征调制，将其注入视频扩散模型。为了训练该模型，我们精心构建了一个时间和相机变化独立参数化的独特数据集，并将公开该数据集。实验表明，我们的模型在多样化的时间模式和相机轨迹下实现了鲁棒的实景4D控制，同时保持了高生成质量并在可控性方面优于先前工作。相关代码和视频结果请访问我们的网站：https://19reborn.github.io/Bullet4D/

LangDriveCTRL is a natural-language-controllable framework for editing real-world driving videos to synthesize diverse traffic scenarios. It represents each video as an explicit 3D scene graph, decomposing the scene into a static background and dynamic object nodes. To enable fine-grained editing and realism, it introduces a feedback-driven agentic pipeline. An Orchestrator converts user instructions into executable graphs that coordinate specialized multi-modal agents and tools. An Object Grounding Agent aligns free-form text with target object nodes in the scene graph; a Behavior Editing Agent generates multi-object trajectories from language instructions; and a Behavior Reviewer Agent iteratively reviews and refines the generated trajectories. The edited scene graph is rendered and harmonized using a video diffusion tool, and then further refined by a Video Reviewer Agent to ensure photorealism and appearance alignment. LangDriveCTRL supports both object node editing (removal, insertion, and replacement) and multi-object behavior editing from natural-language instructions. Quantitatively, it achieves nearly $2\times$ higher instruction alignment than the previous SoTA, with superior photorealism, structural preservation, and traffic realism. Project page is available at: https://yunhe24.github.io/langdrivectrl/.

LangDriveCTRL是一个自然语言可控的框架，用于编辑真实驾驶视频以合成多样化的交通场景。它将每个视频表示为显式的3D场景图，将场景分解为静态背景和动态对象节点。为实现细粒度编辑和真实性，该框架引入了反馈驱动的智能体管道。编排器（Orchestrator）将用户指令转换为可执行图，协调专门的多模态智能体和工具。对象定位智能体（Object Grounding Agent）将自由形式文本与场景图中的目标对象节点对齐；行为编辑智能体（Behavior Editing Agent）根据语言指令生成多对象轨迹；行为审查智能体（Behavior Reviewer Agent）迭代审查和完善生成的轨迹。编辑后的场景图使用视频扩散工具进行渲染和协调，随后由视频审查智能体（Video Reviewer Agent）进一步优化，以确保照片级真实感和外观一致性。LangDriveCTRL支持对象节点编辑（移除、插入和替换）以及来自自然语言指令的多对象行为编辑。定量实验表明，该方法在指令对齐方面比之前的最佳方法提升了近2倍，同时在照片级真实性、结构保持和交通真实性方面表现更优。项目页面见：https://yunhe24.github.io/langdrivectrl/。

Detectors of AI-generated images tend to inherit the biases of the data they are trained on: models fitted to GAN imagery learn to treat GAN-specific artifacts as the very definition of "fake" and consequently miss images produced by diffusion models and commercial generation tools. We study this generalization problem from two directions. First, we introduce Diff-Gen, a balanced corpus consisting of 100k diffusion-generated samples and an equally sized set of real images, with the real subset selected to mirror the class distribution of the synthetic data. A spectral analysis shows that, unlike GAN data, Diff-Gen exhibits broad, non-periodic high-frequency energy, and we find that detectors trained on it transfer substantially better to unseen generator families. Second, we propose AdaptPrompt, a parameter-efficient adaptation of CLIP that combines a visual adapter with learnable text prompts and trains roughly 0.1% of the model's parameters. We further observe that truncating the last transformer block of the vision encoder consistently improves detection, suggesting that the final semantic-alignment layers of CLIP suppress the low-level traces on which forensic decisions rely. Across a benchmark of 25 test sets covering GANs, diffusion models, and commercial tools such as Midjourney and DALL-E 3, AdaptPrompt trained on Diff-Gen attains the best mean average precision (98.60%) and accuracy (92.72%), while matching fully fine-tuned baselines at a fraction of their training cost. We also show that the same framework supports data-efficient training and closed-set source attribution across 22 generators.

AI生成的图像检测器往往继承其训练数据的偏见：针对GAN图像训练的模型将GAN特有的伪影视为"虚假"的定义，因此无法识别扩散模型和商业生成工具产生的图像。我们从两个方面研究这一泛化问题。首先，我们引入Diff-Gen，这是一个平衡语料库，包含10万个扩散生成的样本和同等规模的真实图像集合，其真实图像子集经过选择以匹配合成数据的类别分布。频谱分析表明，与GAN数据不同，Diff-Gen呈现宽频、非周期性高频能量，我们发现基于它训练的检测器能够更好地迁移到未见过的生成器家族。其次，我们提出AdaptPrompt，这是一种参数高效的CLIP适应方法，结合视觉适配器与可学习文本提示，仅训练约0.1%的模型参数。我们进一步观察到，截断视觉编码器的最后一个transformer块 consistently improves detection，持续提升检测性能，这表明CLIP的最终语义对齐层会抑制法医决策所依赖的低层痕迹。在涵盖GAN、扩散模型以及Midjourney和DALL-E 3等商业工具的25个测试集基准上，基于Diff-Gen训练的AdaptPrompt达到了最高的平均精度（98.60%）和准确率（92.72%），同时以极低的训练成本匹配完全微调的基线方法。我们还展示了同一框架支持数据高效训练以及跨22个生成器的闭集来源归属。

Extended reality (XR) demands generative models that respond to users' tracked real-world motion, yet current video world models accept only coarse control signals such as text or keyboard input, limiting their utility for embodied interaction. We introduce a human-centric video world model that is conditioned on both tracked head pose and joint-level hand poses. For this purpose, we evaluate existing diffusion transformer conditioning strategies and propose an effective mechanism for 3D head and hand control, enabling dexterous hand--object interactions. We train a bidirectional video diffusion model teacher using this strategy and distill it into a causal, interactive system that generates egocentric virtual environments. We evaluate this generated reality system with human subjects and demonstrate improved task performance as well as a significantly higher level of perceived amount of control over the performed actions compared with relevant baselines.

扩展现实（XR）要求生成模型能够响应用户被追踪的真实世界运动，然而当前的视频世界模型仅接受文本或键盘输入等粗粒度控制信号，限制了其在具身交互中的实用性。我们提出了一种以人为中心的视频世界模型，该模型以追踪的头部姿态和关节级手部姿态为条件。为此，我们评估了现有的扩散Transformer条件化策略，并提出了一种有效的3D头部和手部控制机制，能够实现灵巧的手-物体交互。我们使用该策略训练了一个双向视频扩散模型教师，并将其蒸馏为一个因果的交互式系统，用于生成自我中心视角的虚拟环境。我们通过人类受试者评估了这一生成现实系统，结果表明与相关基线相比，任务性能得到改善，且对所执行动作的感知控制水平显著提升。

Scaling video generation from seconds to minutes faces a critical bottleneck: while short-video data is abundant and high-fidelity, coherent long-form data is scarce and limited to narrow domains. To address this, we propose a training paradigm where Mode Seeking meets Mean Seeking, decoupling local fidelity from long-term coherence based on a unified representation via a Decoupled Diffusion Transformer. Our approach utilizes a global Flow Matching head trained via supervised learning on long videos to capture narrative structure, while simultaneously employing a local Distribution Matching head that aligns sliding windows to a frozen short-video teacher via a mode-seeking reverse-KL divergence. This strategy enables the synthesis of minute-scale videos that learns long-range coherence and motions from limited long videos via supervised flow matching, while inheriting local realism by aligning every sliding-window segment of the student to a frozen short-video teacher, resulting in a few-step fast long video generator. Evaluations show that our method effectively closes the fidelity-horizon gap by jointly improving local sharpness, motion and long-range consistency. Project website: https://primecai.github.io/mmm/.

将视频生成从秒级扩展到分钟级面临关键瓶颈：虽然短视频数据丰富且质量高，但连贯的长视频数据稀缺且仅限于狭窄领域。为此，我们提出了一种训练范式，让模式寻求与均值寻求相遇，通过解耦扩散变换器将局部保真度与长期连贯性解耦。我们的方法利用一个全局Flow Matching头，在长视频上进行监督学习来捕捉叙事结构，同时采用一个局部Distribution Matching头，通过模式寻求的反向KL散度将滑动窗口与冻结的短视频教师模型对齐。该策略使得能够合成分钟级视频，通过监督流匹配从有限的长视频中学习长期连贯性和运动，同时通过将学生的每个滑动窗口段与冻结的短视频教师模型对齐来继承局部真实性，从而实现少步快速长视频生成。评估表明，我们的方法通过共同提升局部清晰度、运动和长期一致性，有效缩小了保真度-时长差距。项目网站：https://primecai.github.io/mmm/.

In this work, we study the role of Massive Activations (MAs), which are rare, high-magnitude spikes confined to a few fixed hidden dimensions in video diffusion transformers (DiTs). We uncover a structured positional hierarchy: MA magnitudes peak at first-frame tokens and recur at the spatial boundary tokens of latent frames, with this pattern being most pronounced during early denoising. We trace this organization to an encoding asymmetry of the video VAEs, whose causal temporal padding and zero spatial padding cause the first latent frame and frame borders to carry reduced content load. Elevated MAs consistently align with these lower-content structural positions. To understand their function, we analyze intermediate representations and find that MAs act as implicit rescalers of residual computation: enlarging MAs suppresses the corresponding self-attention and feed-forward updates, while erasing them amplifies these updates. Together, these observations suggest that MAs serves as a token-level rescaler of residual computation, which video DiTs deploy unevenly, placing the strongest damping at the encoding-asymmetric structural positions. Motivated by this native rescaling behavior, we propose Structured Activation Steering (STAS), a training-free technique that steers MAs at the observed structural positions toward a scaled, model-derived reference during early denoising. STAS requires no additional forward passes and consistently improves video quality and temporal coherence across text-to-video models with negligible overhead.

本研究探讨了大规模激活（Massive Activations, MAs）在视频扩散变换器（Video Diffusion Transformers, DiTs）中的作用。MAs是一种罕见的高幅度峰值，仅局限于少数固定的隐藏维度。我们揭示了一种结构化的位置层次关系：MAs幅度在第一帧token处达到峰值，并在潜在帧的空间边界token处重现，该模式在早期去噪阶段最为显著。我们追溯这种组织结构，发现其源于视频变分自编码器（Video VAEs）的编码不对称性——因果时间填充和零空间填充导致第一潜在帧和帧边界承载较少的内容负载。较高的大规模激活与这些低内容结构位置始终保持一致。为了理解其功能，我们分析了中间表征，发现MAs充当残差计算的隐式重缩放器：放大MAs会抑制相应的自注意力（self-attention）和前馈（feed-forward）更新，而擦除它们则会放大这些更新。综上，这些观察表明MAs作为token级别的残差计算重缩放器，视频DiTs非均匀地部署它，并将最强的阻尼置于编码不对称的结构位置。受此原生重缩放行为的启发，我们提出了结构化激活引导（Structured Activation Steering, STAS），这是一种无需训练的技术，在早期去噪阶段将观察到结构位置的大规模激活引导至缩放后的模型派生参考值。STAS无需额外的正向传播即可持续提升文本到视频（text-to-video）模型的视频质量和时间一致性，且开销可忽略不计。

Pretrained diffusion models have revolutionized real-world image super-resolution (Real-ISR), but their iterative sampling is computationally prohibitive, driving efforts to distill it into a single step. General one-step methods fine-tune the generative prior into a deterministic mapping, restoring efficiency but discarding its stochastic nature. Conversely, recent attempts re-engage generation by shifting the timestep or injecting random noise, adjusting either the position or the state while the other stays fixed. Because only one side is controlled, the two align at isolated preset timesteps but drift apart once steered, leaving generation unstable. To address this, we present one-step diffusion via Inversion and Degradation-aware Sampling for Real-ISR (IDaS-SR), a one-step framework that bridges deterministic restoration and stochastic generation. At its core, Manifold Anchoring grounds the low-quality latent on the pretrained trajectory through two operations jointly estimated by the Manifold Inversion Noise Estimator (MINE): positioning declares where the latent lies and how it deviates from the clean state, while inversion aligns the latent to the declared position. Upon the anchor, CHARIOT reintroduces controlled stochasticity by jointly rescheduling the trajectory and interpolating the noise, enabling a single scalar to smoothly navigate the fidelity-realism trade-off. Extensive experiments demonstrate that IDaS-SR effectively unleashes the generative prior, achieving state-of-the-art performance under explicit control in a single inference step.

预训练扩散模型革新了真实世界图像超分辨率（Real-ISR），但其迭代采样在计算上难以承受，促使研究工作将其蒸馏为单一步骤。通用一步方法将生成先验微调为确定性映射，提高了效率但丢弃了其随机性。相反，近期尝试通过移动时间步或注入随机噪声来重新激活生成能力，在另一个保持固定的情况下调整位置或状态。由于只控制了一侧，两者在预设的时间步上对齐，但在引导时则会分离，导致生成不稳定。为解决此问题，我们提出了用于Real-ISR的一步扩散反演与退化感知采样方法（IDaS-SR），这是一个桥接确定性恢复与随机生成的一步框架。其核心是流形锚定，它通过流形反演噪声估计器（MINE）联合估计的两个操作将低质量潜表示锚定在预训练轨迹上：定位声明潜表示所在位置及其与干净状态的偏差，而反演则将潜表示对齐到声明的位置。在此锚点之上，CHARIOT通过联合重新调度轨迹和插值噪声来重新引入受控随机性，使得单个标量能够平滑地驾驭保真度与真实感之间的权衡。大量实验表明，IDaS-SR有效释放了生成先验，在单步推理中实现了显式控制下的最先进性能。

One-step diffusion editors are fast because they avoid inversion and iterative optimization, but a single transport update must be aggressive enough to realize the target prompt and conservative enough to preserve the source image--and no fixed update strength satisfies both demands across edit types. We treat this tension as a post-hoc candidate-selection problem on top of energy-field transport rather than as a new editing model. Our proposed method, Riemannian Residual Line Search, first builds a stronger edit by estimating the local time curvature of the prompt-delta field and projecting the corrected direction back onto the update norm of the original first-order energy-field transport estimation. It then forms a small residual path from the source image to this strong edit, retains the original first-order output as one candidate, and picks the final image by maximizing target-prompt CLIP alignment. On a 700-sample PIE-Bench++ evaluation across 10 edit type IDs, our method achieves state-of-the-art (SOTA) performance among current one-step update algorithms.

一步扩散编辑器因避免了反转和迭代优化而速度很快，但单次传输更新必须足够激进以实现目标提示词，同时又要足够保守以保留源图像——而固定的更新强度无法满足不同编辑类型的需求。我们将这一矛盾视为能量场传输上的后验候选选择问题，而非设计新的编辑模型。我们提出的方法——黎曼剩余线搜索，首先通过估计提示词增量场的局部时间曲率来构建更强的编辑，并将校正后的方向投影回原始一阶能量场传输估计的更新范数上。然后，它从源图像到该强编辑形成一条小的残差路径，将原始一阶输出保留为候选之一，并通过最大化目标提示词的CLIP对齐度来选取最终图像。在包含10种编辑类型ID的700样本PIE-Bench++评估中，我们的方法在当前一步更新算法中实现了最先进的（SOTA）性能。

Video shadow removal in the wild remains challenging due to complex illumination, diverse shadow appearances, and limited training data. Despite its importance to numerous vision and graphics applications, it remains largely unexplored in unconstrained real-world scenarios. To address this gap, we present WildShadowRemover, a framework that adapts a pretrained video diffusion model for robust video shadow removal via LoRA fine-tuning. To preserve fine image details while retaining the model's powerful generative prior, we augment the frozen VAE decoder with a detail injection module and introduce a shadow-mask-guided frequency-decomposed modulation module to selectively restore high-frequency textures while suppressing shadow artifacts. Monocular depth priors from Depth Anything 3 further provide geometry-aware guidance under challenging lighting conditions. We also construct WildShadow, a large-scale paired video shadow removal dataset and benchmark, covering diverse synthetic scenes. Extensive experiments demonstrate that our method outperforms existing approaches in shadow removal quality and temporal consistency, producing temporally coherent shadow-free videos with superior visual quality and strong generalization across challenging in-the-wild scenarios.

真实场景下的视频阴影去除由于复杂光照、多样化的阴影外观以及有限的训练数据而仍然具有挑战性。尽管该任务对众多视觉和图形应用具有重要意义，但在无约束的真实世界场景中仍缺乏充分探索。为弥补这一空白，我们提出了WildShadowRemover框架，该框架通过LoRA微调将预训练视频扩散模型适配用于鲁棒的视频阴影去除任务。为了在保留模型强大生成先验的同时保持精细图像细节，我们为冻结的VAE解码器增配了细节注入模块，并引入了阴影掩码引导的频率分解调制模块，以选择性恢复高频纹理同时抑制阴影伪影。来自Depth Anything 3的单目深度先验进一步在挑战性光照条件下提供了几何感知 guidance。我们还构建了WildShadow，一个大规模成对视频阴影去除数据集和基准，涵盖多样化的合成场景。大量实验表明，我们的方法在阴影去除质量和时间一致性方面优于现有方法，能够生成时间一致的无阴影视频，在视觉质量和跨挑战性真实场景的泛化能力方面表现出色。

Unified image and video creation requires a model to follow diverse instructions while preserving identity, geometry, and temporal structure from visual context. However, semantic-only conditioning and creation-only training do not explicitly supervise the local structure needed for precise, temporally consistent editing. We therefore formulate depth and surface-normal prediction as image-form denoising targets, using these dense tasks as structured visual supervision within the same creation interface. Our framework decouples semantic interpretation from spatially aligned visual injection while sharing one multimodal diffusion transformer (MMDiT) backbone across all tasks. Mutual Context Attention (MCA), a paired-video data-construction procedure, and a progressive training curriculum then connect the learned structural cues to temporally localized editing and reference-conditioned creation. A single checkpoint obtains the highest overall score in the reported comparison of unified systems (4.15); adding dense supervision improves OpenVE Overall from 3.98 to 4.06 and Local Add from 3.92 to 4.18. These results support a deliberately bounded conclusion: perception-oriented dense supervision transfers useful structural knowledge to downstream creation, especially editing locality and preservation; we do not claim superiority as a standalone dense predictor.

统一图像和视频生成需要模型遵循多样化的指令，同时保留视觉上下文中的身份、几何结构与时间结构。然而，仅语义条件化与仅生成任务的训练无法明确监督精确、时间一致编辑所需的局部结构。因此，本研究将深度预测与表面法线预测任务形式化为图像形式的去噪目标，在同一生成界面中利用这些密集任务作为结构化视觉监督。本框架将语义解释与空间对齐的视觉注入解耦，同时在所有任务中共享一个多模态扩散Transformer（MMDiT）主干网络。互上下文注意力（MCA）、配对视频数据构建方法与渐进式训练课程进一步将学习到的结构线索与时间局部化编辑和参考条件生成相连接。单一检查点在统一系统报告对比中获得最高综合分数（4.15）；添加密集监督后，OpenVE综合分数从3.98提升至4.06，Local Add从3.92提升至4.18。这些结果支持一个经过审慎限定的结论：感知导向的密集监督能够将有用的结构知识迁移至下游生成任务，尤其是编辑局部性与内容保留方面；而本研究并不声称作为独立密集预测器的优越性。

While text-to-3D generation has advanced rapidly, achieving high geometric fidelity at low inference cost remains challenging. Existing text-to-3D methods either decode discrete shape tokens autoregressively or iteratively refine global 3D representations with diffusion or flow models. However, autoregressive decoding is sequential and cannot revise errors, whereas diffusion and flow-matching models repeatedly process the full representation, making high-quality generation increasingly expensive. In this paper, we propose Block3D, a block-wise diffusion framework that partitions the discrete shape-token sequence into contiguous blocks, generates the blocks autoregressively, and jointly denoises all tokens within the current block. To alleviate error accumulation, we introduce confidence-guided intra-block correction, which revises low-confidence tokens before each block is finalized. On a held-out set from TRELLIS-500K, Block3D reduces mean end-to-end generation time from 25.71 seconds to 4.99 seconds, achieving a $5.15\times$ speedup over the fine-tuned autoregressive baseline without sacrificing geometric fidelity.

虽然文本到3D生成发展迅速，但在低推理成本下实现高几何保真度仍然具有挑战性。现有的文本到3D方法要么通过自回归方式解码离散形状标记，要么使用扩散或流模型迭代优化全局3D表示。然而，自回归解码是顺序执行的，无法修正错误；而扩散和流匹配模型则反复处理整个表示，使得高质量生成的成本越来越高。在本文中，我们提出了Block3D，这是一种分块扩散框架，它将离散形状标记序列划分为连续块，自回归地生成这些块，并在当前块内联合去噪所有标记。为了减轻错误累积，我们引入了置信度引导的块内校正机制，在每个块最终确定之前修正低置信度标记。在TRELLIS-500K的保留测试集上，Block3D将平均端到端生成时间从25.71秒减少到4.99秒，相比微调后的自回归基线实现了5.15倍的加速，同时不牺牲几何保真度。

The widespread adoption of diffusion models for image generation necessitates efficient parallel inference to manage their substantial computational overhead. However, current parallel inference paradigms primarily target homogeneous clusters, often failing to maintain high efficiency in realistic, heterogeneous multi-GPU environments where hardware disparities and fluctuating background workloads cause severe straggler effects. This paper introduces Orchestra, a robust framework that orchestrates fine-grained parallelism across both temporal and spatial dimensions to harmonize computational loads in such settings. Temporally, Orchestra employs a novel computation-aware step allocator using a tiered step reduction strategy, intelligently pruning denoising steps on slower devices after warmup phases and execution synchronization. Spatially, Orchestra performs an elastic patch parallelism mechanism which adaptively adjusts the spatial workload intensity by assigning non-uniform image patches tailored to GPUs according to their computational capability. Extensive experiments on load-imbalanced and heterogeneous clusters validate Orchestra's efficacy in mitigating performance bottlenecks. Compared to patch parallelism, a state-of-the-art diffusion inference framework, our method reduces end-to-end latency by up to 45% and significantly boosts resource utilization on heterogeneous GPUs.

扩散模型在图像生成领域的广泛应用迫切需要高效的并行推理来应对其巨大的计算开销。然而，当前的并行推理范式主要针对同构集群，在真实的异构多GPU环境中往往难以保持高效率，硬件差异和波动的后台工作负载会导致严重的落后者效应。本文提出了Orchestra框架，通过在时间和空间维度上协调细粒度并行来平衡此类环境中的计算负载。在时间维度上，Orchestra采用了一种新颖的计算感知步长分配器，使用分层步长缩减策略，在预热阶段和执行同步后智能地裁剪较慢设备上的去噪步数。在空间维度上，Orchestra执行弹性patch并行机制，根据GPU的计算能力分配非均匀图像块，从而自适应地调整空间工作负载强度。在负载不平衡和异构集群上的大量实验验证了Orchestra在缓解性能瓶颈方面的有效性。与当前最先进的扩散推理框架patch并行相比，本方法将端到端延迟降低高达45%，并显著提升了异构GPU的资源利用率。

Training fast generators on new domains with limited data remains challenging for two reasons. First, adapting a pretrained diffusion or flow model to a new domain leaves its costly multi-step sampling unaddressed, and existing acceleration methods are tied to the source parameterization--$\epsilon$, $x$, $v$, or $u$--leaving heterogeneous pretrained models with no common acceleration target. Second, while adversarial refinement is proven effective for few-step quality, it is formulated only for instantaneous-velocity flows, not for the finite-interval average velocities that MeanFlow (MF) models predict. We address both problems. We propose MeanFlow-Transfer, which maps heterogeneous source outputs into a shared velocity representation, uses it to initialize an MF generator from the source weights, and optimizes an MF objective on the target domain. This unifies adaptation and acceleration in a single training loop across a broad range of pretrained models. We then introduce Continuous Adversarial MeanFlow, a post-training stage that extends continuous adversarial flow models from instantaneous velocities to MF's finite-interval average velocities. CAMF contrasts changes in a learned potential between real and predicted interval endpoints, recovering fine detail that MF regression averages away, and reduces to the instantaneous criterion in the vanishing-interval limit. Adapting four ImageNet-based source models--DiT ($\epsilon$), SiT ($v$), JiT ($x$), iMF ($u$)--to five target domains, MF-T with CAMF matches or exceeds the fine-tuned teacher in FID and FDD at up to $125\times$ fewer Neural Function Evaluations (NFEs), while CAMF improves MF-T&x27;s few-step FID by $29\%$ on average.

在数据有限的新域上训练快速生成器仍然面临两大挑战。首先，将预训练的扩散模型或流模型适应新域时，其昂贵的多步采样问题仍未得到解决，现有的加速方法与源参数化（ε、x、v或u）绑定，导致异构预训练模型缺乏共同的加速目标。其次，虽然对抗性细化已被证明对少步质量有效，但它仅针对瞬时速度流设计，而不适用于MeanFlow（MF）模型所预测的有限区间平均速度。我们针对这两个问题提出了解决方案。我们提出了MeanFlow-Transfer方法，该方法将异构源输出映射到共享的速度表示，使用它从源权重初始化MF生成器，并在目标域上优化MF目标。这在广泛的预训练模型中统一了适应和加速过程。随后，我们引入了连续对抗性MeanFlow，这是一种后训练阶段，将连续对抗性流模型从瞬时速度扩展到MF的有限区间平均速度。CAMF对比学习势能在真实区间端点和预测区间端点之间的变化，恢复被MF回归平均掉的细节，并在区间极限消失时退化为瞬时准则。在将四个基于ImageNet的源模型——DiT（ε）、SiT（v）、JiT（x）、iMF（u）——适应到五个目标域时，带有CAMF的MF-T在神经函数评估（NFEs）减少高达125倍的情况下，FID和FDD指标达到或超过微调教师模型，同时CAMF将MF-T的少步FID平均提升29%。

Multimodal large reasoning models often rely on long Chain-of-Thought (CoT) traces in which a substantial fraction of tokens, such as repeated visual descriptions, self-reflection, and other visually-disengaged filler, inflate inference cost without contributing to the answer. Existing CoT compression methods optimize output length but never measure whether a reasoning token is actually grounded in the image. We propose \textbf{VIG} (Visual Information Gain), an information-theoretic GRPO reward that scores each reasoning token by how much the image reduces its predictive uncertainty. VIG is computed online from two forward passes of the same policy, one with and one without the image, so no reference chains, external annotations, or auxiliary reward models are needed. Across six main multimodal reasoning benchmarks and three Qwen3-VL-Thinking model sizes (2B/4B/8B), plus an additional R1-Onevision-Bench evaluation on 8B, VIG consistently improves the accuracy--efficiency trade-off, supporting our central claim: \emph{efficient multimodal reasoning emerges from raising visual information density, where every reasoning token earns its place by anchoring to the image, rather than from imposing a length budget.} Our source code is available at https://github.com/chaser682/vig.

多模态大型推理模型通常依赖较长的思维链（CoT）轨迹，其中大量token（如重复的视觉描述、自我反思以及其他与视觉无关的填充内容）增加了推理成本，却对最终答案没有贡献。现有的CoT压缩方法优化输出长度，但从未衡量推理token是否真正基于图像。我们提出了VIG（视觉信息增益），一种基于信息论的GRPO奖励，通过图像在多大程度上降低了预测不确定性来对每个推理token进行评分。VIG通过同一策略的两次前向计算得到，一次带图像，一次不带图像，因此无需参考链、外部注释或辅助奖励模型。在六个主要多模态推理基准以及三种Qwen3-VL-Thinking模型规模（2B/4B/8B）上，再加上在8B模型上的额外R1-Onevision-Bench评估，VIG始终改善了准确率-效率权衡，支撑了我们的核心论点：高效的多模态推理源于提升视觉信息密度，即每个推理token通过锚定图像来争取其位置，而非源于施加长度预算。我们的源代码可访问https://github.com/chaser682/vig。

Storing face images under a hard sub-kilobyte budget, as required for identity documents, smart-card biometrics and bandwidth-constrained verification, forces a codec to discard most of the signal while keeping what a face matcher actually reads: identity. Generic codecs optimize pixel fidelity, not the embedding distances that drive verification, so which codec, resolution and setting best preserve identity at 1024 bytes or less, and how that degrades at 512, is unclear. We benchmark ten general and face-specific codecs across resolutions, byte budgets, two datasets (controlled Color FERET, in-the-wild AI-Solutions-KK) and four anchor face matchers, with a fourteen-model ViT and CNN roster confirming the ranking is backbone-invariant. We then train a custom identity-preserving codec that hits the byte budget exactly via binary search over a frozen gain table, and run four studies: resolution, demographic fairness, recompression, and no-box adversarial robustness. Sub-kilobyte identity preservation is feasible, but which codec to deploy depends entirely on the budget. At 1024 bytes and the 112 px working resolution the problem is close to solved: modern codecs hold Color FERET equal-error rate under 0.35 percent on the ArcFace anchor. At 512 bytes the field re-sorts: AVIF, HEIF, JPEG XL and legacy JPEG collapse to 28 to 98 percent false-non-match rate at FMR 1e-4, while WebP, JPEG-AI and our byte-budgeted learned codecs stay out of that band, with 24.3 percent for WebP against 6.9 percent for our accurate variant in the wild. That re-sort, not the 1024-byte ranking, is the operational result: a codec chosen at 1 kB is not the codec to deploy at half that.

在身份证件、智能卡生物特征和带宽受限验证等场景下，将人脸图像存储在严格的低于1千字节的限制内，迫使编解码器在保留人脸匹配器实际读取的特征——身份信息的同时丢弃大部分信号。通用编解码器优化的是像素保真度，而非驱动验证工作的嵌入距离，因此哪种编解码器、分辨率和设置能够在1024字节或更低的比特数下最佳保留身份，以及在512字节时性能如何下降，目前尚不明确。 我们对十种通用和专用于人脸的编解码器进行了基准测试，涵盖不同分辨率、比特数预算、两个数据集（受控环境下的Color FERET和自然场景下的AI-Solutions-KK）以及四个人脸匹配器，并使用包含十四个模型的ViT和CNN阵容确认排名与骨干网络无关。随后，我们训练了一款自定义的保身份编解码器，通过在冻结的增益表上进行二分搜索精确达到比特数预算，并进行了四项研究：分辨率、人口统计公平性、重新压缩和无盒对抗鲁棒性。 低于千字节的身份保持是可行的，但部署哪种编解码器完全取决于预算。在1024字节和112像素的工作分辨率下，该问题已接近解决：现代编解码器在ArcFace作为锚点匹配器时，使Color FERET的等错误率保持在0.35%以下。在512字节时，领域重新排序：AVIF、HEIF、JPEG XL和传统JPEG在FMR为1e-4时崩溃至28%至98%的错误不匹配率，而WebP、JPEG-AI和我们达到比特数预算的学习编解码器则未落入该区间，其中WebP在自然场景下为24.3%，我们精确匹配的变体为6.9%。这一重新排序而非1024字节的排名才是实际应用结果：在1千字节选择的编解码器并非在半数预算下应部署的编解码器。

We study whether the loss design of High-Fidelity Generative Image Compression (HiFiC), a GAN-based neural codec originally built for natural photographs, can be adapted to preserve biologically meaningful structure in Hi-C chromatin contact maps under lossy compression. Standard image compression, including HiFiC in its original form, optimizes for human visual perception; but a Hi-C contact map is normally distributed together with its numeric matrix file (.cool/.mcool), which downstream genomic analysis tools consume directly. Aggressive compression that looks acceptable to the eye can nonetheless blur or delete loops and topologically associating domain (TAD) boundaries that these tools depend on. We modify HiFiC's distortion term with a spatially-weighted MSE that up-weights biologically salient regions (loops, TAD boundaries, stripes, compartment structure) and add an insulation-score loss term that directly penalizes loss of TAD boundary sharpness. We describe a three-phase fine-tuning strategy that adapts a pretrained HiFiC checkpoint to the Hi-C domain without catastrophic forgetting. We evaluate the resulting system, HiFiC-G, using both conventional image-quality metrics (PSNR, SSIM) and genomics-domain preservation metrics (loop/TAD/compartment/stripe preservation percentage) across two cell lines. HiFiC-G preserves local structure, meaning stripes and TAD boundaries, substantially better than the metrics alone would suggest, while long-range A/B compartment structure remains poorly preserved; we show this gap tracks genomic scale and is consistent with a specific architectural cause, the fixed-size tiling that both HiFiC-G and the original HiFiC rely on for memory efficiency.

我们研究了高保真生成式图像压缩（High-Fidelity Generative Image Compression, HiFiC）的损失函数设计——一种最初为自然照片设计的基于GAN的神经编解码器——是否可以在有损压缩下保留Hi-C染色质接触图中具有生物学意义的结构。标准图像压缩（包括原始形式的HiFiC）针对人类视觉感知进行优化；但Hi-C接触图通常以其数值矩阵文件（.cool/.mcool）的形式与下游基因组分析工具直接关联使用。看起来对人眼而言可接受的有损压缩仍可能模糊或删除这些工具所依赖的环（loops）和拓扑关联域（topologically associating domain, TAD）边界。我们修改了HiFiC的失真项，加入空间加权的MSE，对生物显著区域（环、TAD边界、条纹、区室结构）给予更高权重，并添加了绝缘评分损失项直接惩罚TAD边界清晰度的损失。我们描述了一种三阶段微调策略，使预训练的HiFiC检查点适应Hi-C领域，同时避免灾难性遗忘。我们使用常规图像质量指标（PSNR、SSIM）和基因组学领域保存指标（环/TAD/区室/条纹保存百分比）在两种细胞系中评估了所得系统HiFiC-G。HiFiC-G对局部结构（即条纹和TAD边界）的保存远优于仅凭指标所提示的水平；而长程A/B区室结构仍保存不佳；我们表明这一差距与基因组规模相关，且与一个特定的架构原因一致，即HiFiC-G和原始HiFiC为提高内存效率所采用的固定大小平铺策略。