每日 arXiv 论文简报

Discrete denoising diffusion models (DDMs) have recently emerged as a compelling alternative to autoregressive (AR) modeling for discrete data, offering parallel generation and iterative global refinement capabilities. Unlike continuous diffusion, where the state space is fixed, DDMs are fundamentally shaped by how the discrete state space is constructed: the tokenization scheme, the vocabulary topology, and domain-specific structural alphabets. This work introduces a unified conceptual framework that views discrete diffusion models through the construction of the underlying discrete state space. Within this framework, existing formulations, including transition-matrix, masking/absorbing-state, and score/ratio-based approaches, emerge as different instantiations of a common design space. The framework further exposes common design trade-offs across training objectives, inference algorithms, scaling behavior, systems optimization, and evaluation protocols, suggesting several promising directions for future research.

离散去噪扩散模型（DDMs）作为自回归（AR）建模在离散数据上的替代方案近年来备受关注，其具备并行生成和迭代全局精炼的能力。与状态空间固定不变的连续扩散不同，离散扩散模型从根本上取决于离散状态空间的构建方式：分词方案、词汇拓扑结构以及领域特定的结构字母表。本研究提出了一个统一的概念框架，从底层离散状态空间的构建角度审视离散扩散模型。在该框架下，现有 formulations（包括转移矩阵、掩码/吸收态以及基于分数/比率的方法）作为共同设计空间的不同实例化形式得以呈现。该框架进一步揭示了训练目标、推理算法、扩展行为、系统优化和评估协议之间的共同设计权衡，并指出了若干有前景的未来研究方向。

Modern autoregressive ASR systems can emit timestamps as decoded tokens, enabling timestamped transcription without frame-level aligners or inference-time post-processing. We show that these generated timestamps can drift across long non-speech spans: the transcript may remain plausible, but the decoded time axis drifts away from the audio. We study this non-speech-induced timestamp drift with self-built gap and long-gap benchmarks across 15 evaluated timestamp-producing ASR and audio-language systems. Naive timestamp-corrected fine-tuning improves alignment but can severely degrade non-target ASR behavior, exposing a forgetting problem. We propose REDDIT(REplay-based Distribution eDITing), a lightweight two-stage post-training framework that corrects timestamps while avoiding this catastrophic forgetting: it first edits timestamp targets under the model's own replayed decoder context while matching the frozen base distribution on non-timestamp tokens, then applies a short edited-prefix refinement stage. In this framework, we construct correction supervision without human transcripts or human timestamp annotations by combining VAD-trimmed speech spans with inserted non-speech gaps and known concatenation offsets. On Whisper-tiny, 34.9 hours of targeted correction audio used and only 1.6% of model parameters updated, raising long-gap mIoU from 38.7% to 95.0% and reducing mixed-gap out-of-domain AAS from 2752 ms to 223 ms while preserving CV-en MER at 41.3% (versus 524.2% for ordinary SFT decoder tuning).

现代自回归ASR系统可以将时间戳作为解码token输出，从而实现无需帧级对齐器或推理后处理的带时间戳转录。我们发现，这些生成的时间戳在长非语音片段上会发生漂移：转录文本可能仍然合理，但解码后的时间轴已偏离实际音频。我们通过自建的间隙和长间隙基准测试对这种非语音诱发的时间戳漂移进行了研究，评估了15个具有时间戳生成能力的ASR和音频语言系统。朴素的时间戳校正微调虽能改善对齐，但会严重损害非目标ASR行为，暴露了遗忘问题。我们提出了REDDIT（基于重放的分布编辑），这是一个轻量级的两阶段后训练框架，可在避免这种灾难性遗忘的同时校正时间戳：首先在模型自身重放的解码器上下文下编辑时间戳目标，同时匹配非时间戳token的冻结基础分布，然后应用一个简短的编辑前缀优化阶段。在该框架中，我们通过结合VAD修剪的语音片段、插入的非语音间隙和已知的拼接偏移量，在无需人工转录或人工时间戳标注的情况下构建校正监督。在Whisper-tiny上，仅使用34.9小时的定向校正音频并仅更新1.6%的模型参数，即将长间隙mIoU从38.7%提升至95.0%，并将混合间隙域外AAS从2752ms降低至223ms，同时将CV-en MER维持在41.3%（而普通SFT解码器调优的MER为524.2%）。

Generating high-quality triangle meshes is essential for film, gaming, and interactive 3D applications. Mainstream methods rely on mesh serialization and autoregressive processes, which stuggles in effective inference and is sensitive to error accumulation. In this paper, we present Nexus, a diffusion method that achieves holistic mesh generation via decoupled vertex and topology generation. First, we view mesh vertices as sparse voxels organized as an octree and adopt a diffusion model to generate the vertices in a coarse-to-fine manner. Second, for topology modeling, we propose Spacetime Interval, as an extension of Spacetime Distance to encode arbitrary edge and face topology into continuous per-vertex embeddings. It allows for a global and efficient recovery of complex topology. We then employ a diffusion model to generate the continuous embeddings on the generated vertices. Extensive experiments on the Objaverse and Toys4K datasets and in-the-wild images demonstrate that our method outperforms state-of-the-art autoregressive and two-stage baselines, effectively circumventing the inherent limitations of sequential mesh modeling. A blind user study from 3D practitioners confirms strong perceptual preference for our results.

生成高质量三角形网格对于电影、游戏和交互式3D应用至关重要。主流方法依赖于网格序列化和自回归过程，在有效推理方面存在困难，且对误差累积敏感。本文中，我们提出Nexus，一种通过解耦顶点和拓扑生成实现整体网格生成的扩散模型。首先，我们将网格顶点视为由八叉树组织的稀疏体素，采用扩散模型以由粗到精的方式生成顶点。其次，对于拓扑建模，我们提出时空区间（Spacetime Interval），作为时空距离的扩展，将任意边和面拓扑编码为连续的每顶点嵌入。它允许全局且高效地恢复复杂拓扑。随后，我们采用扩散模型在生成的顶点上生成连续嵌入。在Objaverse和Toys4K数据集以及真实场景图像上的广泛实验表明，我们的方法优于最先进的自回归和两阶段基线方法，有效规避了顺序网格建模的固有局限性。来自3D从业者的盲测用户研究确认了我们的结果具有较强的感知偏好。

Video generative models commonly rely on latent spaces learned by 3D Variational Autoencoders (3D-VAEs). However, conventional 3D-VAEs are mainly optimized for pixel-level reconstruction, which can limit the semantic and spatio-temporal structure captured by their latents. Meanwhile, Video Foundation Models (VFMs) such as V-JEPA 2 and VideoMAEv2 show strong video understanding capabilities, yet whether their frozen representations can be transformed into compact, reconstruction-capable, and generation-friendly video latents remains largely unexplored. We answer this question with VideoRAE, a representation autoencoder that leverages multi-scale hierarchical features from a frozen video foundation encoder and compresses them with a lightweight 1D self-attention projector. VideoRAE supports both continuous latents for Diffusion Transformers and discrete tokens for autoregressive models via multi-codebook high-dimensional quantization. During decoding, a local-and-global representation alignment objective with the frozen VFM teacher improves semantic preservation and enables training without KL regularization. Experiments show that VideoRAE achieves strong reconstruction in both continuous and discrete regimes. On UCF-101, it obtains state-of-the-art class-to-video gFVDs of 40 and 93 with AR and DiT generators, respectively, while converging approximately 5x faster than competing autoencoder baselines. In a controlled 2B-scale text-to-video study, replacing LTX-VAE with VideoRAE leads to faster convergence under comparable settings. These results validate frozen VFM representations as versatile and generation-friendly video latents. The model and code will be released on https://zhxie0117.github.io/VideoRAE.

视频生成模型通常依赖于3D变分自编码器（3D-VAE）学习的潜在空间。然而，传统3D-VAE主要针对像素级重建进行优化，这可能限制其潜在表示所捕获的语义和时空结构。与此同时，视频基础模型（VFM），如V-JEPA 2和VideoMAEv2，表现出强大的视频理解能力，但其冻结表示是否能转化为紧凑的、可重建的、对生成友好的视频潜在表示，目前仍鲜有探索。我们通过VideoRAE来回答这一问题，这是一种表示自编码器，利用冻结视频基础编码器的多尺度层次特征，并使用轻量级1D自注意力投影器进行压缩。VideoRAE通过多码本高维量化同时支持用于扩散Transformer的连续潜在表示和用于自回归模型的离散token。在解码阶段，采用与冻结VFM教师的局部-全局表示对齐目标来改善语义保留，并可在无需KL正则化的情况下进行训练。实验表明，VideoRAE在连续和离散模式下均实现了强大的重建性能。在UCF-101数据集上，它在使用AR和DiT生成器时分别获得了40和93的最先进类别到视频gFVD分数，同时收敛速度比竞争的自编码器基线快约5倍。在受控的20亿参数规模文本到视频研究中，在相似设置下用VideoRAE替换LTX-VAE可实现更快的收敛。这些结果验证了冻结VFM表示作为通用且对生成友好的视频潜在表示的可行性。模型和代码将发布于 https://zhxie0117.github.io/VideoRAE。

Reflectance attributes in LiDAR point clouds provide essential information for downstream tasks but remain underexplored in neural compression methods. To address this, we introduce SerLiC, a serialization-based neural compression framework to fully exploit the intrinsic characteristics of LiDAR reflectance. SerLiC first transforms 3D LiDAR point clouds into 1D sequences via scan-order serialization, offering a device-centric perspective for reflectance analysis. Each point is then tokenized into a contextual representation comprising its sensor scanning index, radial distance, and prior reflectance, for effective dependencies exploration. For efficient sequential modeling, Mamba is incorporated with a dual parallelization scheme, enabling simultaneous autoregressive dependency capture and fast processing. Extensive experiments demonstrate that SerLiC attains over 2x volume reduction against the original reflectance data, outperforming the state-of-the-art method by up to 22% reduction of compressed bits while using only 2% of its parameters. Moreover, a lightweight version of SerLiC achieves > 10 fps (frames per second) with just 111K parameters, which is attractive for real-world applications.

激光雷达点云中的反射率属性为下游任务提供重要信息，但在神经压缩方法中尚未得到充分探索。针对这一问题，本文提出了SerLiC，一个基于序列化的神经压缩框架，旨在充分利用激光雷达反射率的内在特性。SerLiC首先通过扫描顺序序列化将三维激光雷达点云转换为一维序列，为反射率分析提供了以设备为中心的视角。随后，每个点被标记化为包含传感器扫描索引、径向距离和先验反射率的上下文表示，以有效探索依赖关系。为了实现高效的序列建模，本文采用Mamba模型并引入双重并行化方案，支持同时捕获自回归依赖关系和快速处理。大量实验表明，SerLiC相对于原始反射率数据实现了超过两倍的体积压缩，在压缩比特数上比当前最先进的方法减少高达22%，同时仅使用其2%的参数量。此外，SerLiC的轻量级版本仅用111K参数就能达到超过10帧每秒的吞吐量，这在实际应用中具有重要意义。

Reasoning-driven universal multimodal embedding has advanced rapidly by introducing Chain-of-Thought (CoT) reasoning into the embedding pipeline. Despite the strong performance across both general and complex tasks, this paradigm suffers from two core limitations: (i) autoregressive CoT reasoning incurs high computational cost, making it impractical for low-latency retrieval; and (ii) embedding performance is heavily coupled with CoT annotation quality, making large-scale training unreliable. These raise fundamental questions: Is textual CoT the optimal form of reasoning for embedding, and can effective embedding reasoning be accomplished in latent space? To this end, we propose LaME (Latent Reasoning Multimodal Embedding), which formulates embedding-oriented latent reasoning as a weakly supervised information bottleneck. LaME employs K learnable reason tokens as a fixed-capacity bottleneck, completing all reasoning within a single forward pass. The two weak supervision signals structurally decouple contrastive from autoregressive objectives and eliminate dependence on CoT annotations, while a two-stage training pipeline ensures stable convergence. Experiments on MMEB-v2 and MRMR show that LaME achieves competitive performance, surpassing some explicit CoT-based models, while delivering 60x faster inference than explicit CoT methods and 2x faster than latent baselines with throughput comparable to discriminative embedding models. Code is available at https://github.com/PeppaWu/LaME.

推理驱动的通用多模态嵌入通过将思维链（CoT）推理引入嵌入流程而快速发展。尽管在通用任务和复杂任务上都表现出色，但该范式存在两个核心局限：（i）自回归思维链推理产生高昂的计算成本，使其难以适用于低延迟检索场景；（ii）嵌入性能严重依赖于思维链标注质量，导致大规模训练不可靠。这些问题引发了一个根本性疑问：文本思维链是否是嵌入推理的最优形式？能否在潜在空间中实现有效的嵌入推理？为此，我们提出了LaME（潜在推理多模态嵌入），该方法将面向嵌入的潜在推理建模为弱监督信息瓶颈。LaME使用K个可学习推理令牌作为固定容量瓶颈，在单次前向传播中完成所有推理。两个弱监督信号在结构上将对比学习与自回归目标解耦，并消除对思维链标注的依赖，而两阶段训练流程确保了稳定的收敛。在MMEB-v2和MRMR数据集上的实验表明，LaME取得了具有竞争力的性能，超越了一些显式思维链模型，同时推理速度比显式思维链方法快60倍，比潜在基线方法快2倍，吞吐量与判别式嵌入模型相当。代码已开源于https://github.com/PeppaWu/LaME。

Inferring gene regulatory networks (GRNs) from single-cell transcriptomic data is crucial for biological discovery, yet existing approaches suffer from a fundamental misalignment with real-world needs. Researchers typically seek a small set of high-confidence regulatory interactions for experimental validation, often involving previously unseen genes. However, current benchmarks rely on transductive splits with global classification metrics, while prevailing models struggle to generalize under inductive settings. To bridge this gap, we reformulate GRN inference as an inductive, ranking-centric graph completion problem and introduce \textbf{\benchmark}, a new benchmark that incorporates an inductive gene-holdout split together with knowledge graph completion metrics to better evaluate top-ranked predictions. Building on this, we propose \textbf{\method}, the first co-evolutionary discrete diffusion framework that jointly models biologically coherent discretized gene expression states and regulatory interactions for robust inductive generalization and improved top-ranked regulatory discovery. We further introduce TF-ALL Subgraph Sampling (TASS) for scalable training. Extensive experiments on {\benchmark} show that {\method} establishes new state-of-the-art performance, significantly outperforming existing methods in novel regulatory discovery, and ablation studies further verify the effectiveness of our design.

从单细胞转录组数据推断基因调控网络对于生物发现至关重要，但现有方法存在与现实需求根本性对齐的问题。研究者通常寻求一小部分高置信度的调控相互作用进行实验验证，这些作用常涉及先前未见的基因。然而，当前的基准测试依赖直推式划分和全局分类指标，而现有模型在归纳式设置下难以泛化。为弥补这一差距，我们重新将基因调控网络推断问题定义为归纳式、以排序为中心的图补全任务，并引入BEELINE-KGC，这是一个新的基准测试，包含归纳式基因保留划分和知识图谱补全指标，能更好地评估排名靠前的预测。在此基础上，我们提出CoDiffGRN，这是首个共演化离散扩散框架，能够联合建模生物学上一致的离散化基因表达状态和调控相互作用，以实现稳健的归纳式泛化和改进的排名靠前调控发现。我们进一步引入TF-ALL子图采样（TASS）以实现可扩展训练。在BEELINE-KGC上的广泛实验表明，CoDiffGRN建立了新的最先进性能，在新型调控发现方面显著优于现有方法，消融实验进一步验证了我们设计的有效性。

Diffusion-based text-to-audio generative models such as AudioLDM achieve high perceptual quality and strong semantic consistency; however, their practical deployment is hindered by the substantial computational cost of the U-Net denoising backbone. In this work, we apply model pruning to improve the computational efficiency of AudioLDM, a U-Net-based text-conditioned audio latent diffusion model. We analyse parameter redundancy across U-Net convolutional blocks and evaluate a filter-pruning strategy. Pruning is guided by norm-based criteria and followed by lightweight finetuning to recover performance losses. Experimental results demonstrate that up to 83% of the parameters and 39% of the multiply-accumulate operations of U-Net have been reduced while maintaining, and in some cases improving, generation quality compared to the baseline unpruned network. We find that pruning affects AudioLDM's ability to generate certain sound events including safety-critical sounds such as gunshots, sirens, and explosions, as well as mechanical sounds such as drills and sewing machines, and other sounds such as sprays and tick-tocks, which are mostly recovered by lightweight finetuning of the pruned model.

基于扩散的文本到音频生成模型（如AudioLDM）能够实现高感知质量和强语义一致性；然而，其U-Net去噪骨干网络的巨大计算成本阻碍了实际部署。本研究将模型剪枝应用于提升AudioLDM（一种基于U-Net的文本条件音频潜在扩散模型）的计算效率。我们分析了U-Net卷积块中的参数冗余，并评估了一种滤波器剪枝策略。剪枝由基于范数的准则引导，随后进行轻量级微调以恢复性能损失。实验结果表明，在保持甚至部分提升生成质量的前提下，U-Net的参数减少了83%，乘累加运算减少了39%。我们发现剪枝影响了AudioLDM生成某些声音事件的能力，包括枪声、警笛和爆炸等安全关键声音，以及电钻和缝纫机等机械声音，还有喷雾声和滴答声等其他声音，而这些能力在剪枝模型的轻量级微调后基本得到恢复。

Discrete denoising diffusion models (DDMs) have recently emerged as a compelling alternative to autoregressive (AR) modeling for discrete data, offering parallel generation and iterative global refinement capabilities. Unlike continuous diffusion, where the state space is fixed, DDMs are fundamentally shaped by how the discrete state space is constructed: the tokenization scheme, the vocabulary topology, and domain-specific structural alphabets. This work introduces a unified conceptual framework that views discrete diffusion models through the construction of the underlying discrete state space. Within this framework, existing formulations, including transition-matrix, masking/absorbing-state, and score/ratio-based approaches, emerge as different instantiations of a common design space. The framework further exposes common design trade-offs across training objectives, inference algorithms, scaling behavior, systems optimization, and evaluation protocols, suggesting several promising directions for future research.

离散去噪扩散模型（DDMs）作为自回归（AR）建模在离散数据上的替代方案近年来备受关注，其具备并行生成和迭代全局精炼的能力。与状态空间固定不变的连续扩散不同，离散扩散模型从根本上取决于离散状态空间的构建方式：分词方案、词汇拓扑结构以及领域特定的结构字母表。本研究提出了一个统一的概念框架，从底层离散状态空间的构建角度审视离散扩散模型。在该框架下，现有 formulations（包括转移矩阵、掩码/吸收态以及基于分数/比率的方法）作为共同设计空间的不同实例化形式得以呈现。该框架进一步揭示了训练目标、推理算法、扩展行为、系统优化和评估协议之间的共同设计权衡，并指出了若干有前景的未来研究方向。

Diffusion models (DMs) have advanced text-to-image (T2I) synthesis, yet their personalization capabilities raise serious privacy and copyright concerns. Malicious actors can misuse these models to generate unauthorized portraits or artistic style replicas. Existing proactive defenses primarily rely on applying adversarial perturbations to reference images to disrupt training. However, these approaches face limitations: they assume all training images are pre-perturbed and are prone to failure when datasets contain unperturbed images or undergo minor data transformations. In this paper, we introduce PersGuard, a novel backdoor-based framework designed to prevent unauthorized personalization of pre-trained T2I diffusion models. Unlike perturbation-based methods, we assume protectors can embed protective backdoors into the models before their release. This mechanism ensures that if a downstream user fine-tunes the model on protected images, the model retains the backdoor and generates predefined protective outputs; conversely, for unprotected images, the backdoor is effectively removed during fine-tuning to ensure normal model utility. We formulate the backdoor injection as a unified optimization problem incorporating three objectives: a backdoor behavior loss to activate protection, a prior preservation loss to maintain standard generation capabilities, and a novel backdoor retention loss. The retention loss is specifically designed to mirror personalization loss, ensuring the backdoor remains robust during downstream fine-tuning. Extensive experiments across gray-box and black-box settings, multi-object protection, and facial identity protection demonstrate that PersGuard provides superior privacy protection compared to existing perturbation-based methods.

扩散模型（Diffusion Models，简称DMs）推动了文本到图像（Text-to-Image，简称T2I）合成技术的发展，但其个性化能力引发了严重的隐私和版权担忧。恶意行为者可能滥用这些模型生成未经授权的肖像或艺术风格复制品。现有的主动防御方法主要依赖于对参考图像应用对抗性扰动来破坏训练过程。然而，这些方法存在局限性：它们假设所有训练图像都经过预先扰动，且当数据集中包含未扰动图像或经历轻微数据变换时容易失效。本文提出了PersGuard，这是一种基于后门的新型框架，旨在防止对预训练T2I扩散模型进行未经授权的个性化。与基于扰动的方法不同，我们假设保护者可以在模型发布前嵌入保护性后门。该机制确保如下效果：如果下游用户在受保护图像上对模型进行微调，模型将保留后门并生成预定义的保护性输出；反之，对于未受保护的图像，后门在微调过程中会被有效移除，以确保模型的正常功能。我们将后门注入表述为一个统一的优化问题，包含三个目标：激活保护的后门行为损失、维持标准生成能力的先验保持损失，以及专门设计用于镜像个性化损失的后门保持损失——该损失确保后门在下游微调过程中保持鲁棒性。在灰盒和黑盒设置、多目标保护以及面部身份保护等场景下进行的大量实验表明，PersGuard相比现有的基于扰动的方法提供了更优的隐私保护。

Autonomous driving in complex traffic requires planners that generalize beyond hand-crafted rules, motivating data-driven approaches that learn behavior from expert demonstrations. Diffusion-based trajectory planners have recently shown strong closed-loop performance by iteratively denoising a full-horizon plan, but they remain difficult to certify and can fail catastrophically in rare or out-of-distribution scenarios. To address this challenge, we present PC-Diffuser, a safety augmentation framework that embeds a certifiable, path-consistent barrier-function structure directly into the denoising loop of diffusion planning. The key idea is to make safety an intrinsic part of trajectory generation rather than a post-hoc fix: we enforce forward invariance along the rollout while preserving the diffusion model's intended path geometry. Specifically, PC-Diffuser (i) evaluates collision risk using a capsule-distance barrier function that better reflects vehicle geometry and reduces unnecessary conservativeness, (ii) converts denoised waypoints into dynamically feasible motion under a kinematic bicycle model, and (iii) applies a path-consistent safety filter that eliminates residual constraint violations without geometric distortion, so the corrected plan remains close to the learned distribution. By injecting these safety-consistent corrections at every denoising step and feeding the refined trajectory back into the diffusion process, PC-Diffuser enables iterative, context-aware safeguarding instead of post-hoc repair...

复杂交通场景中的自动驾驶需要超越手工规则设计的规划器，这促使了从专家演示中学习行为的数据驱动方法的发展。基于扩散模型的轨迹规划器通过迭代去噪完整视距规划展现出优异的闭环性能，但其仍难以验证认证，且在罕见或分布外场景中可能发生灾难性失败。为解决这一挑战，我们提出了PC-Diffuser，一种将可认证的、路径一致的障碍函数结构直接嵌入扩散规划去噪循环的安全增强框架。其核心思想是将安全性作为轨迹生成的内在属性，而非事后补救：我们在展开过程中强制执行前向不变性，同时保留扩散模型预期的路径几何。具体而言，PC-Diffuser (i) 采用胶囊距离障碍函数评估碰撞风险，更好地反映车辆几何形状并减少不必要的保守性；(ii) 将去噪路点通过运动学自行车模型转换为动力学可行的运动；(iii) 应用路径一致的安全滤波器消除残留约束违反而不产生几何畸变，使校正后的规划接近学习到的分布。通过在每个去噪步骤注入安全一致校正并将精炼轨迹反馈到扩散过程中，PC-Diffuser实现了迭代的、上下文感知的防护而非事后修复。

Recent diffusion-based video generation models have enabled high-quality personalized video customization through both tuning-based pipelines, which fine-tune a video diffusion model, and reference-based pipelines such as image-to-video generation. However, these capabilities raise serious concerns about personal privacy, identity ownership and intellectual property protection. Existing anti-customization works focus on protecting images, while protection for videos against both reference- and tuning-based customization remains largely underexplored. Protecting videos in this setting raises three challenges: (i) Image-level perturbations, optimized frame by frame, cannot survive temporal compression by 3D video VAE. (ii) A video-level perturbation optimized on a single video is vulnerable to temporal editing and fails to protect unseen videos. (iii) Temporally inconsistent perturbations are not robust to temporal attacks. To address these challenges, we propose Temporally Consistent Universal Adversarial Perturbations (TC-UAP), the first protection method against both reference- and tuning-based video customization. TC-UAP optimizes an identity-level multi-frame UAP over sliding windows from multiple videos, accounting for local temporal dependencies induced by temporal compression in video VAE and enabling a single perturbation to protect unseen videos of varying lengths. Moreover, we introduce intrinsic temporal modeling and an extrinsic surrogate temporal-attack loss, which make the perturbation temporally consistent and robust to unseen temporal attacks. Empirically, quantitative and qualitative results show that TC-UAP achieves the strongest identity protection compared with existing methods under both reference- and tuning-based video customization, and remains robust under multiple unseen temporal attacks.

近年来，基于扩散的视频生成模型通过基于调优的管线（对视频扩散模型进行微调）和基于参考的管线（如图像到视频生成）实现了高质量的个性化视频定制。然而，这些能力引发了严重的个人隐私、身份所有权和知识产权保护担忧。现有抗定制工作主要关注图像保护，而针对视频同时抵御基于参考和基于调优的定制化攻击仍然缺乏探索。在此场景下保护视频存在三个挑战：（i）逐帧优化的图像级扰动无法在3D视频VAE的时间压缩下存活；（ii）在单一视频上优化的视频级扰动容易受到时间编辑攻击，且无法保护未见的视频；（iii）时间不一致的扰动对时间攻击不够鲁棒。为解决这些挑战，我们提出了时间一致通用对抗扰动（Temporally Consistent Universal Adversarial Perturbations，TC-UAP），这是首个同时抵御基于参考和基于调优视频定制化攻击的保护方法。TC-UAP从多个视频的滑动窗口中优化身份级多帧UAP，考虑了视频VAE中时间压缩引起的局部时间依赖性，并使得单一扰动能够保护不同长度的未见视频。此外，我们引入了内在时间建模和外在代理时间攻击损失，使扰动在时间上保持一致并对未见时间攻击具有鲁棒性。实证结果表明，无论是在基于参考还是基于调优的视频定制化攻击下，TC-UAP在身份保护方面均优于现有方法，并在多种未见时间攻击下保持鲁棒性。

Existing 3D generative models predominantly rely on implicit volumetric representations, which enforce watertight topology and struggle to represent thin-shell and non-manifold geometries such as garments. Geometry image-based approaches offer a surface-centric alternative, but existing methods rely on discrete binary occupancy maps whose resolution-dependent boundary encoding causes staircase artifacts and information loss upon downsampling, while surface reconstruction remains a non-differentiable post-processing step disconnected from the learning pipeline. To address this, we propose Differentiable Geometry Image (DiffGI), an end-to-end 3D-to-2D mapping framework that seamlessly integrates surface representation and geometric optimization. DiffGI replaces binary maps with a continuous 2D Truncated Signed Distance Function (TSDF), which encodes boundary position at subpixel precision within a fixed grid resolution, eliminating resolution-dependent staircase artifacts even under aggressive downsampling. Building on this continuous field, we introduce a differentiable Marching Squares algorithm based on analytical linear interpolation, allowing gradients from 3D surface losses to propagate back to the 2D latent space. Leveraging this differentiable pipeline, we train a DiffGI-VAE augmented with a geometry-aware normal rendering loss to compress complex 3D surfaces into an ultra-compact 32X32 latent space, and instantiate a transformer-based latent diffusion model with a flow-matching objective on top of this space for conditional 3D generation. Extensive experiments on garment and object datasets demonstrate that our method achieves superior reconstruction fidelity and boundary precision compared to prior geometry-image and voxel-based approaches, while requiring significantly fewer computational resources.

现有3D生成模型主要依赖隐式体素表示，这种表示强制要求封闭拓扑结构，难以表示衣物等薄壳和非流形几何体。基于几何图像的方法提供了一种以表面为中心的替代方案，但现有方法依赖于离散的二值占用图，其分辨率依赖的边界编码在降采样时会产生阶梯伪影并导致信息丢失，同时表面重建仍然是一个与学习 pipeline 脱节的可微后处理步骤。为解决这一问题，我们提出了可微几何图像（Differentiable Geometry Image，DiffGI），这是一个端到端的3D到2D映射框架，无缝集成了表面表示和几何优化。DiffGI 用连续的2D截断符号距离函数（TSDF）取代了二值映射，TSDF 在固定网格分辨率内以子像素精度编码边界位置，即使在激进降采样下也能消除分辨率依赖的阶梯伪影。在此连续场的基础上，我们引入了基于解析线性插值的可微 Marching Squares 算法，使来自3D表面损失的梯度能够反向传播到2D潜在空间。利用这一可微 pipeline，我们训练了一个配备几何感知法线渲染损失的 DiffGI-VAE，将复杂3D表面压缩到紧凑的32×32潜在空间，并在此空间上构建了基于 Transformer 的潜在扩散模型，用于条件3D生成。衣物和物体数据集上的广泛实验表明，我们的方法在重建保真度和边界精度方面优于先前基于几何图像和体素的方法，同时显著减少了计算资源需求。

Accurate estimation of landfast sea ice roughness is critical for climate modeling and safe Arctic over-ice travel, yet existing approaches rely on costly airborne surveys or sparse in-situ measurements, limiting spatial coverage and operational scalability. Here we show that high-resolution sea ice topography can be reconstructed directly from optical satellite imagery using a conditional diffusion framework. Our approach, RoughNet, learns to map 10 m Sentinel-2 multispectral images to locally normalized 1 m surface elevation residual fields, enabling fine-scale roughness characterization from widely available satellite data. Trained on airborne LiDAR data from two Arctic regions and evaluated on an unseen third Arctic region, the model generalizes across diverse ice conditions and partially reproduces small-scale topographic structure. The best-performing model achieves an out-of-domain root mean squared error of 9 cm while preserving the statistical and spectral properties of the underlying roughness field. These results demonstrate that generative diffusion models can recover physically meaningful surface structure from optical imagery alone, providing a scalable pathway for high-resolution sea ice mapping and roughness estimation in data-sparse environments.

准确估算固定冰粗糙度对于气候建模和安全的北极冰上出行至关重要，然而现有方法依赖于成本高昂的航空测量或稀疏的实地测量，空间覆盖范围和作业可扩展性受限。本研究证明高分辨率海冰地形可直接从光学卫星图像中使用条件扩散框架重建。我们的方法 RoughNet 学习将 10 米分辨率的 Sentinel-2 多光谱图像映射到局部归一化的 1 米表面高程残差场，从而能够从广泛可用的卫星数据进行精细尺度粗糙度表征。该模型基于两个北极地区的机载 LiDAR 数据进行训练，并在第三个未见过的北极地区进行评估，模型能够跨不同冰况泛化并部分复现小尺度地形结构。最佳模型在域外测试中达到 9 厘米的均方根误差，同时保留了底层粗糙度场的统计特性和频谱特性。这些结果表明，生成式扩散模型仅从光学图像即可恢复物理上有意义的表面结构，为数据稀疏环境下高分辨率海冰制图和粗糙度估算提供了可扩展的途径。

We present the Large Processing Model (LPM), a diffusion-based generative framework for photorealistic video restoration under complex, in-the-wild degradations. To our knowledge, LPM is the first generative video restoration model deployed at industrial scale. LPM addresses the diverse degradations in user-generated content (UGC) through a unified system encompassing large-scale data engineering, foundation-model training, and efficient inference. Its enhanced architecture, progressive training strategy, and temporal-pyramid inference mechanism jointly enable high-fidelity, temporally consistent restoration of arbitrarily long videos across the broad content distribution encountered on UGC platforms. LPM has been deployed in production at Kuaishou, where videos processed by the model account for approximately 45% of total viewing time, delivering consistent improvements across key quality-of-experience metrics. Beyond perceptual enhancement, LPM delivers substantial system-level benefits: at comparable perceptual quality, it reduces bitrate by 20% relative to Kuaishou's in-house codec, yielding annual bandwidth cost savings on the order of hundreds of millions. Its low serving cost also enables integration into products such as Kling, demonstrating that generative restoration can be practical, scalable, and cost-effective for large-scale video processing.

我们提出大处理模型（Large Processing Model，LPM），这是一个基于扩散模型的生成式框架，用于在复杂真实世界退化条件下进行照片级真实感视频修复。据我们所知，LPM是首个在工业规模上部署的生成式视频修复模型。LPM通过一个统一系统来处理用户生成内容（UGC）中的多样化退化问题，该系统包含大规模数据工程、基础模型训练和高效推理。其增强的架构、渐进式训练策略和时序金字塔推理机制共同实现了对UGC平台上各种内容分布的超长视频的高保真、时间一致性修复。LPM已在快手投入生产部署，经该模型处理的视频约占总观看时长的45%，在各项体验质量指标上带来了一致的提升。除感知质量提升外，LPM还带来了显著的系统级收益：在感知质量相当的情况下，相比快手自研编解码器可降低20%的码率，每年可节省数亿元的带宽成本。其低服务成本也使其能够集成到可灵等产品中，证明了生成式修复在大规模视频处理中的实用性、可扩展性和成本效益。

Generating high-quality triangle meshes is essential for film, gaming, and interactive 3D applications. Mainstream methods rely on mesh serialization and autoregressive processes, which stuggles in effective inference and is sensitive to error accumulation. In this paper, we present Nexus, a diffusion method that achieves holistic mesh generation via decoupled vertex and topology generation. First, we view mesh vertices as sparse voxels organized as an octree and adopt a diffusion model to generate the vertices in a coarse-to-fine manner. Second, for topology modeling, we propose Spacetime Interval, as an extension of Spacetime Distance to encode arbitrary edge and face topology into continuous per-vertex embeddings. It allows for a global and efficient recovery of complex topology. We then employ a diffusion model to generate the continuous embeddings on the generated vertices. Extensive experiments on the Objaverse and Toys4K datasets and in-the-wild images demonstrate that our method outperforms state-of-the-art autoregressive and two-stage baselines, effectively circumventing the inherent limitations of sequential mesh modeling. A blind user study from 3D practitioners confirms strong perceptual preference for our results.

生成高质量三角形网格对于电影、游戏和交互式3D应用至关重要。主流方法依赖于网格序列化和自回归过程，在有效推理方面存在困难，且对误差累积敏感。本文中，我们提出Nexus，一种通过解耦顶点和拓扑生成实现整体网格生成的扩散模型。首先，我们将网格顶点视为由八叉树组织的稀疏体素，采用扩散模型以由粗到精的方式生成顶点。其次，对于拓扑建模，我们提出时空区间（Spacetime Interval），作为时空距离的扩展，将任意边和面拓扑编码为连续的每顶点嵌入。它允许全局且高效地恢复复杂拓扑。随后，我们采用扩散模型在生成的顶点上生成连续嵌入。在Objaverse和Toys4K数据集以及真实场景图像上的广泛实验表明，我们的方法优于最先进的自回归和两阶段基线方法，有效规避了顺序网格建模的固有局限性。来自3D从业者的盲测用户研究确认了我们的结果具有较强的感知偏好。

Image-based indoor scene relighting remains challenging due to the complex interplay between cluttered geometry and local illumination, requiring precise modeling of light position, color, and intensity. Existing data-driven methods implicitly learn this relationship via paired multi-illumination datasets. Nevertheless, this data is costly and fails to scale, which is essential for accurate light-source-level control. Conversely, inverse-rendering methods reduce the data dependency by incorporating physical priors; however, they lack the robustness of intrinsic estimation in challenging conditions. In this paper, we present FreeLit, a paired-free framework for controllable indoor relighting that explicitly manipulates light-source location, color, and intensity. Instead of relying on paired supervision, we construct a physics-guided illumination prior from intrinsic scene properties, generating a structured lightmap along with a pseudo-relit image to guide diffusion-based synthesis. To address instability in intrinsic estimation, especially in low-light scenes, we introduce a relighting-guided intrinsic stabilization strategy that enforces illumination-invariant reflectance through structure-aware distillation and consistency constraints. Furthermore, we propose controllability-oriented evaluation metrics to quantify alignment with user-specified illumination color and intensity. Experimental results demonstrate that FreeLit achieves stable, physically consistent, and controllable relighting, with improved robustness in low-light indoor scenes, without requiring paired supervision.

基于图像的室内场景重光照仍具挑战性，这是因为杂乱几何形状与局部光照之间存在复杂相互作用，需要精确建模光源位置、颜色和强度。现有的数据驱动方法通过配对的多光照数据集隐式学习这一关系，然而该数据获取成本高且难以扩展，这对于精确的光源级控制至关重要。相反，逆渲染方法通过引入物理先验降低了数据依赖性，但在挑战性条件下的固有属性估计缺乏鲁棒性。 本文提出FreeLit，一个用于可控室内重光照的无配对框架，能够显式操控光源位置、颜色和强度。不同于依赖配对监督，我们从固有场景属性构建物理引导的光照先验，生成结构化光照图以及伪重光照图像来引导基于扩散模型的合成。为了解决固有属性估计的不稳定性问题（尤其是在低光照场景中），我们引入了一种重光照引导的固有属性稳定化策略，通过结构感知蒸馏和一致性约束来强制实现光照不变的反照率。此外，我们提出面向可控性的评估指标，以量化与用户指定光照颜色和强度的对齐程度。实验结果表明，FreeLit实现了稳定、物理一致且可控的重光照，在低光照室内场景中具有更强的鲁棒性，且无需配对监督。

The rapid evolution of image generation has produced numerous within-family variants, making source-model attribution of suspect images increasingly important for digital forensics. Existing proactive methods rely on watermark embedding or model modification, which may degrade visual quality and limit deployment flexibility. Passive methods often rely on large-scale supervised training or a single reconstruction signal, limiting their ability to handle unknown sources and distinguish highly similar within-family variants. We observe that attribution signals in latent generative models are naturally stratified across architectural levels: VAE-level cues reflect family-shared information, whereas backbone-level cues capture variant-specific behaviors. Motivated by this insight, we propose Dual-stage Native Attribution (DNA), a coarse-to-fine framework that follows this hierarchy without additional neural-network training. The coarse-grained stage uses Autoencoder Double-Reconstruction (AEDR) for efficient open-set family-level screening. The fine-grained stage performs closed-set model-level attribution with Native Prediction Consistency (NPC), which compares native prediction errors of within-family variants across multiple noise levels under semantic conditioning and attributes the source via normalized calibrated scores. To enable systematic evaluation, we construct DNA-30K, a benchmark for within-family variant attribution under open-set family-level evaluation. It comprises 30,000 images generated by 24 candidate models across six families spanning both denoising diffusion and flow matching, plus non-candidate generated and natural images as unknown sources. Experiments show that DNA achieves 89.11% end-to-end attribution accuracy on a task where random guessing accuracy is below 1% and outperforms the strongest baseline by 33.81% even when AEDR is used as the coarse-grained stage.

图像生成的快速发展催生了大量同族变体，使得嫌疑图像的源模型归因对数字取证日益重要。现有主动方法依赖水印嵌入或模型修改，可能导致视觉质量下降并限制部署灵活性。被动方法通常依赖大规模监督训练或单一重建信号，限制了其处理未知来源和区分高度相似同族变体的能力。我们观察到潜在生成模型中的归因信号在架构层级上自然分层：VAE级线索反映家族共享信息，而主干级线索捕获变体特定行为。受此启发，我们提出了双阶段原生归因（DNA），一个遵循该层次结构且无需额外神经网络训练的粗到细框架。粗粒度阶段使用自编码器双重重建（AEDR）进行高效的开放集家族级筛选。细粒度阶段使用原生预测一致性（NPC）进行封闭集模型级归因，其在语义条件下比较多个噪声级别的同族变体的原生预测误差，并通过归一化校准分数进行归因。为实现系统评估，我们构建了DNA-30K，这是一个在开放集家族级评估下进行同族变体归因的基准数据集，包含由跨越去噪扩散和流匹配两大族别的24个候选模型生成的30,000张图像，以及非候选生成图像和自然图像作为未知来源。实验表明，DNA在随机猜测准确率低于1%的任务中实现了89.11%的端到端归因准确率，即使将AEDR作为粗粒度阶段，也比最强基线方法高出33.81%。

Video generative models commonly rely on latent spaces learned by 3D Variational Autoencoders (3D-VAEs). However, conventional 3D-VAEs are mainly optimized for pixel-level reconstruction, which can limit the semantic and spatio-temporal structure captured by their latents. Meanwhile, Video Foundation Models (VFMs) such as V-JEPA 2 and VideoMAEv2 show strong video understanding capabilities, yet whether their frozen representations can be transformed into compact, reconstruction-capable, and generation-friendly video latents remains largely unexplored. We answer this question with VideoRAE, a representation autoencoder that leverages multi-scale hierarchical features from a frozen video foundation encoder and compresses them with a lightweight 1D self-attention projector. VideoRAE supports both continuous latents for Diffusion Transformers and discrete tokens for autoregressive models via multi-codebook high-dimensional quantization. During decoding, a local-and-global representation alignment objective with the frozen VFM teacher improves semantic preservation and enables training without KL regularization. Experiments show that VideoRAE achieves strong reconstruction in both continuous and discrete regimes. On UCF-101, it obtains state-of-the-art class-to-video gFVDs of 40 and 93 with AR and DiT generators, respectively, while converging approximately 5x faster than competing autoencoder baselines. In a controlled 2B-scale text-to-video study, replacing LTX-VAE with VideoRAE leads to faster convergence under comparable settings. These results validate frozen VFM representations as versatile and generation-friendly video latents. The model and code will be released on https://zhxie0117.github.io/VideoRAE.

视频生成模型通常依赖于3D变分自编码器（3D-VAE）学习的潜在空间。然而，传统3D-VAE主要针对像素级重建进行优化，这可能限制其潜在表示所捕获的语义和时空结构。与此同时，视频基础模型（VFM），如V-JEPA 2和VideoMAEv2，表现出强大的视频理解能力，但其冻结表示是否能转化为紧凑的、可重建的、对生成友好的视频潜在表示，目前仍鲜有探索。我们通过VideoRAE来回答这一问题，这是一种表示自编码器，利用冻结视频基础编码器的多尺度层次特征，并使用轻量级1D自注意力投影器进行压缩。VideoRAE通过多码本高维量化同时支持用于扩散Transformer的连续潜在表示和用于自回归模型的离散token。在解码阶段，采用与冻结VFM教师的局部-全局表示对齐目标来改善语义保留，并可在无需KL正则化的情况下进行训练。实验表明，VideoRAE在连续和离散模式下均实现了强大的重建性能。在UCF-101数据集上，它在使用AR和DiT生成器时分别获得了40和93的最先进类别到视频gFVD分数，同时收敛速度比竞争的自编码器基线快约5倍。在受控的20亿参数规模文本到视频研究中，在相似设置下用VideoRAE替换LTX-VAE可实现更快的收敛。这些结果验证了冻结VFM表示作为通用且对生成友好的视频潜在表示的可行性。模型和代码将发布于 https://zhxie0117.github.io/VideoRAE。

Sign language is a primary communication channel for millions of Deaf and hard-of-hearing people, yet text-to-signer video generation remains costly because video diffusion models are expensive to train and evaluate. This paper presents Text2Sign, a text-conditioned diffusion model for short sign-language clips that runs on a single NVIDIA L4 GPU. It combines a frozen vision-language text encoder with a 3D encoder-decoder and factorized spatiotemporal attention to reduce the cost of full-video attention while preserving motion coherence. We compare convolution-only and transformer-style backbones, frozen pretrained and task-specific text encoders, and factorized versus full attention. On a signer-disjoint How2Sign split, the best short-run ablation reaches a validation loss of 0.0648, while a longer-run checkpoint reaches 0.00999. On a compact evaluation slice, the latter achieves an SSIM of $0.2403 \pm 0.0238$, a PSNR of $15.11 \pm 0.42$ dB, and temporal consistency of $1.0000 \pm 0.0000$ using 8-step DDIM sampling with a guidance scale of 5.0. It generates a 32-frame, $64 \times 64$ clip in 12.60 seconds, or 2.54 frames per second, with peak inference memory of 3.12 GB. A held-out denoising audit shows only weak prompt sensitivity: removing text increases late-timestep loss from 0.9875 to 0.9891, while shuffled prompts perform similarly to correct prompts. Frozen text conditioning therefore improves short-budget validation loss, but prompt-specific separation remains limited. The system is restricted to low-resolution, short clips and lacks expert linguistic evaluation, so it should be viewed as a single-GPU research baseline rather than a complete sign-language production system. Code is available at https://github.com/xiaruize0911/text2sign.

手语是数百万聋人和听力障碍者的主要沟通渠道，然而文本到手语者视频生成仍成本高昂，因为视频扩散模型训练和评估代价较大。本文提出Text2Sign，一个用于短手语片段的文本条件扩散模型，可在单块NVIDIA L4 GPU上运行。该模型结合了冻结的视觉-语言文本编码器与3D编码器-解码器，并采用分解的时空注意力机制，以降低全视频注意力的开销，同时保持运动一致性。 本文对比了仅卷积和Transformer风格的主干网络、冻结预训练和任务特定的文本编码器，以及分解注意力和完整注意力。在手语者分离的How2Sign数据划分上，短期消融实验的最佳结果达到0.0648的验证损失，而长期检查点达到0.00999。在紧凑评估切片上，后者实现了SSIM为0.2403±0.0238、PSNR为15.11±0.42 dB、时间一致性为1.0000±0.0000（使用8步DDIM采样，引导尺度为5.0）。该模型在12.60秒内生成一个32帧、64×64的片段，即2.54帧/秒，峰值推理内存为3.12 GB。 针对去噪的审计表明提示敏感性较弱：移除文本后，晚期时间步的损失从0.9875增加到0.9891，而打乱后的提示与正确提示表现相似。因此，冻结文本条件机制改善了短期预算下的验证损失，但提示特定的分隔能力仍然有限。该系统仅限于低分辨率短视频片段，且缺乏专家语言学评估，因此应被视为单GPU研究基线，而非完整的手语生成系统。代码可访问 https://github.com/xiaruize0911/text2sign。

A robot must understand the state of its own body, but a camera sees only part of it. Force and contact leave almost no trace in a single frame, and raw vision features read force at $R^2$ at or below $0.10$ on every robot we test. We present Kepler-Encoder-v0.1, a robot-first multimodal encoder that treats robot state as a modality and fuses vision, proprioception, and force/torque into a single shared latent with a learned-query cross-attention layer, trained self-supervised by masked cross-modal prediction under the LeJEPA/SIGReg objective. At evaluation only vision enters, which poses a sharp question. Does fusing state into training make the vision-only latent carry anything the pixels do not already contain? On the RH20T corpus the answer is yes, precisely where the camera is weakest. On held-out scenes, the vision-only latent recovers end-effector state, and force in particular, significantly above both raw frozen-ViT features and a compute-matched vision-only control on every sensored robot, though absolute force recovery at a single timestep is modest; on motor state, which the camera largely sees, it is statistically tied with the strongest vision baselines, and it is the only feature whose latent geometry tracks state. A single embodiment-agnostic encoder covers four robots, and a data-matched control shows this breadth reflects embodiment diversity rather than data volume. The frozen latent is directly useful. Its own cross-modal prediction error is a training-free invalid-state monitor (AUROC $0.90$ on out-of-range states, $0.69$ on scene-swapped states), and a diffusion decoder (PixNerd) reconstructs the camera frame from the latent, confirming the spatial compression preserves world-state. This report validates the single-timestep case; native-rate temporal fusion is the next step.

机器人必须理解自身状态，但相机只能观测到其中一部分。力和接触在单帧图像中几乎不留下任何痕迹，且在我们测试的所有机器人上，原始视觉特征对力的预测R²均低于0.10。我们提出Kepler-Encoder-v0.1，一种机器人优先的多模态编码器，它将机器人状态作为一种模态来处理，通过学习式查询交叉注意力层将视觉、本体感觉和力/扭矩融合到单一共享潜在空间中，并在LeJEPA/SIGReg目标下通过掩码跨模态预测进行自监督训练。评估时仅输入视觉信息，这引出了一个关键问题：将状态融合到训练中是否会使仅视觉潜在表示包含像素中原本没有的信息？在RH20T数据集上，答案肯定的，恰好在相机能力最薄弱的方面。仅视觉潜在表示在保留场景中能够恢复末端执行器状态，尤其是力感知，其性能显著优于原始冻结的ViT特征和计算匹配的仅视觉对照方法，在所有带传感器的机器人上均是如此，尽管单时间步的绝对力恢复能力有限；对于相机基本能观测到的运动状态，它与最强的视觉基线方法在统计上持平；而它是唯一能够通过潜在几何追踪状态的特征。一个与具身无关的编码器覆盖了四个机器人，数据匹配的对照实验表明这种广度反映的是具身多样性而非数据量。该冻结潜在表示直接具有实用价值。其自身的跨模态预测误差可作为无需训练的无效状态监测器（对越界状态的AUROC为0.90，对场景切换状态的AUROC为0.69），且扩散解码器（PixNerd）能够从该潜在表示重建相机帧，证实空间压缩保留了世界状态。本报告验证了单时间步的情况；原生速率的时间融合是下一步工作。

Recent text-to-video (T2V) diffusion models rely heavily on auxiliary reward signals (e.g., via reward models or DPO) to align generated content with human aesthetics and improve realism. These signals, however, incur substantial computational overhead, require costly human annotations, and often yield limited improvement in fine-grained local details. In this paper, we argue that your data manifold is secretly a reward model. By explicitly modeling the manifold structure of high-quality Supervised Fine-Tuning (SFT) data and encouraging video latents to lie on this manifold, we derive dense, differentiable, and nearly cost-free reward signals that significantly improve video quality, particularly in mitigating low-level distortions. Our modeling builds upon Local Coordinate Coding (LCC), which captures the `skeleton' of the manifold. However, directly applying LCC suffers from mean regression, pulling latents toward the geometric mean and losing high-frequency details. We therefore extend it to Shell Local Coordinate Coding (Shell-LCC), which models the manifold `surface&x27; as an isotropic shell to align with the true high-density region. Experiments demonstrate that our approach improves realism, enhances high-frequency details, reduces over-smoothing artifacts, and alleviates motion blur.

近年来，文本到视频（T2V）扩散模型严重依赖辅助奖励信号（如通过奖励模型或DPO）来使生成内容与人类审美对齐并提升真实感。然而，这些信号会产生大量的计算开销，需要昂贵的人工标注，且对细粒度局部细节的提升往往有限。在本文中，我们认为你的数据流形秘密地是一个奖励模型。通过显式建模高质量监督微调（SFT）数据的流形结构，并鼓励视频潜向量落在这个流形上，我们获得了密集、可微分且几乎无成本的奖励信号，这些信号显著提升了视频质量，特别是在减轻低级失真方面。我们的建模基于局部坐标编码（LCC），它捕捉了流形的“骨架”。然而，直接应用LCC会遇到均值回归问题，将潜向量拉向几何均值而丢失高频细节。因此，我们将其扩展为壳层局部坐标编码（Shell-LCC），将流形“表面”建模为各向同性壳层，以对齐真实的高密度区域。实验表明，我们的方法提升了真实感，增强了高频细节，减少了过度平滑伪影，并缓解了运动模糊。

Video relighting requires balancing long-form temporal consistency with a physically grounded understanding of light transport, which depends on accurate estimation of intrinsic scene properties such as materials, geometry, and illumination. Existing methods follow two paradigms: (1) reconstruct a video's photometric properties via inverse rendering and relight them to a target illumination via forward rendering, using physically-based rendering (PBR) or a neural renderer; these suffer from noisy reconstructions and struggle with hard-to-model effects such as global illumination. (2) Frame the task as generative video-to-video translation conditioned on relighting targets (a target environment map or text); this limits relighting control and temporal stability, since diffusion models struggle to translate long-form videos, and is constrained by the availability of input/relit training pairs. We propose LightCrafter, a hybrid pipeline that reformulates video relighting as video translation of a proxy video: rather than translating the input video directly to the target, we translate a PBR rendering of the input under the target illumination to the final target. This bakes illumination targets into the PBR proxy, removing the need to teach the diffusion model illumination concepts like environment maps, and enables more intricate lighting control while naturally providing long-form temporal consistency. We show PBR renders alone already outperform some prior art but struggle with effects like global illumination; to capture these, we leverage photometric priors in video generation models by post-training CogVideoX on synthetic video pairs and real-world unpaired videos. We outperform prior state-of-the-art on existing real-world relighting benchmarks and contribute a synthetic benchmark for further analysis. We will release our dataset, benchmark, metrics, and code.

视频重光照需要在长期时间一致性与对光传输的物理基础理解之间取得平衡，而这依赖于对材质、几何和光照等内在场景属性的准确估计。现有方法遵循两种范式：（1）通过逆渲染重构视频的光度属性，然后通过前向渲染使用物理基础渲染（PBR）或神经渲染器将其重光照到目标光照；这些方法受困于噪声较大的重构，难以处理全局光照等难以建模的效果。（2）将任务框定为基于重光照目标（目标环境贴图或文本）的生成式视频到视频转换；这限制了重光照控制和时间稳定性，因为扩散模型难以转换长视频，且受限于输入/重光照训练对的可用性。我们提出LightCrafter，这是一种混合管道，将视频重光照重新表述为代理视频的视频转换：不是直接将输入视频转换到目标，而是在目标光照下将输入的PBR渲染转换为最终目标。这将光照目标嵌入PBR代理中，无需向扩散模型传授环境贴图等光照概念，同时实现更精细的光照控制，并自然地提供长期时间一致性。我们发现仅PBR渲染已优于一些现有方法，但在全局光照等效果上存在困难；为捕捉这些，我们通过在合成视频对和真实世界无配对视频上对CogVideoX进行后训练，利用视频生成模型的光度先验。我们在现有真实世界重光照基准测试中优于先前最先进的方法，并贡献了一个合成基准测试用于进一步分析。我们将发布数据集、基准测试、指标和代码。

Robot-assisted minimally invasive surgery (MIS) critically depends on reliable endoscopic perception for navigation and safety. However, conventional endoscopes provide only a limited field of view, leaving large portions of the surrounding anatomy unobserved. Recent neural rendering approaches, such as Neural Radiance Fields and 3D Gaussian Splatting, enable novel view synthesis from endoscopic videos, but their reliance on sparse observations often leads to severe artifacts when extrapolating beyond the training trajectory. In this work, we propose ExtraGS, a framework for enhancing endoscopic view extrapolation through diffusion-guided 3D Gaussian Splatting. Starting from an initial reconstruction, we introduce an uncertainty-guided virtual camera sampling strategy to actively explore blind spots and maximize information gain. The rendered views from these sampled locations are refined using a diffusion model to recover plausible anatomical structures, producing pseudo-observations that guide further optimization. To prevent the generated content from degrading reliable regions, we adopt a confidence-weighted fine-tuning strategy when incorporating these pseudo-observations. Extensive experiments on multiple public endoscopic datasets demonstrate that ExtraGS significantly reduces extrapolation artifacts and achieves state-of-the-art performance in endoscopic novel view synthesis.

机器人辅助微创手术高度依赖于可靠的内镜感知以实现导航和安全保障。然而，传统内镜仅提供有限的视场，导致周围解剖结构的大部分区域无法被观察到。近年来，神经辐射场和3D高斯溅射等神经渲染方法能够从内镜视频中合成新视角，但它们对稀疏观测的依赖在外推超出训练轨迹时往往导致严重的伪影。本研究提出ExtraGS，一个通过扩散引导的3D高斯溅射增强内镜视图外推的框架。从初始重建开始，我们引入了一种不确定性引导的虚拟相机采样策略，以主动探索盲区并最大化信息增益。来自这些采样位置的渲染视图通过扩散模型进行细化，以恢复合理的解剖结构，产生用于进一步优化的伪观测。为了防止生成的内容降质可靠区域，我们在整合这些伪观测时采用了置信度加权微调策略。在多个公开内镜数据集上的广泛实验表明，ExtraGS显著降低了外推伪影，并在内镜新视角合成中实现了最先进的性能。

Recent diffusion-based video generation models have enabled high-quality personalized video customization through both tuning-based pipelines, which fine-tune a video diffusion model, and reference-based pipelines such as image-to-video generation. However, these capabilities raise serious concerns about personal privacy, identity ownership and intellectual property protection. Existing anti-customization works focus on protecting images, while protection for videos against both reference- and tuning-based customization remains largely underexplored. Protecting videos in this setting raises three challenges: (i) Image-level perturbations, optimized frame by frame, cannot survive temporal compression by 3D video VAE. (ii) A video-level perturbation optimized on a single video is vulnerable to temporal editing and fails to protect unseen videos. (iii) Temporally inconsistent perturbations are not robust to temporal attacks. To address these challenges, we propose Temporally Consistent Universal Adversarial Perturbations (TC-UAP), the first protection method against both reference- and tuning-based video customization. TC-UAP optimizes an identity-level multi-frame UAP over sliding windows from multiple videos, accounting for local temporal dependencies induced by temporal compression in video VAE and enabling a single perturbation to protect unseen videos of varying lengths. Moreover, we introduce intrinsic temporal modeling and an extrinsic surrogate temporal-attack loss, which make the perturbation temporally consistent and robust to unseen temporal attacks. Empirically, quantitative and qualitative results show that TC-UAP achieves the strongest identity protection compared with existing methods under both reference- and tuning-based video customization, and remains robust under multiple unseen temporal attacks.

近年来，基于扩散的视频生成模型通过基于调优的管线（对视频扩散模型进行微调）和基于参考的管线（如图像到视频生成）实现了高质量的个性化视频定制。然而，这些能力引发了严重的个人隐私、身份所有权和知识产权保护担忧。现有抗定制工作主要关注图像保护，而针对视频同时抵御基于参考和基于调优的定制化攻击仍然缺乏探索。在此场景下保护视频存在三个挑战：（i）逐帧优化的图像级扰动无法在3D视频VAE的时间压缩下存活；（ii）在单一视频上优化的视频级扰动容易受到时间编辑攻击，且无法保护未见的视频；（iii）时间不一致的扰动对时间攻击不够鲁棒。为解决这些挑战，我们提出了时间一致通用对抗扰动（Temporally Consistent Universal Adversarial Perturbations，TC-UAP），这是首个同时抵御基于参考和基于调优视频定制化攻击的保护方法。TC-UAP从多个视频的滑动窗口中优化身份级多帧UAP，考虑了视频VAE中时间压缩引起的局部时间依赖性，并使得单一扰动能够保护不同长度的未见视频。此外，我们引入了内在时间建模和外在代理时间攻击损失，使扰动在时间上保持一致并对未见时间攻击具有鲁棒性。实证结果表明，无论是在基于参考还是基于调优的视频定制化攻击下，TC-UAP在身份保护方面均优于现有方法，并在多种未见时间攻击下保持鲁棒性。

3D Gaussian Splat (3DGS) enables high-fidelity, real-time novel view synthesis by representing scenes with large sets of anisotropic primitives, but often requires millions of Splats, incurring significant storage and transmission costs. Most existing compression methods rely on GPU-intensive post-training optimization with calibrated images, limiting practical deployment. We introduce \textbf{NanoGS}, a training-free and lightweight framework for Gaussian Splat simplification. Instead of relying on image-based rendering supervision, NanoGS formulates simplification as local pairwise merging over a sparse spatial graph. The method approximates a pair of Gaussians with a single primitive using mass preserved moment matching and evaluates merge quality through a principled merge cost between the original mixture and its approximation. By restricting merge candidates to local neighborhoods and selecting compatible pairs efficiently, NanoGS produces compact Gaussian representations while preserving scene structure and appearance. NanoGS operates directly on existing Gaussian Splat models, runs efficiently on CPU, and preserves the standard 3DGS parameterization, enabling seamless integration with existing rendering pipelines. Experiments demonstrate that NanoGS substantially reduces primitive count while maintaining high rendering fidelity, providing an efficient and practical solution for Gaussian Splat simplification. Our project website is available at \href{https://saliteta.github.io/NanoGS/}{https://saliteta.github.io/NanoGS/}.

3D高斯溅射（3DGS）通过各向异性基元表示场景，实现了高保真、实时的新视角合成，但通常需要数百万个Splat，导致显著的存储和传输开销。现有的压缩方法大多依赖GPU密集型的校准图像后训练优化，限制了实际部署。本文提出了NanoGS，一个无需训练的高斯溅射简化轻量级框架。NanoGS不依赖基于图像的渲染监督，而是将简化问题形式化为稀疏空间图上的局部成对合并。该方法通过质量保持矩匹配用单个基元近似一对高斯，并通过原始混合与其近似之间的原则性合并成本来评估合并质量。通过将合并候选限制在局部邻域并高效选择兼容对，NanoGS在保持场景结构和外观的同时生成紧凑的高斯表示。NanoGS可直接在现有高斯溅射模型上运行，在CPU上高效运行，并保留标准3DGS参数化，可与现有渲染管线无缝集成。实验表明，NanoGS在保持高渲染保真度的同时大幅减少基元数量，为高斯溅射简化提供了一种高效实用的解决方案。项目网站见https://saliteta.github.io/NanoGS/。