每日 arXiv 论文简报

Pixel-space continuous-token autoregressive (AR) generation directly models images as sequences of raw pixel patches, avoiding discrete tokenization or a separately pretrained tokenizer. However, it faces coupled challenges: high-dimensional patch generation causes large single-step errors, and teacher-forced training creates a train--inference gap that makes these errors accumulate across AR steps. Existing fixes such as $x$-prediction and input noise injection only partially mitigate these issues. Exact rollout training better matches inference-time conditions, but is impractical due to prohibitively slow sequential sampling. We propose \emph{Parallel Rollout Approximation} (PRA), a scalable framework that addresses both challenges jointly. PRA generates low-dimensional intermediate states instead of high-dimensional pixel patches, then maps them back to pixel-space tokens with a pixel decoder, preserving a pixel-in, pixel-out AR interface. It also constructs inference-like pixel inputs through the same intermediate-state-to-pixel path used at inference, independently across positions, approximating the pixel-feedback interface encountered during inference-time rollout while retaining parallel teacher-forced training. On class-conditional ImageNet-1K generation at $256\times256$ resolution, PRA-S with 135M parameters achieves an FID of 2.58, surpassing the previous billion-scale pixel-space AR result of 3.60. Scaling to PRA-L with 511M parameters further improves FID to 1.94, establishing a new state of the art among pixel-space AR models. Beyond generation, PRA achieves higher ImageNet classification probing accuracy than other AR and diffusion baselines, suggesting its potential for unified pixel-space image generation and understanding.

像素空间连续token自回归（AR）生成将图像直接建模为原始像素块的序列，避免了离散token化或单独预训练的tokenizer。然而，它面临耦合的挑战：高维块生成导致较大的单步误差，而教师强制训练造成了训练-推理差距，使得这些误差在AR步骤中累积。现有的修复方法如x预测和输入噪声注入只能部分缓解这些问题。精确展开训练更好地匹配推理时条件，但由于禁止性的慢速顺序采样而不切实际。我们提出并行展开近似（PRA），一个联合解决这两个挑战的可扩展框架。PRA生成低维中间状态而非高维像素块，然后使用像素解码器将其映射回像素空间token，保留像素输入输出的AR接口。它还通过推理时使用的相同中间状态到像素路径构建推理类像素输入，并在各位置上独立进行，近似推理时展开过程中遇到的像素反馈接口，同时保留并行教师强制训练。在256×256分辨率的类别条件ImageNet-1K生成上，具有1.35亿参数的PRA-S达到了2.58的FID，超越了此前30亿规模的像素空间AR结果3.60。扩展到具有5.11亿参数的PRA-L进一步将FID提升至1.94，在像素空间AR模型中确立了新的最优水平。除了生成任务，PRA还获得了比其他AR和扩散基线更高的ImageNet分类探测准确率，表明其在统一像素空间图像生成和理解方面的潜力。

The widespread adoption of generative AI models has intensified concerns about misuse, including the creation of unsafe or disturbing imagery. To mitigate such issues, several concept erasure approaches have been proposed to remove harmful content from multimodal generative models. Yet concept erasure for autoregressive image generation remains largely unexplored, despite the growing relevance of these models in recent trends toward unified multimodal architectures. In this work, we fill this gap by introducing Obliviate, a guidance-based concept erasure method for autoregressive image generation. Our method builds on three key design choices: KL-based supervision over visual token distributions, trajectory-level updates over full autoregressive rollouts, and aligned visual prefixes for stable target construction. We evaluate Obliviate on three state-of-the-art autoregressive text-to-image models, Liquid, Emu3-Gen, and Janus-Pro, covering the erasure of explicit content, graphic violence, and branded imagery. Obliviate consistently outperforms current alternatives, reducing nudity on the defensive RAB benchmark from 91.58 to 3.15 while preserving overall model utility.

生成式AI模型的广泛应用加剧了滥用风险的担忧，包括不安全或令人不安图像的生成。为缓解此类问题，多种概念擦除方法已被提出用于从多模态生成模型中移除有害内容。然而，自回归图像生成的概念擦除在很大程度上仍未被探索，尽管这些模型在近期统一多模态架构趋势中越来越重要。本工作通过引入Obliviate来填补这一空白，这是一种用于自回归图像生成的基于引导的概念擦除方法。我们的方法基于三个关键设计选择：对视觉token分布进行基于KL散度的监督、对完整自回归展开进行轨迹级更新，以及用于稳定目标构建的对齐视觉前缀。我们在三种最先进的自回归文本到图像模型Liquid、Emu3-Gen和Janus-Pro上评估了Obliviate，涵盖了明确内容、暴力图形和品牌图像的擦除。Obliviate始终优于现有方法，在防御性RAB基准上将裸露内容从91.58%降低至3.15%，同时保留了整体模型效用。

Concept erasure aims to prevent image generative models from producing unsafe content while preserving their general generative capability. Meanwhile, next-scale autoregressive (AR) image generation has recently emerged as a new generative paradigm characterized by next-scale prediction, for which concept erasure remains largely unexplored. In this paradigm, semantic information is highly compressed at early scales, leading to severe entanglement between unsafe and unrelated semantics. In this paper, we propose ScaleErasure, an inference-time concept erasure method that performs minimal intervention. ScaleErasure precisely selects and guides predicted logits that are most relevant to the unsafe concept, thereby enabling effective erasure under severe semantic entanglement. Specifically, ScaleErasure performs two additional forward passes conditioned on the unsafe concept and the corresponding safe concept, and leverages their outputs to guide the target logits away from unsafe concepts toward safe concepts. To enable precise and minimal intervention, logits selection and guidance are conducted across three dimensions: scales, tokens, and bit channels. Experiments demonstrate that ScaleErasure outperforms adapted baselines in the next-scale AR paradigm, achieving more precise concept erasure while largely preserving general generative capability. The code is available at https://github.com/coziiizz/ScaleErasure.

概念擦除旨在防止图像生成模型产生不安全内容，同时保留其通用生成能力。与此同时，下一代尺度自回归（AR）图像生成作为一种新的生成范式近期兴起，其特点是下一尺度预测，而概念擦除在此范式中仍鲜有探索。在该范式中，语义信息在早期尺度高度压缩，导致不安全语义与无关语义之间存在严重纠缠。本文提出ScaleErasure，一种在推理时进行概念擦除的方法，执行最小干预。ScaleErasure精确选取并引导与不安全概念最相关的预测logits，从而在严重语义纠缠条件下实现有效擦除。具体而言，ScaleErasure以不安全概念和对应的安全概念为条件执行两次额外的前向传播，并利用其输出引导目标logits远离不安全概念，转向安全概念。为实现精确且最小化的干预，logits的选取和引导在三个维度上进行：尺度、标记和比特通道。实验表明，ScaleErasure在下一代尺度AR范式中优于适配后的基线方法，在更大程度保留通用生成能力的同时，实现了更精确的概念擦除。代码可访问 https://github.com/coziiizz/ScaleErasure。

Modeling the bidirectional correspondence between external sensory stimuli and internal neural activity has emerged as a critical frontier in neuroscience. However, existing approaches predominantly treat brain encoding and decoding as isolated tasks, relying heavily on unimodal alignment and external priors while overlooking the brain's intrinsic nature as a multimodal integration system. To address these limitations, we propose BrainJanus, the first unified brain model that integrates brain, vision, and language within a single framework. Specifically, we introduce a Unified Brain Tokenizer to quantize continuous neural dynamics into discrete tokens aligned with visual and linguistic representations in a shared Omni space. Building on this, we utilize an All-in-One autoregressive architecture that leverages next-token prediction to enable seamless any-to-any generation, which encompasses image-to-brain and text-to-brain encoding, and brain-to-image and brain-to-text decoding. Extensive experiments demonstrate that BrainJanus achieves superior performance across diverse benchmarks. Furthermore, our framework exhibits zero-shot generalization and preserves interpretable biological topography, highlighting its potential as a general-purpose brain modeling paradigm. The code is available at \href{https://github.com/HaitaoWuTJU/BrainJanus}{GitHub}.

建模外部感觉刺激与内部神经活动之间的双向对应关系已成为神经科学的关键前沿。然而，现有方法主要将脑编码和解码视为孤立任务，过度依赖单模态对齐和外部先验，忽视了大脑作为多模态整合系统的内在特性。为克服这些局限性，我们提出BrainJanus，这是首个将脑、视觉和语言整合在统一框架中的大脑模型。具体而言，我们引入了统一脑分词器，将连续的神经动态量化为与视觉和语言表示在共享全向空间中对齐的离散标记。在此基础上，我们利用全一体化自回归架构，通过下一个标记预测实现无缝的任意到任意生成，包括图像到脑和文本到脑的编码，以及脑到图像和脑到文本的解码。大量实验表明，BrainJanus在各种基准测试中取得了卓越性能。此外，我们的框架展现出零样本泛化能力，并保留了可解释的生物拓扑结构，凸显其作为通用脑建模范式的潜力。

We present DreamForge-World 0.1 Preview, a preview foundational world model for real-time interactive world simulation. The system adapts the LongLive 1 autoregressive video stack, itself derived from Wan2.1-T2V-1.3B, with a residual action pathway inspired by the Matrix-Game family. DreamForge-World 0.1 Preview focuses on a complementary axis to frontier-scale world simulators: low-compute adaptation, consumer-GPU runtime, and broad interactive capability coverage. It supports live keyboard and mouse control, multimodal initialization, mid-stream reprompting, dual-view operation, and minute-scale interactive rollouts at native 480p resolution, reaching up to 14 to 15 FPS FPS on a single RTX 4090 with a low memory footprint. By leveraging open video backbones and applying targeted adaptation runs, we build the preview system with high cost-efficiency. DF-World 0.1 Preview is not yet a memory-complete or frontier-quality world simulator, but demonstrates a practical low-compute route toward real-time controllable world-model previews on consumer GPUs.

我们提出 DreamForge-World 0.1 预览版，这是一个用于实时交互世界模拟的基础世界模型预览版。该系统适配了 LongLive 1 自回归视频栈（源自 Wan2.1-T2V-1.3B），并引入了受 Matrix-Game 系列启发的残差动作通路。DreamForge-World 0.1 预览版聚焦于与前沿级世界模拟器互补的方向：低算力适配、消费级 GPU 运行时以及广泛的交互能力覆盖。它支持实时键盘和鼠标控制、多模态初始化、流中重提示、双视角操作，以及在原生 480p 分辨率下进行分钟级交互展开，在单块 RTX 4090 上可达到 14-15 FPS，且内存占用低。通过利用开放视频骨干网络并执行针对性适配运行，我们以高成本效益构建了该预览系统。DF-World 0.1 预览版尚非记忆完整或前沿质量的世界模拟器，但展示了在消费级 GPU 上实现实时可控世界模型预览的实用低算力路径。

Generative world models for autonomous driving (AD) are of great value in applications such as data augmentation, closed-loop simulation, and safety-critical scenario evaluation. Unlike the widely studied image modality, in this work we explore generative world models for LiDAR data. Existing generation methods for LiDAR predominantly focus on single frame generation or lack the capacity for interactive simulation, while existing prediction approaches require multiple frames of historical input and can only deterministically predict multiple frames at once. Both paradigms fail to support long-horizon interactive generation. To this end, we introduce \textbf{LaGen}, which, to the best of our knowledge is the first autoregressive framework capable of generating long-horizon LiDAR scenes in a frame-by-frame, interactive manner. LaGen is able to take a single-frame input as a starting point and effectively utilize bounding box information as conditions to generate high-fidelity 4D scene. In addition, we introduce a scene decoupling estimation module to enhance the model's interactive generation capability for object-level content, as well as a noise modulation module to mitigate error accumulation during long-horizon generation. We extensively evaluate LaGen&x27;s performance in controlled data generation and long-horizon scene generation on the nuScenes dataset. The experimental results demonstrate that LaGen achieves state-of-the-art performance, especially on later frames. The code is publicly available at: https://github.com/szzhou88/LaGen.

自动驾驶生成式世界模型在数据增强、闭环仿真和安全关键场景评估等应用中具有重要价值。与广泛研究的图像模态不同，本工作探索了LiDAR数据的生成式世界模型。现有的LiDAR生成方法主要关注单帧生成或缺乏交互式仿真能力，而现有的预测方法需要多帧历史输入且只能一次性确定性地预测多帧。这两种范式都无法支持长时域交互式生成。为此，我们提出了LaGen，据我们所知，这是首个能够以逐帧、交互方式生成长时域LiDAR场景的自回归框架。LaGen能够以单帧输入作为起点，有效利用边界框信息作为条件来生成高保真4D场景。此外，我们引入了场景解耦估计模块以增强模型在目标级内容上的交互式生成能力，以及噪声调制模块以减轻长时域生成过程中的误差累积。我们在nuScenes数据集上对LaGen在受控数据生成和长时域场景生成方面的性能进行了广泛评估。实验结果表明，LaGen实现了最先进的性能，特别是在后续帧的生成上。代码已公开访问：https://github.com/szzhou88/LaGen

Most visual generative models compress images into a latent space before applying diffusion or autoregressive modelling. Yet, existing approaches such as VAEs and foundation model aligned encoders implicitly constrain the latent space without explicitly shaping its distribution, making it unclear which types of distributions are optimal for modeling. We introduce \textbf{Distribution-Matching VAE} (\textbf{DMVAE}), which explicitly aligns the encoder's latent distribution with an arbitrary reference distribution via a distribution matching constraint. This generalizes beyond the Gaussian prior of conventional VAEs, enabling alignment with distributions derived from self-supervised features, diffusion noise, or other prior distributions. With DMVAE, we can systematically investigate which latent distributions are more conducive to modeling, and we find that SSL-derived distributions provide an excellent balance between reconstruction fidelity and modeling efficiency, reaching gFID equals 3.2 on ImageNet with only 64 training epochs. Our results suggest that choosing a suitable latent distribution structure (achieved via distribution-level alignment), rather than relying on fixed priors, is key to bridging the gap between easy-to-model latents and high-fidelity image synthesis. Code is avaliable at https://github.com/sen-ye/dmvae.

大多数视觉生成模型在应用扩散或自回归建模之前，将图像压缩到潜在空间。然而，现有方法如VAE和基础模型对齐编码器隐式约束潜在空间，而没有明确塑造其分布，使得哪种类型的分布最适合建模尚不清楚。我们引入分布匹配变分自编码器（DMVAE），通过分布匹配约束将编码器的潜在分布与任意参考分布明确对齐。这推广了传统VAE的高斯先验，能够与来自自监督特征、扩散噪声或其他先验分布的分布进行对齐。使用DMVAE，我们可以系统地研究哪些潜在分布更有利于建模，并发现自监督学习衍生的分布在重建保真度和建模效率之间提供了极好的平衡，在ImageNet上仅用64个训练周期就达到了gFID等于3.2。我们的结果表明，选择合适的潜在分布结构（通过分布级对齐实现）而不是依赖固定先验，是弥合易于建模的潜在变量与高保真图像合成之间差距的关键。代码可从https://github.com/sen-ye/dmvae获取。

In real scenarios, videos can span several minutes or even hours. However, existing research on spatio-temporal video grounding (STVG), given a textual query, mainly focuses on localizing targets in short videos of tens of seconds, typically less than one minute, which limits real-world applications. In this paper, we explore Long-Form STVG (LF-STVG), which aims to locate targets in long-term videos. Compared with short videos, long-term videos contain much longer temporal spans and more irrelevant information, making it difficult for existing STVG methods that process all frames at once. To address this challenge, we propose an AutoRegressive Transformer architecture for LF-STVG, termed ART-STVG. Unlike conventional STVG methods that require the entire video sequence to make predictions at once, ART-STVG treats the video as streaming input and processes frames sequentially, enabling efficient handling of long videos. To model spatio-temporal context, we design spatial and temporal memory banks and apply them to the decoders. Since memories from different moments are not always relevant to the current frame, we introduce simple yet effective memory selection strategies to provide more relevant information to the decoders, significantly improving performance. Furthermore, instead of parallel spatial and temporal localization, we propose a cascaded spatio-temporal design that connects the spatial decoder to the temporal decoder, allowing fine-grained spatial cues to assist complex temporal localization in long videos. Experiments on newly extended LF-STVG datasets show that ART-STVG significantly outperforms state-of-the-art methods, while achieving competitive performance on conventional short-form STVG. Our code is at: https://github.com/HengLan/ART-STVG.

在现实场景中，视频时长可达数分钟甚至数小时。然而，现有的时空视频定位（STVG）研究给定文本查询后，主要聚焦于对数十秒以内的短视频进行目标定位，通常不足一分钟，这限制了实际应用。本文探索长时视频时空定位（LF-STVG），旨在长时视频中定位目标。与短视频相比，长时视频包含更长的时序跨度和更多无关信息，使得现有需要同时处理所有帧的STVG方法难以应对。为解决这一挑战，本文提出了一种用于LF-STVG的自回归Transformer架构，命名为ART-STVG。与传统STVG方法需要整个视频序列一次性做出预测不同，ART-STVG将视频视为流式输入并逐帧处理，能够高效处理长视频。为了建模时空上下文，本文设计了空间和时间记忆库并将其应用于解码器。由于不同时刻的记忆并非总是与当前帧相关，本文引入了简单而有效的记忆选择策略，为解码器提供更相关的信息，显著提升了性能。此外，本文提出了一种级联时空设计来替代并行的时空定位，将空间解码器与时间解码器相连，使细粒度的空间线索能够辅助长视频中的复杂时序定位。在新扩展的LF-STVG数据集上的实验表明，ART-STVG显著优于当前最先进的方法，同时在传统短视频STVG上实现了具有竞争力的性能。我们的代码地址为：https://github.com/HengLan/ART-STVG。

Autoregressive (AR)-Diffusion hybrid paradigms combine AR's structured semantic modeling with diffusion&x27;s high-fidelity synthesis, yet suffer from a dual speed bottleneck: the sequential AR stage and the iterative multi-step denoising of the diffusion vision decode stage. Existing methods address each in isolation without a unified principle design. We observe that the per-position \emph{prediction entropy} of continuous-space AR models naturally encodes spatially varying generation uncertainty, which simultaneously governing draft prediction quality in the AR stage and reflecting the corrective effort required by vision decoding stage, which is not fully explored before. Since entropy is inherently tied to both bottlenecks, it serves as a natural unifying signal for joint acceleration. In this work, we propose \textbf{Drift-AR}, which leverages entropy signal to accelerate both stages: 1) for AR acceleration, we introduce Entropy-Informed Speculative Decoding that align draft-target entropy distributions via a causal-normalized entropy loss, resolving the entropy mismatch that causes excessive draft rejection; 2) for visual decoder acceleration, we reinterpret entropy as the \emph{physical variance} of the initial state for an anti-symmetric drifting field -- high-entropy positions activate stronger drift toward the data manifold while low-entropy positions yield vanishing drift -- enabling single-step (1-NFE) decoding without iterative denoising or distillation. Moreover, both stages share the same entropy signal, which is computed once with no extra cost. Experiments on MAR, TransDiff, and NextStep-1 demonstrate 3.8-5.5$\times$ speedup with genuine 1-NFE decoding, matching or surpassing original quality. Code will be available at https://github.com/aSleepyTree/Drift-AR.

自回归(AR)-扩散混合范式结合了自回归的结构化语义建模与扩散的高保真合成，但面临双重速度瓶颈：顺序执行的AR阶段和扩散视觉解码阶段的多步迭代去噪。现有问题各自独立处理这两个瓶颈，缺乏统一的设计原则。我们观察到，连续空间AR模型的逐位置预测熵自然地编码了空间变化的生成不确定性，它同时决定了AR阶段的草稿预测质量，并反映了视觉解码阶段所需的校正工作量，这一点此前未被充分探索。由于熵与这两个瓶颈固有相关联，它可作为联合加速的自然统一信号。在本工作中，我们提出Drift-AR，利用熵信号加速两个阶段：1) 针对AR加速，我们引入熵信息投机解码，通过因果归一化熵损失对齐草稿-目标熵分布，解决了导致过度草稿拒绝的熵不匹配问题；2) 针对视觉解码器加速，我们将熵重新解释为反对称漂移场的初始状态的物理方差——高熵位置激活更强的漂移以趋向数据流形，而低熵位置产生趋于零的漂移——从而实现无需迭代去噪或蒸馏的单步(1-NFE)解码。此外，两个阶段共享同一个熵信号，计算一次即可，无额外开销。在MAR、TransDiff和NextStep-1上的实验表明，我们的方法实现了3.8-5.5倍加速，并实现了真正的1-NFE解码，达到或超越原始质量。代码将开源于https://github.com/aSleepyTree/Drift-AR。

Interactive real-time autoregressive video generation is essential for applications such as content creation and world modeling, where visual content must adapt to dynamically evolving event conditions. A fundamental challenge lies in balancing reactivity and stability: models must respond promptly to new events while maintaining temporal coherence over long horizons. Existing approaches distill bidirectional models into autoregressive generators and further adapt them via streaming long tuning, yet often exhibit persistent drift after condition changes. We identify the cause as conditional bias, where the teacher may provide condition-aligned but trajectory-agnostic guidance, biasing generation toward locally valid yet globally inconsistent modes. Inspired by Trust Region Policy Optimization, we propose Delta Forcing, a simple yet effective framework that constrains unreliable teacher supervision within an adaptive trust region. Specifically, Delta Forcing estimates transition consistency from the latent delta between teacher and generator trajectories, and uses it to balance teacher supervision with a monotonic continuity objective. This suppress unreliable teacher-induced shifts while preserving responsiveness to new events. Extensive experiments demonstrate that Delta Forcing significantly improves consistency while maintaining event reactivity.

交互式实时自回归视频生成对于内容创作和世界建模等应用至关重要，其中视觉内容必须能够适应动态演变的事件条件。一个根本性的挑战在于平衡响应性与稳定性：模型必须能够及时响应新事件，同时在长时序上保持时间一致性。现有的方法将双向模型蒸馏为自回归生成器，并通过流式长调整进行进一步适配，但在条件变化后往往表现出持续漂移。我们将此问题归因于条件偏差，即教师模型可能提供与条件对齐但与轨迹无关的引导，导致生成偏向局部有效但全局不一致的模式。受信任域策略优化（TRPO）的启发，我们提出了Delta Forcing，一个简单而有效的框架，将不可靠的教师监督约束在自适应信任域内。具体而言，Delta Forcing从教师和生成器轨迹之间的潜在差异估计转移一致性，并利用它来平衡教师监督与单调连续性目标。这既抑制了不可靠的教师诱导偏移，同时保留了对新事件的响应性。大量实验表明，Delta Forcing在保持事件响应性的同时显著提升了一致性。

Few-shot object detection aims to detect novel object categories from only a few labeled examples, avoiding costly large-scale annotation. Recent prototype-based similarity learning approaches enable training-free adaptation by matching query features with class prototypes. However, they suffer from two fundamental limitations: (i) class confusion arising from inter-class similarity margin collapse, and (ii) insufficient visual cues for precise localization, as similarity scores capture only class-level semantic affinity while providing limited spatial information. To address these issues, we introduce two complementary components. Text-Anchored Semantic Mask (TSMa) leverages class-level text features as semantic anchors to identify semantically aligned channels through channel-wise interaction between visual and text features. By suppressing style-induced spurious responses and emphasizing class-intrinsic signals, TSMa enlarges inter-class similarity margins and mitigates class confusion. We further propose Stage-Aligned Hierarchical Autoregressive Regression (SHARe), which reformulates localization as a hierarchical autoregressive process that progressively refines bounding boxes across multiple stages. SHARe leverages the layer-wise characteristics of ViT representations by aligning feature abstraction levels with regression stages: deeper layers guide early coarse localization, while shallower layers rich in edge and texture cues refine spatial details in later stages. Experiments on COCO demonstrate a new state of the art, outperforming the previous best by +10.1 nAP, with extensive analysis validating each component. The code is available at https://github.com/VisualScienceLab-KHU/ReSet.

少样本目标检测旨在仅从少量标注样本中检测新颖目标类别，避免昂贵的大规模标注成本。基于原型相似度学习的最新方法通过将查询特征与类别原型进行匹配实现无需训练的适应。然而，它们存在两个根本性局限性：（i）类间相似度边界崩溃导致的类别混淆；（ii）用于精确定位的视觉线索不足，因为相似度得分仅捕获类别级语义亲和力，缺乏空间信息。为解决这些问题，我们引入两个互补组件。文本锚定语义掩码（Text-Anchored Semantic Mask, TSMa）利用类别级文本特征作为语义锚，通过视觉与文本特征之间的通道级交互来识别语义对齐的通道。TSMa通过抑制风格引起的虚假响应并强调类别内在信号，扩大类间相似度边界并缓解类别混淆。我们进一步提出阶段对齐层次自回归回归（Stage-Aligned Hierarchical Autoregressive Regression, SHARe），它将定位重新表述为在多个阶段逐步精炼边界框的层次自回归过程。SHARe利用ViT表示的层级特性，将特征抽象水平与回归阶段对齐：较深层引导早期粗定位，而包含丰富边缘和纹理线索的较浅层在后续阶段精炼空间细节。在COCO数据集上的实验表明达到了新的最优性能，超越之前最佳方法达+10.1 nAP，并进行了广泛分析验证各组件的有效性。代码可访问 https://github.com/VisualScienceLab-KHU/ReSet。

Foundation-model-based monocular depth estimation offers a viable alternative to active sensors for robot perception, yet its computational cost often prohibits deployment on edge platforms. Existing methods perform independent per-frame inference, wasting the substantial computational redundancy between adjacent viewpoints in continuous robot operation. This paper presents AsyncMDE, an asynchronous depth perception system consisting of a frozen foundation model and a lightweight fast path that amortizes the foundation model's computational cost over time. The foundation model periodically produces high-quality spatial features in the background, while the lightweight fast path runs asynchronously in the foreground, fusing cached memory with current observations through complementary fusion, outputting depth estimates, and autoregressively updating memory. This enables cross-frame feature reuse with bounded accuracy degradation. With 3.83M trainable fast-path parameters and a 97.5M frozen slow path, AsyncMDE&x27;s fast path operates at 237 FPS on an RTX 4090, recovering 77% of the accuracy gap to the foundation model. Across indoor static, dynamic, and synthetic extreme-motion benchmarks, AsyncMDE degrades predictably and reaches 161 FPS fast-path inference on a TensorRT-optimized Jetson AGX Orin, supporting real-time edge deployment.

基于基础模型的单目深度估计为机器人感知提供了一种相较于主动传感器的可行替代方案，但其计算成本往往阻碍了在边缘平台上的部署。现有的方法执行独立的逐帧推理，浪费了连续机器人操作中相邻视角之间的大量计算冗余。本文提出AsyncMDE，一种由冻结的基础模型和轻量级快速路径组成的异步深度感知系统，能够随时间分摊基础模型的计算成本。基础模型在后台定期生成高质量的空间特征，而轻量级快速路径则在前台异步运行，通过互补融合将缓存的记忆与当前观测相结合，输出深度估计值，并自回归地更新记忆。这实现了跨帧特征复用，同时保持精度有界降解。AsyncMDE拥有3.83M个可训练的快速路径参数和97.5M个冻结的慢速路径参数，其快速路径在RTX 4090上以237 FPS运行，恢复了对基础模型精度差距的77%。在室内静态、动态和合成极端运动基准测试中，AsyncMDE表现出可预测的精度降解，并在TensorRT优化的Jetson AGX Orin上达到161 FPS的快速路径推理速度，支持实时边缘部署。

3D scene inpainting is essential for reconstructing areas corrupted by occlusions or limited viewpoints. While recent methods leverage Gaussian Splatting (GS) for efficient 3D editing, they often depend on precise multi-view segmentation masks and are inherently constrained to object removal tasks. We propose CoIn, a novel framework that bridges 2D inpainting models and 3DGS through a multi-stage consistency pipeline. Our approach first generates initial inpainted images using a diffusion model, enabling the use of arbitrary-shaped masks and diverse tasks like object insertion. We then introduce Reference Adaptive GS with Feature Attention to reconstruct a coarse 3D scene by adaptively weighing towards a reference view (2D -> 3D). This 3D representation provides geometric guidance to the diffusion process via GS-based Reference Feature Warping, ensuring multi-view consistency (3D -> 2D). Finally, a Texture-Enhancing Discriminator refines the 3D scene to achieve high photometric realism (2D -> 3D). Experiments show that CoIn, effectively leveraging bidirectional information flow, achieves state-of-the-art performance and effectively handles both object removal and object insertion with flexible mask input.

3D场景修复对于重建被遮挡或视角受限的区域至关重要。虽然近期方法利用高斯溅射（GS）实现高效的3D编辑，但它们通常依赖于精确的多视角分割掩码，并且本质上局限于物体移除任务。我们提出了CoIn，一个通过多阶段一致性管道连接2D修复模型和3DGS的新框架。我们的方法首先使用扩散模型生成初始修复图像，从而能够使用任意形状掩码并支持物体插入等多种任务。随后，我们引入参考自适应高斯溅射（Reference Adaptive GS）与特征注意力机制，通过自适应地向参考视图加权来重建粗略的3D场景（2D→3D）。该3D表示通过基于高斯溅射的参考特征扭曲（GS-based Reference Feature Warping）为扩散过程提供几何引导，确保多视角一致性（3D→2D）。最后，纹理增强判别器（Texture-Enhancing Discriminator）优化3D场景以实现高光度真实感（2D→3D）。实验表明，CoIn有效地利用双向信息流，实现了最先进的性能，并能够灵活处理物体移除和物体插入任务。

In this paper, we are the first to examine the correlations between class frequency and the multi-scale noise schedule within diffusion models. For score-based generative models, low-density regions often lead to inaccurately estimated scores, thereby compromising the generation quality. Although the multi-scale noise schedule can alleviate this issue during the diffusion process, low-frequency classes still face the challenge of large low-density regions, resulting in more inaccurate estimated scores than high-frequency classes. Furthermore, high-frequency classes tend to dominate the score space, causing a convergence of most data points towards generating samples from these classes. Consequently, samples generated within low-frequency classes exhibit suboptimal quality and limited diversity. To address this challenge, we propose the \textit{Class-frequency Guided (CFRG)} noise schedule, leveraging the insight that low-frequency classes should be endowed with larger-scale noises. To illustrate the effectiveness of our method, we conduct experiments on various tasks, including image generation, image classification, and text-to-image generation, using imbalanced datasets, \textit{i.e.}, CIFAR-100-LT, and ImageNet-LT. By employing the CFRG noise schedule, we achieve substantial improvements over baselines, manifesting the crucial role of frequency statistics in noise schedule design.

本文首次研究了扩散模型中类别频率与多尺度噪声调度之间的相关性。对于基于分数的生成模型，低密度区域往往导致分数估计不准确，从而影响生成质量。尽管多尺度噪声调度可以在扩散过程中缓解这一问题，但低频类别仍面临大低密度区域的挑战，导致其分数估计比高频类别更不准确。此外，高频类别倾向于主导分数空间，导致大多数数据点向生成这些类别的样本收敛。因此，低频类别内生成的样本质量欠佳且多样性受限。针对这一挑战，我们提出了类别频率引导（CFRG）噪声调度方法，其核心洞见是低频类别应被赋予更大尺度的噪声。为了验证方法的有效性，我们在多种任务上进行了实验，包括使用不平衡数据集（即CIFAR-100-LT和ImageNet-LT）进行的图像生成、图像分类和文本到图像生成。通过采用CFRG噪声调度，我们在基线方法上取得了显著提升，证明了频率统计在噪声调度设计中的关键作用。

Offline reinforcement learning enables policy learning from fixed datasets without additional environment interaction, making it appealing for safety-critical applications where online exploration is costly or unsafe. Diffusion-based decision-making methods have recently achieved strong performance in offline RL by modeling rich, multimodal trajectory distributions. However, existing diffusion planners are typically risk-neutral and therefore may overlook rare but catastrophic outcomes that are crucial in real-world deployment. In this work, we propose RS-Diffuser, a risk-sensitive offline diffusion planning framework that combines diffusion-based trajectory generation with distributional value critics. RS-Diffuser learns a diffusion planner over future state trajectories, a separate inverse dynamics model for action decoding, and a Monte Carlo distributional critic that estimates the full return distribution of candidate plans through quantile regression. At sampling time, we incorporate a risk-sensitive guidance signal into the denoising process, using gradients computed from tail-aware objectives such as Conditional Value at Risk to steer generation toward desired risk profiles. As a result, a single trained model can flexibly produce risk-averse, risk-neutral, or risk-seeking behaviors by changing only the inference-time risk parameter. Extensive experiments on risk-sensitive D4RL and risky robot navigation benchmarks demonstrate that RS-Diffuser achieves state-of-the-art performance, improving both overall return and worst-case robustness while reducing safety violations.

离线强化学习能够从固定数据集中学习策略，无需额外环境交互，使其在在线探索成本高昂或不安全的 safety-critical 应用场景中具有吸引力。基于扩散的决策方法通过建模丰富的多模态轨迹分布在离线强化学习中取得了强劲性能。然而，现有的扩散规划器通常是风险中性的，因此可能会忽视在实际部署中至关重要的罕见但灾难性后果。本工作提出 RS-Diffuser，一个风险敏感的离线扩散规划框架，结合了基于扩散的轨迹生成与分布价值评论器。RS-Diffuser 学习一个基于未来状态轨迹的扩散规划器、一个用于动作解码的独立逆动力学模型，以及一个通过分位数回归估计候选方案完整回报分布的蒙特卡洛分布评论器。在采样时，我们将风险敏感的引导信号融入去噪过程，使用来自条件风险价值等尾部感知目标计算的梯度，将生成导向所需的风险特征。因此，仅通过改变推理时的风险参数，一个训练好的模型就能灵活地产生风险规避、风险中性或风险寻求的行为。在风险敏感的 D4RL 和危险机器人导航基准上的广泛实验表明，RS-Diffuser 达到了最先进性能，在提升整体回报和最坏情况鲁棒性的同时减少了安全违规。

Pixel-space continuous-token autoregressive (AR) generation directly models images as sequences of raw pixel patches, avoiding discrete tokenization or a separately pretrained tokenizer. However, it faces coupled challenges: high-dimensional patch generation causes large single-step errors, and teacher-forced training creates a train--inference gap that makes these errors accumulate across AR steps. Existing fixes such as $x$-prediction and input noise injection only partially mitigate these issues. Exact rollout training better matches inference-time conditions, but is impractical due to prohibitively slow sequential sampling. We propose \emph{Parallel Rollout Approximation} (PRA), a scalable framework that addresses both challenges jointly. PRA generates low-dimensional intermediate states instead of high-dimensional pixel patches, then maps them back to pixel-space tokens with a pixel decoder, preserving a pixel-in, pixel-out AR interface. It also constructs inference-like pixel inputs through the same intermediate-state-to-pixel path used at inference, independently across positions, approximating the pixel-feedback interface encountered during inference-time rollout while retaining parallel teacher-forced training. On class-conditional ImageNet-1K generation at $256\times256$ resolution, PRA-S with 135M parameters achieves an FID of 2.58, surpassing the previous billion-scale pixel-space AR result of 3.60. Scaling to PRA-L with 511M parameters further improves FID to 1.94, establishing a new state of the art among pixel-space AR models. Beyond generation, PRA achieves higher ImageNet classification probing accuracy than other AR and diffusion baselines, suggesting its potential for unified pixel-space image generation and understanding.

像素空间连续token自回归（AR）生成将图像直接建模为原始像素块的序列，避免了离散token化或单独预训练的tokenizer。然而，它面临耦合的挑战：高维块生成导致较大的单步误差，而教师强制训练造成了训练-推理差距，使得这些误差在AR步骤中累积。现有的修复方法如x预测和输入噪声注入只能部分缓解这些问题。精确展开训练更好地匹配推理时条件，但由于禁止性的慢速顺序采样而不切实际。我们提出并行展开近似（PRA），一个联合解决这两个挑战的可扩展框架。PRA生成低维中间状态而非高维像素块，然后使用像素解码器将其映射回像素空间token，保留像素输入输出的AR接口。它还通过推理时使用的相同中间状态到像素路径构建推理类像素输入，并在各位置上独立进行，近似推理时展开过程中遇到的像素反馈接口，同时保留并行教师强制训练。在256×256分辨率的类别条件ImageNet-1K生成上，具有1.35亿参数的PRA-S达到了2.58的FID，超越了此前30亿规模的像素空间AR结果3.60。扩展到具有5.11亿参数的PRA-L进一步将FID提升至1.94，在像素空间AR模型中确立了新的最优水平。除了生成任务，PRA还获得了比其他AR和扩散基线更高的ImageNet分类探测准确率，表明其在统一像素空间图像生成和理解方面的潜力。

Demand for high-resolution satellite imagery has increased interest in super-resolution (SR) to bridge the spatial resolution gap between freely available missions such as Sentinel-2 and commercial systems like PlanetScope. Because no sensor provides true paired low- and high-resolution observations, SR models are usually trained on synthetically degraded data, creating a domain gap on real cross-sensor imagery. In this work, we provide the first systematic study of how this synthetic-to-real mismatch affects the performance of modern diffusion-based SR models. Using a large, geometrically and temporally aligned dataset of Sentinel-2 and PlanetScope imagery, we evaluate five state-of-the-art diffusion architectures under controlled experimental settings. We also introduce LPIPS-Sat, a domain-adapted perceptual metric based on Sentinel-2 self-supervised features. Our results show two persistent challenges: synthetically trained models degrade sharply on real pairs, while models trained on real cross-sensor data exhibit optimisation difficulties and struggle to adapt to the physical and radiometric diversity. These findings highlight a key limitation of current SR and motivate methods that disentangle super-resolution from domain adaptation.

对高分辨率卫星图像需求的增长激发了超分辨率（SR）技术的研究，以弥合Sentinel-2等免费可用任务与PlanetScope等商业系统之间的空间分辨率差距。由于没有传感器提供真实的低分辨率和高分辨率配对观测数据，SR模型通常在合成退化数据上进行训练，这在真实的跨传感器图像上产生了域差异。本研究首次系统性地研究这种合成到真实的 mismatch 如何影响现代基于扩散的SR模型的性能。我们使用一个大规模的Sentinel-2和PlanetScope几何和时间对齐数据集，在受控实验设置下评估了五种最先进的扩散架构。我们还引入了LPIPS-Sat，这是一种基于Sentinel-2自监督特征的领域自适应感知度量。我们的结果表明了两个持续的挑战：在真实数据对上，合成训练的模型性能急剧下降；而在真实跨传感器数据上训练的模型则表现出优化困难，并且难以适应物理和辐射多样性。这些发现突出了当前SR方法的关键局限性，并激励了将超分辨率与领域适应分离的方法研究。

Real-world object removal is challenging due to two key difficulties: the target object's non-local effects, such as shadows and reflections, which are difficult to model, and the fact that user-provided masks are often inaccurate or incomplete. With billions of parameters and tens of denoising steps, diffusion-based models achieve strong removal performance at the expense of substantial computational cost, limiting their use in interactive applications and on edge devices. To address these challenges, we present OSOR (One-Step Object Removal), which simultaneously achieves efficient, effect-aware, and mask-robust object removal. Concretely, OSOR introduces: (1) an occupancy-guided discriminator for precise boundary supervision, enabling stable single-step diffusion training; (2) an alpha head that leverages knowledge from pretrained diffusion models to predict appropriate removal regions with minimal overhead, thereby handling imperfect masks; and (3) a semantic-anchored verification pipeline (SAVP) that filters noisy instruction-based triplets to produce effect-aware supervision at scale. Using SAVP, we curate CORNE, which contains 280K verified removal pairs, and further annotate AnimeEraseBench and TextEraseBench to evaluate performance on more complex removal tasks. Experiments show that OSOR surpasses strong multi-step diffusion baselines in perceptual quality while achieving $4\times$ to $30\times$ faster inference.

现实世界的物体移除面临两个关键挑战：目标物体的非局部效应（如阴影和反射）难以建模，以及用户提供的掩码往往不准确或不完整。扩散模型拥有数十亿参数和数十个去噪步骤，虽能实现强大的移除效果，但计算成本很高，限制了其在交互应用和边缘设备上的使用。为解决这些挑战，我们提出了OSOR（单步物体移除），它同时实现了高效、效果感知和掩码鲁棒的物体移除。具体而言，OSOR引入：（1）一个占用引导判别器，用于精确的边界监督，实现稳定的单步扩散训练；（2）一个α头模块，利用预训练扩散模型的知识以最小开销预测适当的移除区域，从而处理不完美的掩码；以及（3）一个语义锚定验证管道（SAVP），用于过滤基于指令的嘈杂三元组，以大规模生成效果感知的监督信号。利用SAVP，我们整理了CORNE数据集，包含28万对经过验证的移除样本，并进一步标注了AnimeEraseBench和TextEraseBench以评估更复杂的移除任务。实验表明，OSOR在感知质量上超越了强大的多步扩散基线模型，同时实现了4倍至30倍的推理加速。

Graph-based fraud detection is essential for safeguarding large-scale transaction systems, where undetected anomalies may lead to substantial financial losses and security risks. Real-world fraud graphs pose two coupled challenges: sparse and imbalanced supervision, where verified fraudulent labels are scarce and heavily skewed toward benign accounts, and representation dilution, where spatial message passing may oversmooth camouflaged anomalies while spectral filters may suppress fraud-relevant mid- and high-frequency irregularities. To address these challenges, we propose ADC-GNN, short for Attention-guided Diffusion-Contrastive Graph Neural Network, a unified framework that combines diffusion-guided feature augmentation, contrastive representation learning, and multi-hop spectral attention for few-shot graph fraud detection. The diffusion component is formulated as a feature-space denoising augmentation mechanism rather than a full topology-generative graph diffusion model: it constructs noise-perturbed node-feature views under a cosine schedule and uses contrastive learning to stabilize node representations across perturbations. The spectral attention module further adaptively emphasizes fraud-relevant hop-level and relation-level cues. We evaluate ADC-GNN primarily on three public benchmarks and additionally report a proprietary real-world telecom transaction dataset with approximately 60,000 records as a private case study. Under the 1% training setting, ADC-GNN achieves consistent improvements over original graph fraud baselines and four protocol-consistent recent graph anomaly/fraud baselines on the public benchmarks. Additional analyses on split stability, training ratios, oversampling alternatives, module-level ablations, diffusion schedules, and runtime and memory-consumption comparisons further characterize the effective operating regime of ADC-GNN.

基于图的欺诈检测对于保护大规模交易系统至关重要，未被检测的异常可能导致重大经济损失和安全风险。现实世界的欺诈图面临两个相互耦合的挑战：稀疏且不平衡的监督，即验证过的欺诈标签稀缺且严重偏向正常账户；以及表示稀释，即空间消息传递可能过度平滑伪装异常，而谱滤波器可能抑制与欺诈相关的中高频不规则性。为应对这些挑战，我们提出ADC-GNN，即注意力引导的扩散对比图神经网络，这是一个统一框架，结合了扩散引导特征增强、对比表征学习和多跳谱注意力用于小样本图欺诈检测。扩散组件被形式化为特征空间去噪增强机制，而非完整的拓扑生成图扩散模型：它在余弦调度下构建噪声扰动的节点特征视图，并利用对比学习稳定跨扰动的节点表征。谱注意力模块进一步自适应地强调与欺诈相关的跳级和关系级线索。我们主要在三个公开基准数据集上评估ADC-GNN，并额外部署了一个包含约60,000条记录的真实世界电信交易数据集作为私有案例研究。在1%训练设置下，ADC-GNN在公开基准数据集上相对于原始图欺诈基线和四个协议一致的最新图异常/欺诈基线取得了一致的改进。对划分稳定性、训练比例、过采样替代方案、模块级消融、扩散调度以及运行时和内存消耗比较的额外分析进一步刻画了ADC-GNN的有效工作范围。

Text-guided image editing has advanced rapidly with diffusion models and unified multimodal foundation models. However, most existing methods remain confined to single-turn settings, overlooking the more realistic scenario of multi-turn in-context editing, where users iteratively refine an image through a sequence of instructions. In this setting, a model must follow each new instruction while preserving accumulated session-level constraints, challenged by two coupled failure modes: long-context dilution, where sparse textual constraints become difficult to recover from growing interleaved image-text histories, and state contamination, where earlier editing mistakes degrade subsequent generations. We introduce Edit-R2, a novel reinforcement learning post-training framework for unified multimodal models. Edit-R2 reconstructs the operative session intent, which effectively consolidates scattered historical constraints into an explicit reasoning trace before each editing turn. It further enables multi-turn RL over both reasoning and generation through a unified objective that jointly optimizes intent reconstruction generation in discrete text space and flow-matching image generation in continuous latent space, while a trajectory filtering mechanism suppresses corrupted rollouts to stabilize training under state contamination. To support systematic evaluation, we introduce MICE-Bench, a large-scale benchmark for multi-turn in-context editing with automated metrics for instruction following (IF), content consistency (CC), and global awareness (GA) over accumulated session constraints. Experiments show that Edit-R2 substantially improves multi-turn in-context editing and achieves competitive performance compared against strong baselines.

文本引导的图像编辑随着扩散模型和统一多模态基础模型的发展而快速进步。然而，大多数现有方法仍局限于单轮设置，忽视了更现实的多轮上下文编辑场景，即用户通过一系列指令迭代地优化图像。在这一设置中，模型必须遵循每条新指令，同时保留累积的会话级约束，并面临两种耦合的失败模式：长上下文稀释，即稀疏的文本约束在不断增长的交错图像-文本历史中难以恢复；以及状态污染，即早期的编辑错误会降质后续生成。我们提出了Edit-R2，这是一个用于统一多模态模型的新型强化学习后训练框架。Edit-R2重建运作的会话意图，这有效地将分散的历史约束 consolidation 为每个编辑轮次之前的显式推理轨迹。它还通过统一目标实现对推理和生成的多轮强化学习，该目标在离散文本空间中联合优化意图重建生成，在连续潜在空间中优化流匹配图像生成，同时轨迹过滤机制抑制损坏的 rollout 以在状态污染下稳定训练。为支持系统评估，我们引入了MICE-Bench，这是一个用于多轮上下文编辑的大规模基准，包含指令遵循(IF)、内容一致性(CC)和累积会话约束全局感知(GA)的自动化指标。实验表明，Edit-R2显著提升了多轮上下文编辑性能，并取得了与强基线相比具有竞争力的表现。

While orthogonal subspace methods try to mitigate task interference in Continual Learning (CL), they often suffer from energy diffusion across the basis, hindering knowledge compaction and exhausting capacity for future tasks. We observe that output feature drift induced by parameter updates is inherently low-rank, and theoretically prove that preserving parameters along the principal directions of this drift minimizes the output reconstruction error. Motivated by this, we propose \textbf{E}nergy-Concentrated and \textbf{E}nergy-Ordered \textbf{Lo}w-\textbf{R}ank \textbf{A}daptation (E$^2$-LoRA). By explicitly ordering and concentrating knowledge into leading ranks, E$^2$-LoRA frees capacity for subsequent tasks. Furthermore, we design a dynamic rank allocation strategy to balance stability and plasticity by jointly optimizing energy retention and model plasticity. Extensive experiments across multiple benchmarks demonstrate that E$^2$-LoRA achieves state-of-the-art performance. Code is available at https://github.com/kiddo127/E2-LoRA.

虽然正交子空间方法试图减轻持续学习（CL）中的任务干扰，但它们经常遭受跨基底能量扩散的困扰，阻碍了知识压缩并耗尽了未来任务的容量。我们观察到参数更新引起的输出特征漂移本质上是低秩的，并理论上证明沿着该漂移主方向保留参数可以最小化输出重构误差。基于此，我们提出了能量集中且能量有序的低秩适应（E²-LoRA）。通过将知识明确排序并集中到主导秩，E²-LoRA为后续任务释放了容量。此外，我们设计了一种动态秩分配策略，通过联合优化能量保持和模型可塑性来平衡稳定性和可塑性。在多个基准数据集上的广泛实验表明，E²-LoRA实现了最先进的性能。代码可访问 https://github.com/kiddo127/E2-LoRA。

Recently, diffusion models have been widely adopted in generative modeling and have served as foundational models for many image generation tasks. To control the generation without costly re-training or fine-tuning, many works seek inference-time guidance methods to steer the latent via a differentiable objective at inference time. However, these methods cannot effectively preserve the original Gaussian distribution because they introduce distributional drift, thereby degrading the sample quality. To address this gap, we propose DiffRGD, a distribution-aware guidance framework that explicitly preserves the latent Gaussian structure. DiffRGD formulates each sampling step as a constrained optimization problem on a spherical manifold induced by the latent Gaussian distribution, and solves it efficiently via Riemannian Gradient Descent (RGD). DiffRGD is a plug-and-play method that can be seamlessly integrated into any pre-trained diffusion model. Extensive experiments demonstrate that DiffRGD outperforms previous methods in most image restoration and conditional generation tasks. Our codebase is available at https://github.com/jwliao1209/DiffRGD.

最近，扩散模型已被广泛应用于生成建模，并作为许多图像生成任务的基础模型。为了在不进行昂贵的重训练或微调的情况下控制生成，许多研究寻求推理时间引导方法，通过推理时的可微目标来引导潜在表示。然而，这些方法无法有效保持原始高斯分布，因为它们引入了分布漂移，从而降低了样本质量。为了解决这一差距，我们提出了DiffRGD，这是一种显式保持潜在高斯结构的分布感知引导框架。DiffRGD将每个采样步骤表述为潜在高斯分布诱导的球形流形上的约束优化问题，并通过黎曼梯度下降（RGD）进行高效求解。DiffRGD是一种即插即用的方法，可以无缝集成到任何预训练的扩散模型中。大量实验表明，DiffRGD在大多数图像恢复和条件生成任务中优于先前方法。我们的代码库可访问 https://github.com/jwliao1209/DiffRGD。

Text-to-image (T2I) diffusion models typically require substantial computational resources and cloud infrastructure, posing significant challenges for edge deployment in terms of latency, cost, and user privacy. We present JuZhou 1.0, an ultra-lightweight T2I foundation model designed for fully offline, on-device execution. JuZhou 1.0 achieves its efficiency through four key designs: (1) a compact image-generation backbone consisting of a 0.385B-parameter denoising U-Net and a 1.90M-parameter distilled decoder, totaling approximately 0.387B parameters; (2) Rectified Flow training combined with DMD2 distillation, reducing inference to 4 sampling steps; (3) Chinese semantic alignment trained on 9M curated image-text pairs, enabling direct Chinese prompting without external translation at inference time; and (4) a training and distillation pipeline completed on domestically developed Sugon K100 AI accelerators without relying on NVIDIA GPUs for training or distillation. Despite its compact scale, the 28-step base model of JuZhou 1.0 achieves an overall GenEval score of 0.69, outperforming published baselines including SDXL (2.6B, 0.55), SD3-Medium (2B, 0.62), and IF-XL (4.3B, 0.61). We further validate the full poetry-to-image pipeline on Android and the core CLIP-U-Net-VAE generation branch on iOS. On a smartphone powered by the Snapdragon 8 Elite Gen 5 Mobile Platform, the 4-step U-Net denoising branch runs in approximately 1.6 seconds, while the full Android poetry-to-image pipeline takes 4.5 seconds with on-device prompt refinement on Xiaomi 17 Pro Max. These results position JuZhou 1.0 as a practical approach to mobile text-to-image generation and provide a concrete reference for Chinese-native generation, domestic-compute training, and fully offline on-device deployment after one-time installation.

文本到图像（T2I）扩散模型通常需要大量计算资源和云端基础设施，在边缘部署方面面临延迟、成本和用户隐私方面的重大挑战。我们提出JuZhou 1.0，一款专为完全离线、端侧运行设计的超轻量级T2I基座模型。JuZhou 1.0通过四项关键设计实现高效性能：（1）紧凑的图像生成主干网络，由0.385B参数的去噪U-Net和1.90M参数的蒸馏解码器组成，总计约0.387B参数；（2）结合Rectified Flow训练与DMD2蒸馏，将推理步骤减少至4步；（3）基于900万对精选图像-文本对训练的中文语义对齐，实现推理时无需外部翻译即可直接使用中文提示词；以及（4）完全在国产曙光K100 AI加速器上完成训练和蒸馏流程，不依赖英伟达GPU进行训练或蒸馏。尽管规模紧凑，JuZhou 1.0的28步基础模型在GenEval基准上取得了0.69的整体分数，优于已发布的基线模型，包括SDXL（2.6B参数，0.55分）、SD3-Medium（2B参数，0.62分）和IF-XL（4.3B参数，0.61分）。我们进一步在Android上验证了完整的诗歌到图像流程，并在iOS上验证了核心的CLIP-U-Net-VAE生成分支。在搭载骁龙8 Elite Gen 5移动平台的智能手机上，4步U-Net去噪分支运行时间约为1.6秒，而完整的Android诗歌到图像流程在小米17 Pro Max上配合端侧提示词优化需要4.5秒。这些结果使JuZhou 1.0成为移动端文本到图像生成的可行方案，并为中文本土化生成、国产算力训练以及一次性安装后完全离线端侧部署提供了具体参考。

While diffusion models excel in video restoration, their reliance on extensive iterative steps limits efficiency. Conversely, aggressive single-step distillation often compromises fine texture recovery. To achieve an optimal balance, we present SATB-VR, a few-step paradigm that jump-starts the denoising process via an auxiliary predictor, explicitly bypassing early low signal-to-noise ratio (SNR) steps. However, naive joint training of the predictor and the denoiser inherently introduces a severe train-inference discrepancy. To resolve this, we propose the SNR-Aware Trajectory Blending (SATB) strategy. During the forward process, SATB constructs the noisy input by dynamically blending the predictor's output with the ground-truth trajectory based on the SNRs. This forces the denoiser to robustly compensate for initial prediction errors while smoothly converging to the clean data manifold. Furthermore, we introduce a Denoiser-Driven Consistency (DDC) loss, leveraging the concurrently updated denoiser as a dynamic evaluator to explicitly align internal features and boost predictor accuracy. Extensive experiments demonstrate that, under flexible few-step inference regimes (\eg, $\le 5$ steps), SATB-VR performs favorably against existing approaches on synthetic, real-world, and AIGC benchmarks.

尽管扩散模型在视频恢复任务中表现出色，但其对大量迭代步骤的依赖限制了效率。相反，激进的单步蒸馏往往会损害精细纹理的恢复。为了实现最佳平衡，我们提出了SATB-VR，这是一种少步范式，通过辅助预测器启动去噪过程，明确绕过早期低信噪比(SNR)步骤。然而，预测器与去噪器的朴素联合训练本身会引入严重的训练-推理差异。为解决此问题，我们提出了SNR感知轨迹混合(SATB)策略。在前向过程中，SATB根据SNR动态混合预测器输出与真实轨迹来构建噪声输入。这迫使去噪器稳健地补偿初始预测误差，同时平滑收敛到干净数据流形。此外，我们引入了去噪器驱动一致性(DDC)损失，利用同时更新的去噪器作为动态评估器，显式对齐内部特征并提升预测器精度。大量实验表明，在灵活的少步推理机制（例如≤5步）下，SATB-VR在合成、真实世界及AIGC基准测试中的表现优于现有方法。

Diffusion prior-based methods have shown impressive results in real-world image super-resolution (ISR), yet two key challenges persist: balancing pixel-level fidelity with semantic quality, and adapting to diverse degradations. Existing dual-branch approaches freeze the pixel module during semantic training, but the semantic branch can still expand capacity within the pixel subspace, precluding genuine perceptual improvement. Moreover, using a single static adapter cannot generalize across heterogeneous real-world corruptions. To address both issues, we propose FreqOrtho-SR, which comprises: $\textbf{Freq}$uency-guided Mixture of LoRA Experts (FreqMoE), it routes inputs to specialized experts via a non-parametric FFT-based degradation-feature extractor that encodes frequency-domain signatures, enabling stable and interpretable specialization across corruption types; and $\textbf{Ortho}$gonal Gradient Projection (OGP), which reframes the dual-objective optimization as a subspace-constrained problem: by extracting the pixel-fidelity subspace via SVD on combined expert weight deltas and projecting semantic gradients onto its null space, OGP guarantees orthogonality between the two objectives, enabling genuinely complementary learning without mutual interference. Experiments show that FreqOrtho-SR achieves competitive overall performance and a strong fidelity-perception trade-off across multiple benchmarks with efficient single-step inference. The source code of our method can be found at $\href{https://github.com/sonhm3029/FreqOrtho-SR}{\texttt{sonhm3029/FreqOrtho-SR}}$.

基于扩散先验的方法在真实世界图像超分辨率（ISR）中取得了令人印象深刻的效果，但仍然存在两个关键挑战：平衡像素级保真度与语义质量，以及适应多样化退化。现有的双分支方法在语义训练期间冻结像素模块，但语义分支仍可在像素子空间中扩展容量，导致无法实现真正的感知提升。此外，使用单一静态适配器无法泛化到异构的真实世界退化。为解决这两个问题，我们提出了FreqOrtho-SR，它由以下两部分组成：频率引导的LoRA专家混合（FreqMoE），它通过基于非参数FFT的退化特征提取器将输入路由到专用专家，该提取器编码频域签名，能够在各类退化类型中实现稳定且可解释的专业化；以及正交梯度投影（OGP），它将双目标优化重新表述为子空间约束问题：通过对组合专家权重差进行SVD提取像素保真度子空间，并将语义梯度投影到其零空间，OGP保证两个目标之间的正交性，实现真正的互补学习而不会相互干扰。实验表明，FreqOrtho-SR在多个基准测试中实现了具有竞争力的整体性能和较强的保真度-感知权衡，且具有高效的单步推理能力。该方法的源代码可在https://github.com/sonhm3029/FreqOrtho-SR获取。

Predicting future states is essential for autonomous agents, yet current Vision-Language-Action (VLA) models fundamentally lack this capability, relying instead on reactive perception-action mapping. While integrating Predictive World Models (PWMs) addresses this gap, existing approaches either incur prohibitive cascaded latency or act as shallow terminal tasks that fail to deeply embed forward-looking reasoning. To endow VLA models with this reasoning capability, we propose X-Mind. Rather than treating PWMs as an external auxiliary module, this framework internalizes them as the Visual Chain-of-Thought (Visual CoT). By enforcing a world rollout prior to action, the model is constrained to imagine future evolution first, yielding a driving policy that is robustly grounded in environmental dynamics and aware of the future consequences its actions will unfold. The challenge here is efficiency, and we tackle it on two fronts. First, we introduce a compact representation of visual thinking: an abstract sketch that fuses a Bird's-Eye-View (BEV) layout with abstract driving priors (e.g., navigation intents and traffic rules). Rather than rolling out dense future frames, the model reasons over this sketch as a mental canvas; aided by a Deep Compression Autoencoder (DC-AE), a 12-frame future rollout is reduced to merely 96 tokens, alleviating the long-context computational bottleneck. Second, to accelerate generation further, we propose a recurrent block diffusion scheme that unrolls the denoising steps across the layers of the large drive model, folding iterative refinement into the backbone&x27;s one forward pass. Trained and validated on large-scale real-world data, X-Mind achieves competitive end-to-end driving performance, which makes it a highly practical, low-latency solution that successfully deploys large-scale cognitive reasoning directly onto resource-constrained vehicle platforms.

预测未来状态对于自主智能体至关重要，然而当前的视觉-语言-动作（VLA）模型从根本上缺乏这一能力，仅依赖于反应式感知-动作映射。虽然集成预测世界模型（PWM）可以弥补这一缺陷，但现有方法要么产生难以承受的级联延迟，要么仅作为浅层的终端任务，未能深入嵌入前瞻性推理能力。为赋予VLA模型这一推理能力，我们提出了X-Mind框架。该框架不再将PWM视为外部辅助模块，而是将其内化为视觉思维链（Visual CoT）。通过强制在动作之前进行世界推演，模型被约束首先想象未来的演变，从而产生一个稳健地根植于环境动态并意识到其动作将展开的未来后果的驾驶策略。这里的挑战在于效率，我们从两个方面着手解决。首先，我们引入了一种紧凑的视觉思考表示：一种融合鸟瞰图（BEV）布局与抽象驾驶先验（如导航意图和交通规则）的抽象草图。模型不是推演密集的未来帧，而是将这个草图作为心智画布进行推理；借助深度压缩自编码器（DC-AE），12帧的未来推演被压缩到仅96个标记，缓解了长上下文计算瓶颈。其次，为了进一步加速生成，我们提出了一种循环块扩散方案，将去噪步骤展开到大型驾驶模型的层中，将迭代精炼融入到主干网络的一次前向传播中。X-Mind在大规模真实世界数据上训练和验证，取得了具有竞争力的端到端驾驶性能，使其成为一个高度实用、低延迟的解决方案，成功地将大规模认知推理直接部署到资源受限的车载平台上。

Benefiting from the strong ability to capture data distributions, diffusion models have become powerful tools for solving image inverse problems. The key is to controllably steer the sampling trajectory toward the measurements while respecting the diffusion prior. In this work, we introduce Stochastic Optimal Control Sampling (SOCS), which models the denoising process as a dynamical system and injects control signals via SOC. Previous SOC-based approach addresses inverse problems by optimizing over the entire trajectory, which is computationally expensive. In contrast, we derive a closed-form control update and apply it at each sampling step, pulling the measurement-consistent clean prediction back onto the denoising flow. In SOCS, we can readily modulate the control strength to align with the diffusion model's native capabilities and thereby enhance perceptual quality. Our method is compatible with a variety of linear stochastic differential equation backbones. Extensive experiments across a broad spectrum of image inverse tasks demonstrate that SOCS achieves accurate measurement-aligned reconstructions with improved visual fidelity and stronger quantitative performance.

凭借强大的数据分布捕捉能力，扩散模型已成为解决图像逆问题的强大工具。关键在于可控地将采样轨迹引导至测量值，同时尊重扩散先验。本文提出随机最优控制采样（Stochastic Optimal Control Sampling, SOCS），该方法将去噪过程建模为动态系统，并通过随机最优控制注入控制信号。先前基于随机最优控制的方法通过优化整个轨迹来解决逆问题，计算成本较高。与之不同，本文推导出一种闭环形式控制更新，并在每个采样步骤中应用，将符合测量一致的干净预测拉回至去噪流中。在SOCS中，我们可以轻松调节控制强度以与扩散模型的原生能力保持一致，从而增强感知质量。该方法与多种线性随机微分方程backbone兼容。在广泛的图像逆任务中进行的大量实验表明，SOCS实现了精确的测量对齐重建，具有更高的视觉真实感和更强的定量性能。

Diffusion-based video relighting enables controllable relighting from a single input video, but modern video diffusion backbones are trained on short clips and applied to long-horizon videos through chunked sliding-window inference, often causing temporal discontinuities at chunk boundaries. We address this by reframing long-horizon relighting as \emph{temporally conditioned latent domain translation}. Our framework enforces cross-chunk continuity by propagating target-domain latents across boundaries and makes this behavior learnable using \emph{masked target-domain self-conditioning}, training the model to continue from temporally masked propagated context. We further introduce \emph{warm-start prompting} with a relit prompt anchor from a controllable generative model, which establishes the initial target-domain state and creates a general interface for prompt-based relighting. Experiments on in-the-wild long-horizon videos show markedly improved temporal consistency, with chunk-boundary artifacts largely reduced and unwanted appearance changes across chunks greatly suppressed.

基于扩散的视频重光照能够从单一输入视频实现可控的重光照，但现代视频扩散骨干模型在短片段上训练，并通过分块滑动窗口推理应用于长时序视频，往往导致分块边界处的时间不一致性问题。我们通过将长时序重光照重新定义为时序条件化潜域转换来解决这一问题。我们的框架通过跨边界传播目标域潜变量来强制执行跨分块连续性，并利用掩码目标域自条件化使这一行为可学习，训练模型从时间掩码传播的上下文继续推理。我们进一步引入暖启动提示方法，使用来自可控生成模型的重光照提示锚点建立初始目标域状态，并创建了基于提示的重光照通用接口。在真实场景长时序视频上的实验表明，时间一致性显著改善，分块边界伪影大幅减少，跨分块的不良外观变化得到有效抑制。

As the most perceptually powerful Face Video Super-Resolution (FVSR) method, existing works in Generative FVSR (GFVSR) mainly exploit the generative prior of pretrained diffusion models. However, viewed as full generation, they suffer from fixed sampling and expensive inference costs if without large-scale auxiliary training. Furthermore, an excessive pursuit of generic perceptual metrics often results in low fidelity. To address these issues, we present Dynamic Trajectory Initialization (DTI) paradigm for GFVSR, which reformulates GFVSR as an input-driven directional restoration. With a novel enhancement-and-injection conditioning mechanism for pretrained DiT backbone, fidelity of our model has been significantly improved without compromising perceptual quality. To dynamically set the starting sampling point, we propose a Discriminative Guide (DG) trained via objective Signal-to-Noise Ratio (SNR) alignment. With only minor model adaptation and fine-tuning, our method achieves a SOTA overall performance across diverse metrics and benchmarks. An analysis of relationship between actual comprehensive quality and common metrics is also conducted, which demonstrates the perception-distortion trade-off and that the LPIPS is the most convincing metric in our case.

作为感知能力最强的人脸视频超分辨率（FVSR）方法，现有生成式人脸视频超分辨率（GFVSR）研究主要利用预训练扩散模型的生成先验。然而，由于被视为完整生成，若无大规模辅助训练，其采样过程固定且推理成本昂贵。此外，过度追求通用感知指标往往导致保真度较低。针对这些问题，我们提出了用于GFVSR的动态轨迹初始化（DTI）范式，将GFVSR重新表述为输入驱动的方向性修复。针对预训练的DiT骨干网络，我们设计了一种增强-注入条件机制，在不牺牲感知质量的前提下显著提升了模型的保真度。为了动态设置采样起点，我们提出了通过客观信噪比（SNR）对齐训练的判别引导（DG）模块。只需进行少量的模型适配和微调，我们的方法在各种指标和基准测试中实现了最先进的综合性能。我们还分析了实际综合质量与常见指标之间的关系，证明了感知-失真权衡的存在，并表明LPIPS在我们的场景中是最具说服力的指标。

Synthetic data mitigates the data scarcity problem in autonomous driving perception. However, the synthetic-to-real gap leads to performance degradation, hindering real-world model generalization. Although current methods leverage diffusion models for photorealistic style transfer to bridge this gap, they critically ignore a practical asymmetry: while synthetic data possesses perfect pixel-level annotations, real-world style reference images generally lack corresponding labels. Consequently, existing methods relying on symmetric semantic guidance suffer from either prohibitive annotation costs or severe semantic misalignment. To address this dilemma, we formally propose a novel task: Asymmetric Style Transfer for Autonomous Driving (ASTAD), which requires semantically consistent transfer using only labeled synthetic content and unlabeled real-world references. We further introduce the ASTModel, a training-free two-stage framework designed to bridge this domain gap under asymmetric constraints. ASTModel first extracts a coarse semantic prior from the unlabeled target, followed by dynamic prior refinement and class-consistent style injection during the denoising process. Extensive experiments demonstrate that ASTModel significantly outperforms existing methods in downstream perception utility and structural fidelity, while offering a 3.2$\times$ inference speedup. This work aligns synthetic-to-real adaptation with practical constraints, holding the potential to accelerate the scalable deployment of robust autonomous driving systems. Code: https://github.com/Dingyi-Yao/ASTAD.

合成数据缓解了自动驾驶感知中的数据稀缺问题。然而，合成到真实的域差距导致性能下降，阻碍了模型在真实世界的泛化。尽管当前方法利用扩散模型进行逼真的风格迁移以弥合这一差距，但它们严重忽视了一个实际问题：合成数据具有完美的像素级注释，而真实世界的风格参考图像通常缺乏对应的标签。因此，依赖对称语义引导的现有方法要么面临高昂的标注成本，要么遭受严重的语义错位。为解决这一困境，我们正式提出了一项新任务：自动驾驶非对称风格迁移（ASTAD），该任务要求仅使用有标注的合成内容和无标注的真实世界参考进行语义一致的迁移。我们进一步提出了ASTModel，一个无需训练的两阶段框架，旨在非对称约束下弥合域差距。ASTModel首先从无标注的目标域提取粗粒度语义先验，然后在去噪过程中进行动态先验优化和类别一致的风格注入。大量实验表明，ASTModel在下游感知效用和结构保真度方面显著优于现有方法，同时实现3.2倍的推理加速。本工作将合成到真实域适应与实际约束相结合，有望加速鲁棒自动驾驶系统的规模化部署。代码：https://github.com/Dingyi-Yao/ASTAD。

We propose a mask-free method for lossless multi-object 3D reconstruction from sparse and occluded real-world views, enabling physically plausible interaction via Material Point Method (MPM) simulation. Our key insight is that object coupling stems from occlusion and limited viewpoints, which we address by formulating multi-object decoupling as a sparse-view reconstruction problem. Using 3D Gaussian Splatting as base representation, we first obtain coarse instance partitions with a SAM2-trained segmentation field. Rather than relying on masks, we reconstruct fragmented geometries by leveraging a joint Score Distillation Sampling (SDS) process, which integrates reference-view supervision with novel-view synthesis guided by 2D and 3D diffusion priors to enforce both texture fidelity and 3D consistency. Furthermore, we incorporate geometry-aware priors such as intra-object and inter-object similarity to regularize geometric reasoning. Experimental results demonstrate that our method produces complete, simulation-ready 3D objects without requiring manual masks, enabling realistic dynamic interactions on both synthetic and real-world datasets.

我们提出了一种无掩码方法，用于从稀疏且存在遮挡的真实世界视图进行无损多目标3D重建，并通过物质点法(MPM)模拟实现物理上可信的交互。我们的核心发现是目标耦合源于遮挡和有限的视角，我们将多目标解耦问题形式化为稀疏视图重建问题来解决这一挑战。以3D高斯溅射作为基础表示，我们首先利用经过SAM2训练的分割场获得了粗粒度的实例分割。我们转而通过联合分数蒸馏采样(SDS)过程重建碎片化几何体，该过程整合了参考视图监督与由2D和3D扩散先验引导的新视图合成，以同时确保纹理保真度和3D一致性。此外，我们引入了目标内和目标间相似性等几何感知先验，以规范化几何推理过程。实验结果表明，我们的方法能够在无需手动掩码的情况下生成完整、可用于模拟的3D目标，并在合成数据集和真实世界数据集上实现逼真的动态交互。

While text-guided image editing has made remarkable progress, it remains limited in structural portrait retouching. Textual descriptions struggle to convey fine-grained changes to facial features and body proportions. To address this gap, we introduce Exemplar-Based Portrait Photo Retouching, where the model is given an exemplar pair and tasked with inferring and applying the same retouching operations to a new query image. Existing exemplar-based editing methods primarily focus on tasks with pronounced visual transformations. In contrast, structural portrait retouching involves extremely delicate and localized modifications, making accurate extraction and transfer of these edits challenging. To tackle this, we propose MirrorPPR, a novel framework designed to capture and transfer subtle structural retouching operations. Our method uses a Retouching Operation Extractor to capture the subtle differences from the exemplar pair. The extracted representations are then injected into a pre-trained Diffusion Transformer (DiT) through a connector and Low-Rank Adaptation (LoRA) modules. Furthermore, constructing perfectly aligned cross-identity training pairs is severely hindered by operation misalignment. To overcome this, we propose an advanced data self-augmentation paradigm that ensures strictly aligned retouching operations. To alleviate data scarcity and support this novel task, we introduce MirrorPPR47M, a large-scale dataset with over 47 million retouched pairs. By structuring the dataset into simulated and professional subsets, we enable progressive curriculum learning to smoothly optimize the network. Extensive experiments demonstrate that MirrorPPR significantly outperforms existing baselines in both retouching quality and identity preservation. The project page is available at https://sjtu-deng-lab.github.io/MirrorPPR.

尽管文本引导的图像编辑已取得显著进展，但在结构化人像美化方面仍存在局限。文本描述难以传达面部特征和身体比例的精细变化。为解决这一空白，我们提出基于示例的人像照片美化任务，其中模型给定一个示例对，并负责推断并将相同的美化操作应用于新的查询图像。现有的基于示例的编辑方法主要侧重于具有明显视觉变换的任务。相比之下，结构化人像美化涉及极其精细和局部的修改，使得这些编辑的准确提取和迁移具有挑战性。为此，我们提出了MirrorPPR，这是一个旨在捕获和迁移微妙结构化美化操作的新框架。我们的方法使用修图操作提取器从示例对中捕获细微差异。提取的表示通过连接器和低秩适应（LoRA）模块注入到预训练的扩散Transformer（DiT）中。此外，由于操作错位，构建完美对齐的跨身份训练对受到严重阻碍。为克服这一问题，我们提出了一种先进的数据自增强范式，确保严格对齐的修图操作。为了缓解数据稀缺并支持这一新任务，我们引入了MirrorPPR47M，这是一个包含超过4700万美化对的大规模数据集。通过将数据集组织为模拟和专业子集，我们能够进行渐进式课程学习以平滑优化网络。大量实验表明，MirrorPPR在美化质量和身份保持方面均显著优于现有基线方法。项目页面见 https://sjtu-deng-lab.github.io/MirrorPPR。

Image-based Virtual Try-On (IVTON) has greatly advanced through diffusion models, yet existing methods require many sampling steps and depend on masks with costly auxiliary networks. In addition, the absence of large-scale mask-free paired datasets further limits the development of mask-free IVTON. We propose FDM-MFVT, a few-step diffusion model for mask-free IVTON, integrating an Outfit-aware Noise Optimization Module (OANO) and an Instruction-driven Try-on Module (IDT) to enhance efficiency and flexibility.The OANO module initializes the alignment space with noise using the input image and only needs 6 steps to generate a higher-fidelity try-on image compared to 30 steps.The IDT module uses virtual try-on prompts and efficient adaptation to generate high-quality results from garment and person images alone. We further introduce MFVT, a 30,000-pair mask-free IVTON dataset. Experiments show that FDM-MFVT achieves superior quantitative and qualitative results with fewer inference steps than mask-based and mask-free baseline methods.

基于图像的虚拟试穿（IVTON）通过扩散模型取得了显著进展，但现有方法需要大量采样步数，且依赖于掩码和成本较高的辅助网络。此外，缺乏大规模免掩码成对数据集进一步限制了免掩码IVTON的发展。我们提出了FDM-MFVT，这是一种面向免掩码虚拟试穿的少步扩散模型，整合了服装感知噪声优化模块（OANO）和指令驱动试穿模块（IDT）以提升效率和灵活性。OANO模块利用输入图像和噪声初始化对齐空间，仅需6步即可生成比30步更高保真度的试穿图像。IDT模块使用虚拟试穿提示词和高效适配，仅凭服装和人物图像即可生成高质量结果。我们进一步构建了MFVT，一个包含30,000对的免掩码IVTON数据集。实验表明，FDM-MFVT在更少推理步数的前提下，取得了优于基于掩码和免掩码基线方法的定量和定性结果。

High-resolution Diffusion Transformer (DiT) inference contains substantial spatial redundancy, but many spatially adaptive implementations encode regional computation as attention masks, which can inadvertently move scaled dot-product attention (SDPA) away from FlashAttention fast paths. We identify this avoidable systems bottleneck as Mask-Induced Dispatch Tax (MIDT) and show that it grows with latent sequence length. We introduce SAFE-DiT, a training-free Semantics-Aware Fast-path Execution framework that separates exact mask elision from approximation-based spatial scheduling. SAFE-DiT removes only provenance-certified image self-attention masks that induce a row-wise constant shift in attention logits, preserves semantics-bearing masks such as text-padding masks, and realizes spatial adaptation through prompt-conditioned token partitioning, selective state updates with global context, and periodic context refresh. We call this acceleration-only configuration SAFE-Core and report sensitivity-weighted classifier-free guidance separately as SAFE-DiT+SW. On the evaluated PyTorch SDPA stack, redundant masks make long-sequence attention $4.1\times$ to $5.8\times$ slower than the mask-free path. On Lumina-Next, SAFE-DiT achieves $2.69\times$ end-to-end acceleration at $1024^2$ resolution and $5.09\times$ at $2560^2$, reduces peak memory at $2560^2$ from 94.1 to 27.9 GB, and enables $3072^2$ generation when dense inference runs out of memory. Paired metrics, component ablations, and a blinded human study support visual non-inferiority of SAFE-Core to the dense fast-path baseline, while SAFE-DiT+SW provides a separate prompt-alignment operating point without reintroducing spatial self-attention masks. Code is available at https://github.com/xuanhuayin/SAFE-DiT.

高分辨率扩散变换器（DiT）推理存在大量空间冗余，但许多空间自适应实现将区域计算编码为注意力掩码，这可能无意中使缩放点积注意力（SDPA）偏离FlashAttention快速路径。我们识别出这种可避免的系统瓶颈为掩码诱导调度税（MIDT），并表明它随潜码序列长度增长而加剧。我们提出SAFE-DiT，一个免训练的语义感知快速路径执行框架，将精确的掩码消除与基于近似的空间调度分离。SAFE-DiT仅移除那些在注意力logits中引起行向常量偏移的溯源认证图像自注意力掩码，保留承载语义的掩码（如文本填充掩码），并通过提示条件化token分区、带有全局上下文的选择性状态更新和周期性上下文刷新实现空间适应。我们将这种仅加速配置称为SAFE-Core，并单独报告以敏感性加权的无分类器引导作为SAFE-DiT+SW。在评估的PyTorch SDPA堆栈上，冗余掩码使长序列注意力比无掩码路径慢4.1倍至5.8倍。在Lumina-Next上，SAFE-DiT在1024^2分辨率下实现2.69倍端到端加速，在2560^2分辨率下实现5.09倍加速，将2560^2分辨率下的峰值内存从94.1 GB降至27.9 GB，并使3072^2生成在密集推理内存耗尽时得以实现。成对指标、组件消融和盲化人类研究支持SAFE-Core在视觉上不劣于密集快速路径基线，而SAFE-DiT+SW提供了另一个提示对齐工作点，且不会重新引入空间自注意力掩码。代码见https://github.com/xuanhuayin/SAFE-DiT。

Text-to-image diffusion models remain vulnerable to adversarial prompts that elicit disallowed content, motivating reliable inference-time controls. A popular approach is negative guidance, which subtracts a negative prompt direction with a fixed weight. However, it often forces a safety-fidelity trade-off, causing artifacts or prompt drift when over-applied and failing under attacks when under-applied. Dynamic variants reweight guidance using posterior-odds signals, which can be brittle for open-vocabulary compositional prompts, while lightweight similarity-based methods ignore the evolving image evidence along the denoising trajectory. We introduce Concept Removal Guidance (CRG), a training-free method that estimates unwanted-concept presence at each diffusion step from the model's noise predictions, and adaptively calibrates negative guidance via a closed-form constrained update enforcing a target presence threshold while minimally perturbing the conditional trajectory. Across red-teaming benchmarks, CRG reduces attack success rates while preserving benign fidelity, and extends to additional suppression targets such as artist style and violence without fine-tuning or external classifiers.

文本到图像扩散模型仍然容易受到对抗性提示词的影响而产生禁止内容，这推动了可靠的推理时控制方法的研究。一种流行方法是负面引导，即以固定权重减去负面提示方向。然而，它往往迫使安全-保真度做出权衡，在过度应用时导致伪影或提示漂移，在应用不足时在攻击下失效。动态变体使用后验几率信号重新加权引导，但对于开放词汇组合提示可能不够稳健，而基于相似性的轻量级方法则忽略了去噪轨迹上不断演变的图像证据。我们提出了概念移除引导（CRG），这是一种无需训练的方法，从模型的噪声预测中估计每个扩散步骤中不期望概念的存在，并通过封闭形式约束更新来自适应校准负面引导，同时执行目标存在阈值并最小化条件轨迹的扰动。在红队基准测试中，CRG在保持良性保真度的同时降低了攻击成功率，并可扩展到其他抑制目标，如艺术家风格和暴力内容，无需微调或外部分类器。

We propose Nemotron-Labs-Diffusion-Image, a state-of-the-art masked discrete diffusion model (MDM) for high-resolution text-to-image synthesis. Compared with prior work on masked image generation, Nemotron-Labs-Diffusion-Image addresses two key challenges. First, unlike continuous diffusion models which progressively refine latent representations across the entire image, standard MDMs lack self-correcting capability because discrete tokens cannot be modified once they are unmasked. Second, although increasing the vocabulary size of discrete image tokenizers improves reconstruction fidelity, it introduces optimization difficulties for generative modeling as the per-token training signal becomes increasingly sparse. To address the first challenge, Nemotron-Labs-Diffusion-Image incorporates a token-editing mechanism that enables the model to dynamically revise already-unmasked tokens during inference, similar to how a sculptor iteratively refines their work. To tackle the second challenge, we propose a Grouped Cross-Entropy (GCE) objective that assigns positive learning signals to tokens neighboring the ground truth in embedding space, thereby alleviating signal sparsity. To further improve training efficiency, we implement a custom fused operator for GCE that significantly reduces VRAM usage in large-vocabulary settings. Experimental results demonstrate that these innovations substantially improve both training efficiency and image fidelity of masked discrete image generators, achieving a score of 0.90 on GenEval, 86.9 on DPG and 10.76 of HPSv3.

我们提出了Nemotron-Labs-Diffusion-Image，这是一个用于高分辨率文本到图像合成的先进掩码离散扩散模型(MDM)。与先前关于掩码图像生成的研究相比，Nemotron-Labs-Diffusion-Image解决了两个关键挑战。首先，与在整个图像上逐步精炼潜在表示的连续扩散模型不同，标准MDM缺乏自纠正能力，因为离散token一旦取消掩码就无法修改。其次，虽然增大离散图像分词器的词汇表大小可以提高重建保真度，但会导致每token的训练信号变得日益稀疏，从而为生成式建模带来优化困难。为解决第一个挑战，Nemotron-Labs-Diffusion-Image引入了一种token编辑机制，使模型能够在推理过程中动态修改已取消掩码的token，类似于雕刻家迭代精炼其作品的方式。为解决第二个挑战，我们提出了一种分组交叉熵(Grouped Cross-Entropy, GCE)目标函数，为嵌入空间中真实值邻近的token分配正向学习信号，从而缓解信号稀疏问题。为进一步提高训练效率，我们为GCE实现了一个自定义融合算子，显著降低了大词汇表设置下的显存使用量。实验结果表明，这些创新显著提高了掩码离散图像生成器的训练效率和图像质量，在GenEval上达到0.90分，在DPG上达到86.9分，在HPSv3上达到10.76分。

Recently, zero-shot object customization generation methods have rapidly developed and shown tremendous potential for applications. For instance, in the e-commerce domain, consumers can observe the visual effect of furniture placed within their personal living spaces or clothes worn on their own bodies. Many existing approaches perform object customization generation based on diffusion models and extracted reference object features. However, the generated object significantly diverges from the original reference object in details such as patterns and curves. Particularly for asymmetrical reference objects, the absence of comprehensive multi-viewpoint information prevents the generation of object poses that harmonize with the background scene. To address these shortcomings, we have constructed a novel dataset comprising multi-angle images of furniture and indoor scenes. Based on diffusion models, we introduce HomeDiffusion, which can leverage multi-viewpoint images of the same reference object to accurately generate visually harmonious object poses within specified areas of the background scene. During the diffusion process, we further extract high-fidelity details of the reference object and perform cross-attention with the noise latents in the latent space, thereby ensuring the preservation of details in the customized object generation. Extensive qualitative and quantitative experiments demonstrate that our method achieves superior performance over other existing zero-shot as well as few-shot object customization approaches.

近年来，零样本对象定制生成方法快速发展，展现出巨大的应用潜力。例如，在电子商务领域，消费者可以观察家具放置在自己居住空间中的视觉效果，或衣服穿在自己身上的效果。许多现有方法基于扩散模型和提取的参考对象特征进行对象定制生成。然而，生成的对象在图案、曲线等细节方面与原始参考对象存在显著差异。特别是对于非对称参考对象，缺乏全面的多视角信息导致无法生成与背景场景协调一致的对象姿态。针对这些不足，我们构建了一个包含家具和室内场景多角度图像的新数据集。在此基础上，我们提出了HomeDiffusion方法，该方法能够利用同一参考对象的多视角图像，在背景场景的指定区域内准确生成视觉上和谐一致的对象姿态。在扩散过程中，我们进一步提取参考对象的高保真细节，并与潜在空间中的噪声潜向量进行交叉注意力交互，从而确保定制对象生成中细节的保留。大量定性及定量实验表明，我们的方法在性能上优于其他现有的零样本及少样本对象定制方法。

Generating 3D hand-object interactions is essential for applications in robotics, XR, and synthetic data generation, where flexible controllability and strong generalization to diverse object geometries are required. However, existing methods rarely satisfy these requirements, limiting their practical applicability. We present DCGrasp, a distance-aware controllable grasp generation system built on a novel grasp energy term. This term computes Distance Profile, a signed distance from each hand vertex to the nearest object point, coupled with distance-aware weighting, effectively capturing the semantically similar hand-object interaction in near-contact regions while remaining invariant to object and hand identity. Given various controllable signals, DCGrasp first generates a Distance Profile based on a Diffusion Transformer, together with a corresponding candidate hand pose. We then refine the candidate pose through optimization, enforcing consistency between the optimized hand pose and the generated Distance Profile in near-contact regions. Our experiments show that DCGrasp produces high-quality, physically plausible grasps with flexible user control, generalizing to diverse object and hand shapes and scales. Our work establishes a robust and versatile pipeline for the synthesis of controllable 3D hand-object interactions.

生成3D手-物体交互对于机器人技术、扩展现实和合成数据生成等应用至关重要，这些应用要求具备灵活的可控性以及对不同物体几何形状的强大泛化能力。然而，现有方法难以同时满足这些要求，限制了其实用性。我们提出了DCGrasp，一个基于新型抓取能量项的距离感知可控抓取生成系统。该能量项计算距离场（Distance Profile），即每个手部顶点到最近物体点的有符号距离，并结合距离感知加权，有效捕捉近接触区域中语义相似的手-物体交互，同时对物体和手部身份保持不变。给定各种可控信号，DCGrasp首先基于扩散Transformer生成距离场，并生成相应的候选手部姿态。然后，我们通过优化对候选姿态进行细化，使优化后的手部姿态与生成的距离场在近接触区域保持一致。我们的实验表明，DCGrasp能够生成高质量、物理合理的抓取，具有灵活的用户控制能力，可泛化到不同的物体和手部形状与规模。我们的工作建立了一个稳健且通用的可控3D手-物体交互合成流程。

Score distillation turns a pretrained 2D diffusion model into a 3D generator, but the per-step gradient is estimated from a single randomly chosen view: it is high-variance and blind to global shape consistency. Prior work addresses this by retraining the diffusion prior on multi-view data; this improves consistency but makes the sampling contribution inseparable from prior quality. We instead isolate the sampling axis. The per-step gradient is one noisy sample of an expectation over views; aggregating K samples per step at a fixed total UNet budget reduces variance without touching the prior. We introduce Multi-View Aggregated Score Distillation (MV-SDI), which aggregates gradients from K views per step via gradient accumulation, keeping peak memory unchanged and the 2D prior frozen, and draws views as antithetic antipodal pairs, a prior-independent geometric property, for balanced angular coverage. At a fixed 10,000-UNet-call budget, K=2 raises CLIP R-Precision from 74.8% to 83.8% and CLIP score from 0.297 to 0.312, with consistent gains on HPSv2 and ImageReward and a 0.0% divergence rate on the 43-prompt benchmark; optimization steps halve as a consequence. K=4 gives a fourfold step reduction at R-Precision 86.9% and CLIP 0.307, still well above the single-view baseline on every alignment metric. MV-SDI is compatible with gradient-based score-distillation pipelines, including Score Distillation via Inversion, and requires no retraining and no multi-view data.

分数蒸馏将预训练的2D扩散模型转变为3D生成器，但每步梯度是从单个随机选择的视角估计的：其方差较高且无法感知全局形状一致性。先前的工作通过在多视角数据上重新训练扩散先验来解决这一问题；这提高了一致性，但使得采样贡献与先验质量难以分离。我们转而分离采样轴。每步梯度是对视角期望的一次噪声采样；在固定的UNet调用预算下，每步聚合K个样本可以在不改动先验的情况下降低方差。我们提出了多视角聚合分数蒸馏（MV-SDI），该方法通过梯度累积在每步聚合来自K个视角的梯度，保持峰值内存不变且2D先验冻结，并将视角采样为对偶对应点对，这是一种先验无关的几何属性，以实现平衡的角覆盖率。在固定的10,000次UNet调用预算下，K=2将CLIP R-Precision从74.8%提升至83.8%，CLIP分数从0.297提升至0.312，在HPSv2和ImageReward上均获得一致的提升，且在43提示词基准上发散率为0.0%；因此优化步数减少了一半。K=4在R-Precision为86.9%、CLIP为0.307的情况下实现了四倍步数减少，仍在所有对齐指标上显著高于单视角基线。MV-SDI与基于梯度的分数蒸馏流程兼容，包括通过反转的分数蒸馏，且无需重新训练和无需多视角数据。

Recent co-speech gesture generation methods often overlook cultural differences, limiting their effectiveness in human-agent interaction. Moreover, culture-conditioned models are rarely evaluated under speaker-disjoint splits, so apparent "cultural" behavior may be confounded with speaker-specific gesturing style. We introduce SICAGE, a modular framework for culture-aware co-speech gesture generation that conditions motion synthesis models on speaker-independent cultural representations. SICAGE learns these representations from audio and text by treating each speaker as a separate domain while imposing invariance across speakers. This encourages representations to remain culture-discriminative while reducing dependence on speaker identity. The resulting cultural embeddings condition a multimodal generator to produce culturally appropriate gestures. We instantiate this idea with two domain generalization approaches: adversarial learning and Fishr regularization. We further introduce ALaDiT, a real-time diffusion-based gesture generator designed to efficiently incorporate the learned cultural embeddings. To validate our method, we built TED4C-L, a 106-hour multimodal dataset of 764 TED speakers from four cultural groups. Experiments show that SICAGE improves motion realism, diversity, beat synchronization, semantic relevance, and cultural consistency.

近期的协同手势生成方法往往忽视文化差异，限制了其在人机交互中的有效性。此外，以文化为条件的模型在说话者分离划分设置下鲜有评估，因此所呈现的"文化"行为可能与说话者特有的手势风格相混淆。我们提出SICAGE，一个用于文化感知协同手势生成的模块化框架，它将运动合成模型建立在说话者无关的文化表征之上。SICAGE通过将每位说话者视为独立域，同时施加跨说话者的不变性约束，从音频和文本中学习这些表征。这促使表征保持文化区分性的同时，减少对说话者身份的依赖。生成的文化嵌入作为多模态生成器的条件，以产生符合文化特征的手势。我们通过两种域泛化方法实现这一思路：对抗学习和Fishr正则化。我们进一步提出ALaDiT，一个基于实时扩散的手势生成器，旨在高效整合学习到的文化嵌入。为验证方法的有效性，我们构建了TED4C-L，这是一个包含764位TED演讲者、来自四个文化群体、时长106小时的多模态数据集。实验表明，SICAGE在运动真实感、多样性、节拍同步性、语义相关性和文化一致性方面均有提升。

Precisely manipulating objects in a single photograph (translation, rotation, scaling) while obeying 3D physical constraints remains unsolved for diffusion-based editors. Current 2D methods lack spatial awareness and produce perspective violations. Forcing structural proxies into the latent space also disrupts variance homogeneity, and the resulting self-attention leakage leads to ghosting and background blur. The core difficulty is asymmetric: the relocated object must follow a rigid geometry, yet the uncovered background needs freedom to synthesize plausible content. We present GeoEdit, a training-free Lift-Manipulate-Render-Denoise pipeline that satisfies both constraints. We decouple scene and object in 3D, align them through point correspondence, and render a geometry-aligned proxy with a structural depth map. A Dual-Branch Denoising stage then refines this proxy: a video diffusion backbone preserves object identity, while 3D constraints are injected into the foreground within a narrow denoising window at matching noise variance (variance-homogeneous injection). The background denoises freely. Because the injected signal matches the native latent statistics, self-attention stays undisturbed. We also introduce GeoEditBench, a pose-aware benchmark covering object translation, object rotation, and camera movement with pose-aware evaluation metrics. Experiments confirm consistent gains in geometric accuracy, identity fidelity, and background quality. Our codes are available at https://github.com/Heey731/GeoEdit.

在单张照片中精确操纵目标（平移、旋转、缩放）同时遵守3D物理约束，对于基于扩散的编辑器而言仍是一个未解决的问题。当前2D方法缺乏空间感知能力，会产生透视违规。强行将结构代理嵌入潜在空间也会破坏方差均匀性，由此产生的自注意力泄漏会导致重影和背景模糊。核心困难在于不对称性：迁移后的目标必须遵循刚性几何，而暴露的背景则需要自由合成合理内容。我们提出GeoEdit，一个无需训练的提升-操纵-渲染-去噪流程，可同时满足这两个约束。我们在3D空间中解耦场景和目标，通过点对应进行对齐，并使用结构深度图渲染几何对齐的代理。随后双分支去噪阶段对该代理进行细化：视频扩散主干网络保持目标身份，而3D约束在匹配噪声方差的狭窄去噪窗口内注入到前景中（方差均匀注入）。背景则自由去噪。由于注入信号与原生潜在统计特性匹配，自注意力保持不受干扰。我们还引入GeoEditBench，这是一个覆盖目标平移、目标旋转和相机运动的姿态感知基准数据集，并配有姿态感知评估指标。实验证实了几何精度、身份保真度和背景质量的一致性提升。我们的代码可访问https://github.com/Heey731/GeoEdit。

Volume microscopy, including electron and light microscopy, suffers from severe anisotropic resolution due to physical axial sectioning. Existing self-supervised axial super-resolution (ASR) methods face a trilemma bounded by overly smoothed regression textures, structural hallucinations of pure diffusion models, and prohibitive inference latency. In this paper, we propose Skeleton-refinE Microscopy (SkelEM), a self-supervised framework that decouples ASR at the training-signal level: a frozen topological network and a diffusion refiner are optimized by disjoint objectives, separating low-frequency topology formulation from high-frequency detail enhancement. Building on this deterministic skeleton, we exploit a unified cycle-consistent mechanism on input sparse slices to simultaneously extract a real-domain residual prior and bidirectionally align the diffusion refiner, washing away cross-plane artifacts without synthetic bias. By truncating the reverse diffusion process with this physical prior, SkelEM achieves high-fidelity detail restoration in merely $\le 5$ steps. To rigorously assess cross-instrument generalization, we further introduce BRAVE-ASR, a new benchmark of co-aligned anisotropic and isotropic volumes acquired on a Plasma-FIB instrument. Across public benchmarks, SkelEM achieves the most favorable balance across the fidelity-perception trade-off among self-supervised methods, with state-of-the-art downstream membrane segmentation performance and robust zero-shot generalization across distinct modalities.

体显微镜（包括电子显微镜和光学显微镜）由于物理轴向切片而面临严重的各向异性分辨率问题。现有自监督轴向超分辨率（ASR）方法面临一个三难困境：过度平滑的回归纹理、纯扩散模型的结构幻觉以及禁止的推理延迟。本文提出骨架精修显微镜（SkelEM），一种在训练信号层面解耦ASR的自监督框架：冻结的拓扑网络和扩散精修器通过不同目标进行优化，将低频拓扑构建与高频细节增强分离。在此确定性骨架基础上，我们在输入稀疏切片上利用统一的循环一致性机制同时提取真实域残差先验并双向对齐扩散精修器，消除跨平面伪影且不引入合成偏差。通过用该物理先验截断反向扩散过程，SkelEM仅需不超过5步即可实现高保真细节恢复。为严格评估跨仪器泛化能力，我们进一步引入BRAVE-ASR，这是一个在Plasma-FIB仪器上获取的对齐各向同性和各向异性体数据的新基准。在公开基准上，SkelEM在自监督方法中实现了保真度-感知权衡的最佳平衡，具有最先进的下游膜分割性能，并在不同模态间展现出稳健的零样本泛化能力。

Interactive video generation systems for camera-controlled world exploration roll out growing sequences of latent video frames, entangling state transition with high-frequency observation synthesis. We propose Walking in the Implicit, a scene-centric paradigm that changes the rollout variable from frame latents to a fixed-length, renderable implicit state, termed Neural Implicit Scene (NIS). This factorizes interactive generation into stochastic transition of a compact scene state and deterministic pose-conditioned rendering given the sampled state. We instantiate this paradigm as NeuWorld: a transformer VAE learns locally anchored NIS from sparse posed frames, and a diffusion transformer evolves NIS conditioned on future camera trajectories and geometry-aware retrieved history. By reusing the VAE encoder as a unified conditioner, NeuWorld maps camera, reference-image, and history cues into the same NIS modality, avoiding external heterogeneous encoders. Trained from scratch on public posed-view data without pretrained video backbones or auxiliary 3D reconstructors, NeuWorld achieves strong long-horizon consistency with favorable inference efficiency.

用于相机控制世界探索的交互式视频生成系统会不断生成潜在视频帧序列，将状态转换与高频观测合成紧密耦合。我们提出“漫步隐式空间”，一种以场景为中心的范式，将生成变量从帧潜在向量转换为一种固定长度、可渲染的隐式状态，称为神经隐式场景（Neural Implicit Scene，NIS）。该范式将交互式生成分解为紧凑场景状态的随机转换，以及给定采样状态后的确定性姿态条件渲染。我们将这一范式实例化为NeuWorld：一个Transformer VAE从稀疏姿态帧中学习局部锚定的NIS，一个扩散Transformer根据未来相机轨迹和几何感知检索的历史信息来演化NIS。通过将VAE编码器重用为统一条件器，NeuWorld将相机、参考图像和历史线索映射到同一NIS模态，避免了外部异构编码器。NeuWorld从零开始在公开的Pose数据上训练，无需预训练视频backbone或辅助3D重建器，即可实现强大的长程一致性以及良好的推理效率。

Recent progress in Text-to-Image generation benefits from large-scale Text-Image pairs. However, the scarcity of Text-LiDAR pairs often causes over-smoothed scenes and limited controllability. In this paper, we rethink the limitations of Text-LiDAR generation task, focusing on alleviating insufficient training priors and constructing controllable Text-LiDAR data. We propose a \textbf{T}ext-\textbf{to}-\textbf{L}iDAR \textbf{D}iffusion \textbf{M}odel for LiDAR scene generation, T2LDM++, with a Self-Conditioned Representation Guidance (SCRG). Specifically, to alleviate object over-smoothing, SCRG employs a Guidance Network (GN) to provide reconstruction-based soft supervision to the Denoising Network (DN). This enables DN to learn geometry-aware representations through reconstruction guidance, leading to more accurate denoising in DDPMs. Meanwhile, through analysis and design, SCRG exhibits more effective and lightweight, while decoupled in inference, avoiding computational overhead. Furthermore, we construct two high-quality Text-LiDAR benchmarks ($>$100K samples) using a generalized strategy of geometric annotations, along with a controllability metric. Moreover, a directional position prior is designed to mitigate street distortion, further improving scene fidelity. Additionally, T2LDM++ supports multiple conditions, including (Semantic, Box, BEV, Camera)-to-LiDAR, Sparse-to-Dense, and Dense-to-Sparse generation, by learning a control encoder via frozen DN. With effective prior modeling and high-quality Text-LiDAR benchmarks, T2LDM++ can generate realistic LiDAR scenes with rich geometric details in unconditional and conditional settings.

文本到图像生成领域的最新进展得益于大规模文本-图像对数据。然而，文本-激光雷达对的稀缺往往导致场景过度平滑以及可控性受限。本文重新审视文本-激光雷达生成任务的局限性，重点关注缓解训练先验不足以及构建可控的文本-激光雷达数据问题。我们提出了一种用于激光雷达场景生成的文本到激光雷达扩散模型T2LDM++，该模型采用自条件表示引导（Self-Conditioned Representation Guidance，SCRG）机制。具体而言，为了缓解目标过度平滑问题，SCRG利用引导网络（Guidance Network，GN）为去噪网络（Denoising Network，DN）提供基于重建的软监督。这使得DN能够通过重建引导学习几何感知表示，从而在去噪扩散概率模型（DDPM）中实现更精确的去噪。同时，通过分析和设计，SCRG在推理过程中表现出更高的效率和轻量性，且实现解耦，避免了计算开销。此外，我们利用几何标注的通用化策略构建了两个高质量的文本-激光雷达基准数据集（样本数超过10万），并设计了相应的可控性指标。为了进一步提升场景保真度，我们设计了方向位置先验来减轻街道畸变。此外，T2LDM++还支持多种条件生成任务，包括（语义、边界框、BEV、相机）到激光雷达、稀疏到稠密以及稠密到稀疏的生成，这些功能通过使用冻结的DN学习控制编码器实现。凭借有效的先验建模和高质量的文本-激光雷达基准数据集，T2LDM++能够在无条件和条件生成设置下生成具有丰富几何细节的逼真激光雷达场景。

Recent text-to-video (T2V) diffusion models rely heavily on auxiliary reward signals (e.g., via reward models or DPO) to align generated content with human aesthetics and improve realism. These signals, however, incur substantial computational overhead, require costly human annotations, and often yield limited improvement in fine-grained local details. In this paper, we argue that your data manifold is secretly a reward model. By explicitly modeling the manifold structure of high-quality Supervised Fine-Tuning (SFT) data and encouraging video latents to lie on this manifold, we derive dense, differentiable, and nearly cost-free reward signals that significantly improve video quality, particularly in mitigating low-level distortions. Our modeling builds upon Local Coordinate Coding (LCC), which captures the `skeleton' of the manifold. However, directly applying LCC suffers from mean regression, pulling latents toward the geometric mean and losing high-frequency details. We therefore extend it to Shell Local Coordinate Coding (Shell-LCC), which models the manifold `surface&x27; as an isotropic shell to align with the true high-density region. Experiments demonstrate that our approach improves realism, enhances high-frequency details, reduces over-smoothing artifacts, and alleviates motion blur.

当前的文本到视频扩散模型严重依赖辅助奖励信号（例如通过奖励模型或DPO）来对齐生成内容与人类审美并提升真实感。然而，这些信号带来了巨大的计算开销，需要昂贵的人工标注，且对细粒度局部细节的提升往往有限。在本文中，我们提出数据流形本身就是奖励模型。通过显式建模高质量监督微调（SFT）数据的流形结构，并鼓励视频潜变量落在这个流形上，我们得到了密集、可微且几乎零成本的奖励信号，显著提升了视频质量，特别是在缓解低层次失真方面。我们的建模基于局部坐标编码（LCC），该方法捕获了流形的“骨架”。然而，直接应用LCC会导致均值回归问题，将潜变量拉向几何均值而丢失高频细节。因此，我们将其扩展为Shell局部坐标编码（Shell-LCC），将流形“表面”建模为等向壳，以对齐真实高密度区域。实验表明，我们的方法提升了真实感，增强了高频细节，减少了过度平滑伪影，并缓解了运动模糊。

Text-to-image (T2I) diffusion models often fail to faithfully render explicit textual descriptions, instead defaulting to strongly learned visual priors due to a phenomenon referred to as concept association bias. We show that such bias is particularly strong for one-and-only (OAO) objects, entities that exist in a single canonical form, such as celestial bodies, landmarks, and artworks. The deeply ingrained visual identity for these concepts often resists modification through prompting alone. Addressing this challenge, we first identify through an information-theoretic analysis that the final text embedding discards concept-level information present in the intermediate-layer text representations, reducing the mutual information available to the subsequent denoising process. We then propose Intermediate Text Representation (IR)-guided diffusion, which injects intermediate hidden states of the text encoder into the conditioning signal during early denoising steps, recovering suppressed concepts without any additional training, optimization, or external models. To systematically evaluate the challenging task of aligning generative outputs with unusual prompts for OAO objects, we introduce OAO-AttackBench, a benchmark comprising counterfactual prompts that directly conflict with the core visual identity of OAO objects. Experiments on four benchmarks, including OAO-AttackBench, show that our method achieves up to a 19.1 percentage-point improvement in VQAScore while preserving generation fidelity and human preference. Project page: https://soyoun-won.github.io/one-and-only-ir-guidance/.

文本到图像（T2I）扩散模型经常无法忠实呈现明确的文本描述，而是由于所谓的概念联想偏见现象，默认采用强学习的视觉先验。我们表明，这种偏见在唯一性（OAO）对象上尤为强烈，这些对象以单一规范形式存在，如天体、地标和艺术品。这些概念的深层视觉特征往往仅通过提示词难以被修改。为解决这一挑战，我们首先通过信息论分析发现，最终的文本嵌入丢弃了中间层文本表示中存在的概念级信息，从而降低了后续去噪过程可用的互信息。随后，我们提出中间文本表示（IR）引导扩散方法，将文本编码器的中间隐藏状态注入到早期去噪步骤的条件信号中，无需任何额外训练、优化或外部模型即可恢复被抑制的概念。为系统评估将生成输出与OAO对象的异常提示词对齐这一挑战性任务，我们引入了OAO-AttackBench基准，该基准由直接与OAO对象核心视觉特征相矛盾的反事实提示词组成。在包括OAO-AttackBench在内的四个基准上的实验表明，我们的方法在保持生成保真度和人类偏好的同时，实现了高达19.1个百分点的VQAScore提升。项目页面：https://soyoun-won.github.io/one-and-only-ir-guidance/。

4D hand motion reconstruction from egocentric video is bottlenecked by clear limitations of existing methods: image-based pipelines depend on a detector that fails under heavy occlusion, while video-based methods rely on temporal modules learned only from scarce hand-pose annotations, a narrow signal insufficient to model motion dynamics, occlusion reasoning, and hand-object interaction. These capabilities, however, are exactly what video generative models must implicitly acquire when trained to synthesize coherent video at internet scale. Motivated by this, we present ViDiHand, which leverages the representations of a pretrained video diffusion model to reconstruct 4D two-hand pose. We adapt it via a hand-overlay rendering objective that specializes its features for hands while preserving its world priors. A decoder then recovers metric-scale pose from the adapted features. The whole pipeline operates directly on full frames--no detector, no infiller, and no test-time optimization. On ARCTIC, HOT3D, and HOI4D, ViDiHand substantially outperforms prior methods, establishing video diffusion models as a powerful new foundation for hand motion reconstruction and a promising route to scalable in-the-wild data collection for embodied AI. Project page: https://vidihand.github.io.

从第一人称视频进行4D手部动作重建受限于现有方法的明显缺陷：基于图像的流程依赖于在严重遮挡情况下失效的检测器，而基于视频的方法则依赖于仅从稀缺的手部姿态标注学习的时序模块，这种狭隘的信号不足以建模运动动力学、遮挡推理和手-物体交互。然而，这些能力正是视频生成模型在全球规模数据上训练以生成连贯视频时必须隐式获取的能力。受此启发，我们提出了ViDiHand，它利用预训练视频扩散模型的表示来重建4D双手姿态。我们通过一个手部覆盖渲染目标对其进行适配，使其特征专门化用于手部同时保留其世界先验。然后，一个解码器从适配后的特征恢复度量尺度的姿态。整个流程直接对完整帧进行操作——无需检测器，无需填充器，也无需测试时优化。在ARCTIC、HOT3D和HOI4D数据集上，ViDiHand显著优于先前方法，确立了视频扩散模型作为手部动作重建的强大新基础，以及为具身AI收集可扩展的野外数据的有前景途径。

Recent advances in diffusion models have shown impressive performance in controllable image generation and dense prediction tasks. However, existing approaches typically treat diffusion-based controllable generation and dense prediction as separate tasks, overlooking the potential benefits of jointly modeling the heterogeneous distributions. In this work, we introduce UniGP, a framework built upon MMDiT, which unifies controllable generation and dense prediction through simple joint training, without the need for complex task-specific designs or losses, while preserving the backbone's versatile priors. By learning controllable generation and prediction under different conditions, our model effectively captures the joint distribution of image-geometry pairs. UniGP is capable of versatile controllable generation, dense prediction, and joint generation. Specifically, the proposed UniGP consists of DUGP and a unified dataset training strategy. The former, following the principle of Occam&x27;s razor, uses only a copied image branch of MMDiT to model dense distributions beyond RGB, while the latter integrates heterogeneous datasets into a unified training framework to jointly model generation and perception tasks. Extensive experiments demonstrate that our unified model surpasses prior unified approaches and performs on par with specialized methods. Furthermore, we demonstrate that multi-task joint training provides complementary benefits: generative priors enrich perceptual details, while perceptual learning improves structural alignment in generation.

近年来，扩散模型在可控图像生成和密集预测任务中展现出令人瞩目的性能。然而，现有方法通常将基于扩散的可控生成和密集预测视为独立任务，未能充分挖掘联合建模异构分布的潜在优势。本研究提出UniGP框架，该框架基于MMDiT构建，通过简单的联合训练统一可控生成与密集预测任务，无需复杂的任务特定设计或损失函数，同时保持骨干网络的多功能先验能力。通过在不同条件下学习可控生成和预测，我们的模型有效捕捉了图像-几何对的联合分布。UniGP具备多样化的可控生成、密集预测和联合生成能力。具体而言，所提出的UniGP由DUGP和统一数据集训练策略组成。前者遵循奥卡姆剃刀原则，仅使用MMDiT的复制图像分支来建模RGB之外的密集分布；后者将异构数据集整合到统一训练框架中，以联合建模生成和感知任务。大量实验表明，我们的统一模型超越了先前的一致化方法，并与专门方法性能相当。此外，我们证明了多任务联合训练能够带来互补收益：生成先验丰富了感知细节，而感知学习则改善了生成中的结构对齐。

Monocular dense prediction has recently seen remarkable success by repurposing pre-trained diffusion models. This opens a promising yet challenging avenue for more efficient multi-task learning paradigm. However, existing multi-task diffusion methods often introduce parameter-heavy adapters, experts, or learnable task tokens, leading to computational redundancy. In this paper, we reveal an inherent mechanism within one-step diffusion models: the native, fixed sinusoidal timestep embedding can be repurposed as an endogenous task steering signal. Based on this discovery, we propose Multi-task Unified eStimation via timestep Embedding (MUSE), a parameter-free, single-model multi-tasking approach for dense prediction. We interpret this mechanism via Manifold Decoupling, where discrete, fixed timestep values deterministically steer the generation process towards decoupled, task-specific manifolds in the latent space. Extensive experiments across 10 datasets demonstrate that MUSE achieves highly competitive performance on both monocular depth and normal estimation, and its efficacy generalizes across U-Net and DiT architectures. Our work offers a concise and efficient path toward generalist vision models by simply unlocking the latent potential of existing generation infrastructure.

单目密集预测通过重构预训练扩散模型已取得显著成功。这为更高效的多任务学习范式开辟了一条前景广阔但具有挑战性的道路。然而，现有的多任务扩散方法通常引入参数繁重的适配器、专家或可学习任务令牌，导致计算冗余。本文揭示了单步扩散模型中的一个固有机制：原生且固定的正弦时间步嵌入可以被重构为内生任务引导信号。基于这一发现，我们提出了多任务统一时间步嵌入估计（MUSE），这是一种用于密集预测的无参数、单模型多任务方法。我们通过流形解耦来解释这一机制，即离散、固定的时间步值以确定性方式引导生成过程走向潜在空间中解耦的任务特定流形。在10个数据集上的广泛实验表明，MUSE在单目深度估计和法向估计上都取得了极具竞争力的性能，并且其有效性在U-Net和DiT架构之间具有泛化性。我们的工作通过简单释放现有生成基础设施的潜在能力，为通用视觉模型提供了一条简洁高效的路径。

Human image animation, which aims to generate a video of a reference subject following a provided action sequence, has received increasing research interest. With the development of diffusion-based/flow-based video foundation models, existing animation works have began to upgrade the guidance information from 2D skeleton/pose to 3D modeling conditions. Despite achieving reasonable results, these approaches face challenges in synthesizing trajectory-controllable human motion within natural scene under changed camera views. In this work, we present a scene-adaptive human image animation framework that controls both human motion and camera trajectories within a reconstructed 3D environment for video generation. To achieve this, we first develop a ground-adaptive 3D motion retargeting approach to enable user-friendly motion trajectory control adapting to the changes of elevations of ground and orientations automatically. Then we design a viewpoint-adaptive latent fusion mechanism to inject point-cloud geometric priors through scene-visibility masking into the generative process, providing precise guidance of viewpoint changes under camera control. Experiments on two standard human image animation benchmark datasets demonstrate remarkable improvements of our method over the state of the arts in related video generation metics. Project page: https://robinhood256100.github.io/web-disp

人体图像动画旨在根据给定的动作序列生成目标人物的视频，近年来研究兴趣日益增长。随着基于扩散/基于流的视频基础模型的发展，现有动画方法开始将引导信息从2D骨架/姿态升级为3D建模条件。尽管取得了合理的效果，但这些方法在变化相机视角下自然场景中合成轨迹可控的人体运动仍面临挑战。本工作提出了一种场景自适应人体图像动画框架，可在重建的3D环境中同时控制人体运动和相机轨迹以生成视频。为此，我们首先开发了一种地面自适应3D运动重定向方法，使运动轨迹控制能够自动适应地面高度和朝向的变化。然后，我们设计了视角自适应潜在融合机制，通过场景可见性掩码将点云几何先验注入生成过程，为相机控制下的视角变化提供精确引导。在两个人体图像动画标准基准数据集上的实验表明，我们的方法在相关视频生成指标上相较于现有最先进方法取得了显著改进。项目页面：https://robinhood256100.github.io/web-disp

Current generative models, including GANs and diffusion models, have reached an outstanding level of photorealism, posing significant risks to privacy and security. To ensure real-world applicability, deepfake detectors must generalise effectively to unseen generators. However, most existing approaches rely on supervised training with both real and fake images, which limits their generalisation especially across generators categories (e.g. GANs vs DMs). In this work, we introduce $\mu$Flow, a one-class deepfake detector trained only on real images without relying on pseudo-deepfakes or synthetic artifacts. Our approach builds on the observation that averaging multiple images amplifies consistent generative traces, producing highly discriminative feature representations. We leverage this property by modelling the distribution of features extracted from averaged images and training a normalizing flow to align the feature space of individual images with this distribution. This alignment yields a likelihood-based criterion that separates real and fake samples while promoting strong generalisation. We evaluate $\mu$Flow on a fully out-of-distribution setting, where both real and fake datasets are unseen during training. Experimental results show that our method significantly outperforms SOTA detectors. Project page: https://opontorno.github.io/MuFlow.

当前的生成模型（包括GANs和扩散模型）已达到卓越的照片级真实感水平，对隐私和安全构成重大风险。为确保实际应用有效性，深度伪造检测器必须能够有效泛化至未见过的生成器。然而，大多数现有方法依赖于同时使用真实图像和伪造图像的监督训练，这限制了其泛化能力，尤其是在不同生成器类别（如GANs与扩散模型之间的跨类别泛化）之间。本工作提出了μFlow，一种仅在真实图像上训练的单类深度伪造检测器，无需依赖伪深度伪造或合成伪影。我们的方法基于以下观察：对多张图像进行平均会增强一致的生成痕迹，产生高度判别的特征表示。我们利用这一特性，对从平均图像提取的特征分布进行建模，并训练归一化流将单个图像的特征空间与该分布进行对齐。这种对齐产生了一种基于似然的准则，能够区分真实和伪造样本，同时促进强泛化能力。我们在完全分布外的设置下评估μFlow，其中训练时未见过的真实和伪造数据集。实验结果表明，我们的方法显著优于最先进的检测器。项目页面：https://opontorno.github.io/MuFlow

Diffusion posterior samplers for accelerated MRI can reconstruct accurately yet still disagree on the acquired k-space across samples, placing posterior variability on coefficients the scanner has already measured. We identify this measured-subspace leakage as a physical-admissibility failure. Under a hard-constraint model it violates the measurement constraint and inflates the reported uncertainty with disagreement about coefficients the scanner has already determined. To quantify this leakage, we introduce complementary measured- and unmeasured-subspace k-space dispersion metrics (MSD/USD). We then present Measured-Subspace Consistency (MSC), a training-free terminal correction that wraps any compatible image-space posterior sampler with a standard multi-coil consistency lock. The ideal lock follows classical range/null-space data consistency. Our contribution is to repurpose it as a black-box posterior audit and correction rather than a new reconstructor or learned sampler. Theoretically, we prove that the ideal transform confines pairwise sample differences to the MRI null space and bound the residual cross-subspace coupling left by practical sensitivity-weighted implementations. Across six base samplers and two MRI anatomies, including out-of-distribution transfer where a knee prior reconstructs brain, MSC substantially reduces measured-subspace dispersion for Soft samplers (a median 16.5x reduction for DPS across five brain contrasts, up to ~29x), while preserving unmeasured-subspace diversity and acting as a near-identity map for Consistent ones. Furthermore, MSC maintains or modestly improves PSNR/SSIM, with no retraining, retuning, or significant computational overhead.

用于加速MRI的扩散后验采样器虽然能够准确重建，但在已采集的k空间样本间仍存在分歧，将后验不确定性置于扫描仪已经测量的系数上。我们将这种测量子空间泄漏识别为物理可容性失效。在硬约束模型下，它违反了测量约束，并通过对扫描仪已确定系数的分歧来夸大报告的不确定性。为了量化这种泄漏，我们引入了互补的测量和未测量子空间k空间分散度指标（MSD/USD）。随后，我们提出了测量子空间一致性（MSC），这是一种无训练的终端校正方法，可将任何兼容的图像空间后验采样器与标准多线圈一致性锁定进行包装。理想锁定遵循经典的 值域/零空间数据一致性。我们的贡献在于将其重新定位为黑盒后验审计和校正工具，而非新的重建器或学习采样器。理论上，我们证明了理想变换将成对样本差异限制在MRI零空间内，并约束了实际灵敏度加权实现所遗留的跨子空间耦合残差。在六个基础采样器和两种MRI解剖结构（包括分布外迁移场景，即膝盖先验重建大脑）上，MSC显著降低了软采样器的测量子空间分散度（DPS在中枢脑对比度上中位数降低16.5倍，最高约29倍），同时保留了未测量子空间的多样性，并对一致性采样器表现出近似恒等映射的特性。此外，MSC在无需重新训练、重新调参或显著计算开销的情况下，保持或适度改善了PSNR/SSIM。

Diffusion and continuous-flow generative models achieve high-quality generation, and their deterministic sampling can be formulated as solving learned ODE dynamics. However, accurate ODE discretization often requires many steps, making efficient few-step generation a key challenge. Among acceleration strategies, reflow-based distillation simplifies teacher ODE trajectories so that a student model can approximate the teacher transport with fewer steps. We identify a theoretical limitation of this paradigm, namely that trajectory matching can under-determine the distribution induced by the student model. In particular, two student models can attain the same trajectory-matching loss while inducing different endpoint marginal distributions, which may lead to different generation quality. To address this limitation, we introduce a marginal-alignment regularizer that penalizes the discrepancy between the student-induced marginal and the corresponding teacher marginal at the endpoint of each distillation interval. The regularizer is computed by tracking log-density changes along the ODE induced by the student model and evaluating scores from the frozen teacher model, without requiring auxiliary trainable networks or adversarial optimization. The resulting framework applies uniformly to the reflow family, including vanilla reflow and piecewise reflow. We further prove a telescoping total-variation bound showing that local marginal alignment controls the final-time discrepancy between the student-induced and teacher-induced distributions. Experiments on benchmark backbones demonstrate the effectiveness of the proposed method for few-step generation.

扩散模型和连续流生成模型实现了高质量生成，其确定性采样可表述为求解学习到的常微分方程动力学。然而，精确的常微分方程离散化通常需要许多步骤，因此高效的少步生成成为关键挑战。在加速策略中，基于重流的蒸馏简化了教师常微分方程轨迹，使 student 模型能够用更少的步骤近似教师传输。我们发现了这一范式的理论局限性，即轨迹匹配可能无法完全确定 student 模型所诱导的分布。具体而言，两个 student 模型可以达到相同的轨迹匹配损失，却诱导出不同的末端边缘分布，从而导致生成质量差异。为解决这一局限性，我们引入了一种边缘对齐正则化器，用于惩罚每个蒸馏区间末端 student 诱导的边缘与相应教师边缘之间的差异。该正则化器通过沿 student 模型诱导的常微分方程跟踪对数密度变化，并评估冻结教师模型的分数来计算，无需辅助的可训练网络或对抗优化。该框架统一适用于重流家族，包括 vanilla reflow 和分段重流。我们进一步证明了望远镜全变差界，表明局部边缘对齐能够控制 student 诱导分布与教师诱导分布之间的最终时间差异。在基准 backbone 上的实验证明了所提方法在少步生成方面的有效性。

Continuous physical fields represent a large fraction of data under scientific investigation. Their multiscale structures are central to discovery, yet useful coordinates are not known in advance. Standard self-supervised methods define context and targets in fixed image coordinates, posing a predictive task misaligned with fields organized across a continuous scale hierarchy. We introduce ScaleAware-JEPA, a framework that constructs dense, label-free latent coordinates for continuous scalar fields. Constrained Diffusion Decomposition (CDD) separates each field into pixel-registered scale components and provides the scale coordinates that define the masking geometry. The resulting JEPA objective predicts hidden structure with a context footprint tied to the diffusion scale of each component rather than to an arbitrary patch size. Across MHD turbulence, interstellar molecular gas and urban nighttime-light structure, the learned geometry maps back to coherent morphology, forming dense structural atlases without labels or predefined segmentation rules. By tying latent prediction to the scale hierarchy of a field, ScaleAware-JEPA constructs latent coordinates through which complex physical patterns can be inspected before their relevant structures have been prescribed. Code is available at https://github.com/gxli/SA-JEPA.

连续物理场代表了科学研究中相当大一部分数据。其多尺度结构是科学发现的核心，但有用的坐标并非事先已知。标准自监督方法在固定图像坐标中定义上下文和目标，提出了与跨连续尺度层级组织的场不对齐的预测任务。我们引入ScaleAware-JEPA，这是一个为连续标量场构建密集、无标签潜在坐标的框架。约束扩散分解(CDD)将每个场分离为像素注册的尺度分量，并提供定义掩码几何结构的尺度坐标。得到的JEPA目标使用与每个分量的扩散尺度而非任意patch大小相关的上下文足迹来预测隐藏结构。在磁流体动力学湍流、星际分子气体和城市夜间灯光结构中，学习到的几何结构映射回连续形态，形成无需标签或预定义分割规则的密集结构图谱。通过将潜在预测与场的尺度层级相绑定，ScaleAware-JEPA构建了潜在坐标，使得复杂物理模式可以在其相关结构被预先规定之前被检查。代码可访问https://github.com/gxli/SA-JEPA。

Recent studies have shown that semantic watermarks, which embed information into the initial noise of latent diffusion models (LDMs), are vulnerable to black-box forgery attacks. However, existing methods primarily rely on empirical evidence and lack a rigorous theoretical understanding of the conditions under which such attacks succeed or fail. To bridge this gap, we rethink the nature of such attacks through the lens of rate-distortion in the latent space. Our analysis identifies an irreducible distortion floor due to structural mismatches between proxy and target models, which fundamentally limits the fidelity of forged watermarks. We further characterize this distortion as structured geometric deviations on the latent manifold, in the form of global drift and local deformation rather than stochastic noise. Leveraging these insights, we propose a scheme-agnostic detection method that distinguishes forged samples before watermark verification. Extensive experiments demonstrate the effectiveness of our method across diverse black-box scenarios, while preserving robustness to common distortions.

近期研究表明，语义水印将信息嵌入潜在扩散模型（LDMs）的初始噪声中，容易受到黑盒伪造攻击。然而，现有方法主要依赖经验证据，缺乏对攻击成功或失败条件的严格理论理解。为弥补这一空白，我们从潜在空间的率失真理论角度重新审视此类攻击的性质。我们的分析识别出由于代理模型与目标模型之间的结构不匹配而导致的不可约失真底限，这从根本上限制了伪造水印的保真度。我们进一步将这种失真表征为潜在流形上的结构化几何偏差，表现为全局漂移和局部变形，而非随机噪声。利用这些见解，我们提出了一种方案无关的检测方法，能够在水印验证之前区分伪造样本。大量实验表明，我们的方法在各种黑盒场景下具有良好的有效性，同时保持了对常见失真的鲁棒性。

Objectives: To characterize residual false positives in prostate MRI detection, and to evaluate a lightweight post-hoc refinement head for case-level specificity. Materials and Methods: This retrospective study used PI-CAI (5-fold cross-validation) and Prostate158 (n=158; external). A context-aware evidence head and an 89,216-parameter refinement head were trained on a frozen detection backbone; the evidence head was also trained on four further backbones (bare nnU-Net, bare U-Net, bare Mamba, MIGF-Mamba). For each false-positive region, T2-weighted, apparent-diffusion-coefficient, and high-b-value contrast ratios versus peri-lesional rings were compared against ground-truth lesions and contralateral benign regions. Results: False positives were closer to true cancers than to benign tissue in evidence and raw T2-weighted and apparent-diffusion-coefficient contrast, reproducing 35/35 across five architectures (Cohen's d 1.10; FP/benign evidence ratio 2.38x) and 105/105 across modality-perturbation scenarios. On PI-CAI fold-0, refinement raised case-level specificity from 0.469 to 0.549 (+17.2%) at preserved sensitivity (0.943); 5-fold cross-validation showed fold-conditional behavior (9/15 observations positive; range -22% to +28%). On Prostate158, both models saturated (McNemar pooled p=0.69), while the false-positive contrast-matching finding replicated. Conclusion: Residual false positives are contrast-matched to cancer (sharing raw imaging features rather than histologically confirmed mimicry), reproducing across five architectures -- a data-level imaging property, not model-specific artifacts; post-hoc refinement adds practical specificity in-domain but is fold-conditional.

目的：表征前列腺MRI检测中的残留假阳性，并评估一种用于病例级特异性的轻量级后处理优化头。材料与方法：本回顾性研究使用PI-CAI（5折交叉验证）和Prostate158（n=158；外部验证）数据集。在冻结的检测骨干网络上训练了一个上下文感知证据头和一个参数为89,216的优化头；证据头还在四个其他骨干网络上进行了训练（基础nnU-Net、基础U-Net、基础Mamba、MIGF-Mamba）。对于每个假阳性区域，将其T2加权、表观扩散系数及高b值对比度与病灶周围环的比值与真实病灶及对侧良性区域进行对比。结果：假阳性在证据头以及原始T2加权和表观扩散系数对比度上与真实癌症的距离比良性组织更近，在五个架构中复现了35/35例（Cohen's d 1.10；假阳性/良性证据比值2.38倍），在模态扰动场景中复现了105/105例。在PI-CAI第0折，优化头将病例级特异性从0.469提升至0.549（+17.2%），同时保持敏感性（0.943）不变；5折交叉验证显示折条件性行为（15个观察中9个为阳性；范围-22%至+28%）。在Prostate158上，两个模型均达到饱和（McNemar合并p=0.69），而假阳性对比度匹配发现得以复现。结论：残留假阳性在对比度上与癌症匹配（共享原始成像特征而非组织学确认的模拟），在五个架构中复现——这是一种数据级成像属性，非模型特异性伪影；后处理优化在域内可增加实际特异性，但具有折条件性。

Aligning generative flow models on continuous spaces via online reinforcement learning is constrained by intractable trajectory likelihoods. Existing density-approximated policy gradient methods rely on stochastic SDE samplers to construct tractable transition kernels, which introduce training-inference inconsistencies and necessitates Classifier-Free Guidance (CFG). While implicit frameworks such as DiffusionNFT directly optimize forward-process velocity fields, its heuristic fixed-magnitude corrections prevent optimization strength from relative intra-group quality. We propose \textit{Flow Advantage-Weighted Rectification} (\textbf{FlowAWR}), a paradigm that recasts continuous generative policy optimization as supervised regression toward a theoretically optimal velocity field. Starting from the optimal policy of a KL-constrained reward maximization, FlowAWR derives the optimal velocity field that admits a magnitude-aware, advantage-weighted rectification form, yielding SDE-free optimization and CFG-free generation. In comparative evaluations on SD3.5-Medium, FlowAWR achieves improved alignment performance alongside a 2$\times$ to 5$\times$ convergence acceleration over DiffusionNFT (e.g., reaching a 24.12 PickScore in 1.2k steps, versus 23.82 in 2.0k steps for DiffusionNFT and 23.50 in $>$4k steps for FlowGRPO). Under multi-reward constraints, FlowAWR sustains generation quality, satisfying structural rules while maintaining stable out-of-domain performance.

通过在线强化学习对齐连续空间中的生成流模型受到难以计算的轨迹似然的约束。现有的密度近似策略梯度方法依赖于随机SDE采样器来构建可处理的转移核，这引入了训练-推理不一致性，并需要无分类器引导（CFG）。而诸如DiffusionNFT之类的隐式框架虽能直接优化前向过程速度场，但其启发式固定幅度校正无法实现组内相对质量的优化强度。我们提出了流优势加权矫正（FlowAWR），该范式将连续生成策略优化重新表述为对理论最优速度场的监督回归。FlowAWR从KL约束奖励最优策略出发，推导出一种幅度感知、优势加权的矫正形式的最优速度场，实现了无SDE优化和无CFG生成。在SD3.5-Medium上的对比评估中，FlowAWR取得了更优的对齐性能，同时相比DiffusionNFT实现了2倍至5倍的收敛加速（例如在1.2k步内达到24.12的PickScore，而DiffusionNFT在2.0k步内达到23.82，FlowGRPO在超过4k步内达到23.50）。在多奖励约束下，FlowAWR保持较高的生成质量，在满足结构规则的同时维持了稳定的域外性能。

Given the remarkable achievements in image generation through diffusion models, the research community has shown increasing interest in extending these models to video generation. Recent diffusion models for video generation have predominantly utilized attention layers to extract temporal features. However, attention layers are limited by their computational costs, which increase quadratically with the sequence length. This limitation presents significant challenges when generating longer video sequences using diffusion models. To overcome this challenge, we propose leveraging state-space models (SSMs) as temporal feature extractors. SSMs (e.g., Mamba) have recently gained attention as promising alternatives due to their linear-time memory consumption relative to sequence length. In line with previous research suggesting that using bidirectional SSMs is effective for understanding spatial features in image generation, we found that bidirectionality is also beneficial for capturing temporal features in video data, rather than relying on traditional unidirectional SSMs. We conducted comprehensive evaluations on multiple long-term video datasets, such as MineRL Navigate, across various model sizes. For sequences up to 256 frames, SSM-based models require less memory to achieve the same FVD as attention-based models. Moreover, SSM-based models often deliver better performance with comparable GPU memory usage. Our codes are available at https://github.com/shim0114/SSM-Meets-Video-Diffusion-Models.

鉴于扩散模型在图像生成领域取得的显著成就，研究界对将这些模型扩展到视频生成表现出越来越高的兴趣。近期用于视频生成的扩散模型主要利用注意力层来提取时间特征。然而，注意力层的计算成本随序列长度呈二次增长，这一局限性在生成长视频序列时面临重大挑战。为克服这一挑战，我们提出利用状态空间模型（SSM）作为时间特征提取器。SSM（例如Mamba）因其相对于序列长度的线性时间内存消耗而受到关注，作为有前景的替代方案逐渐兴起。与先前研究建议使用双向SSM理解图像生成中的空间特征相一致，我们发现双向性同样有利于捕捉视频数据中的时间特征，而非依赖传统的单向SSM。我们在多个长视频数据集（如MineRL Navigate）上针对不同模型规模进行了全面评估。对于长达256帧的序列，SSM模型在达到相同FVD（Fréchet视频距离）时所需的内存更少。此外，SSM模型在相近的GPU内存消耗下往往能提供更好的性能。我们的代码可访问https://github.com/shim0114/SSM-Meets-Video-Diffusion-Models。

We introduce Seed-to-Seed Translation (StS), a novel approach that combines GANs and diffusion models (DMs) for unpaired Image-to-Image Translation. Our approach is aimed at global translations of complex automotive scenes, where close adherence to the structure and semantics of the source image is essential. We demonstrate that the semantic information encoded in the space of inverted latents (seeds) of a pretrained DM, dubbed as the seed-space, can be used for discriminative tasks, and leverage this information to perform image-to-image translation. Our method involves training an sts-GAN, an unpaired seed-to-seed translation model, based on CycleGAN. The translated seeds are used as the starting point for the DM's sampling process, while structure preservation is ensured using a ControlNet. We demonstrate the effectiveness of our approach for structure-preserving translation of complex automotive scenes, showcasing superior performance compared to existing GAN-based and diffusion-based methods. In addition to advancing the SoTA in automotive scene translations, our approach offers a fresh perspective on leveraging the semantic information encoded within the seed-space of pretrained DMs for effective image editing and manipulation.

我们提出了一种名为种子到种子转换（Seed-to-Seed Translation，StS）的新方法，该方法将生成对抗网络（GAN）与扩散模型（Diffusion Model，DM）相结合，用于非配对图像到图像转换。我们的方法旨在实现复杂汽车场景的全局转换，同时严格保持源图像的结构和语义。我们证明，预训练DM的逆转潜在表示（种子）空间（即种子空间）中编码的语义信息可用于判别任务，并利用该信息执行图像到图像转换。我们的方法包括训练一个基于CycleGAN的非配对种子到种子转换模型（sts-GAN）。转换后的种子被用作DM采样过程的起点，同时使用ControlNet确保结构保持。我们验证了所提方法在复杂汽车场景结构保持转换中的有效性，在现有基于GAN和基于扩散的方法中展现出卓越性能。除了推进汽车场景转换的技术水平外，我们的方法还为利用预训练DM种子空间中编码的语义信息进行有效图像编辑和操作提供了全新视角。

Recent open-weight text-to-image (T2I) diffusion models still struggle with multi-instance prompts, often omitting or merging instances and mixing semantics among similar objects. We trace these failures to early denoising steps, before instance boundaries are reliably stabilized. Existing training-free guidance is largely driven by cross-attention or other token-conditioned semantic signals. Such guidance can separate concepts at the token level, but largely assumes that distinct instance regions have already emerged. In early denoising steps, it cannot reliably carve out these regions, so count failures and semantic mixing persist. By contrast, self-attention exposes class-agnostic instance layouts during early denoising. To exploit this asymmetry, we propose $\textbf{ISAC}$ ($\textbf{I}$nstance-to-$\textbf{S}$emantic $\textbf{A}$ttention $\textbf{C}$ontrol), a training-free, model-agnostic objective that first stabilizes self-attention layouts and then binds cross-attention semantics within them, without fine-tuning or external vision models. Across T2I-CompBench, HRS-Bench, and our newly curated IntraCompBench, ISAC consistently outperforms prior training-free methods. Furthermore, ISAC enhances layout-to-image controllers by refining coarse, overlapping bounding boxes into dense instance masks.

当前开源权重的文本到图像（T2I）扩散模型在处理多实例提示词时仍存在困难，经常遗漏或合并实例，并在相似物体间产生语义混淆。我们将这些问题追溯到早期去噪步骤，因为在此时实例边界尚未稳定。现有的无训练引导方法主要基于交叉注意力或其他token条件的语义信号。这类引导可以在token层面分离概念，但很大程度上假设不同的实例区域已经形成。在早期去噪步骤中，它无法可靠地划分这些区域，因此计数错误和语义混淆问题持续存在。相比之下，自注意力在早期去噪中会暴露与类别无关的实例布局。为利用这一不对称性，我们提出了ISAC（Instance-to-Semantic Attention Control，实例到语义注意力控制），这是一个无训练、模型无关的目标函数，首先稳定自注意力布局，然后将交叉注意力语义绑定到其中，无需微调或外部视觉模型。在T2I-CompBench、HRS-Bench以及我们新构建的IntraCompBench上，ISAC始终优于以往的无训练方法。此外，ISAC还能通过将粗略的重叠边界框精化为密集实例掩码来增强布局到图像控制器的性能。

We present Vivid-VR, a DiT-based generative video restoration method built upon an advanced T2V foundation model, where ControlNet is leveraged to control the generation process, ensuring content consistency. However, conventional fine-tuning of such controllable pipelines frequently suffers from distribution drift due to limitations in imperfect multimodal alignment, resulting in compromised texture realism and temporal coherence. To tackle this challenge, we propose a concept distillation training strategy that utilizes the pretrained T2V model to synthesize training samples with embedded textual concepts, thereby distilling its conceptual understanding to preserve texture and temporal quality. To enhance generation controllability, we redesign the control architecture with two key components: 1) a control feature projector that filters degradation artifacts from input video latents to minimize their propagation through the generation pipeline, and 2) a new ControlNet connector employing a dual-branch design. This connector synergistically combines MLP-based feature mapping with cross-attention mechanism for dynamic control feature retrieval, enabling both content preservation and adaptive control signal modulation. Extensive experiments show that Vivid-VR performs favorably against existing approaches on both synthetic and real-world benchmarks, as well as AIGC videos, achieving impressive texture realism, visual vividness, and temporal consistency. The codes and checkpoints are publicly available at https://github.com/csbhr/Vivid-VR.

我们提出了Vivid-VR，一种基于DiT的生成式视频修复方法，构建于先进的T2V基础模型之上，其中利用ControlNet控制生成过程，确保内容一致性。然而，此类可控管道的常规微调常因多模态对齐不完善而遭受分布漂移问题，导致纹理真实感和时间一致性受损。为解决这一挑战，我们提出了一种概念蒸馏训练策略，利用预训练的T2V模型合成嵌入文本概念的训练样本，从而将其概念理解能力蒸馏出来以保持纹理和时间质量。为增强生成可控性，我们重新设计了控制架构，包含两个关键组件：1）控制特征投影器，用于从输入视频潜码中过滤退化伪影，以最大程度减少其在生成管道中的传播；2）采用双分支设计的新型ControlNet连接器。该连接器协同结合基于MLP的特征映射与交叉注意力机制，实现动态控制特征检索，同时支持内容保持和自适应控制信号调制。大量实验表明，Vivid-VR在合成和真实世界基准测试以及AIGC视频上均优于现有方法，实现了令人印象深刻的纹理真实感、视觉生动性和时间一致性。代码和模型权重已在https://github.com/csbhr/Vivid-VR公开提供。

Tokenizers are a key component of state-of-the-art generative image models, extracting the most important features from the signal while reducing data dimension and redundancy. Most current tokenizers are based on KL-regularized variational autoencoders (KL-VAE), trained with reconstruction, perceptual and adversarial losses. Diffusion decoders have been proposed as a more principled alternative to model the distribution over images conditioned on the latent. However, matching the performance of KL-VAE still requires adversarial losses, as well as a higher decoding time due to iterative sampling. To address these limitations, we introduce a new pixel diffusion decoder architecture for improved scaling and training stability, benefiting from transformer components and GAN-free training. We use distillation to replicate the performance of the diffusion decoder in an efficient single-step decoder. This makes SSDD the first diffusion decoder optimized for single-step reconstruction trained without adversarial losses, reaching higher reconstruction quality and faster sampling than KL-VAE. In particular, SSDD improves reconstruction FID from $0.87$ to $0.46$ with $1.4\times$ higher throughput and preserve generation quality of DiTs with $3.8\times$ faster sampling. As such, SSDD can be used as a drop-in replacement for KL-VAE, and for building higher-quality and faster generative models.

分词器是最先进的生成式图像模型的关键组件，能够从信号中提取最重要的特征，同时降低数据维度和冗余度。当前大多数分词器基于KL正则化变分自编码器（KL-VAE），采用重建损失、感知损失和对抗损失进行训练。扩散解码器作为一种更具原则性的替代方案被提出，用于对以潜在表示为条件的图像分布进行建模。然而，要匹配KL-VAE的性能仍然需要对抗损失，并且由于迭代采样导致解码时间较长。为解决这些局限性，我们引入了一种新的像素扩散解码器架构，以提高可扩展性和训练稳定性，得益于Transformer组件和无GAN训练。我们通过蒸馏将扩散解码器的性能复制到高效的单步解码器中。这使得SSDD成为首个针对单步重建进行优化的扩散解码器，无需对抗损失即可训练，达到比KL-VAE更高的重建质量和更快的采样速度。具体而言，SSDD将重建FID从0.87提升至0.46，吞吐量提高1.4倍，并保持DiTs的生成质量，采样速度提升3.8倍。因此，SSDD可以作为KL-VAE的即插即用替代品，用于构建更高质量、更快的生成模型。

Ultra-high-resolution text-to-image generation is increasingly vital for applications requiring fine-grained textures and global structural fidelity, yet state-of-the-art text-to-image diffusion models such as FLUX and SD3 remain confined to sub 2MP (< $1K\times2K$) resolutions due to the quadratic complexity of attention mechanisms and the scarcity of high-quality high-resolution training data. We present UltraImageGen, a novel framework that introduces hierarchical local attention with low-resolution global guidance, enabling efficient, scalable, and semantically coherent image synthesis at ultra-high resolutions. Specifically, high-resolution latents are divided into hardware aligned fixed-size local windows to reduce attention complexity from quadratic to near-linear, while a low-resolution latent equipped with scaled positional embeddings injects global semantics as an anchor. A lightweight LoRA adaptation bridges global and local pathways during denoising, ensuring consistency across structure and detail. To maximize inference efficiency and achieve scalable ultra-high-resolution generation, we repermute token sequence in window-first order, so that the GPU-friendly dense local blocks in attention calculation equals to the fixed-size local window in 2D regardless of resolution. Together ourwork reliably scales the pretrained model to resolutions higher than $8K$ with more than $10\times$ speed up and significantly lower memory usage. Extensive experiments demonstrate that ourwork achieves superior quality while maintaining computational efficiency, establishing a practical paradigm for advancing ultra-high-resolution image generation.

超高清文本到图像生成对于需要细粒度纹理和全局结构保真的应用越来越重要，然而目前最先进的文本到图像扩散模型（如FLUX和SD3）仍受限于200万像素以下（<1K×2K）的分辨率，原因在于注意力机制的二次复杂度以及高质量高分辨率训练数据的匮乏。我们提出了UltraImageGen，这是一个新颖的框架，引入了一种低分辨率全局引导的分层局部注意力机制，能够在超高分辨率下实现高效、可扩展且语义一致的图像合成。具体而言，高分辨率潜在特征被划分为硬件对齐的固定大小局部窗口，将注意力复杂度从二次降低到近线性，而配备缩放位置嵌入的低分辨率潜在特征则作为锚点注入全局语义。一个轻量级的LoRA适配器在去噪过程中桥接全局和局部路径，确保结构和细节的一致性。为了最大化推理效率并实现可扩展的超高清分辨率生成，我们将token序列按窗口优先顺序重排，使得注意力计算中GPU友好的密集局部块在二维空间中与固定大小的局部窗口相同，而与分辨率无关。综上，我们的工作能够将预训练模型可靠地扩展到8K以上的分辨率，实现超过10倍的加速并显著降低内存消耗。大量实验表明，我们的工作在保持计算效率的同时实现了卓越的质量，为推进超高清图像生成建立了实用的范式。

Generative image compression has recently shown impressive perceptual quality, but often suffers from semantic inconsistency at ultra-low bitrates (bpp < 0.05), limiting its reliable deployment in bandwidth-constrained scenarios such as 6G semantic communications. This inconsistency stems from incomplete guidance information, which introduces semantic ambiguity into the generation process and may lead to natural-looking but source-inconsistent content. In this work, we propose a Semantic-Disambiguation-Guided Generative Image Compression (SDGIC) framework to constrain diffusion-based reconstruction at ultra-low bitrates. Specifically, SDGIC compresses the source image into three compact and complementary guidance streams: a concise text caption for global semantics, a highly compressed image (HCI) for dense visual evidence, and Reconstruction-Aware Semantic Residual Tokens (RSRTs) for reconstruction-relevant residual semantics that remain ambiguous under the text caption and HCI conditions. The RSRTs are directly optimized toward the downstream denoising objective, enabling them to provide source-specific semantic constraints for disambiguating diffusion-based reconstruction. To inject these three guidance streams into the generation process effectively, we design a Dual-Path Conditioned Diffusion Decoder (DPCD), which uses cross-attention for semantic conditions and ControlNet residuals for dense visual guidance. Extensive experiments demonstrate that SDGIC improves semantic consistency at ultra-low bitrates while maintaining favorable perceptual quality, with a 23.4% reduction in AFINE on the CLIC2020 dataset.

生成式图像压缩近期在感知质量方面展现出优异性能，但在超低码率（bpp < 0.05）下常遭受语义不一致问题，这限制了其在6G语义通信等带宽受限场景中的可靠部署。这种不一致源于不完整的引导信息，其在生成过程中引入了语义歧义，可能导致内容看起来自然但与源图像不一致。本工作提出了一种语义消歧引导的生成式图像压缩（SDGIC）框架，以在超低码率下约束基于扩散的重建过程。具体而言，SDGIC将源图像压缩为三个紧凑且互补的引导流：用于全局语义的简洁文本描述、用于密集视觉证据的高度压缩图像（HCI），以及用于在文本描述和HCI条件下仍存在歧义的重建相关残差语义的重建感知语义残差 tokens（RSRTs）。RSRTs直接针对下游去噪目标进行优化，使其能够提供针对源的语义约束，以消歧基于扩散的重建过程。为了有效将这三种引导流注入生成过程，我们设计了双路径条件扩散解码器（DPCD），该解码器使用交叉注意力处理语义条件，并使用ControlNet残差进行密集视觉引导。大量实验表明，SDGIC在超低码率下提升了语义一致性，同时保持了良好的感知质量，在CLIC2020数据集上实现了AFINE降低23.4%。

Most visual generative models compress images into a latent space before applying diffusion or autoregressive modelling. Yet, existing approaches such as VAEs and foundation model aligned encoders implicitly constrain the latent space without explicitly shaping its distribution, making it unclear which types of distributions are optimal for modeling. We introduce \textbf{Distribution-Matching VAE} (\textbf{DMVAE}), which explicitly aligns the encoder's latent distribution with an arbitrary reference distribution via a distribution matching constraint. This generalizes beyond the Gaussian prior of conventional VAEs, enabling alignment with distributions derived from self-supervised features, diffusion noise, or other prior distributions. With DMVAE, we can systematically investigate which latent distributions are more conducive to modeling, and we find that SSL-derived distributions provide an excellent balance between reconstruction fidelity and modeling efficiency, reaching gFID equals 3.2 on ImageNet with only 64 training epochs. Our results suggest that choosing a suitable latent distribution structure (achieved via distribution-level alignment), rather than relying on fixed priors, is key to bridging the gap between easy-to-model latents and high-fidelity image synthesis. Code is avaliable at https://github.com/sen-ye/dmvae.

大多数视觉生成模型在应用扩散或自回归建模之前，将图像压缩到潜在空间。然而，现有方法如VAE和基础模型对齐编码器隐式约束潜在空间，而没有明确塑造其分布，使得哪种类型的分布最适合建模尚不清楚。我们引入分布匹配变分自编码器（DMVAE），通过分布匹配约束将编码器的潜在分布与任意参考分布明确对齐。这推广了传统VAE的高斯先验，能够与来自自监督特征、扩散噪声或其他先验分布的分布进行对齐。使用DMVAE，我们可以系统地研究哪些潜在分布更有利于建模，并发现自监督学习衍生的分布在重建保真度和建模效率之间提供了极好的平衡，在ImageNet上仅用64个训练周期就达到了gFID等于3.2。我们的结果表明，选择合适的潜在分布结构（通过分布级对齐实现）而不是依赖固定先验，是弥合易于建模的潜在变量与高保真图像合成之间差距的关键。代码可从https://github.com/sen-ye/dmvae获取。

Conditional diffusion models frequently suffer from language-image misalignments. Due to the ambiguity of intermediate noise corrupted latents, assessing prompt adherence currently requires completing the entire sampling trajectory. This late-stage evaluation incurs even higher computational costs during test-time scaling strategies, such as Best-of-N (BoN) sampling, as all misaligned trajectories must finish generation before being discarded. To tackle this, we propose NoisyCLIP, a noise-aware twin-tower model that enables early language-to-latent alignment estimation. By learning a vision encoder on noise-corrupted latents, we allow the model to "see" through the ambiguity of intermediate diffusion steps. To facilitate this training, we investigate noise-data augmentation sampling strategies and introduce two new benchmark datasets: Noisy-Conceptual-Captions and Noisy-GenAI-Bench. When applied as an early-stopping criterion for BoN, NoisyCLIP at half cost matches or beats frozen CLIP at full cost. Ultimately, this transforms alignment assessment from an expensive final check into a continuous monitoring tool, drastically reducing compute costs without sacrificing semantic fidelity.

条件扩散模型经常遭受语言-图像不对齐问题。由于中间噪声损坏的潜在表示具有模糊性，评估提示词遵循目前需要完成整个采样轨迹。这种后期评估在测试时扩展策略（如Best-of-N采样）中会产生更高的计算成本，因为所有不对齐的轨迹必须在被丢弃之前完成生成。为了解决这个问题，我们提出了NoisyCLIP，这是一种噪声感知的双塔模型，能够实现早期语言到潜在对齐的估计。通过在学习噪声损坏潜在表示上训练视觉编码器，我们使模型能够“看穿”中间扩散步骤的模糊性。为了促进这一训练，我们研究了噪声数据增强采样策略，并引入了两个新的基准数据集：Noisy-Conceptual-Captions和Noisy-GenAI-Bench。当应用于Best-of-N采样的早停标准时，成本仅为一半的NoisyCLIP可达到或优于全成本冻结CLIP的性能。最终，这将对齐评估从昂贵的最终检查转变为连续监控工具，在不牺牲语义保真度的情况下大幅降低计算成本。

We present a framework for document-centric background generation with multi-page editing and thematic continuity. To ensure text regions remain readable, we employ a latent masking formulation that softly attenuates updates in the diffusion space, inspired by smooth barrier functions in physics and numerical optimization. In addition, we introduce Automated Readability Optimization (ARO), which automatically places semi-transparent, rounded backing shapes behind text regions. ARO determines the minimal opacity needed to satisfy perceptual contrast standards (WCAG 2.2) relative to the underlying background, ensuring readability while maintaining aesthetic harmony without human intervention. Multi-page consistency is maintained through a summarization-and-instruction process, where each page is distilled into a compact representation that recursively guides subsequent generations. This design reflects how humans build continuity by retaining prior context, ensuring that visual motifs evolve coherently across an entire document. Our method further treats a document as a structured composition in which text, figures, and backgrounds are preserved or regenerated as separate layers, allowing targeted background editing without compromising readability. Finally, user-provided prompts allow stylistic adjustments in color and texture, balancing automated consistency with flexible customization. Our training-free framework produces visually coherent, text-preserving, and thematically aligned documents, bridging generative modeling with natural design workflows.

我们提出了一个以文档为中心的背景生成框架，支持多页编辑和主题连续性。为确保文本区域保持可读性，我们采用了一种潜空间掩码方法，在扩散空间中对更新进行软性衰减，其灵感来源于物理学和数值优化中的光滑障碍函数。此外，我们引入了自动可读性优化（ARO）技术，该技术自动在文本区域后方放置半透明的圆角背景形状。ARO根据感知对比度标准（WCAG 2.2）确定满足可读性所需的最小不透明度，确保在无需人工干预的情况下保持可读性与美学协调。多页一致性通过总结与指导过程来维护，每一页都被提炼为紧凑的表示形式，用于递归引导后续页面的生成。这一设计反映了人类通过保留先验上下文来构建连续性的方式，确保视觉元素在整个文档中连贯演变。我们的方法还将文档视为结构化组合，文本、图形和背景作为独立图层被保留或重新生成，从而实现有针对性的背景编辑而不影响可读性。最后，用户提供的提示允许在颜色和纹理方面进行风格调整，在自动一致性与灵活定制之间取得平衡。我们的无需训练框架可生成视觉连贯、保留文本且主题对齐的文档，将生成式建模与自然设计工作流程相结合。

Recent advances in diffusion models have enabled impressive video editing capabilities, yet production-grade Video Object Insertion (VOI) remains challenging due to inadequate 4D scene understanding and a lack of proper optical interactions, such as shadows and reflections. To address these limitations, we present InsertAnywhere, a comprehensive VOI framework that achieves geometrically grounded object placement and optics-aware video synthesis. Our approach first leverages a 4D-aware mask generation module that allows users to anchor an object&#x27;s 3D pose in a single frame. The framework automatically propagates this placement across the video, accurately handling local scene dynamics and occlusions. To synthesize realistic physical lighting interactions, we introduce Optics-Aware Representation Alignment, a novel strategy that utilizes an extended mask to guide feature extraction, enabling optical effects to seamlessly extend beyond the inserted object&x27;s boundary. Finally, to overcome the lack of training data for such phenomena, we construct and open-source ROSE++, a specialized quadruplet dataset tailored for the supervised learning of optical effects. Extensive experiments demonstrate that InsertAnywhere produces geometrically plausible and photometrically realistic insertions in complex real-world scenarios, significantly outperforming existing research and commercial generative tools.

扩散模型的最新进展实现了令人印象深刻的视频编辑能力，然而由于4D场景理解不足以及缺乏适当的光学交互（如阴影和反射），生产级视频物体插入（VOI）仍然具有挑战性。为解决这些局限性，我们提出了InsertAnywhere，这是一个综合性的VOI框架，实现了几何锚定的物体放置和光学感知的视频合成。我们的方法首先利用4D感知掩码生成模块，允许用户在单帧中锚定物体的3D姿态。该框架自动将这一放置传播到整个视频中，准确处理局部场景动态和遮挡。为了合成逼真的物理光照交互，我们引入了光学感知表示对齐，这是一种利用扩展掩码引导特征提取的新策略，使光学效果能够无缝延伸至插入物体的边界之外。最后，为了克服此类现象训练数据匮乏的问题，我们构建并开源了ROSE++，这是一个专门为光学效果监督学习设计的四元组数据集。大量实验表明，InsertAnywhere在复杂的现实场景中能够产生几何上合理且光度上逼真的物体插入，显著优于现有的研究方法和商业生成工具。

Despite achieving strong results on standard benchmarks, current point tracking methods rely on feature backbones that are rarely designed with the temporal coherence needed for robust real-world performance. While recent works incorporate powerful visual foundation model (VFM) features into tracking pipelines, no prior work has systematically analyzed which VFM provides the most robust representations for point tracking. We present the first such analysis, evaluating diverse VFMs in a zero-shot setting on both standard and robustness benchmarks for point tracking. Our study reveals that video diffusion transformers (DiTs) consistently yield the most temporally coherent and discriminative features, even surpassing ResNet backbones explicitly supervised on tracking data. We hypothesize this advantage stem from large-scale video pretraining, full 3D spatio-temporal attention, and a diffusion training objective. Motivated by this finding, we propose DiTracker, which integrates video DiT features into existing tracking frameworks through query-key matching cost computation, cost-level fusion with a lightweight ResNet branch, and LoRA adaptation. Under the same tracking head, DiTracker is trained solely on synthetic data with far fewer iterations, yet outperforms CoTracker3 trained with additional real-world videos, with the largest gains under challenging and corrupted scenarios. It further generalizes across tracking heads and scales with backbone size, confirming that generative video pretraining provides real-world priors that reduce the dependence on large-scale real-data supervision.

尽管在标准基准上取得了优异成绩，但当前点跟踪方法所依赖的特征骨干网络很少针对鲁棒的现实世界性能所需的时间一致性进行专门设计。虽然近期工作将强大的视觉基础模型（VFM）特征融入跟踪流程，但此前尚无研究系统分析哪种VFM能为点跟踪提供最鲁棒的特征表示。我们开展了首个此类分析，在点跟踪的标准基准和鲁棒性基准上以零样本方式评估了多种VFM。我们的研究表明，视频扩散变换器（DiT）始终产生最具时间一致性和判别性的特征，甚至超越了专门在跟踪数据上监督训练的ResNet骨干网络。我们假设这一优势来源于大规模视频预训练、完整的3D时空注意力机制以及扩散训练目标。基于这一发现，我们提出了DiTracker，该方法通过查询-键匹配代价计算、代价级融合轻量级ResNet分支以及LoRA适配，将视频DiT特征集成到现有跟踪框架中。在相同的跟踪头下，DiTracker仅使用合成数据进行训练，且迭代次数少得多，但性能却优于使用额外真实视频训练的CoTracker3，在具有挑战性和数据损坏场景下提升尤为显著。它还能跨跟踪头泛化，并随骨干网络规模扩展，证实了生成式视频预训练提供的现实世界先验知识减少了对大规模真实数据监督的依赖。

The slow iterative sampling nature remains a major bottleneck for the practical deployment of diffusion and flow-based generative models. While consistency models (CMs) represent a state-of-the-art distillation-based approach for efficient generation, their large-scale application is still limited by two key issues: training instability and inflexible sampling. Existing methods seek to mitigate these problems through architectural adjustments or regularized objectives, yet overlook the critical reliance on trajectory selection. In this work, we first conduct an analysis on these two limitations: training instability originates from loss divergence induced by unstable self-supervised term, whereas sampling inflexibility arises from error accumulation. Based on these insights and analysis, we propose the Dual-End Consistency Model (DE-CM) that selects vital sub-trajectory clusters to achieve stable and effective training. DE-CM decomposes the PF-ODE trajectory and selects three critical sub-trajectories as optimization targets. Specifically, our approach leverages continuous-time CMs objectives to achieve few-step distillation and utilizes flow matching as a boundary regularizer to stabilize the training process. Furthermore, we propose a novel noise-to-noisy (N2N) mapping that can map noise to any point, thereby alleviating the error accumulation in the first step. Extensive experimental results show the effectiveness of our method: it achieves a state-of-the-art FID score of 1.70 in one-step generation on the ImageNet 256x256 dataset, outperforming existing CM-based one-step approaches.

缓慢的迭代采样过程仍是扩散模型和流匹配生成模型实际部署的主要瓶颈。尽管一致性模型（CMs）代表了当前最先进的基于蒸馏的高效生成方法，但其大规模应用仍受两个关键问题制约：训练不稳定和采样不灵活。现有方法试图通过架构调整或正则化目标来缓解这些问题，但忽略了轨迹选择的关键依赖性。本工作首先对这两个局限性进行了分析：训练不稳定源于不稳定自监督项导致的损失发散，而采样不灵活则源于误差累积。基于这些洞察和分析，我们提出了双端一致性模型（DE-CM），通过选择关键的子轨迹簇来实现稳定有效的训练。DE-CM对概率流常微分方程（PF-ODE）轨迹进行分解，并选取三个关键子轨迹作为优化目标。具体而言，我们的方法利用连续时间一致性模型目标实现少步蒸馏，并采用流匹配作为边界正则化器来稳定训练过程。此外，我们提出了一种新颖的噪声到噪声（N2N）映射方法，可以将噪声映射到任意点，从而缓解首步的误差累积。大量实验结果表明了我们方法的有效性：在ImageNet 256x256数据集上的一步生成中，实现了1.70的最先进FID分数，优于现有的基于一致性模型的一步生成方法。

World models based on video generation demonstrate remarkable potential for simulating interactive environments yet suffer from persistent difficulties in two key areas: maintaining long-term content consistency when scenes are revisited and enabling precise camera control from user-specified inputs. Existing methods based on explicit 3D reconstruction often compromise flexibility in unbounded scenarios and struggle to preserve fine-grained structures. Alternative methods rely directly on previously generated frames without establishing explicit spatial correspondence, thereby limiting controllability and consistency. To address these limitations, we present UCM, a novel framework for unified modeling of long-term memory and precise camera control via a time-aware positional encoding warping mechanism. To reduce computational overhead, we design an efficient dual-stream diffusion transformer for high-fidelity generation. Moreover, we introduce a scalable data curation strategy that utilizes point-cloud-based rendering to simulate scene revisiting, enabling training on over 500K monocular videos. Extensive experiments on real-world and synthetic benchmarks demonstrate that UCM significantly outperforms state-of-the-art methods on long-term scene consistency, while achieving precise camera controllability in high-fidelity video generation.

基于视频生成的世界模型在模拟交互环境方面展现出巨大潜力，但在两个关键方面仍面临持续挑战：场景重访时保持长期内容一致性，以及根据用户指定输入实现精确相机控制。现有的显式3D重建方法在无界场景中往往牺牲了灵活性，且难以保留细粒度结构。替代方法则直接依赖先前生成的帧而未建立显式的空间对应关系，从而限制了可控性和一致性。为解决这些局限性，我们提出了UCM，这是一个通过时间感知位置编码扭曲机制统一建模长期记忆与精确相机控制的新颖框架。为降低计算开销，我们设计了一个高效的双流扩散变换器用于高保真生成。此外，我们引入了一种可扩展的数据整理策略，利用基于点云的渲染模拟场景重访，从而能够在超过50万段单目视频上进行训练。在真实世界和合成基准数据集上的广泛实验表明，UCM在长期场景一致性方面显著优于最先进的方法，同时在高保真视频生成中实现了精确的相机可控性。

We introduce TerraDiT, a diffusion transformer designed for text-to-satellite image generation with point-based control. Existing controlled satellite image generative models often require pixel-level maps that are time-consuming to acquire, yet semantically limited. To address this limitation, we introduce a novel point-based conditioning framework that controls the generation process through the spatial location of the points and the textual description associated with each point, providing semantically rich control signals. This approach enables flexible, annotation-friendly, and computationally simple inference for satellite image generation. To this end, we introduce an adaptive local attention mechanism that effectively regularizes the attention scores based on the input point queries. We systematically evaluate various domain-specific design choices for training TerraDiT, including the selection of satellite image representation for alignment and geolocation representation for conditioning. Our experiments demonstrate that TerraDiT achieves impressive generation performance, surpassing the state-of-the-art remote sensing generative models. Our models, dataset, and code are available at https://github.com/mvrl/TerraDiT.

我们提出了TerraDiT，一个用于文本到卫星图像生成的扩散变换器，支持基于点的控制。现有的受控卫星图像生成模型通常需要耗时获取的像素级地图，且语义表达能力有限。为解决这一局限性，我们引入了一种新颖的点条件框架，通过点的空间位置和与每个点关联的文本描述来控制生成过程，提供语义丰富的控制信号。该方法实现了灵活、标注友好且计算简单的卫星图像生成推理。为此，我们引入了一种自适应局部注意力机制，基于输入点查询有效正则化注意力分数。我们系统评估了训练TerraDiT的各种领域特定设计选择，包括用于对齐的卫星图像表示和用于条件的地理定位表示。我们的实验表明，TerraDiT取得了优异的生成性能，超越了最先进的遥感生成模型。我们的模型、数据集和代码可访问 https://github.com/mvrl/TerraDiT。

Leveraging the priors of 2D diffusion models for 3D editing has emerged as a promising paradigm. However, multi-view consistency remains challenging in edited results, and the extreme scarcity of paired 3D-consistent editing data makes supervised fine-tuning (SFT) impractical, despite its effectiveness for editing tasks. In this paper, we observe that, while generating multi-view consistent 3D content is highly challenging, verifying 3D consistency is tractable, naturally positioning reinforcement learning (RL) as a feasible solution. Motivated by this, we propose RL3DEdit, a single-pass framework driven by RL optimization with novel rewards derived from the 3D foundation model, VGGT. Specifically, we leverage VGGT's robust priors learned from massive real-world data, feed the edited images into it, and utilize the output confidence maps and pose estimation errors as reward signals, effectively anchoring the 2D editing priors onto a 3D-consistent manifold via RL. Extensive experiments demonstrate that RL3DEdit achieves stable multi-view consistency and outperforms state-of-the-art methods in editing quality with high efficiency. To promote the development of 3D editing, we will release the code and model.

利用2D扩散模型的先验知识进行3D编辑已成为一个有前景的研究范式。然而，多视角一致性在编辑结果中仍然难以保证，且成对的3D一致编辑数据极度稀缺，使得监督微调（SFT）虽在编辑任务中有效，却难以实际应用。本文中我们观察到，尽管生成多视角一致的3D内容非常困难，但验证3D一致性是可行的，这使强化学习（RL）成为一个可行的解决方案。基于此，我们提出了RL3DEdit，这是一个由RL优化驱动的单次框架，其奖励信号来源于3D基础模型VGGT。具体而言，我们利用VGGT从海量真实世界数据中学习到的鲁棒先验，将编辑后的图像输入VGGT，并利用输出的置信度图和姿态估计误差作为奖励信号，通过RL将2D编辑先验有效锚定到3D一致性流形上。大量实验表明，RL3DEdit实现了稳定的多视角一致性，并在编辑质量和效率方面优于现有最先进的方法。为推动3D编辑领域的发展，我们将公开代码和模型。

Diffusion Transformers (DiTs) are a dominant backbone for high-fidelity text-to-image generation due to strong scalability and alignment at high resolutions. However, quadratic self-attention over dense spatial tokens leads to high inference latency and limits deployment. We observe that denoising is spatially non-uniform with respect to aesthetic descriptors in the prompt. Regions associated with aesthetic tokens receive concentrated cross-attention and show larger temporal variation, while low-affinity regions evolve smoothly with redundant computation. Based on this insight, we propose AccelAes, a training-free framework that accelerates DiTs through aesthetics-aware spatio-temporal reduction while improving perceptual aesthetics. AccelAes builds AesMask, a one-shot aesthetic focus mask derived from prompt semantics and cross-attention signals. When localized computation is feasible, SkipSparse reallocates computation and guidance to masked regions. We further reduce temporal redundancy using a lightweight step-level prediction cache that periodically replaces full Transformer evaluations. Experiments on representative DiT families show consistent acceleration and improved aesthetics-oriented quality. On Lumina-Next, AccelAes achieves a 2.11$\times$ speedup and improves ImageReward by +11.9% over the dense baseline. Code is available at https://github.com/xuanhuayin/AccelAes.

扩散Transformer（DiT）因其强大的可扩展性和高分辨率对齐能力，已成为高保真文本到图像生成的主流骨干网络。然而，对密集空间token的二次方自注意力导致高推理延迟，限制了部署应用。我们观察到，去噪过程在prompt中的美学描述符方面呈现空间非均匀性：与美学token相关的区域接收集中的交叉注意力并表现出更大的时间变化，而低亲和力区域则平稳演变，存在冗余计算。基于这一洞察，我们提出了AccelAes，一个无需训练的框架，通过美学感知的时空约简来加速DiTs，同时提升感知美学质量。AccelAes构建了AesMask，这是一种从prompt语义和交叉注意力信号中派生的一次性美学聚焦掩码。当局部计算可行时，SkipSparse将计算资源和引导重新分配到掩码区域。我们进一步使用轻量级的步长级预测缓存来减少时间冗余，该缓存定期替代完整的Transformer评估。在代表性DiT家族上的实验表明，AccelAes实现了一致的加速效果和提升的美学导向质量。在Lumina-Next上，AccelAes实现了2.11倍加速，并在ImageReward上比密集基线提升了11.9%。代码已开源于 https://github.com/xuanhuayin/AccelAes。

Text-guided 3D motion editing has seen success in single-person scenarios, but its extension to multi-person settings is less explored due to limited paired data and the complexity of inter-person interactions. We introduce the task of multi-person 3D motion editing, where a target motion is generated from a source and a text instruction. To support this, we propose InterEdit3D, a new dataset with manual two-person motion change annotations, and a Text-guided Multi-human Motion Editing (TMME) benchmark. We present InterEdit, a synchronized classifier-free conditional diffusion model for TMME. It introduces Semantic-Aware Plan Token Alignment with learnable tokens to capture high-level interaction cues and an Interaction-Aware Frequency Token Alignment strategy using DCT and energy pooling to model periodic motion dynamics. Experiments show that InterEdit improves text-to-motion consistency and edit fidelity, achieving state-of-the-art TMME performance. The dataset and code will be released at https://github.com/YNG916/InterEdit.

文本引导的三维动作编辑在单人场景中取得了成功，但由于缺乏成对数据以及人际交互的复杂性，其在多人场景中的扩展尚未得到充分探索。我们提出了多人三维动作编辑任务，即根据源动作和文本指令生成目标动作。为此，我们构建了InterEdit3D数据集，包含双人动作修改的人工标注，并设计了文本引导多人动作编辑（TMME）基准。我们提出了InterEdit，一种用于TMME的同步无分类器条件扩散模型。该方法引入语义感知规划标记对齐（Semantic-Aware Plan Token Alignment）机制，通过可学习标记捕捉高级交互线索，并采用基于离散余弦变换和能量池化的交互感知频率标记对齐策略（Interaction-Aware Frequency Token Alignment）来建模周期性运动动力学。实验表明，InterEdit提升了文本-动作一致性和编辑保真度，实现了TMME任务的当前最优性能。数据集和代码将发布于https://github.com/YNG916/InterEdit。

We present AHOY, a method for reconstructing complete, animatable 3D Gaussian avatars from in-the-wild monocular video despite heavy occlusion. Existing methods assume unoccluded input-a fully visible subject, often in a canonical pose-excluding the vast majority of real-world footage where people are routinely occluded by furniture, objects, or other people. Reconstructing from such footage poses fundamental challenges: large body regions may never be observed, and multi-view supervision per pose is unavailable. We address these challenges with four contributions: (i) a hallucination-as-supervision pipeline that uses identity-finetuned diffusion models to generate dense supervision for previously unobserved body regions; (ii) a two-stage canonical-to-pose-dependent architecture that bootstraps from sparse observations to full pose-dependent Gaussian maps; (iii) a map-pose/LBS-pose decoupling that absorbs multi-view inconsistencies from the generated data; (iv) a head/body split supervision strategy that preserves facial identity. We evaluate on YouTube videos and on multi-view capture data with significant occlusion and demonstrate state-of-the-art reconstruction quality. We also demonstrate that the resulting avatars are robust enough to be animated with novel poses and composited into 3DGS scenes captured using cell-phone video. Our project page is available at https://miraymen.github.io/ahoy/

我们提出了AHOY方法，用于从野外单目视频中重建完整、可动画化的3D Gaussianavatar，即使在严重遮挡情况下也能工作。现有方法假设输入无遮挡——即完全可见的主体，通常处于规范姿势——这排除了现实生活中人们经常被家具、物体或其他人遮挡的绝大多数 footage。从此类 footage 重建带来了根本性挑战：大量身体区域可能从未被观察到，且每个姿势没有多视角监督。我们通过四个贡献来解决这些挑战：(i) 幻觉-作为-监督管道，使用身份微调的扩散模型为之前未观察到的身体区域生成密集监督；(ii) 双阶段规范到姿势依赖架构，从稀疏观测自举到完整的姿势依赖高斯图；(iii) map-pose/LBS-pose 解耦，吸收生成数据中的多视角不一致；(iv) 头/身分离监督策略，保持面部身份。我们在YouTube视频和具有显著遮挡的多视角捕获数据上进行评估，并展示了最先进的重建质量。我们还证明，结果的 avatar 足够鲁棒，可以由新姿势动画化，并合成到使用手机视频捕获的3DGS场景中。项目页面见 https://miraymen.github.io/ahoy/

Reference-to-video (R2V) generation is a controllable video synthesis paradigm that constrains the generation process using both text prompts and reference images, enabling applications such as personalized advertising and virtual try-on. In practice, existing R2V methods typically introduce additional high-level semantic or cross-modal features alongside the VAE latent representation of the reference image and jointly feed them into the diffusion Transformer (DiT). These auxiliary representations provide semantic guidance and act as implicit alignment signals, which can partially alleviate pixel-level information leakage in the VAE latent space. However, they may still struggle to address copy--paste artifacts and multi-subject confusion caused by modality mismatch across heterogeneous encoder features. In this paper, we propose RefAlign, a representation alignment framework that explicitly aligns DiT reference-branch features to the semantic space of a visual foundation model (VFM). The core of RefAlign is a reference alignment loss that pulls the reference features and VFM features of the same subject closer to improve identity consistency, while pushing apart the corresponding features of different subjects to enhance semantic discriminability. This simple yet effective strategy is applied only during training, incurring no inference-time overhead, and achieves a better balance between text controllability and reference fidelity. Extensive experiments on the OpenS2V-Eval benchmark demonstrate that RefAlign outperforms current state-of-the-art methods in TotalScore, validating the effectiveness of explicit reference alignment for R2V tasks.

参考图像到视频（Reference-to-Video, R2V）生成是一种可控视频合成范式，它通过文本提示和参考图像同时约束生成过程，可应用于个性化广告和虚拟试穿等领域。实际应用中，现有的R2V方法通常在参考图像的VAE潜在表征基础上引入额外的高层语义或跨模态特征，并将其联合输入扩散Transformer（DiT）。这些辅助表征提供语义指导并作为隐式对齐信号，可在一定程度上缓解VAE潜在空间中的像素级信息泄露问题。然而，它们可能仍难以解决由异构编码器特征之间的模态不匹配所导致的复制粘贴伪影和多主体混淆问题。本文提出RefAlign，一种显式将DiT参考分支特征对齐到视觉基础模型（Visual Foundation Model, VFM）语义空间的表征对齐框架。RefAlign的核心是参考对齐损失，它将同一主体的参考特征和VFM特征拉近以提升身份一致性，同时将不同主体的对应特征推远以增强语义可辨别性。这种简单有效的策略仅在训练阶段采用，不引入推理时的计算开销，并在文本可控性和参考保真度之间实现了更好的平衡。在OpenS2V-Eval基准上的大量实验表明，RefAlign在TotalScore指标上优于当前最先进的方法，验证了显式参考对齐对R2V任务的有效性。

Autoregressive (AR)-Diffusion hybrid paradigms combine AR&#x27;s structured semantic modeling with diffusion&x27;s high-fidelity synthesis, yet suffer from a dual speed bottleneck: the sequential AR stage and the iterative multi-step denoising of the diffusion vision decode stage. Existing methods address each in isolation without a unified principle design. We observe that the per-position \emph{prediction entropy} of continuous-space AR models naturally encodes spatially varying generation uncertainty, which simultaneously governing draft prediction quality in the AR stage and reflecting the corrective effort required by vision decoding stage, which is not fully explored before. Since entropy is inherently tied to both bottlenecks, it serves as a natural unifying signal for joint acceleration. In this work, we propose \textbf{Drift-AR}, which leverages entropy signal to accelerate both stages: 1) for AR acceleration, we introduce Entropy-Informed Speculative Decoding that align draft-target entropy distributions via a causal-normalized entropy loss, resolving the entropy mismatch that causes excessive draft rejection; 2) for visual decoder acceleration, we reinterpret entropy as the \emph{physical variance} of the initial state for an anti-symmetric drifting field -- high-entropy positions activate stronger drift toward the data manifold while low-entropy positions yield vanishing drift -- enabling single-step (1-NFE) decoding without iterative denoising or distillation. Moreover, both stages share the same entropy signal, which is computed once with no extra cost. Experiments on MAR, TransDiff, and NextStep-1 demonstrate 3.8-5.5$\times$ speedup with genuine 1-NFE decoding, matching or surpassing original quality. Code will be available at https://github.com/aSleepyTree/Drift-AR.

自回归(AR)-扩散混合范式结合了自回归的结构化语义建模与扩散的高保真合成，但面临双重速度瓶颈：顺序执行的AR阶段和扩散视觉解码阶段的多步迭代去噪。现有问题各自独立处理这两个瓶颈，缺乏统一的设计原则。我们观察到，连续空间AR模型的逐位置预测熵自然地编码了空间变化的生成不确定性，它同时决定了AR阶段的草稿预测质量，并反映了视觉解码阶段所需的校正工作量，这一点此前未被充分探索。由于熵与这两个瓶颈固有相关联，它可作为联合加速的自然统一信号。在本工作中，我们提出Drift-AR，利用熵信号加速两个阶段：1) 针对AR加速，我们引入熵信息投机解码，通过因果归一化熵损失对齐草稿-目标熵分布，解决了导致过度草稿拒绝的熵不匹配问题；2) 针对视觉解码器加速，我们将熵重新解释为反对称漂移场的初始状态的物理方差——高熵位置激活更强的漂移以趋向数据流形，而低熵位置产生趋于零的漂移——从而实现无需迭代去噪或蒸馏的单步(1-NFE)解码。此外，两个阶段共享同一个熵信号，计算一次即可，无额外开销。在MAR、TransDiff和NextStep-1上的实验表明，我们的方法实现了3.8-5.5倍加速，并实现了真正的1-NFE解码，达到或超越原始质量。代码将开源于https://github.com/aSleepyTree/Drift-AR。

Recent advances in Diffusion Transformers (DiTs) have enabled high-quality joint audio-video generation, producing videos with synchronized audio within a single model. However, existing controllable generation frameworks are typically restricted to video-only control. This restricts comprehensive controllability and often leads to suboptimal cross-modal alignment. To bridge this gap, we present MMControl, which enables users to perform Multi-Modal Control in joint audio-video generation. MMControl introduces a dual-stream conditional injection mechanism. It incorporates both visual and acoustic control signals, including reference images, reference audio, depth maps, and pose sequences, into a joint generation process. These conditions are injected through bypass branches into a joint audio-video Diffusion Transformer, enabling the model to simultaneously generate identity-consistent video and timbre-consistent audio under structural constraints. Furthermore, we introduce modality-specific guidance scaling, which allows users to independently and dynamically adjust the influence strength of each visual and acoustic condition at inference time. Extensive experiments demonstrate that MMControl achieves fine-grained, composable control over character identity, voice timbre, body pose, and scene layout in joint audio-video generation.

扩散Transformer（DiTs）的最新进展使得高质量的联合音视频生成成为可能，能够在单一模型内生成音画同步的视频。然而，现有的可控生成框架通常仅支持视频控制，这限制了全面的可控性，并常常导致次优的跨模态对齐。为弥补这一差距，我们提出了MMControl，使用户能够在联合音视频生成中执行多模态控制。MMControl引入了一种双流条件注入机制，将视觉和音频控制信号（包括参考图像、参考音频、深度图和姿态序列）整合到联合生成过程中。这些条件通过旁路分支注入到联合音视频扩散Transformer中，使模型能够在结构约束下同时生成身份一致的视频和音色一致的音频。此外，我们引入了模态特定引导缩放机制，允许用户在推理时独立动态地调整每个视觉和音频条件的影响强度。大量实验表明，MMControl在联合音视频生成中实现了对角色身份、声音音色、身体姿态和场景布局的细粒度、可组合控制。

Video-guided 3D animation holds immense potential for content creation, offering intuitive and precise control over dynamic assets. However, practical deployment faces a critical yet frequently overlooked hurdle: the pose misalignment dilemma. In real-world scenarios, the initial pose of a user-provided static mesh rarely aligns with the starting frame of a reference video. Naively forcing a mesh to follow a mismatched trajectory inevitably leads to severe geometric distortion or animation failure. To address this, we present Rectified Dynamic Mesh (R-DMesh), a unified framework designed to generate high-fidelity 4D meshes that are ``rectified&#x27;&x27; to align with video context. Unlike standard motion transfer approaches, our method introduces a novel VAE that explicitly disentangles the input into a conditional base mesh, relative motion trajectories, and a crucial rectification jump offset. This offset is learned to automatically transform the arbitrary pose of the input mesh to match the video's initial state before animation begins. We process these components via a Triflow Attention mechanism, which leverages vertex-wise geometric features to modulate the three orthogonal flows, ensuring physical consistency and local rigidity during the rectification and animation process. For generation, we employ a Rectified Flow-based Diffusion Transformer conditioned on pre-trained video latents, effectively transferring rich spatio-temporal priors to the 3D domain. To support this task, we construct Video-RDMesh, a large-scale dataset of over 500k dynamic mesh sequences specifically curated to simulate pose misalignment. Extensive experiments demonstrate that R-DMesh not only solves the alignment problem but also enables robust downstream applications, including pose retargeting and holistic 4D generation.

视频引导的三维动画在内容创作领域具有巨大潜力，能够对动态资产提供直观且精确的控制。然而，实际应用面临一个关键但常被忽视的难题：姿态错位问题。在实际场景中，用户提供的静态网格的初始姿态极少与参考视频的起始帧对齐。简单地强制网格跟随不匹配的轨迹必然导致严重的几何畸变或动画失败。为解决这一问题，我们提出了修正动态网格（R-DMesh），这是一个统一的框架，旨在生成与视频上下文“对齐”的高质量四维网格。与标准的运动迁移方法不同，我们的方法引入了一种新颖的变分自编码器（VAE），明确地将输入解耦为条件基础网格、相对运动轨迹以及一个关键的修正跳跃偏移量。该偏移量被学习用于自动将输入网格的任意姿态转换为与视频初始状态相匹配的状态，然后开始动画处理。我们通过三流注意力机制（Triflow Attention）处理这些组件，该机制利用逐顶点几何特征来调制三个正交流，确保在修正和动画过程中保持物理一致性和局部刚性。在生成阶段，我们采用基于修正流（Rectified Flow）的扩散变换器（Diffusion Transformer），并以预训练的视频潜在表示为条件，有效地将其丰富的时空先验迁移到三维领域。为支持此任务，我们构建了Video-RDMesh数据集，包含超过50万条动态网格序列，专门为模拟姿态错位而策划。大量实验表明，R-DMesh不仅解决了对齐问题，还能够支持稳健的下游应用，包括姿态重定向和整体四维生成。

Diffusion-based methods demonstrate significant potential for remote sensing image super-resolution at large scaling factors, particularly in reference-based super-resolution (RefSR), where high-resolution reference images provide critical fine-grained texture priors. However, existing methods often suffer from a trade-off between over-reliance on reference information, which leads to texture artifacts, and under-utilization of such information, which results in insufficient detail recovery. To address these issues, we propose DS-DiT, a Decoupled Siamese Diffusion Transformer that decouples the interaction between low-resolution (LR) and reference (Ref) conditions within the attention mechanism. By allowing LR structural priors and Ref texture information to independently interact with the noisy latent, the framework effectively mitigates competition between the two conditional sources. To further compensate for the limited local modeling ability of global attention, we introduce a Patch-Level Weighting (PLW) module that adaptively modulates the fusion of conditional sources. In addition, the siamese architecture enables an inference-time autoguidance strategy that exploits the prediction discrepancy between strong and weak Ref conditions to improve generation quality without additional training. Experimental results across multiple datasets and scaling factors show that DS-DiT outperforms existing methods in both quantitative metrics and visual fidelity.

扩散模型方法在遥感图像大倍率超分辨率任务中展现出显著潜力，尤其在基于参考的超分辨率（RefSR）任务中，高分辨率参考图像能够提供关键的细粒度纹理先验。然而，现有方法常面临两个条件之间的权衡困境：过度依赖参考信息会导致纹理伪影，而参考信息利用不足则会造成细节恢复不充分。为解决这些问题，我们提出了DS-DiT，一种解耦孛生扩散Transformer，它在注意力机制中解耦了低分辨率（LR）图像与参考（Ref）图像条件之间的交互。通过让LR的结构先验和Ref的纹理信息独立地与噪声潜变量进行交互，该框架有效缓解了两个条件源之间的竞争问题。为进一步弥补全局注意力有限的局部建模能力，我们引入了补丁级加权（PLW）模块，用于自适应地调节条件源的融合。此外，孛生架构支持一种推理时的自动引导策略，利用强Ref条件和弱Ref条件之间的预测差异来提升生成质量，无需额外训练。多个数据集和放大倍率下的实验结果表明，DS-DiT在定量指标和视觉保真度方面均优于现有方法。

Motion generation for rigged shapes is vital for scalable 4D asset production. However, template-based methods are limited by specific topologies and fail to generalize across diverse morphologies. Conversely, per-case optimization is computationally expensive, susceptible to local optima, and highly sensitive to viewpoint-induced ambiguities. In this paper, we present SkelMo, a diffusion-based framework designed for category-agnostic skeletal animation generation from 2D video guidance. To overcome the scarcity of high-quality training data, we have curated a large-scale dynamic dataset comprising approximately 20,000 diverse 3D animations, each featuring complete textures, skeletal rigging, and a wide array of comprehensive animation sequences. To bridge the kinematic gap between 2D visual motion cues and heterogeneous 3D skeletal structures, we propose a structural-semantic injection mechanism. Our model integrates texture and semantic attributes directly into skeletal joint representations. This allows it to map perceived visual dynamics to specific joint hierarchies and their functional roles. This enables SkelMo to synthesize high-fidelity animations that maintain anatomical consistency across a vast range of unseen categories, from existing biological species to fantastical beings. Extensive experiments demonstrate that our approach significantly outperforms existing methods, setting a new state-of-the-art benchmark for robust and efficient 4D asset generation. Project Page: https://research.davytao.me/skelmo/.

绑定模型的运动生成对于可扩展的4D资产生产至关重要。然而，基于模板的方法受限于特定拓扑结构，难以在不同形态间泛化。相反，逐案例优化计算成本高，易陷入局部最优，且对视点引起的歧义高度敏感。本文提出SkelMo，一个基于扩散模型的框架，旨在实现从2D视频指导生成类别无关的骨骼动画。为克服高质量训练数据稀缺的问题，我们构建了一个大规模动态数据集，包含约20,000个多样化的3D动画，每个动画均具有完整的纹理、骨骼绑定以及广泛的全面的动画序列。为弥补2D视觉运动线索与异构3D骨骼结构之间的运动学差距，我们提出了一种结构性语义注入机制。该模型将纹理和语义属性直接整合到骨骼关节表示中，使其能够将感知到的视觉动态映射到特定的关节层级及其功能角色。这使得SkelMo能够合成高保真动画，并在大量未知类别中保持解剖学一致性，从现有生物物种到幻想生物均可适用。大量实验表明，我们的方法显著优于现有方法，为稳健高效的4D资产生成设定了新的最先进基准。项目主页：https://research.davytao.me/skelmo/

High-quality 3D vehicle assets are essential for autonomous driving simulation. Although multi-view diffusion-based paradigms enable controllable single-image reconstruction, they typically produce limited viewpoints and exhibit cross-view geometric inconsistencies, thereby reducing reconstruction fidelity in real-world scenarios. In this work, we introduce 3DCarGen, a scalable single-view 3D car generation framework designed for real-world images by synthesizing an arbitrary number of 3D-consistent multi-view images. Specifically, given a single image as input, we first synthesize a set of images from fixed viewpoints. These images are then fed into a feed-forward reconstruction model, resulting in a coarse 3D representation based on 3D Gaussian Splatting. Conditioned on this explicit 3D prior, our multi-view diffusion model generates 3D-consistent images from arbitrary camera viewpoints. We further extend a fast mesh reconstruction algorithm by incorporating color-normal joint optimization to recover detailed and coherent 3D vehicle models from the synthesized dense views. Extensive experiments on synthetic and real-world datasets demonstrate that our approach achieves robust geometric consistency and reconstruction fidelity compared to existing methods. Project page: https://honglixiao.github.io/3dcargen.github.io/.

高质量的3D车辆资产对于自动驾驶仿真至关重要。虽然多视角扩散范式能够实现可控的单图像重建，但它们通常只能生成有限的视角，并存在跨视角几何不一致的问题，从而降低了真实场景中的重建保真度。在本工作中，我们提出了3DCarGen，这是一个可扩展的单视角3D车辆生成框架，通过合成任意数量的3D一致多视角图像，专门针对真实世界图像设计。具体而言，给定单张图像作为输入，我们首先从固定视角合成一组图像。这些图像随后被送入前馈重建模型，生成基于3D Gaussian Splatting的粗糙3D表示。在此显式3D先验的条件下，我们的多视角扩散模型能够从任意相机视角生成3D一致性的图像。我们进一步通过引入颜色-法线联合优化来扩展快速网格重建算法，以从合成的密集视角中恢复细节丰富且连贯的3D车辆模型。在合成数据集和真实世界数据集上的大量实验表明，与现有方法相比，我们的方法实现了更强的几何一致性和重建保真度。项目主页：https://honglixiao.github.io/3dcargen.github.io/

A growing family of training-free solvers -- FlowDPS, FLOWER, PnP-Flow and their diffusion ancestors (DPS, DAPS) -- repurpose a pretrained flow-matching prior to solve imaging inverse problems by adding a measurement-guidance term to the deterministic probability-flow ODE. Despite strong empirical results, what these per-step corrections actually approximate -- and how far the resulting samples are from the true posterior $p(x\mid y)$ -- has not been characterized. We give a posterior-transport account of flow-based inverse problem solving. Our starting point is a simple but consequential fact: for a \emph{deterministic} flow prior, Bayesian conditioning is realized entirely by a \emph{reweighting of the source distribution}, not by a drift correction; pushing the reweighted source through the \emph{unmodified} velocity field yields exact posterior samples. From this we show that trajectory-guidance solvers can be read as the minimum-kinetic-energy \emph{correction} field needed to morph the unconditional source into the posterior, and that FlowDPS / FLOWER / PnP-Flow correspond to distinct zeroth-order / Gaussian / proximal approximations of this single object; we bound the resulting posterior bias in Wasserstein distance. A controlled $2$D study with a closed-form posterior confirms the theory decisively: source reweighting matches the true posterior to the Monte-Carlo floor on every metric, whereas trajectory guidance incurs $200$--$800\times$ larger error and collapses posterior modes, \emph{regardless of guidance strength}. Guided by the analysis we propose a cheap, principled velocity-correction solver that is competitive across two in-domain priors (AFHQ, CelebA) and two out-of-distribution settings while, unlike point-estimate source-space optimizers, producing diverse posterior samples with uncertainty that correlates with reconstruction error.

一类日益壮大的无需训练求解器——FlowDPS、FLOWER、PnP-Flow及其扩散先驱（DPS、DAPS）——通过向确定性概率流常微分方程添加测量引导项，重用预训练的流匹配先验来求解成像逆问题。尽管实证结果表现出色，但这些逐步校正实际近似了什么——以及产生的样本与真实后验$p(x\mid y)$之间的偏差程度——尚未得到明确描述。本文从后验传输的角度分析基于流的逆问题求解。我们的起点是一个简单但意义重大的事实：对于确定性流先验，贝叶斯条件化完全通过源分布的重加权来实现，而非通过漂移校正实现；将重加权后的源推送通过未修改的速度场即可得到精确的后验样本。由此我们表明，轨迹引导求解器可被解读为将无条件源形变为后验所需的最小动能校正场，而FlowDPS/FLOWER/PnP-Flow对应于这一统一对象的不同零阶/高斯/近端近似；我们以瓦瑟斯坦距离界定了由此产生的后验偏差。一项在二维闭式后验上的受控研究确凿地验证了理论：源重加权在所有指标上都将真实后验匹配到蒙特卡洛基线水平，而轨迹引导则产生200至800倍更大的误差并坍缩后验模态，与引导强度无关。受分析启发，我们提出了一种廉价且原则性的速度校正求解器，在两个域内先验（AFHQ、CelebA）和两个分布外设置下具有竞争力，且与点估计源空间优化器不同，能够产生与重建误差相关的不确定性的多样化后验样本。

Existing 3D vehicle generation methods often suffer from low geometric fidelity and blurry textures, hindering their downstream applications. While recent works adopt multi-view diffusion models for high-fidelity texture, they are often constrained by fixed viewpoints, limited resolution, and a reliance on costly fine-tuning to achieve cross-view consistency. In this paper, we propose HiFiVe, a training-free framework for high-fidelity vehicle modeling through joint texture and geometry enhancement by imposing 3D geometric constraints to anchor 2D generative priors. Specifically, we propose an auto-regressive texture refinement pipeline that progressively synthesizes high-resolution textures from arbitrary viewpoints. To ensure cross-view consistency, the coarse geometry serves as a synchronization prior, conditioning each generation step on previously synthesized frames via depth-based warping and multi-view texture fusion. Moreover, the inherent symmetry of vehicles is exploited to mitigate error accumulation. Finally, high-frequency surface details are recovered by refining the mesh geometry using normal maps estimated from the enhanced textures. Extensive experiments on synthetic and real-world vehicle datasets demonstrate that our method significantly improves both geometric detail and texture quality compared to state-of-the-art baselines. Project page: https://honglixiao.github.io/hifive.github.io/.

现有3D车辆生成方法通常存在几何保真度低和纹理模糊的问题，阻碍了其下游应用。虽然近期工作采用多视角扩散模型来实现高保真纹理，但它们通常受限于固定视角、分辨率受限，且需要依赖昂贵的微调来实现跨视角一致性。本文提出HiFiVe，一个无需训练的框架，通过施加3D几何约束来锚定2D生成先验，从而实现高保真车辆的纹理与几何联合增强。具体而言，我们提出了一种自回归纹理优化管道，可从任意视角逐步合成高分辨率纹理。为确保跨视角一致性，粗略几何作为同步先验，通过基于深度的变形和多视角纹理融合来调节每个生成步骤。此外，利用车辆固有的对称性来缓解误差累积。最后，通过使用从增强纹理中估计的法线贴图优化网格几何，以恢复高频表面细节。在合成和真实世界车辆数据集上的广泛实验表明，与现有最先进的方法相比，本方法显著提升了几何细节和纹理质量。

Flow-based generative methods offer a simple and effective framework for high-fidelity generation, yet pretrained flow models are rarely used in their vanilla conditional form: in image generation, samples without guidance often appear diffuse and lack fine-grained detail. Existing guidance techniques such as classifier-free guidance (CFG) improve fidelity but reduce sample diversity. We introduce Momentum Guidance (MG), a guidance method that improves sample quality by extrapolating the current velocity away from an exponential moving average of past velocities along the ODE trajectory, while preserving the standard one-evaluation-per-step cost. MG provides gains beyond CFG, improving the precision-recall Pareto frontier. Experiments demonstrate the effectiveness of MG across benchmarks. On ImageNet-256, MG improves FID by 36.54% without CFG and 25.42% with CFG on average across sampling settings, attaining an FID of 1.553 at 16 sampling steps. Evaluations on large flow-based models, including Stable Diffusion 3 and FLUX.1-dev, further confirm improvements across standard metrics.

基于流的生成方法为高保真生成提供了简单有效的框架，但预训练流模型很少以标准条件形式使用：在图像生成中，无引导的样本通常显得模糊且缺乏细粒度细节。现有引导技术如无分类器引导（CFG）能提高保真度但会降低样本多样性。我们提出动量引导（MG），这是一种通过沿常微分方程轨迹将当前速度外推至过去速度的指数移动平均来提高样本质量的引导方法，同时保持标准单步单次评估的开销。MG提供了超越CFG的增益，改善了精确率-召回率帕累托前沿。实验表明MG在各类基准测试上均有效。在ImageNet-256上，MG在不使用CFG时平均提升FID 36.54%，使用CFG时提升25.42%，在16步采样下达到1.553的FID。对大型流模型（包括Stable Diffusion 3和FLUX.1-dev）的评估进一步证实了其在标准指标上的改进。

Resource-constrained visual Internet of Things (IoT) systems, such as edge cameras, unmanned sensing platforms, industrial inspection nodes, and remote monitoring sensors, often need to transmit task-relevant visual evidence over low-rate wireless links to an edge/cloud service. Existing image communication methods usually compress or transmit complete global representations, leaving limited room to exploit receiver-side generative restoration. This paper proposes a semantic-aware generative image transmission framework for edge-assisted visual IoT. The image captured by an IoT visual sensor is encoded into a discrete token grid by a VQ encoder. At the IoT transmitter or nearby gateway, token recoverability, estimated from prediction entropy and local structure complexity, is fused with semantic importance obtained from instance segmentation and category-aware scoring. A spatial dispersal sampler then selects the tokens to be transmitted under a bitrate budget. The transmitter sends only the quantization indices of kept tokens and a binary mask map, while the edge/cloud receiver recovers masked tokens through MaskGIT with Halton sequence scheduling. Experiments on Kodak and VisDrone scenes under AWGN and Rayleigh channels show that the proposed method provides a flexible bitrate-quality tradeoff for narrowband visual IoT links. At 0.074 bpp, it uses 44.6% of the transmitted bits of the 0.167-bpp DeepJSCC/WITT reference while achieving 29.9 dB PSNR. A pseudo-GT downstream detection study on Kodak further shows that semantic-aware masking preserves task-relevant objects better than random masking at both 30% and 50% mask ratios.

资源受限的视觉物联网系统（如边缘摄像头、无人感知平台、工业检测节点和远程监控传感器）通常需要通过低速率无线链路向边缘/云服务传输任务相关的视觉证据。现有图像通信方法通常压缩或传输完整的全局表示，难以充分利用接收端的生成式恢复能力。本文提出了一种面向边缘辅助视觉物联网的语义感知生成式图像传输框架。视觉物联网传感器捕获的图像由VQ编码器编码为离散token网格。在物联网发射端或邻近网关上，基于预测熵和局部结构复杂度估计的token可恢复性与来自实例分割和类别感知评分获得的语义重要性进行融合。空间分散采样器随后在比特率预算约束下选择待传输的token。发射端仅发送保留token的量化索引和二进制掩码图，而边缘/云接收端通过采用Halton序列调度的MaskGIT恢复被掩码的token。在AWGN和瑞利信道下对Kodak和VisDrone场景的实验表明，所提方法为窄带视觉物联网链路提供了灵活的比特率-质量权衡。在0.074 bpp下，其传输比特仅为0.167 bpp的DeepJSCC/WITT参考方法的44.6%，同时达到了29.9 dB的PSNR。对Kodak的伪地面真值下游检测研究进一步表明，在30%和50%掩码比下，语义感知掩码比随机掩码能更好地保留任务相关目标。

ICAO-compliant machine readable travel documents enable automated biometric face verification. The biometric reference is stored on an RFID chip included in form of a JPEG or JPEG 2000 compressed facial image. In contrast, temporary travel documents lack of machine readability, which excludes the owner from such automated processes. This disadvantage could be solved by equipping such documents with 2D barcodes. This technology offers a resource-saving alternative to expensive RFID chips, while still offering machine readability and fast issuing processes. However, this solution introduces the challenge of storing the face images at significantly smaller storage capacities, creating the need for reducing the file size of the included facial image to a maximum of 1024 bytes. This study examines preprocessing steps and compression configurations, using JPEG, JPEG 2000, JPEG XL, JPEG AI, HEIF, AVIF, and WebP for image compression to this target size, while still preserving as much face recognition performance as possible. While the reference sample must always comply with ICAO specifications, the individual samples may or may not meet these requirements, depending on the application. This work optimizes compression steps for both of these prerequisites. It is shown that the recently standardised JPEG AI, when using optimized settings, provides the best face recognition performance, in particular when the comparison includes only images with high face image quality. AVIF and WebP also provide good results. The losses caused by the strong lossy compression are comparatively small. For the comparison of ICAO-compliant face images only, converting the images to grayscale proves to be a helpful preprocessing step, whereas for comparisons involving less suitable samples, preserving color is preferable. In addition, smoothing and resizing the images beforehand also turns out to be beneficial.

符合ICAO标准的机读旅行证件支持自动生物识别人脸验证。生物特征参考以JPEG或JPEG 2000压缩人脸图像的形式存储在RFID芯片中。相比之下，临时旅行证件缺乏机读性，导致持有人无法享受此类自动化流程。这一劣势可以通过为证件配备二维条码来解决。该技术提供了一种比昂贵RFID芯片更节约资源的替代方案，同时仍具备机读性和快速签发流程。然而，这一方案带来了将人脸图像存储在极小存储容量中的挑战，因此需要将人脸图像的文件大小压缩至最大1024字节。本研究使用JPEG、JPEG 2000、JPEG XL、JPEG AI、HEIF、AVIF和WebP进行图像压缩，检验了针对该目标大小的预处理步骤和压缩配置，同时尽可能保留人脸识别性能。由于参考样本始终需要符合ICAO规范，而个体样本则根据应用场景可能符合或不符合这些要求，本工作针对这两种前提条件优化了压缩步骤。研究表明，使用优化设置后，最近标准化的JPEG AI提供了最佳的人脸识别性能，尤其是在仅包含高质量人脸图像的比较中。AVIF和WebP也取得了良好的结果。由强有损压缩造成的损失相对较小。对于仅比较符合ICAO标准的人脸图像，将图像转换为灰度被证明是有益的预处理步骤；而对于涉及不太合适的样本的比较，保留色彩则更为可取。此外，事先对图像进行平滑处理和调整尺寸也被证明是有益的。

Deploying large convolutional neural networks (CNNs) on resource-constrained devices is challenging due to their high computational cost. While dynamic execution methods are promising, existing approaches for CNNs typically require specialized training or fine-tuning, limiting their effectiveness when applied to pre-trained models and requiring data access. To address this gap, we propose HASTE (Hashing for Tractable Efficiency), a plug-and-play convolution module that enables training-free, dynamic compression of large pre-trained CNNs. At inference time, HASTE uses locality-sensitive hashing to identify and merge redundant channels of latent feature maps on a patch-wise basis. This process simultaneously compresses the depth of both input features and their corresponding filters, resulting in computationally cheaper convolutions. We conduct extensive experiments on CIFAR-10 and ImageNet across a range of architectures, demonstrating a 46.2% FLOPs reduction in a ResNet34 on CIFAR-10 with only a 1.25% drop in accuracy, without any retraining. We support our claims by comprehensive ablation studies to validate our core design choices, an analysis of the method's properties and limitations, and a discussion that connects our channel merging scheme to the conceptually related task of token merging in Vision Transformers. Our results demonstrate that HASTE provides an effective solution for steerable compression of pre-trained CNNs at runtime, opening new possibilities for the deployment of efficient deep learning methods.

在资源受限的设备上部署大型卷积神经网络（CNN）由于其高计算成本而具有挑战性。虽然动态执行方法很有前景，但现有的CNN方法通常需要专门的训练或微调，这限制了它们在预训练模型上的有效性，并且需要数据访问。为了解决这一差距，我们提出了HASTE（用于可处理效率的哈希），这是一个即插即用的卷积模块，能够对大型预训练CNN进行无训练的动态压缩。在推理时，HASTE使用局部敏感哈希来识别和合并潜在特征图的冗余通道，采用逐patch的方式。这个过程同时压缩了输入特征及其对应滤波器的深度，从而产生计算成本更低的卷积。我们在CIFAR-10和ImageNet上对各种架构进行了广泛的实验，展示了在CIFAR-10上ResNet34的FLOPs减少46.2%，而准确率仅下降1.25%，无需任何重新训练。我们通过全面的消融实验来验证我们的核心设计选择，对方法的特性和局限性进行分析，并将我们的通道合并方案与Vision Transformers中概念上相关的token合并任务进行对比讨论。研究结果表明，HASTE为预训练CNN在运行时的可调控压缩提供了有效的解决方案，为高效深度学习方法的部署开辟了新的可能性。

Generative image compression has recently shown impressive perceptual quality, but often suffers from semantic inconsistency at ultra-low bitrates (bpp < 0.05), limiting its reliable deployment in bandwidth-constrained scenarios such as 6G semantic communications. This inconsistency stems from incomplete guidance information, which introduces semantic ambiguity into the generation process and may lead to natural-looking but source-inconsistent content. In this work, we propose a Semantic-Disambiguation-Guided Generative Image Compression (SDGIC) framework to constrain diffusion-based reconstruction at ultra-low bitrates. Specifically, SDGIC compresses the source image into three compact and complementary guidance streams: a concise text caption for global semantics, a highly compressed image (HCI) for dense visual evidence, and Reconstruction-Aware Semantic Residual Tokens (RSRTs) for reconstruction-relevant residual semantics that remain ambiguous under the text caption and HCI conditions. The RSRTs are directly optimized toward the downstream denoising objective, enabling them to provide source-specific semantic constraints for disambiguating diffusion-based reconstruction. To inject these three guidance streams into the generation process effectively, we design a Dual-Path Conditioned Diffusion Decoder (DPCD), which uses cross-attention for semantic conditions and ControlNet residuals for dense visual guidance. Extensive experiments demonstrate that SDGIC improves semantic consistency at ultra-low bitrates while maintaining favorable perceptual quality, with a 23.4% reduction in AFINE on the CLIC2020 dataset.

生成式图像压缩近期在感知质量方面展现出优异性能，但在超低码率（bpp < 0.05）下常遭受语义不一致问题，这限制了其在6G语义通信等带宽受限场景中的可靠部署。这种不一致源于不完整的引导信息，其在生成过程中引入了语义歧义，可能导致内容看起来自然但与源图像不一致。本工作提出了一种语义消歧引导的生成式图像压缩（SDGIC）框架，以在超低码率下约束基于扩散的重建过程。具体而言，SDGIC将源图像压缩为三个紧凑且互补的引导流：用于全局语义的简洁文本描述、用于密集视觉证据的高度压缩图像（HCI），以及用于在文本描述和HCI条件下仍存在歧义的重建相关残差语义的重建感知语义残差 tokens（RSRTs）。RSRTs直接针对下游去噪目标进行优化，使其能够提供针对源的语义约束，以消歧基于扩散的重建过程。为了有效将这三种引导流注入生成过程，我们设计了双路径条件扩散解码器（DPCD），该解码器使用交叉注意力处理语义条件，并使用ControlNet残差进行密集视觉引导。大量实验表明，SDGIC在超低码率下提升了语义一致性，同时保持了良好的感知质量，在CLIC2020数据集上实现了AFINE降低23.4%。