每日 arXiv 论文简报

Pixel-space continuous-token autoregressive (AR) generation directly models images as sequences of raw pixel patches, avoiding discrete tokenization or a separately pretrained tokenizer. However, it faces coupled challenges: high-dimensional patch generation causes large single-step errors, and teacher-forced training creates a train--inference gap that makes these errors accumulate across AR steps. Existing fixes such as $x$-prediction and input noise injection only partially mitigate these issues. Exact rollout training better matches inference-time conditions, but is impractical due to prohibitively slow sequential sampling. We propose \emph{Parallel Rollout Approximation} (PRA), a scalable framework that addresses both challenges jointly. PRA generates low-dimensional intermediate states instead of high-dimensional pixel patches, then maps them back to pixel-space tokens with a pixel decoder, preserving a pixel-in, pixel-out AR interface. It also constructs inference-like pixel inputs through the same intermediate-state-to-pixel path used at inference, independently across positions, approximating the pixel-feedback interface encountered during inference-time rollout while retaining parallel teacher-forced training. On class-conditional ImageNet-1K generation at $256\times256$ resolution, PRA-S with 135M parameters achieves an FID of 2.58, surpassing the previous billion-scale pixel-space AR result of 3.60. Scaling to PRA-L with 511M parameters further improves FID to 1.94, establishing a new state of the art among pixel-space AR models. Beyond generation, PRA achieves higher ImageNet classification probing accuracy than other AR and diffusion baselines, suggesting its potential for unified pixel-space image generation and understanding.

像素空间连续token自回归(AR)生成直接将图像建模为原始像素块的序列，避免了离散token化或单独预训练的tokenizer。然而，它面临耦合的挑战：高维块生成导致较大的单步误差，而教师强制训练造成了训练-推理差距，使得这些误差在AR步骤中累积。现有的修复方法，如x预测和输入噪声注入，仅部分缓解了这些问题。精确展开训练更好地匹配推理时条件，但由于顺序采样的速度极慢而不切实际。我们提出并行展开近似(PRA)，一个可扩展的框架，联合解决这两个挑战。PRA生成低维中间状态而非高维像素块，然后使用像素解码器将其映射回像素空间token，保持像素输入输出的AR接口。它还通过推理时使用的相同中间状态到像素路径构建类似推理的像素输入，在各位置上独立进行，近似推理时展开过程中遇到的像素反馈接口，同时保留并行教师强制训练。在256×256分辨率的类别条件ImageNet-1K生成中，PRA-S以1.35亿参数实现了2.58的FID，超越了此前十亿规模的像素空间AR结果的3.60。扩展到PRA-L(5.11亿参数)进一步将FID提升至1.94，在像素空间AR模型中确立了新的最先进水平。除生成任务外，PRA实现了比其他AR和扩散基线更高的ImageNet分类探测准确率，显示出其在统一像素空间图像生成和理解方面的潜力。

Generating lifelike facial animation for dyadic conversations requires reconciling high-level cognitive intent with precise low-level motor reflexes, yet existing methods fall short in the semantic understanding of dialogue context and in precise dynamic control. In this paper, we propose MindFlow, a dual-pathway generative framework inspired by the Ventral-Dorsal pathway model in neuroscience, which decouples generation into two collaborative streams, thereby harmonizing deep semantic reasoning with fine-grained control. In the Ventral module, we transform the conventional Sentence-Action approach into a novel Chunk-State approach that models raw acoustic streams as a context-aware, evolving emotional state chain, capturing subtle paralinguistic nuances and mid-utterance emotional shifts missed by sentence-level modeling. The Dorsal module features a conditional autoregressive flow matching network for high-fidelity facial motion, driven by high-frequency acoustic cues and modulated by emotion states, plus a Selective Acoustic Injector for adaptive audio gating to ensure robustness in talking-and-listening dynamics without interference. Extensive experiments demonstrate that MindFlow achieves superior semantic appropriateness and motion naturalness compared to state-of-the-art baselines.

生成逼真的双人对话面部动画需要将高层认知意图与精确的低层运动反射相协调，然而现有方法在对话语境的语义理解和精确动态控制方面仍存在不足。本文提出MindFlow，一个受神经科学腹侧-背侧通路模型启发的双路径生成框架，将生成任务解耦为两个协作流，从而实现深度语义推理与精细控制的协同。在腹侧模块中，我们将传统的句子-动作方法转变为新型的分块-状态方法，将原始声流建模为上下文感知的演进情绪链，能够捕捉句子级建模所遗漏的微妙副语言细节和话语中的情绪变化。背侧模块包含一个条件自回归流匹配网络，用于生成高保真面部运动，该网络由高频声学线索驱动并受情绪状态调节，还包含一个选择性声学注入器，用于自适应音频门控，确保在说话-倾听动态过程中的鲁棒性而互不干扰。大量实验表明，MindFlow在语义适当性和运动自然度方面均优于当前最先进的基线方法。

Building interactive world models requires generating realistic videos while maintaining controllable dynamics over long horizons. Autoregressive video generation offers a scalable foundation, but suffers from error accumulation and temporal degradation during extended rollouts. This issue is further amplified under heterogeneous controls such as human motion and camera trajectories, which may interfere and destabilize a pretrained video prior, while existing methods often trade off controllability and visual quality. We propose "Directing the World", a fast autoregressive framework for controllable world-model video generation with compositional human-motion and camera-trajectory control. Our key idea is to decouple control learning while preserving a unified autoregressive video prior. We introduce a Fast-Slow Memory training strategy to stabilize long-horizon rollout learning and improve convergence. For human motion control, we design a t-guided Dynamic Projection mechanism and a refined Motion-CFG strategy, enabling temporally smooth and accurate motion alignment without degrading visual fidelity, and supporting multi-person control.After learning a robust motion prior, we introduce a second-stage camera-trajectory control module to compose human dynamics with viewpoint changes for coherent world exploration. We further construct a large-scale dataset with synchronized video, text, human-motion, and camera-trajectory annotations, organized into motion-centric and camera-centric subsets for decoupled training. Extensive experiments show stable long-horizon generation with precise controllability and high visual quality. See more at https://whydahuzi.github.io/Directing-the-World.github.io/.

构建交互式世界模型需要在长时序生成中保持可控动态的同时生成逼真视频。自回归视频生成提供了可扩展的基础，但在长时间展开过程中存在误差累积和时间退化的问题。异构控制（如人体动作和相机轨迹）进一步放大了这一问题，这些控制可能相互干扰并破坏预训练的视频先验，而现有方法往往在可控性和视觉质量之间进行权衡。我们提出“执导世界”（Directing the World），这是一个用于可控世界模型视频生成的快速自回归框架，支持组合式人体动作和相机轨迹控制。我们的核心思想是在保持统一自回归视频先验的同时解耦控制学习。我们引入快慢记忆（Fast-Slow Memory）训练策略以稳定长时序展开学习并提高收敛速度。对于人体动作控制，我们设计了t引导的动态投影（t-guided Dynamic Projection）机制和精化的动作CFG（Motion-CFG）策略，实现时间平滑且精确的动作对齐，同时保持视觉保真度，并支持多人控制。在学习到稳健的动作先验后，我们引入第二阶段相机轨迹控制模块，将人物动态与视角变化组合以实现一致的世界探索。我们进一步构建了一个大规模数据集，包含同步的视频、文本、人体动作和相机轨迹标注，整理为以动作中心和以相机为中心的子集用于解耦训练。大量的实验表明，该方法能够实现稳定的长时序生成，同时具备精确的可控性和较高的视觉质量。更多内容见 https://whydahuzi.github.io/Directing-the-World.github.io/。

We present HunyuanImage 3.0, a native multimodal model that unifies multimodal understanding and generation within an autoregressive framework, with its image generation module publicly available. The achievement of HunyuanImage 3.0 relies on several key components, including meticulous data curation, advanced architecture design, a native Chain-of-Thoughts schema, progressive model pre-training, aggressive model post-training, and an efficient infrastructure that enables large-scale training and inference. With these advancements, we successfully trained a Mixture-of-Experts (MoE) model comprising over 80 billion parameters in total, with 13 billion parameters activated per token during inference, making it the largest and most powerful open-source image generative model to date. We conducted extensive experiments and the results of automatic and human evaluation of text-image alignment and visual quality demonstrate that HunyuanImage 3.0 rivals previous state-of-the-art models. By releasing the code and weights of HunyuanImage 3.0, we aim to enable the community to explore new ideas with a state-of-the-art foundation model, fostering a dynamic and vibrant multimodal ecosystem. All open source assets are publicly available at https://github.com/Tencent-Hunyuan/HunyuanImage-3.0

我们提出 HunyuanImage 3.0，这是一个原生多模态模型，在自回归框架内统一了多模态理解和生成功能，其图像生成模块已公开可用。HunyuanImage 3.0 的成就依赖于几个关键组件，包括精细的数据整理、先进的架构设计、原生思维链模式、渐进式模型预训练、激进的模型后训练，以及支持大规模训练和推理的高效基础设施。基于这些进展，我们成功训练了一个包含超过 800 亿参数的总参数量、推理时每 token 激活 130 亿参数的混合专家（MoE）模型，使其成为迄今为止规模最大、功能最强的开源图像生成模型。我们进行了大量实验，自动评估和人工评估的结果表明，文本-图像对齐和视觉质量方面，HunyuanImage 3.0 可与此前最先进的模型相媲美。通过开源 HunyuanImage 3.0 的代码和权重，我们旨在使社区能够基于这一先进的基础模型探索新想法，促进充满活力的多模态生态系统发展。所有开源资源均可在 https://github.com/Tencent-Hunyuan/HunyuanImage-3.0 获取。

3D scene inpainting is essential for reconstructing areas corrupted by occlusions or limited viewpoints. While recent methods leverage Gaussian Splatting (GS) for efficient 3D editing, they often depend on precise multi-view segmentation masks and are inherently constrained to object removal tasks. We propose CoIn, a novel framework that bridges 2D inpainting models and 3DGS through a multi-stage consistency pipeline. Our approach first generates initial inpainted images using a diffusion model, enabling the use of arbitrary-shaped masks and diverse tasks like object insertion. We then introduce Reference Adaptive GS with Feature Attention to reconstruct a coarse 3D scene by adaptively weighing towards a reference view (2D -> 3D). This 3D representation provides geometric guidance to the diffusion process via GS-based Reference Feature Warping, ensuring multi-view consistency (3D -> 2D). Finally, a Texture-Enhancing Discriminator refines the 3D scene to achieve high photometric realism (2D -> 3D). Experiments show that CoIn, effectively leveraging bidirectional information flow, achieves state-of-the-art performance and effectively handles both object removal and object insertion with flexible mask input.

3D场景修复对于重建被遮挡或视角受限的区域至关重要。尽管近期方法利用高斯溅射（GS）进行高效的3D编辑，但它们通常依赖于精确的多视角分割掩码，并且本质上局限于物体移除任务。我们提出了CoIn，这是一个通过多阶段一致性管道将二维修复模型与3DGS相结合的新框架。我们的方法首先使用扩散模型生成初始修复图像，能够使用任意形状的掩码并处理物体插入等多样化任务。随后，我们引入特征注意力参考自适应高斯溅射（Reference Adaptive GS with Feature Attention），通过自适应地向参考视图加权来重建粗略3D场景（二维 -> 三维）。该3D表示通过基于高斯溅射的参考特征扭曲（GS-based Reference Feature Warping）为扩散过程提供几何引导，确保多视角一致性（三维 -> 二维）。最后，纹理增强判别器（Texture-Enhancing Discriminator）优化3D场景以实现高光度真实感（二维 -> 三维）。实验表明，CoIn有效利用双向信息流，实现了最先进的性能，并能灵活处理物体移除和物体插入任务。

In this paper, we are the first to examine the correlations between class frequency and the multi-scale noise schedule within diffusion models. For score-based generative models, low-density regions often lead to inaccurately estimated scores, thereby compromising the generation quality. Although the multi-scale noise schedule can alleviate this issue during the diffusion process, low-frequency classes still face the challenge of large low-density regions, resulting in more inaccurate estimated scores than high-frequency classes. Furthermore, high-frequency classes tend to dominate the score space, causing a convergence of most data points towards generating samples from these classes. Consequently, samples generated within low-frequency classes exhibit suboptimal quality and limited diversity. To address this challenge, we propose the \textit{Class-frequency Guided (CFRG)} noise schedule, leveraging the insight that low-frequency classes should be endowed with larger-scale noises. To illustrate the effectiveness of our method, we conduct experiments on various tasks, including image generation, image classification, and text-to-image generation, using imbalanced datasets, \textit{i.e.}, CIFAR-100-LT, and ImageNet-LT. By employing the CFRG noise schedule, we achieve substantial improvements over baselines, manifesting the crucial role of frequency statistics in noise schedule design.

在本文中，我们首次研究了扩散模型中类别频率与多尺度噪声调度之间的相关性。对于基于分数的生成模型，低密度区域往往导致分数估计不准确，从而影响生成质量。尽管多尺度噪声调度可以在扩散过程中缓解这一问题，但低频类别仍面临较大的低密度区域挑战，导致其分数估计比高频类别更加不准确。此外，高频类别倾向于主导分数空间，导致大多数数据点倾向于生成这些类别的样本。因此，低频类别生成的样本质量较差且多样性受限。针对这一挑战，我们提出了类别频率引导噪声调度（CFRG），其核心思想是低频类别应该被赋予更大尺度的噪声。为了验证我们方法的有效性，我们在多种任务上进行了实验，包括图像生成、图像分类和文本到图像生成，使用了不平衡数据集，即CIFAR-100-LT和ImageNet-LT。通过采用CFRG噪声调度，我们在基线模型上取得了显著提升，证明了频率统计在噪声调度设计中的关键作用。

Offline reinforcement learning enables policy learning from fixed datasets without additional environment interaction, making it appealing for safety-critical applications where online exploration is costly or unsafe. Diffusion-based decision-making methods have recently achieved strong performance in offline RL by modeling rich, multimodal trajectory distributions. However, existing diffusion planners are typically risk-neutral and therefore may overlook rare but catastrophic outcomes that are crucial in real-world deployment. In this work, we propose RS-Diffuser, a risk-sensitive offline diffusion planning framework that combines diffusion-based trajectory generation with distributional value critics. RS-Diffuser learns a diffusion planner over future state trajectories, a separate inverse dynamics model for action decoding, and a Monte Carlo distributional critic that estimates the full return distribution of candidate plans through quantile regression. At sampling time, we incorporate a risk-sensitive guidance signal into the denoising process, using gradients computed from tail-aware objectives such as Conditional Value at Risk to steer generation toward desired risk profiles. As a result, a single trained model can flexibly produce risk-averse, risk-neutral, or risk-seeking behaviors by changing only the inference-time risk parameter. Extensive experiments on risk-sensitive D4RL and risky robot navigation benchmarks demonstrate that RS-Diffuser achieves state-of-the-art performance, improving both overall return and worst-case robustness while reducing safety violations.

离线强化学习能够从固定数据集中学习策略，无需额外环境交互，因此对于在线探索成本高昂或不安全的安全关键应用场景具有吸引力。基于扩散的决策方法通过建模丰富的多模态轨迹分布，在离线强化学习中取得了强劲性能。然而，现有的扩散规划器通常是风险中性的，因此可能会忽略在现实部署中至关重要但罕见的灾难性后果。本工作提出RS-Diffuser，一个风险敏感的离线扩散规划框架，将基于扩散的轨迹生成与分布式价值评论器相结合。RS-Diffuser学习一个面向未来状态轨迹的扩散规划器、一个用于动作解码的独立逆动力学模型，以及一个通过分位数回归估计候选计划完整回报分布的蒙特卡洛分布评论器。在采样时，我们将风险敏感引导信号融入去噪过程，使用来自尾部感知目标（如条件风险价值）的梯度来引导生成向期望的风险特征演进。因此，只需更改推理时的风险参数，单个训练好的模型就能灵活地产生风险规避、风险中性或风险寻求行为。在风险敏感的D4RL和危险机器人导航基准上的广泛实验表明，RS-Diffuser实现了最先进的性能，在提升整体回报和最坏情况鲁棒性的同时减少安全违规。

Pixel-space continuous-token autoregressive (AR) generation directly models images as sequences of raw pixel patches, avoiding discrete tokenization or a separately pretrained tokenizer. However, it faces coupled challenges: high-dimensional patch generation causes large single-step errors, and teacher-forced training creates a train--inference gap that makes these errors accumulate across AR steps. Existing fixes such as $x$-prediction and input noise injection only partially mitigate these issues. Exact rollout training better matches inference-time conditions, but is impractical due to prohibitively slow sequential sampling. We propose \emph{Parallel Rollout Approximation} (PRA), a scalable framework that addresses both challenges jointly. PRA generates low-dimensional intermediate states instead of high-dimensional pixel patches, then maps them back to pixel-space tokens with a pixel decoder, preserving a pixel-in, pixel-out AR interface. It also constructs inference-like pixel inputs through the same intermediate-state-to-pixel path used at inference, independently across positions, approximating the pixel-feedback interface encountered during inference-time rollout while retaining parallel teacher-forced training. On class-conditional ImageNet-1K generation at $256\times256$ resolution, PRA-S with 135M parameters achieves an FID of 2.58, surpassing the previous billion-scale pixel-space AR result of 3.60. Scaling to PRA-L with 511M parameters further improves FID to 1.94, establishing a new state of the art among pixel-space AR models. Beyond generation, PRA achieves higher ImageNet classification probing accuracy than other AR and diffusion baselines, suggesting its potential for unified pixel-space image generation and understanding.

像素空间连续token自回归(AR)生成直接将图像建模为原始像素块的序列，避免了离散token化或单独预训练的tokenizer。然而，它面临耦合的挑战：高维块生成导致较大的单步误差，而教师强制训练造成了训练-推理差距，使得这些误差在AR步骤中累积。现有的修复方法，如x预测和输入噪声注入，仅部分缓解了这些问题。精确展开训练更好地匹配推理时条件，但由于顺序采样的速度极慢而不切实际。我们提出并行展开近似(PRA)，一个可扩展的框架，联合解决这两个挑战。PRA生成低维中间状态而非高维像素块，然后使用像素解码器将其映射回像素空间token，保持像素输入输出的AR接口。它还通过推理时使用的相同中间状态到像素路径构建类似推理的像素输入，在各位置上独立进行，近似推理时展开过程中遇到的像素反馈接口，同时保留并行教师强制训练。在256×256分辨率的类别条件ImageNet-1K生成中，PRA-S以1.35亿参数实现了2.58的FID，超越了此前十亿规模的像素空间AR结果的3.60。扩展到PRA-L(5.11亿参数)进一步将FID提升至1.94，在像素空间AR模型中确立了新的最先进水平。除生成任务外，PRA实现了比其他AR和扩散基线更高的ImageNet分类探测准确率，显示出其在统一像素空间图像生成和理解方面的潜力。

Demand for high-resolution satellite imagery has increased interest in super-resolution (SR) to bridge the spatial resolution gap between freely available missions such as Sentinel-2 and commercial systems like PlanetScope. Because no sensor provides true paired low- and high-resolution observations, SR models are usually trained on synthetically degraded data, creating a domain gap on real cross-sensor imagery. In this work, we provide the first systematic study of how this synthetic-to-real mismatch affects the performance of modern diffusion-based SR models. Using a large, geometrically and temporally aligned dataset of Sentinel-2 and PlanetScope imagery, we evaluate five state-of-the-art diffusion architectures under controlled experimental settings. We also introduce LPIPS-Sat, a domain-adapted perceptual metric based on Sentinel-2 self-supervised features. Our results show two persistent challenges: synthetically trained models degrade sharply on real pairs, while models trained on real cross-sensor data exhibit optimisation difficulties and struggle to adapt to the physical and radiometric diversity. These findings highlight a key limitation of current SR and motivate methods that disentangle super-resolution from domain adaptation.

对高分辨率卫星图像需求的增长激发了人们对超分辨率（SR）技术的兴趣，以弥合Sentinel-2等免费任务与PlanetScope等商业系统之间的空间分辨率差距。由于没有任何传感器提供真正的成对低分辨率和高分辨率观测，SR模型通常在合成降质数据上进行训练，这在真实跨传感器图像上产生了域差距。本研究首次系统性地研究了这种合成到真实的差异如何影响现代基于扩散的SR模型的表现。我们使用一个大型的Sentinel-2和PlanetScope几何与时间对齐数据集，在受控实验设置下评估了五种最先进的扩散架构。我们还引入了LPIPS-Sat，这是一种基于Sentinel-2自监督特征的域适应感知度量。我们的研究结果揭示了两个持续存在的挑战：在合成数据上训练的模型在真实成对数据上性能急剧下降；而在真实跨传感器数据上训练的模型则表现出优化困难，难以适应物理和辐射多样性。这些发现突出了当前SR方法的关键局限性，并推动了将超分辨率与域适应解耦的方法研究。

Real-world object removal is challenging due to two key difficulties: the target object's non-local effects, such as shadows and reflections, which are difficult to model, and the fact that user-provided masks are often inaccurate or incomplete. With billions of parameters and tens of denoising steps, diffusion-based models achieve strong removal performance at the expense of substantial computational cost, limiting their use in interactive applications and on edge devices. To address these challenges, we present OSOR (One-Step Object Removal), which simultaneously achieves efficient, effect-aware, and mask-robust object removal. Concretely, OSOR introduces: (1) an occupancy-guided discriminator for precise boundary supervision, enabling stable single-step diffusion training; (2) an alpha head that leverages knowledge from pretrained diffusion models to predict appropriate removal regions with minimal overhead, thereby handling imperfect masks; and (3) a semantic-anchored verification pipeline (SAVP) that filters noisy instruction-based triplets to produce effect-aware supervision at scale. Using SAVP, we curate CORNE, which contains 280K verified removal pairs, and further annotate AnimeEraseBench and TextEraseBench to evaluate performance on more complex removal tasks. Experiments show that OSOR surpasses strong multi-step diffusion baselines in perceptual quality while achieving $4\times$ to $30\times$ faster inference.

现实世界中的目标移除面临两大核心挑战：目标物体的非局部效应（如阴影和反射）难以建模，以及用户提供的掩码往往不准确或不完整。扩散模型虽然凭借数十亿参数和数十步去噪过程实现了强大的移除效果，但计算成本高昂，限制了其在交互式应用和边缘设备上的使用。为解决这些挑战，我们提出了OSOR（一步目标移除），该方法同时实现了高效、效果感知且掩码鲁棒的目标移除。具体而言，OSOR引入了：（1）占用引导判别器，用于精确的边界监督，实现稳定的单步扩散训练；（2）Alpha头部，利用预训练扩散模型的知识以最小开销预测适当的移除区域，从而处理不完美的掩码；（3）语义锚定验证管道（SAVP），用于过滤噪声指令三元组以大规模生成效果感知监督数据。使用SAVP，我们整理了CORNE数据集，包含28万对经过验证的移除样本，并进一步标注了AnimeEraseBench和TextEraseBench以评估更复杂移除任务的性能。实验表明，OSOR在感知质量上超越了强大的多步扩散基线，同时实现了4倍至30倍的推理加速。

Graph-based fraud detection is essential for safeguarding large-scale transaction systems, where undetected anomalies may lead to substantial financial losses and security risks. Real-world fraud graphs pose two coupled challenges: sparse and imbalanced supervision, where verified fraudulent labels are scarce and heavily skewed toward benign accounts, and representation dilution, where spatial message passing may oversmooth camouflaged anomalies while spectral filters may suppress fraud-relevant mid- and high-frequency irregularities. To address these challenges, we propose ADC-GNN, short for Attention-guided Diffusion-Contrastive Graph Neural Network, a unified framework that combines diffusion-guided feature augmentation, contrastive representation learning, and multi-hop spectral attention for few-shot graph fraud detection. The diffusion component is formulated as a feature-space denoising augmentation mechanism rather than a full topology-generative graph diffusion model: it constructs noise-perturbed node-feature views under a cosine schedule and uses contrastive learning to stabilize node representations across perturbations. The spectral attention module further adaptively emphasizes fraud-relevant hop-level and relation-level cues. We evaluate ADC-GNN primarily on three public benchmarks and additionally report a proprietary real-world telecom transaction dataset with approximately 60,000 records as a private case study. Under the 1% training setting, ADC-GNN achieves consistent improvements over original graph fraud baselines and four protocol-consistent recent graph anomaly/fraud baselines on the public benchmarks. Additional analyses on split stability, training ratios, oversampling alternatives, module-level ablations, diffusion schedules, and runtime and memory-consumption comparisons further characterize the effective operating regime of ADC-GNN.

基于图的欺诈检测对于保护大规模交易系统至关重要，未被检测到的异常可能导致重大经济损失和安全风险。现实世界的欺诈图面临两个相互耦合的挑战：稀疏且不平衡的监督，即已验证的欺诈标签稀缺且严重偏向正常账户；以及表示稀释，即空间消息传递可能过度平滑伪装异常，而谱滤波器可能抑制欺诈相关的中高频不规则性。为应对这些挑战，我们提出ADC-GNN，即注意力引导的扩散对比图神经网络（Attention-guided Diffusion-Contrastive Graph Neural Network），它是一个统一框架，结合了扩散引导的特征增强、对比表示学习和多跳谱注意力，用于小样本图欺诈检测。扩散组件被形式化为特征空间去噪增强机制，而非完全拓扑生成的图扩散模型：它在余弦调度下构建噪声扰动的节点特征视图，并使用对比学习来稳定节点在扰动下的表示。谱注意力模块进一步自适应地强调欺诈相关的跳级和关系级线索。我们主要在三个公开基准数据集上评估ADC-GNN，并额外报告了一个包含约60,000条记录的真实世界电信交易数据集作为私有案例研究。在1%训练设置下，ADC-GNN在公开基准数据集上相对于原始图欺诈基线和四个协议一致的最新图异常/欺诈基线取得了一致的改进。对划分稳定性、训练比例、过采样替代方案、模块级消融、扩散调度以及运行时和内存消耗的进一步分析进一步刻画了ADC-GNN的有效工作范围。

Text-guided image editing has advanced rapidly with diffusion models and unified multimodal foundation models. However, most existing methods remain confined to single-turn settings, overlooking the more realistic scenario of multi-turn in-context editing, where users iteratively refine an image through a sequence of instructions. In this setting, a model must follow each new instruction while preserving accumulated session-level constraints, challenged by two coupled failure modes: long-context dilution, where sparse textual constraints become difficult to recover from growing interleaved image-text histories, and state contamination, where earlier editing mistakes degrade subsequent generations. We introduce Edit-R2, a novel reinforcement learning post-training framework for unified multimodal models. Edit-R2 reconstructs the operative session intent, which effectively consolidates scattered historical constraints into an explicit reasoning trace before each editing turn. It further enables multi-turn RL over both reasoning and generation through a unified objective that jointly optimizes intent reconstruction generation in discrete text space and flow-matching image generation in continuous latent space, while a trajectory filtering mechanism suppresses corrupted rollouts to stabilize training under state contamination. To support systematic evaluation, we introduce MICE-Bench, a large-scale benchmark for multi-turn in-context editing with automated metrics for instruction following (IF), content consistency (CC), and global awareness (GA) over accumulated session constraints. Experiments show that Edit-R2 substantially improves multi-turn in-context editing and achieves competitive performance compared against strong baselines.

文本引导的图像编辑随着扩散模型和统一多模态基础模型的发展而快速进步。然而，现有大多数方法仍局限于单轮设置，忽略了更现实的多轮上下文编辑场景，即用户通过一系列指令迭代式地优化图像。在此设置下，模型必须在保留累积的会话级约束的同时遵循每条新指令，并面临两种耦合的失败模式：长上下文稀释，即稀疏的文本约束在不断增长的交错图像-文本历史中变得难以恢复；以及状态污染，即早期的编辑错误会降低后续生成的质量。我们提出了Edit-R2，这是一个用于统一多模态模型的新型强化学习后训练框架。Edit-R2重建操作性的会话意图，在每次编辑之前将分散的历史约束有效整合为明确的推理轨迹。它还通过统一目标实现推理和生成的多轮强化学习，在离散文本空间中联合优化意图重建生成，在连续潜在空间中优化流匹配图像生成，同时轨迹过滤机制抑制损坏的 rollout 以在状态污染下稳定训练。为了支持系统性评估，我们引入了MICE-Bench，这是一个用于多轮上下文编辑的大规模基准测试，包含指令遵循（IF）、内容一致性（CC）和累积会话约束的全局感知（GA）的自动化指标。实验表明，Edit-R2显著提升了多轮上下文编辑的性能，并取得了与强基线相比具有竞争力的表现。

While orthogonal subspace methods try to mitigate task interference in Continual Learning (CL), they often suffer from energy diffusion across the basis, hindering knowledge compaction and exhausting capacity for future tasks. We observe that output feature drift induced by parameter updates is inherently low-rank, and theoretically prove that preserving parameters along the principal directions of this drift minimizes the output reconstruction error. Motivated by this, we propose \textbf{E}nergy-Concentrated and \textbf{E}nergy-Ordered \textbf{Lo}w-\textbf{R}ank \textbf{A}daptation (E$^2$-LoRA). By explicitly ordering and concentrating knowledge into leading ranks, E$^2$-LoRA frees capacity for subsequent tasks. Furthermore, we design a dynamic rank allocation strategy to balance stability and plasticity by jointly optimizing energy retention and model plasticity. Extensive experiments across multiple benchmarks demonstrate that E$^2$-LoRA achieves state-of-the-art performance. Code is available at https://github.com/kiddo127/E2-LoRA.

尽管正交子空间方法试图缓解持续学习（CL）中的任务干扰问题，但它们经常面临基向量之间能量扩散的困境，这阻碍了知识压缩并耗尽了未来任务的容量。我们观察到参数更新引起的输出特征漂移本质上是低秩的，并从理论上证明，沿着该漂移主方向保留参数可以最小化输出重构误差。受此启发，我们提出了能量集中且能量有序的低秩适应（E²-LoRA）。通过将知识明确排序并集中到前导秩中，E²-LoRA为后续任务释放了容量。此外，我们设计了一种动态秩分配策略，通过联合优化能量保持和模型可塑性来平衡稳定性和可塑性。在多个基准测试上的广泛实验表明，E²-LoRA实现了最先进的性能。代码可访问 https://github.com/kiddo127/E2-LoRA。

We present GeoFace, a geometry-constrained multi-view diffusion framework for consistent face generation from a single input. % While recent multi-view diffusion models achieve photorealistic synthesis at the per-view level, they lack an explicit mechanism to enforce a shared 3D structure across views, often leading to inconsistent geometry across viewpoints. To address this, GeoFace proposes a unified dual-stream framework for joint generation of multi-view RGB images and 3D face geometry, where the appearance and geometry streams interact through shared attention layers. To encourage the two streams to mutually constrain each other, we introduce a geometry-guided attention alignment loss that supervises the cross-attention between appearance and geometry tokens with 3D-consistent correspondences, enabling the appearance stream to correctly reference pose-invariant geometric cues for robust alignment across viewpoints. Geometry is represented as a canonical UV position map, derived from a FLAME mesh fitted to multi-view observations, serving as a view-invariant shared constraint across all generated views. Experiments on RenderMe-360 and NeRSemble demonstrate that GeoFace consistently outperforms existing methods in both visual quality and cross-view geometric consistency, facilitating more efficient 3D reconstruction.

本文提出GeoFace，一个用于从单张输入图像生成一致性人脸的几何约束多视图扩散框架。现有的多视图扩散模型虽能在单视图层面实现逼真合成，但缺乏在视图间强制执行共享3D结构的明确机制，常导致视角间几何不一致。为解决这一问题，GeoFace提出统一的双流框架，用于联合生成多视图RGB图像和3D人脸几何，其中外观流与几何流通过共享注意力层进行交互。为促使两流相互约束，本文引入几何引导的注意力对齐损失，该损失使用3D一致性对应关系监督外观token与几何token之间的交叉注意力，使外观流能够正确参考姿态不变的几何线索，从而实现跨视角的稳健对齐。几何表示采用规范UV位置图，该位置图源自拟合至多视图观测的FLAME网格，作为所有生成视图的视图不变共享约束。在RenderMe-360和NeRSemble数据集上的实验表明，GeoFace在视觉质量和跨视图几何一致性方面均始终优于现有方法，有助于实现更高效的3D重建。

Recent advances in video diffusion models have greatly improved visual fidelity, yet their generated motions often violate physical plausibility. We observe a common kinematic failure, "motion entanglement", the unintended coupling of independent motion sources, such as camera movement and object motion. We identify that this issue stems from data bias and the reconstruction-based training design of diffusion models. Training on noisy videos that still retain coarse motion cues inadvertently encourages the model to replicate existing motion without an incentive to learn how to model kinematically-grounded motions. To address this, we propose a Self-Imagination Fine-Tuning (SIFT) paradigm, which enables the model to learn from its own generated videos rather than directly reconstructing real ones, breaking the reconstruction shortcut. We further employ motion-aware discriminative supervision and a progressive hard-case replay strategy to stabilize and accelerate learning. By leveraging freely-generated text prompts, our method can densely cover a broad motion space, including rare or finely-disentangled scenarios that would be costly to collect as video data. Extensive experiments demonstrate that our approach substantially improves the physical realism, motion disentanglement, and controllability of generated videos.

近期视频扩散模型的进展显著提升了视觉保真度，但其生成的运动往往违背物理合理性。本研究发现了一种常见的运动学故障——「运动纠缠」，即独立运动源（如摄像机运动与物体运动）之间的非预期耦合。本工作指出该问题源于数据偏差及扩散模型基于重建的训练设计。在仍保留粗略运动线索的噪声视频上进行训练，会无意中鼓励模型复制现有运动，而缺乏学习基于运动学建模运动的激励机制。为此，本研究提出了一种自我想象微调（SIFT）范式，使模型能够从自身生成的视频中学习，而非直接重建真实视频，从而打破重建捷径。本研究进一步采用运动感知判别监督和渐进式困难案例回放策略来稳定和加速学习。通过利用自由生成的文本提示，本方法能够密集覆盖广泛的运动空间，包括罕见或精细解耦的场景，而这些场景若作为视频数据收集则成本高昂。大量实验表明，本方法显著提升了生成视频的物理真实感、运动解耦性和可控性。

End-to-end pixel-space diffusion models bypass the lossy compression of Latent Diffusion Models (LDMs) but struggle to jointly model low-frequency semantics and high-frequency signals in high-dimensional space. Existing works heavily rely on complex pixel decoders to alleviate this issue. In this paper, we challenge this trend by revealing that these decoders primarily compensate for the optimization difficulties inherent to velocity prediction ($v$-prediction). Under the clean data paradigm ($x$-prediction), they are redundant. Motivated by this insight, we advocate for simplicity over complexity and introduce PixelU, a minimalist, single-stage U-shaped Diffusion Transformer tailored for pixel space. PixelU abandons auxiliary decoders in favor of zero-cost skip connections, which provide an "information highway" that directly routes uncorrupted high-frequency spatial details from shallow to deep layers. To further enable the backbone to focus exclusively on modeling low-frequency semantics, we introduce a constant-channel spatial down-sampling mechanism as a natural low-pass filter, which compresses deep features into a compact, low-frequency semantic manifold. Extensive experiments demonstrate that this decoupling of frequencies could outperform the strong baseline (JiT-G) with only about 1/3 of its computation cost. On ImageNet 256$\times$256 and 512$\times$512, PixelU achieves FID of 1.63 and 1.92 respectively, surpassing recent pixel-space methods and establishing a simple yet powerful new paradigm for end-to-end diffusion models.

端到端像素空间扩散模型绕过了潜在扩散模型（LDM）的有损压缩，但在高维空间中难以联合建模低频语义和高频信号。现有工作严重依赖复杂的像素解码器来解决这一问题。本文挑战这一趋势，揭示这些解码器主要用于弥补速度预测（v-prediction）固有的优化困难。在干净数据范式（x-prediction）下，它们是冗余的。基于这一洞察，我们主张化繁为简，推出PixelU——一种专为像素空间设计的极简单阶段U形扩散Transformer。PixelU摒弃了辅助解码器，采用零成本跳跃连接，提供了一条“信息高速公路”，将未受损的高频空间细节直接从浅层传递到深层。为进一步使骨干网络专注于建模低频语义，我们引入恒定通道空间下采样机制作为自然低通滤波器，将深层特征压缩到紧凑的低频语义流形中。大量实验表明，这种频率解耦仅用约1/3的计算成本就能超越强基线（JiT-G）。在ImageNet 256×256和512×512上，PixelU的FID分别达到1.63和1.92，超越了现有的像素空间方法，建立了端到端扩散模型简洁而强大的新范式。

Unified fashion generation integrates tasks like virtual try-on and garment reconstruction into a single model to reduce task-specific adaptation costs. However, naive parameter sharing across semantically distinct tasks induces negative transfer through severe inter-task gradient conflict. We propose OrthoTryOn, a unified framework mitigating this interference within a shared Low-Rank Adaptation (LoRA) module. Its Orthogonal Subspace Projection (OSP) applies task-specific orthogonal rotations to bottleneck features, mapping them into decorrelated coordinate frames. To address residual semantic coupling at inference time, we further propose Fisher-guided Negative Guidance (FNG), a parameter-free strategy that utilizes diagonal Fisher information to quantify inter-task sensitivity overlap and explicitly repels generation trajectories from the most confusable task via Classifier-Free Guidance. Extensive experiments demonstrate that OrthoTryOn avoids the severe performance degradation typical of naive unified training and even surpasses independently trained task-specific models, achieving state-of-the-art results across multiple benchmarks while generalizing robustly across diverse diffusion backbones. Code is available at https://github.com/NJU-PCALab/OrthoTryOn.

统一时尚生成将虚拟试穿和服装重建等任务整合到单一模型中，以降低任务适配成本。然而，在语义不同的任务之间进行朴素参数共享会导致严重的任务间梯度冲突，从而引发负迁移问题。我们提出OrthoTryOn，这是一个统一的框架，通过共享的低秩适应（LoRA）模块缓解这种干扰。其正交子空间投影（OSP）方法对瓶颈特征应用任务特定的正交旋转，将其映射到解相关的坐标框架中。为解决推理时残留的语义耦合问题，我们进一步提出费雪引导的负向引导（FNG）策略，该策略利用对角费雪信息量化任务敏感度重叠，并通过无分类器引导明确地将生成轨迹从最易混淆的任务中驱离。大量实验表明，OrthoTryOn避免了朴素统一训练中常见的严重性能退化，甚至超越了独立训练的任务特定模型，在多个基准测试中实现了最先进的结果，并在不同的扩散主干网络上展现出强大的泛化能力。代码可访问https://github.com/NJU-PCALab/OrthoTryOn。

Analyzing fine-grained skill activities (e.g., sports, surgery) requires not only recognizing visual patterns but also performing step-by-step visual reasoning that leads to the final judgment. While recent advances in action quality assessment have achieved remarkable progress in evaluating performance, existing models remain black boxes, where they lack the ability to explicitly reveal the reasoning processes underlying their judgments. To address this limitation, we propose Latent Visual Diffusion Reasoning (LVDR), a novel framework that integrates keypoint-guided Monte Carlo Tree Search (MCTS) to model and visualize the latent visual reasoning process. LVDR not only produces more accurate skill assessments but also uncovers the critical visual reasoning sequences that contribute to the final evaluation. Extensive experiments across four datasets spanning diverse sports and surgical domains demonstrate that LVDR achieves competitive quantitative performance while providing interpretable visual reasoning trajectories leading to the final predictions. Source codes and models can be found through the following link: https://github.com/XiruiTeng/LVDR_Official.git.

分析细粒度技能活动（如体育运动、外科手术）不仅需要识别视觉模式，还需要执行逐步的视觉推理以得出最终判断。虽然动作质量评估领域的最新进展在评估性能方面取得了显著进展，但现有模型仍然是黑箱模型，缺乏明确揭示其判断背后推理过程的能力。为解决这一局限性，我们提出了潜在视觉扩散推理（Latent Visual Diffusion Reasoning, LVDR）这一新型框架，该框架整合了关键点引导的蒙特卡洛树搜索（keypoint-guided Monte Carlo Tree Search, MCTS）来建模和可视化潜在视觉推理过程。LVDR不仅能够产生更准确的技能评估，还能揭示对最终评价至关重要的关键视觉推理序列。在涵盖不同体育和外科领域的四个数据集上进行的广泛实验表明，LVDR在实现具有竞争力的定量性能的同时，还提供了可解释的通往最终预测的视觉推理轨迹。源代码和模型可通过以下链接获取：https://github.com/XiruiTeng/LVDR_Official.git

Reconstructing high-fidelity, relightable 3D avatars from a single in-the-wild image is a challenging ill-posed problem, primarily hindered by the scarcity of high-quality PBR data and the complexity of disentangling illumination from intrinsic materials. In this paper, we present a data-efficient framework that leverages the robust priors of a unified pre-trained diffusion backbone to sequentially address texture completion, delighting, and material decomposition. Unlike existing methods that rely on fragmented pipelines or extensive proprietary datasets, we utilize cascaded Low-Rank Adaptations (LoRAs) to adapt the strong generative prior of the diffusion model for each sub-task in UV space. Specifically, we first employ an Inpainting LoRA to complete missing UV textures caused by occlusion, leveraging the model's semantic understanding to generate semantically and photometrically coherent details. Subsequently, a Light-Homogenization LoRA and a novel Cross-Intrinsic Attention mechanism are introduced to remove baked-in lighting and collaboratively synthesize pixel-aligned PBR maps (Albedo, Normal, Roughness, Specular, and Displacement). To ensure physical plausibility, we impose a UV-space differentiable BRDF shading loss during the decomposition stage, forcing the generative process to adhere to the rendering equation without the artifacts typical of rasterization-based supervision. Extensive experiments demonstrate that our method, trained on fewer than 100 real 3D scans, generates comprehensive, 4K-resolution PBR assets with superior realism and generalization compared to state-of-the-art methods, and all training code and model weights will be released upon acceptance.

从单张自然场景图像重建高保真、可重光照的3D头像是一个具有挑战性的不适定问题，主要受到高质量PBR数据稀缺以及光照与材质分离复杂性的制约。本论文提出了一种数据高效利用的框架，利用统一预训练扩散模型的强大先验知识，依次完成纹理补全、光照分离和材质分解。与现有依赖碎片化流程或大规模专有数据集的方法不同，我们采用级联低秩适配（LoRA）来针对UV空间中的每个子任务对扩散模型的强生成先验进行适配。具体而言，我们首先使用修复LoRA来补全因遮挡导致的缺失UV纹理，利用模型的语义理解能力生成语义和光度上连贯的细节。随后，引入光照均衡化LoRA和一种新颖的跨内在属性注意力机制来消除烘焙光照，并协作合成像素对齐的PBR贴图（反照率、法线、粗糙度、高光和位移）。为确保物理合理性，我们在分解阶段施加UV空间可微分BRDF着色损失，强制生成过程遵循渲染方程，避免基于光栅化监督产生的伪影。大量实验表明，我们的方法仅使用不到100个真实3D扫描进行训练，即可生成全面、4K分辨率的PBR资产，在真实感和泛化能力方面优于现有最先进方法，且所有训练代码和模型权重将在论文被接受后发布。

Diffusion models excel in solving imaging inverse problems due to their ability to model complex image priors. However, their reliance on large, clean datasets for training limits their practical use where clean data is scarce. In this paper, we propose EMDiffusion, an expectation-maximization (EM) approach to train diffusion models from corrupted observations. Our method alternates between reconstructing clean images from corrupted data using a known diffusion model (E-step) and refining diffusion model weights based on these reconstructions (M-step). This iterative process leads the learned diffusion model to gradually converge to the true clean data distribution. We validate our method through extensive experiments on diverse computational imaging tasks, including random inpainting, denoising, and deblurring, achieving new state-of-the-art performance.

扩散模型在解决成像逆问题方面表现出色，这归功于其模拟复杂图像先验的能力。然而，其对大规模清洁数据集的依赖限制了其在清洁数据稀缺场景中的实际应用。本文提出EMDiffusion，一种期望最大化（EM）方法，用于从损坏观测中训练扩散模型。我们的方法在使用已知扩散模型从损坏数据中重建清洁图像（E步）与根据这些重建结果优化扩散模型权重（M步）之间交替进行。该迭代过程使学习到的扩散模型逐渐收敛至真实的清洁数据分布。我们通过在多种计算成像任务（包括随机修复、去噪和去模糊）上开展大量实验来验证本方法，取得了新的最先进性能。

We present StableMotion, a novel framework that leverages geometric and content priors from pretrained large-scale image diffusion models for motion estimation in single-image rectification tasks such as Stitched Image Rectangling (SIR) and Rolling Shutter Correction (RSC). Specifically, StableMotion takes a text-to-image Stable Diffusion (SD) model as its backbone and repurposes it as an image-to-motion estimator. To mitigate inconsistent outputs produced by diffusion models, we propose Adaptive Ensemble Strategy (AES), which consolidates multiple outputs into a cohesive, high-fidelity result. Additionally, we present Sampling Steps Disaster (SSD), a counterintuitive phenomenon in which increasing the number of sampling steps can lead to poorer outcomes, motivating our one-step inference design. StableMotion is evaluated on two image rectification tasks and delivers state-of-the-art performance on both, while also showing promising transferability through qualitative examples and no-reference evaluations on unseen SIR-OOD and real-captured RSC benchmarks. Supported by SSD, StableMotion achieves efficient one-step inference, offering over 100$\times$ speedup compared to previous diffusion model-based methods even when combined with the optional AES post-processing. Code and weights are available at https://github.com/ivowang/StableMotion.

我们提出了StableMotion，这是一个新颖的框架，利用预训练大规模图像扩散模型的几何和内容先验来估计单图像校正任务中的运动，例如拼接图像矫正（SIR）和滚动快门校正（RSC）。具体而言，StableMotion以文生图Stable Diffusion（SD）模型为主干，并将其重新用作图像到运动估计器。为了缓解扩散模型产生的不一致输出，我们提出了自适应集成策略（AES），该策略将多个输出整合为连贯、高保真的结果。此外，我们提出了采样步数灾难（SSD）这一反直觉现象，即增加采样步数反而可能导致更差的结果，这促使我们设计单步推理。StableMotion在两个图像校正任务上进行了评估，并在两者上都实现了最先进的性能，同时通过对未见过的SIR-OOD和真实拍摄的RSC基准的定性示例和无参考评估展示了有前景的迁移能力。在SSD的支持下，StableMotion实现了高效的单步推理，即使结合可选的AES后处理，相比之前的基于扩散模型的方法也能实现超过100倍的加速。代码和权重可在https://github.com/ivowang/StableMotion获取。

Most end-to-end autonomous driving methods rely on imitation learning from single expert demonstrations, often leading to conservative and homogeneous behaviors that limit generalization in complex real-world scenarios. In this work, we propose DIVER, an end-to-end driving framework that integrates reinforcement learning with diffusion-based generation to produce diverse and feasible trajectories. At the core of DIVER lies a reinforced diffusion-based generation mechanism. First, the model conditions on map elements and surrounding agents to generate multiple reference trajectories from a single ground-truth trajectory, alleviating the limitations of imitation learning that arise from relying solely on single expert demonstrations. Second, reinforcement learning is employed to guide the diffusion process, where reward-based supervision enforces safety and diversity constraints on the generated trajectories, thereby enhancing their practicality and generalization capability. Furthermore, to address the limitations of L2-based open-loop metrics in capturing trajectory diversity, we propose a novel Diversity metric to evaluate the diversity of multi-mode predictions.Extensive experiments on the closed-loop NAVSIM and Bench2Drive benchmarks, as well as the open-loop nuScenes dataset, demonstrate that DIVER significantly improves trajectory diversity, effectively addressing the mode collapse problem inherent in imitation learning.

大多数端到端自动驾驶方法依赖于模仿单一专家演示，往往导致保守且同质化的行为，限制了复杂真实场景中的泛化能力。在本工作中，我们提出DIVER，一个将强化学习与扩散生成相结合的端到端驾驶框架，以产生多样且可行的轨迹。DIVER的核心是强化扩散生成机制。首先，模型以地图元素和周围交通参与者为条件，从单一真值轨迹生成多条参考轨迹，从而缓解了仅依赖单一专家演示的模仿学习所带来的局限性。其次，采用强化学习来引导扩散过程，其中基于奖励的监督对生成轨迹施加安全和多样性约束，从而增强其实用性和泛化能力。此外，针对基于L2距离的开环指标在捕捉轨迹多样性方面的局限性，我们提出了一种新颖的多样性指标来评估多模态预测的多样性。在闭环NAVSIM和Bench2Drive基准测试以及开环nuScenes数据集上的大量实验表明，DIVER显著提高了轨迹多样性，有效解决了模仿学习固有的模式崩溃问题。

This study focuses on a challenging yet promising task, Text-to-Sounding-Video (T2SV) generation, which aims to generate a video with synchronized audio from text conditions, meanwhile ensuring both modalities are aligned with text. Despite progress in joint audio-video training, two critical challenges still remain unaddressed: (1) a single, shared text caption where the text for video is equal to the text for audio often creates modal interference, confusing the pretrained backbones, and (2) the optimal mechanism for cross-modal feature interaction remains unclear. To address these challenges, we first propose the Hierarchical Visual-Grounded Captioning (HVGC) framework that generates pairs of disentangled captions, a video caption, and an audio caption, eliminating interference at the conditioning stage. Based on HVGC, we further introduce BridgeDiT, a novel dual-tower diffusion transformer, which employs a Dual CrossAttention (DCA) mechanism that acts as a robust ``bridge" to enable a symmetric, bidirectional exchange of information, achieving both semantic and temporal synchronization. Extensive experiments on three benchmark datasets, supported by human evaluations, demonstrate that our method achieves state-of-the-art results on most metrics. Comprehensive ablation studies further validate the effectiveness of our contributions, offering key insights for the future T2SV task. All the codes and checkpoints will be publicly released.

本研究聚焦于一项具有挑战性且前景广阔的任务——文本到声音视频（Text-to-Sounding-Video, T2SV）生成，旨在根据文本条件生成带有同步音频的视频，同时确保视频和音频两种模态均与文本对齐。尽管在联合音视频训练方面取得了进展，但两个关键挑战仍未得到解决：（1）单一共享文本描述（视频文本与音频文本相同）经常造成模态干扰，使预训练骨干网络产生混淆；（2）跨模态特征交互的最优机制尚不明确。为解决这些挑战，我们首先提出分层视觉 grounded 描述生成（Hierarchical Visual-Grounded Captioning, HVGC）框架，该框架生成解耦的描述文本对——视频描述和音频描述，从而在条件生成阶段消除干扰。在此基础上，我们进一步提出 BridgeDiT——一种新型双塔扩散变换器，采用双向交叉注意力（Dual CrossAttention, DCA）机制作为稳健的“桥梁”，实现对称双向的信息交换，达到语义和时间上的双重同步。在三个基准数据集上的大量实验及人工评估表明，我们的方法在大多数指标上达到了最先进水平。全面的消融实验进一步验证了我们所提出贡献的有效性，为未来 T2SV 任务提供了关键洞察。所有代码和检查点将公开发布。

Portrait animation has witnessed tremendous quality improvements thanks to recent advances in video diffusion models. However, these 2D methods often compromise 3D consistency and speed, limiting their applicability in real-world scenarios, such as digital twins or telepresence. In contrast, 3D-aware feedforward facial animation methods -- built upon 3D representations, such as neural radiance fields or Gaussian splatting -- ensure 3D consistency and achieve faster inference speed, but come with inferior expression details. In this paper, we address this portrait animation trilemma (speed, 3D consistency, and expressiveness) and propose a pipeline that instantly converts an in-the-wild single image into a 3D-consistent, fast yet expressive animatable representation via a feed-forward encoder. Unlike previous computationally intensive global fusion mechanisms (e.g., multiple attention layers) for fusing 3D structural and animation information, our design employs an efficient lightweight local fusion strategy to achieve high animation expressivity. Furthermore, our animation representation is decoupled from the face's 3D representation and learns motion implicitly from data, eliminating the dependency on pre-defined parametric models that often constrain animation capabilities. Our method runs at 107.31 FPS for animation and pose control, representing a 3-4 order of magnitude speedup versus the state of the art while achieving comparable animation quality, thus surpassing alternative designs that trade speed for quality or vice versa.

肖像动画领域得益于视频扩散模型的最新进展，呈现出显著的质量提升。然而，这些二维方法往往以牺牲三维一致性和速度为代价，限制了其在数字孪生或远程临场等现实场景中的应用。相比之下，基于神经辐射场或高斯溅射等三维表征构建的三维感知前馈面部动画方法虽能保证三维一致性并实现更快的推理速度，但表情细节表现不足。本文针对这一肖像动画三难困境（速度、三维一致性和表现力），提出了一种通过前馈编码器将任意野外单图像即时转换为三维一致、快速且可驱动的高表现力表征的流水线。与以往用于融合三维结构与动画信息的计算密集型全局融合机制（如多层注意力机制）不同，本设计采用高效的轻量级局部融合策略来实现高动画表现力。此外，我们的动画表征与面部三维表征解耦，从数据中隐式学习运动，摆脱了对预定义参数化模型的依赖，而这些模型往往会限制动画能力。我们的方法在动画和姿态控制方面达到107.31 FPS的运行速度，与最先进的方法相比实现了3-4个数量级的加速，同时达到了可比的动画质量，从而超越了那些在速度与质量之间进行权衡的替代方案。

Existing video object removal methods predominantly rely on diffusion models following a noise-to-data paradigm, where generation starts from uninformative Gaussian noise. This approach discards the rich structural and contextual priors present in the original input video. Consequently, such methods often lack sufficient guidance, leading to incomplete object erasure or the synthesis of implausible content that conflicts with the scene's physical logic. In this paper, we reformulate video object removal as a video-to-video translation task via a stochastic bridge model. Unlike noise-initialized methods, our framework establishes a direct stochastic path from the source video (with objects) to the target video (objects removed). This bridge formulation effectively leverages the input video as a strong structural prior, guiding the model to perform precise removal while ensuring that the filled regions are logically consistent with the surrounding environment. To address the trade-off where strong bridge priors hinder the removal of large objects, we propose a novel adaptive mask modulation strategy. This mechanism dynamically modulates input embeddings based on mask characteristics, balancing background fidelity with generative flexibility. Extensive experiments demonstrate that our approach significantly outperforms existing methods in both visual quality and temporal consistency. The project page is https://bridgeremoval.github.io/.

现有视频目标移除方法主要遵循噪声到数据范式的扩散模型，生成过程从无信息的高斯噪声开始。这种方法忽视了原始输入视频中丰富的结构和上下文先验。因此，这些方法往往缺乏足够的指导，导致对象擦除不完整或合成出与场景物理逻辑相悖的不合理内容。本研究将视频目标移除重新定义为一个通过随机桥模型实现的视频到视频转换任务。与噪声初始化方法不同，我们的框架建立了一条从源视频（含目标）到目标视频（目标已移除）的直接随机路径。这种桥接方法有效地利用了输入视频作为强大的结构先验，引导模型进行精确的移除操作，同时确保填充区域与周围环境在逻辑上保持一致。为了解决强桥接先验阻碍大目标移除的权衡问题，我们提出了一种新型的自适应掩码调制策略。该机制基于掩码特征动态调制输入嵌入，在背景保真度和生成灵活性之间取得平衡。大量实验表明，我们的方法在视觉质量和时间一致性方面均显著优于现有方法。

Visual navigation requires agents to reach goals in complex environments through perception and planning. World models address this task by simulating action-conditioned state transitions to predict future observations. Current navigation world models typically learn state evolution under actions within the compressed latent space of a Variational Autoencoder, where spatial compression often discards fine-grained structural information and hinders precise control. To better understand the propagation characteristics of different representations, we conduct a linear dynamics probe and observe that dense DINOv2 features exhibit stronger linear predictability for action-conditioned transitions. Motivated by this observation, we propose the Representation Autoencoder-based Navigation World Model (RAE-NWM), which models navigation dynamics in a dense visual representation space. We employ a Conditional Diffusion Transformer with Decoupled Diffusion Transformer head (CDiT-DH) to model continuous transitions, and introduce a separate time-driven gating module for dynamics conditioning to regulate action injection strength during generation. Extensive evaluations show that modeling sequential rollouts in this space improves structural stability and action accuracy, benefiting downstream planning and navigation.

视觉导航需要智能体通过感知和规划在复杂环境中到达目标位置。世界模型通过模拟动作条件下的状态转换来预测未来观测，从而解决这一任务。当前导航世界模型通常在变分自编码器的压缩潜在空间中学习动作下的状态演化，其中空间压缩往往丢失细粒度结构信息并阻碍精确控制。为更好地理解不同表示的传播特性，我们进行了线性动力学探测，发现密集的DINOv2特征对动作条件转换表现出更强的线性可预测性。受此启发，我们提出了基于表示自编码器的导航世界模型（RAE-NWM），该模型在密集视觉表示空间中建模导航动态。我们采用带解耦扩散变换器头的条件扩散变换器（CDiT-DH）来建模连续转换，并引入独立的时间驱动门控模块进行动态条件调节，以控制生成过程中动作注入的强度。广泛评估表明，在该空间中建模顺序展开能够提高结构稳定性和动作精度，有利于下游规划和导航。

We present GuidedSceneGen, a text-to-3D generation framework that produces metrically accurate, globally consistent, and semantically interpretable indoor scenes. Unlike prior text-driven methods that often suffer from geometric drift or scale ambiguity, our approach maintains an absolute world coordinate frame throughout the entire generation process. Starting from a textual scene description, we predict a global 3D layout encoding both semantic and geometric structure, which serves as a guiding proxy for downstream stages. A semantics- and depth-conditioned panoramic diffusion model then synthesizes 360{\deg} imagery aligned with the global layout, substantially improving spatial coherence. To explore unobserved regions, we employ a video diffusion model guided by optimized camera trajectories that balances coverage and collision avoidance, achieving up to 10x faster sampling compared to exhaustive path exploration. The generated views are fused using 3D Gaussian Splatting, yielding a consistent and fully navigable 3D scene in absolute scale. GuidedSceneGen enables accurate transfer of object poses and semantic labels from layout to reconstruction, and supports progressive scene expansion without re-alignment. Quantitative results and a user study demonstrate greater 3D consistency and layout plausibility compared to recent panoramic text-to-3D baselines.

我们提出了 GuidedSceneGen，一个文本到3D生成框架，能够生成度量准确、全局一致且语义可解释的室内场景。与以往存在几何漂移或尺度歧义问题的文本驱动方法不同，我们的方法在整个生成过程中保持绝对世界坐标系。给定文本场景描述，我们预测同时编码语义和几何结构的全局3D布局，作为下游阶段的引导代理。随后，一个语义和深度条件化的全景扩散模型生成与全局布局对齐的360°图像，显著提升了空间一致性。为探索未观测区域，我们采用由优化相机轨迹引导的视频扩散模型，在覆盖率和碰撞避免之间取得平衡，与穷举路径探索相比实现高达10倍的加速采样。生成的多视角图像通过3D高斯溅射进行融合，在绝对尺度下产生一致且完全可导航的3D场景。GuidedSceneGen能够准确地将物体姿态和语义标签从布局转移到重建结果中，并支持无需重新对齐的渐进式场景扩展。定量结果和用户研究表明，与最近的全景文本到3D基线方法相比，本方法具有更强的3D一致性和布局合理性。

Image-conditioned video diffusion models achieve impressive visual realism but often suffer from weakened motion fidelity, e.g., reduced motion dynamics or degraded long-term temporal coherence, especially after fine-tuning. We study motion alignment in video diffusion models post-training. To address this, we introduce pixel-motion rewards based on pixel flux dynamics, capturing both instantaneous and long-term motion consistency. We further propose \underline{S}mooth \underline{H}ybr\underline{i}d \underline{F}ine-\underline{t}uning (SHIFT), a scalable reward-driven framework that unifies supervised fine-tuning and advantage-weighted fine-tuning. Benefiting from novel adversarial advantages, SHIFT improves convergence speed and mitigates reward hacking. Experiments show that our approach efficiently resolves dynamic-degree collapse in modern video diffusion models supervised fine-tuning. Project page: https://xiye20.github.io/projects/SHIFT/.

图像条件视频扩散模型在视觉真实感方面取得了令人瞩目的成就，但往往存在运动保真度下降的问题，例如运动动态减弱或长期时间一致性退化，尤其是在微调之后。我们研究了视频扩散模型训练后的运动对齐问题。为此，我们引入了基于像素通量动态的像素运动奖励，以捕捉瞬时和长期运动一致性。我们进一步提出了平滑混合微调（SHIFT），这是一个可扩展的奖励驱动框架，统一了监督微调和优势加权微调。得益于新颖的对抗性优势，SHIFT提高了收敛速度并缓解了奖励作弊问题。实验表明，我们的方法有效地解决了现代视频扩散模型监督微调中的动态度崩溃问题。项目主页：https://xiye20.github.io/projects/SHIFT/.

Exo-to-Ego video generation aims to synthesize a first-person video from a synchronized third-person view and corresponding camera poses. While paired supervision is available, synchronized exo-ego data inherently introduces substantial spatio-temporal and geometric discontinuities, violating the smooth-motion assumptions of standard video generation benchmarks. We identify this synchronization-induced jump as the central challenge and propose Syn2Seq-Forcing, a sequential formulation that interpolates between the source and target videos to form a single continuous signal. By reframing Exo2Ego as sequential signal modeling rather than a conventional condition-output task, our approach enables diffusion-based sequence models, e.g. Diffusion Forcing Transformers (DFoT), to capture coherent transitions across frames more effectively. Empirically, we show that interpolating only the videos, without performing pose interpolation already produces significant improvements, emphasizing that the dominant difficulty arises from spatio-temporal discontinuities. Beyond immediate performance gains, this formulation establishes a general and flexible framework capable of unifying both Exo2Ego and Ego2Exo generation within a single continuous sequence model, providing a principled foundation for future research in cross-view video synthesis.

外到内视角视频生成旨在根据同步的第三人称视角及对应的相机姿态合成第一人称视频。虽然可以使用成对监督，但同步的外-内视角数据本质上会引入大量的时空和几何不连续性，违反了标准视频生成基准中的平滑运动假设。我们将这种同步引起的跳跃确定为核心挑战，并提出Syn2Seq-Forcing，这是一种序列 formulations，通过在源视频和目标视频之间进行插值来形成单一连续信号。通过将外到内视角重新定义为序列信号建模而非传统的条件输出任务，我们的方法使基于扩散的序列模型（如Diffusion Forcing Transformers，DFoT）能够更有效地捕捉跨帧的连贯转换。实证表明，仅对视频进行插值而不进行姿态插值 already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces significant improvements already produces

Camera-controllable image editing aims to synthesize novel views of a given scene under varying camera poses while strictly preserving cross-view geometric consistency. However, existing methods typically rely on fragmented geometric guidance, such as only injecting point clouds at the representation level despite models containing multiple levels, and are mainly based on image diffusion models that operate on discrete view mappings. These two limitations jointly lead to geometric drift and structural degradation under continuous camera motion. We observe that while leveraging video models provides continuous viewpoint priors for camera-controllable image editing, they still struggle to form stable geometric understanding if geometric guidance remains fragmented. To systematically address this, we inject unified geometric guidance across three levels that jointly determine the generative output: representation, architecture, and loss function. To this end, we propose UniGeo, a novel camera-controllable editing framework. Specifically, at the representation level, UniGeo incorporates a frame-decoupled geometric reference injection mechanism to provide robust cross-view geometry context. At the architecture level, it introduces geometric anchor attention to align multi-view features. At the loss function level, it proposes a trajectory-endpoint geometric supervision strategy to explicitly reinforce the structural fidelity of target views. Comprehensive experiments across multiple public benchmarks, encompassing both extensive and limited camera motion settings, demonstrate that UniGeo significantly outperforms existing methods in both visual quality and geometric consistency.

相机可控图像编辑旨在给定场景的不同相机姿态下合成新视图，同时严格保持跨视图几何一致性。然而，现有方法通常依赖于碎片化的几何引导，例如仅在表示层注入点云，尽管模型包含多个层级，且主要基于在离散视图映射上操作的图像扩散模型。这两个局限性共同导致连续相机运动下的几何漂移和结构退化。 我们观察到，尽管利用视频模型为相机可控图像编辑提供了连续视角先验，但如果几何引导仍然是碎片化的，它们仍难以形成稳定的几何理解。为了系统性地解决这一问题，我们在三个层级注入统一的几何引导：表示层、架构层和损失函数层，共同决定生成输出。 为此，我们提出了UniGeo，一种新颖的相机可控编辑框架。具体而言，在表示层，UniGeo引入了一种帧解耦几何参考注入机制，以提供鲁棒的跨视图几何上下文。在架构层，它引入了几何锚点注意力来对齐多视角特征。在损失函数层，它提出了轨迹端点几何监督策略，以明确强化目标视图的结构保真度。 在多个公开基准数据集上进行的全面实验，涵盖大范围和有限相机运动设置，表明UniGeo在视觉质量和几何一致性方面均显著优于现有方法。

Existing score-based methods for inverse problems often resort to approximate minimization of the KL divergence between the inversion distribution and the Bayesian posterior. Such an approximation leads to severe mode collapse and unreliable uncertainty quantification. In this paper, we propose Principled Posterior Matching (PPM), a framework that returns to the fundamentals of variational inference, rather than using tricky approximations. Instead of relying on heuristic approximations, we rigorously formulate the exact optimization of the KL divergence via the integration of Fisher divergence. We derive a tractable, equivalent gradient form of this integral, enabling precise optimization without the biases introduced by prior approximations. Our analysis clearly reveals that the mode collapse in previous methods stems directly from this approximation gap. Supported by our theoretical solution, PPM unifies two complementary paradigms: (1) In variational inference, PPM adopts mass-covering divergences that significantly improve the inversion diversity and uncertainty quantification; (2) In amortized inference, it enables the training of an efficient reconstruction network for rapid, single-step reconstruction. Furthermore, our formulation naturally extends to a broader family of divergence measures by generalizing the integral of the Fisher divergence. We validate PPM across challenging computational imaging tasks, including inpainting, super-resolution fluorescent microscopy, and radio interferometric black-hole imaging. In all experiments, PPM achieves superior reconstruction fidelity, faithful multimodal posterior recovery, and well-calibrated uncertainty estimates, establishing a robust framework for scientific imaging.

现有的基于分数的逆问题方法通常采用近似最小化反演分布与贝叶斯后验之间的KL散度。这种近似会导致严重的模式坍塌和不可靠的不确定性量化。本文提出了原则性后验匹配（PPM）框架，该框架回归变分推断的基本原理，而非使用技巧性近似。PPM不依赖启发式近似，而是通过费舍尔散度的积分严格推导KL散度的精确优化形式。我们推导了该积分的可处理、等价的梯度形式，使得无需引入先验近似的偏差即可进行精确优化。我们的分析清晰表明先前方法中的模式坍塌直接源于这种近似差距。在理论解决方案的支持下，PPM统一了两种互补范式：(1) 在变分推断中，PPM采用质量覆盖散度，显著提升了反演多样性和不确定性量化；(2) 在摊销推断中，它使得高效重建网络的训练成为可能，实现了快速单步重建。此外，我们的公式通过推广费舍尔散度的积分，自然地扩展到更广泛的散度度量家族。我们在具有挑战性的计算成像任务上验证了PPM，包括图像修复、超分辨率荧光显微镜和射电干涉黑洞成像。在所有实验中，PPM均实现了卓越的重建保真度、忠实的多模态后验恢复和良好校准的不确定性估计，为科学成像建立了稳健的框架。

Diffusion-based dataset distillation has recently emerged as a promising paradigm for condensing large-scale datasets into compact synthetic sets. By leveraging pretrained generative priors, these methods can produce realistic class-conditional samples more efficiently than traditional matching-based approaches. However, most existing diffusion-based methods still adopt a rigid ``Generate-and-Use'&x27; strategy, where the generated samples are directly treated as the final distilled set under a fixed images-per-class budget. Such a design tightly couples candidate generation with final budget allocation, which may result in redundant waste of the limited budget or insufficiently informative samples. In this paper, we propose ``Pool-Select-Refine'&x27;, a two-stage framework for allocation-aware generative dataset distillation. First, instead of directly using a fixed number of generated samples, we construct an over-complete candidate pool and select a compact subset under the target budget. Second, we refine the selected samples in latent space using soft-label supervision derived from the teacher model, improving semantic alignment while preserving the generative prior. This design explicitly decouples generation, selection, and refinement, enabling more effective use of the distillation budget. Experiments on large-scale and fine-grained image classification benchmarks show that the proposed framework delivers consistent gains over diffusion-based baselines. The results suggest that introducing a curation stage before refinement is a simple yet effective way to improve diffusion-based dataset distillation.

基于扩散的数据集蒸馏已成为一种前景广阔的新范式，用于将大规模数据集压缩为紧凑的合成集。通过利用预训练的生成先验，这些方法能够比传统基于匹配的方法更高效地生成逼真的类别条件样本。然而，现有的多数基于扩散的方法仍采用僵化的"生成并使用"策略，其中生成的样本在固定的每类图像预算下直接被视为最终的蒸馏集。这种设计将候选生成与最终预算分配紧密耦合，可能导致有限预算的冗余浪费或样本信息不足。本文提出"池化-选择-优化"，一个面向感知分配的生成式数据集蒸馏的两阶段框架。首先，我们不直接使用固定数量的生成样本，而是构建一个过度完整的候选池，并在目标预算下选择一个紧凑的子集。其次，我们利用教师模型派生的软标签监督在潜在空间中对选定的样本进行优化，在保持生成先验的同时增强语义对齐。这种设计明确解耦了生成、选择和优化过程，从而能够更有效地利用蒸馏预算。在大规模和细粒度图像分类基准上的实验表明，所提出的框架相比基于扩散的基线方法持续取得性能提升。结果表明，在优化之前引入精选阶段是一种简单而有效的方式来改进基于扩散的数据集蒸馏。

Training image generation foundation models consumes substantial resources. Previous methods have attempted to leverage semantic guidance to accelerate the training process, yet their experiments were only conducted on simple datasets such as ImageNet, at low resolutions, and with small-scale models. In this paper, we propose SeFi-Image, a text-to-image foundation model built upon semantic-first diffusion, a novel latent diffusion modeling paradigm. We instantiate SeFi-Image at three model scales, 1B, 2B, and 5B parameters, enabling systematic study of scaling behavior and flexible deployment under varying compute budgets. Notably, our largest 5B model was trained with merely 125K A800 GPU hours, corresponding to roughly 10-20% of the training compute used by Z-Image. However, it achieves results comparable to or even superior to Qwen-Image and Z-Image. Despite this modest training compute, SeFi-Image achieves strong performance on a wide range of benchmarks, including GenEval, DPG, LongTextBench, OneIG, and CVTG-2K. Moreover, we provide DMD2-distilled few-step turbo variants for each model scale to accommodate diverse hardware constraints and latency requirements. We publicly release our code, weights and hope this work offers the community useful insights into semantic-guided diffusion modeling for T2I generation, while also providing practical and readily deployable model options.

训练图像生成基础模型需要消耗大量资源。此前已有方法尝试利用语义指导来加速训练过程，但其实验仅在ImageNet等简单数据集、低分辨率和小规模模型条件下进行。本文提出SeFi-Image，一种基于语义优先扩散的文生图基础模型，这是一种新型的潜在扩散建模范式。我们将SeFi-Image实例化为三种模型规模（1B、2B和5B参数），从而能够系统研究扩展行为，并在不同计算预算下实现灵活部署。值得注意的是，我们最大的5B模型仅使用125K A800 GPU小时进行训练，约为Z-Image训练计算量的10%-20%，然而却取得了与Qwen-Image和Z-Image相当甚至更优的结果。尽管训练计算量较小，SeFi-Image在GenEval、DPG、LongTextBench、OneIG和CVTG-2K等广泛基准测试中均表现出色。此外，我们为每个模型规模提供了DMD2蒸馏的少步Turbo变体，以适应不同的硬件约束和延迟需求。我们公开发布了代码和模型权重，希望这项工作能为社区提供关于T2I生成中语义引导扩散建模的有益见解，同时提供实用且易于部署的模型选择。

Modern video diffusion transformers position their tokens through RoPE on the (u,v,t) axes -- a description of the camera's sampling grid that says nothing about the 3D structure of the scene. We observe that the geometric relation between two camera rays is captured by the Plucker reciprocal product, which is bilinear in the two rays -- the same algebraic form as the dot product in Transformer attention. Building on this analogy, we propose RayPE, a positional-encoding extension that injects per-token 6D Plucker coordinates additively into the queries and keys of self-attention, with a query/key flip arrangement under which the symmetric identity configuration coincides exactly with the reciprocal product. The injection is additive, the resulting attention score decomposes into a content term, a geometry term, and two content and geometry cross-terms -- all of which our experiments find individually necessary. To make the encoding stable across video data with heterogeneous camera-translation scales (SfM, deep SLAM, metric), we further decouple ray direction from moment magnitude, gate the encoding by a learned function of the log-magnitude, and apply RMSNorm to align it with the QKNorm-normalized content branch. The full module adds less than 0.1% parameters to a pretrained video DiT, is zero-initialized to start from the pretrained weights, and improves camera controllability, cross-frame 3D consistency, and overall video quality on a four-dataset training mixture.

现代视频扩散变换器通过RoPE在(u,v,t)轴上对token进行定位——这是对相机采样网格的描述，未涉及场景的3D结构。我们观察到，两条相机射线之间的几何关系由Plucker倒数积刻画，该积对两条射线是双线性的——与Transformer注意力中的点积代数形式相同。基于这一类比，我们提出RayPE，一个位置编码扩展方法，将每个token的6D Plucker坐标加性地注入自注意力的查询和键中，通过查询/键翻转排列，使得对称恒等配置恰好与倒数积重合。注入是加性的，所得注意力分数分解为一个内容项、一个几何项以及两个内容-几何交叉项——实验表明这些项各自都是必要的。为使编码在具有异构相机平移尺度的视频数据（SfM、深度SLAM、度量尺度）上保持稳定，我们进一步将射线方向与时间矩幅度解耦，用关于对数幅度的学习函数门控编码，并应用RMSNorm使其与QKNorm标准化的内容分支对齐。该模块为预训练视频DiT增加的参数不足0.1%，以零初始化开始以保持预训练权重，并在四数据集训练混合上提升了相机可控性、跨帧3D一致性和整体视频质量。

End-to-end pixel-space diffusion models bypass the lossy compression of Latent Diffusion Models (LDMs) but struggle to jointly model low-frequency semantics and high-frequency signals in high-dimensional space. Existing works heavily rely on complex pixel decoders to alleviate this issue. In this paper, we challenge this trend by revealing that these decoders primarily compensate for the optimization difficulties inherent to velocity prediction ($v$-prediction). Under the clean data paradigm ($x$-prediction), they are redundant. Motivated by this insight, we advocate for simplicity over complexity and introduce PixelU, a minimalist, single-stage U-shaped Diffusion Transformer tailored for pixel space. PixelU abandons auxiliary decoders in favor of zero-cost skip connections, which provide an "information highway" that directly routes uncorrupted high-frequency spatial details from shallow to deep layers. To further enable the backbone to focus exclusively on modeling low-frequency semantics, we introduce a constant-channel spatial down-sampling mechanism as a natural low-pass filter, which compresses deep features into a compact, low-frequency semantic manifold. Extensive experiments demonstrate that this decoupling of frequencies could outperform the strong baseline (JiT-G) with only about 1/3 of its computation cost. On ImageNet 256$\times$256 and 512$\times$512, PixelU achieves FID of 1.63 and 1.92 respectively, surpassing recent pixel-space methods and establishing a simple yet powerful new paradigm for end-to-end diffusion models.

端到端像素空间扩散模型绕过了潜在扩散模型（LDM）的有损压缩，但在高维空间中难以联合建模低频语义和高频信号。现有工作严重依赖复杂的像素解码器来解决这一问题。本文挑战这一趋势，揭示这些解码器主要用于弥补速度预测（v-prediction）固有的优化困难。在干净数据范式（x-prediction）下，它们是冗余的。基于这一洞察，我们主张化繁为简，推出PixelU——一种专为像素空间设计的极简单阶段U形扩散Transformer。PixelU摒弃了辅助解码器，采用零成本跳跃连接，提供了一条“信息高速公路”，将未受损的高频空间细节直接从浅层传递到深层。为进一步使骨干网络专注于建模低频语义，我们引入恒定通道空间下采样机制作为自然低通滤波器，将深层特征压缩到紧凑的低频语义流形中。大量实验表明，这种频率解耦仅用约1/3的计算成本就能超越强基线（JiT-G）。在ImageNet 256×256和512×512上，PixelU的FID分别达到1.63和1.92，超越了现有的像素空间方法，建立了端到端扩散模型简洁而强大的新范式。

Illegal logging and timber trade continue to pose significant challenges in the Philippines, where accurate wood species identification is essential for enforcement but limited by the need for specialised equipment and expertise. This study aims to evaluate whether AI models for macroscopic wood identification can be developed and deployed by wood scientists without programming expertise using the Xylorix platform, focusing on five Philippine hardwood species: Mangium (Acacia mangium Willd.), Rain Tree [Samanea saman (Jacq.) Merr.], Banuyo (Wallaceodendron celebicum Koord.), Tindalo [Afzelia rhomboidea (Blanco) Vidal], and Ipil [Intsia bijuga (Colebr.) O. Kuntze]. Binary classifiers were trained on 10,663 verified cross-section images from 260 specimens and evaluated using specimen-level mean scoring to mirror operational field conditions. Area Under the ROC Curve (AUC) values ranged from 0.969 (Ipil) to 1.000 (Mangium), and Average Precision (AP) values ranged from 0.589 (Samanea) to 1.000 (Mangium). Four of five species achieved AA grade (AUC and AP both \geq 0.90); Rain Tree received AE (AUC \geq 0.90, AP < 0.60) due to AP compression from its small positive test set (3 specimens). All five classifiers rank their target specimens above non-target specimens with near-perfect fidelity. Specimen-level error analysis revealed 9 false negatives from Ipil, primarily stemming from localized image artifacts and 3 false positives for Rain Tree and 1 false positive for Tindalo caused by shared tribal-level anatomical traits. These findings demonstrate that Xylorix non-programmers can leverage the Xylorix platform to construct operationally reliable wood identification models suitable for field deployment at supply chain checkpoints.

非法采伐和木材贸易在菲律宾仍然构成重大挑战，准确识别木材物种对于执法至关重要，但受限于专业设备和专业知识的需求。本研究旨在评估木材科学家是否能够在无需编程专业知识的情况下，利用Xylorix平台开发和部署用于宏观木材鉴定的人工智能模型，研究聚焦于五种菲律宾硬木树种：马占相思（Acacia mangium Willd.）、雨树[Samanea saman (Jacq.) Merr.]、巴努约（Wallaceodendron celebicum Koord.）、廷达洛[Afzelia rhomboidea (Blanco) Vidal]和伊比尔[Intsia bijuga (Colebr.) O. Kuntze]。二分类器基于来自260个样本的10,663张经核实的横截面图像进行训练，并采用样本级平均评分进行评估，以模拟实际操作现场条件。ROC曲线下面积（AUC）值从0.969（伊比尔）到1.000（马占相思）不等，平均精确率（AP）值从0.589（雨树）到1.000（马占相思）不等。五个物种中有四个达到AA级（AUC和AP均≥0.90）；雨树获得AE级（AUC≥0.90，AP<0.60），这是由于其阳性测试集样本量较小（3个样本）导致AP被压缩。五个分类器均以近乎完美的保真度将目标样本排在非目标样本之上。样本级错误分析显示，伊比尔出现9个假阴性，主要源于局部图像伪影；雨树出现3个假阳性，廷达洛出现1个假阳性，均由共享的族级解剖学特征引起。这些发现表明，非程序员木材科学家可以利用Xylorix平台构建适用于供应链检查点现场部署的运营可靠木材鉴定模型。