每日 arXiv 论文简报

Enabling embodied agents to imagine future states is essential for robust and generalizable visual navigation. Yet, state-of-the-art systems typically rely on modular designs that decouple navigation planning from visual world modeling, which often induces state-action misalignment and weak adaptability in novel or dynamic scenarios. We propose UniWM, a unified, memory-augmented world model that integrates egocentric visual foresight and planning within a single multimodal autoregressive backbone. UniWM explicitly grounds action selection in visually imagined outcomes, tightly aligning prediction with control. Meanwhile, a hierarchical memory mechanism fuses short-term perceptual cues with longer-term trajectory context, supporting stable and coherent reasoning over extended horizons. Extensive experiments on four challenging benchmarks (Go Stanford, ReCon, SCAND, HuRoN) and the 1X Humanoid Dataset show that UniWM improves navigation success rates by up to 30%, substantially reduces trajectory errors against strong baselines, generalizes zero-shot to the unseen TartanDrive dataset, and scales naturally to high-dimensional humanoid navigation. These results position UniWM as a principled step toward unified, imagination-driven embodied navigation. The code and models are available at https://github.com/UWMILab/UniWM.

使具身智能体能够想象未来状态对于实现鲁棒且可泛化的视觉导航至关重要。然而，当前最先进的方法通常依赖模块化设计，将导航规划与视觉世界建模解耦，这往往导致状态-动作错位以及在新颖或动态场景中适应性较弱。我们提出UniWM，一种统一的、记忆增强的世界模型，将自我中心的视觉预测与规划集成到单一的多模态自回归骨干网络中。UniWM将动作选择明确地基于视觉想象的结果，实现预测与控制之间的紧密对齐。同时，分层记忆机制将短期感知线索与长期轨迹上下文相融合，支持在扩展时域上进行稳定且连贯的推理。在四个具有挑战性的基准测试（Go Stanford、ReCon、SCAND、HuRoN）以及1X人形机器人数据集上的大量实验表明，UniWM将导航成功率提升高达30%，显著降低了轨迹误差，超越了强大的基线方法，并能够零样本泛化到未见的TartanDrive数据集，且能够自然扩展到高维人形机器人导航。这些结果使UniWM成为迈向统一、想象驱动具身导航的原则性一步。代码和模型已发布于https://github.com/UWMILab/UniWM。

Vision-Language-Action (VLA) models have emerged as a prominent paradigm for end-to-end autonomous driving; however, their efficient deployment is severely constrained by high computational latency and exposure bias arising from sequential autoregressive decoding. Conversely, while specialized diffusion policies enable low-latency, parallel execution, training them from scratch typically yields narrow, single-task architectures that lack holistic visual-linguistic reasoning. Successfully transforming pre-trained autoregressive generalists into parallel diffusion models could combine multi-task cognitive intelligence with execution efficiency, yet this transition presents a formidable architectural challenge due to mismatched attention patterns (causal versus bidirectional) and divergent optimization objectives. To bridge this divide, we introduce WAM-Diff2, a multi-task discrete diffusion VLA framework powered by a three-stage hierarchical distillation strategy. By structuring the architectural shift through progressive block-wise adaptation, block-wise distillation, and model-wise cross-scale distillation, WAM-Diff2 preserves the underlying semantic foundations of the base model while accelerating inference. Extensive evaluations across driving understanding, perception, and planning benchmarks demonstrate that WAM-Diff2 effectively mitigates exposure bias and achieves performance parity with autoregressive baselines. Crucially, the autoregressive-to-diffusion transition yields a 2.8x decoding speedup, which scales to an ultimate 15.1x acceleration when combined with system-level optimizations including FlashInfer and CUDA Graphs.

视觉语言动作（VLA）模型已成为端到端自动驾驶的主流范式；然而，其高效部署受到高计算延迟和顺序自回归解码所导致的暴露偏差的严重制约。相比之下，尽管专用扩散策略能够实现低延迟并行执行，但从零开始训练通常会产生狭隘的单任务架构，缺乏全面的视觉语言推理能力。将预训练的自回归通用模型成功转化为并行扩散模型，可以结合多任务认知智能与执行效率，但由于注意力模式（因果与双向）不匹配以及优化目标存在差异，这种转变面临严峻的架构挑战。为弥补这一差距，我们提出了WAM-Diff2，一个由三阶段层次化蒸馏策略驱动的多任务离散扩散VLA框架。通过渐进式分块适配、分块蒸馏和模型级跨尺度蒸馏来组织架构转变，WAM-Diff2在加速推理的同时保留了基础模型的底层语义基础。在驾驶理解、感知和规划基准上的广泛评估表明，WAM-Diff2有效缓解了暴露偏差，并实现了与自回归基线相当的性能。关键在于，自回归到扩散的转变带来了2.8倍的解码加速，结合FlashInfer和CUDA Graphs等系统级优化后，最终可扩展至15.1倍的加速效果。

We introduce LaviGen, a framework that repurposes 3D generative models for 3D layout generation. Unlike previous methods that infer object layouts from textual descriptions, LaviGen operates directly in the native 3D space, formulating layout generation as an autoregressive process that explicitly models geometric relations and physical constraints among objects, producing coherent and physically plausible 3D scenes. To further enhance this process, we propose an adapted 3D diffusion model that integrates scene, object, and instruction information and employs a dual-guidance self-rollout distillation mechanism to improve efficiency and spatial accuracy. Extensive experiments on the LayoutVLM benchmark show LaviGen achieves superior 3D layout generation performance, with 19% higher physical plausibility than the state of the art and 65% faster computation. Our code is publicly available at https://github.com/fenghora/LaviGen.

本文提出LaviGen框架，该框架将3D生成模型重新用于3D布局生成。不同于以往从文本描述推断物体布局的方法，LaviGen直接在原生3D空间中运行，将布局生成形式化为自回归过程，明确建模物体间的几何关系和物理约束，从而生成连贯且物理上合理的3D场景。为进一步增强该过程，本文提出一种改进的3D扩散模型，该模型整合场景、物体和指令信息，并采用双引导自展开蒸馏机制以提升效率和空间准确性。在LayoutVLM基准数据集上的大量实验表明，LaviGen实现了卓越的3D布局生成性能，物理合理性较现有最优方法提升19%，计算速度提升65%。代码已公开访问：https://github.com/fenghora/LaviGen。

Large-scale image generation has benefited from advances in data scale, quality, rebalancing, and recaptioning, yet conventional pipelines typically optimize task-specific datasets in isolation. A central challenge is not only how to curate each task-specific corpus, but also how to organize heterogeneous supervision according to the dependencies among generative capabilities. We present a \textbf{capability-driven data infrastructure} that couples capability-specific supervision construction with capability-aligned curriculum scheduling. Its three specialized yet interoperable data engines build complementary relational supervision for text-image grounding, inter-image transformation, and image-knowledge association, while caption experts align T2I and editing supervision across tasks and granularities. A multi-stage curriculum jointly evolves task composition, visual-concept distribution, data quality, and image resolution along the dependency order of capability acquisition, with capability-aware evaluation closing the loop through targeted retrieval, expert construction, and gap-aware resampling. At scale, the framework curates a 440M-image T2I corpus, 120M editing pairs, and over 27M image-entity pairs. With this infrastructure, we train multimodal diffusion models at two scales from scratch, with 3B and 6B sizes respectively. We conduct quantitative evaluation on CPI-Bench, along with qualitative evaluations across diverse text-to-image and editing scenarios. Experimental results present broad visual coverage, versatile rendering, and effective transfer across generative capabilities.

大规模图像生成受益于数据规模、质量、再平衡和重新标注的进步，但传统流程通常孤立优化特定任务的数据集。一个核心挑战不仅是如何看待每个特定任务的语料库，还包括如何根据生成能力之间的依赖关系组织异构监督。我们提出了一个 extbf{能力驱动的数据基础设施}，将特定能力监督构建与能力对齐的课程调度相结合。其三个专业化但可互操作的数据引擎为文本-图像基础、图像间转换和图像-知识关联构建了互补的关系监督，而标注专家在任务和粒度上对齐T2I和编辑监督。多阶段课程按照能力习得的依赖顺序联合演进任务组成、视觉概念分布、数据质量和图像分辨率，能力感知评估通过针对性检索、专家构建和缺口感知重采样来闭环。在规模上，该框架整理了4.4亿图像的T2I语料库、1.2亿编辑对以及超过2700万图像-实体对。利用该基础设施，我们从零开始训练了两种规模的多模态扩散模型，分别为30亿和60亿参数。我们在CPI-Bench上进行了定量评估，并在各种文本到图像和编辑场景中进行了定性评估。实验结果显示了广泛的视觉覆盖、多功能的渲染能力以及在生成能力间的有效迁移。

Diffusion models have been verified to be effective in generating complex distributions from natural images to motion trajectories. Recent diffusion-based methods show impressive performance in 3D robotic manipulation tasks, whereas they suffer from severe runtime inefficiency due to multiple denoising steps, especially with high-dimensional observations. To this end, we propose a real-time robotic manipulation model named ManiCM that imposes the consistency constraint to the diffusion process, so that the model can generate robot actions in only one-step inference. Specifically, we formulate a consistent diffusion process in the robot action space conditioned on the point cloud input, where the original action is required to be directly denoised from any point along the ODE trajectory. To model this process, we design a consistency distillation technique to predict the action sample directly instead of predicting the noise within the vision community for fast convergence in the low-dimensional action manifold. We evaluate ManiCM on 31 robotic manipulation tasks from Adroit and Metaworld, and the results demonstrate that our approach accelerates the state-of-the-art method by 10 times in average inference speed while maintaining competitive average success rate.

扩散模型已被验证能够有效生成从自然图像到运动轨迹的复杂分布。近期的基于扩散的方法在3D机器人操作任务中展现出卓越性能，然而由于多步去噪过程，特别是面对高维观测时，存在严重的运行时效率问题。为此，我们提出了一种名为ManiCM的实时机器人操作模型，该模型将一致性约束应用于扩散过程，从而实现单步推理即可生成机器人动作。具体而言，我们在点云输入的条件下，在机器人动作空间中构建了一致性扩散过程，要求原始动作能够从常微分方程轨迹上的任意点直接进行去噪。为对该过程进行建模，我们设计了一种一致性蒸馏技术，直接预测动作样本而非预测噪声，以实现低维动作流形上的快速收敛。我们在Adroit和Metaworld的31个机器人操作任务上对ManiCM进行了评估，结果表明该方法在保持竞争力的平均成功率的同时，平均推理速度比当前最先进的方法快了10倍。

Uncrewed Aerial Vehicles (UAVs) are increasingly used in modern communication networks. However, challenges in decision-making and digital modeling continue to hinder their rapid development. Reinforcement Learning (RL) algorithms face limitations such as low sample efficiency and limited data versatility, which are further amplified in UAV communications scenarios. Additionally, Digital Twin (DT) modeling presents significant challenges in decision-making and data management. RL models, often integrated into DT frameworks to address these issues, require large amounts of training data to make accurate predictions. Unlike traditional approaches that focus on class boundaries, Diffusion Models (DMs)-a new class of generative AI-learn the underlying probability distribution from training data and can generate reliable new patterns based on this learned distribution. DT and RL have complementary roles in enabling intelligent, data-driven UAV operations. DMs further enhance this synergy by addressing data scarcity, improving modeling accuracy, and generating realistic scenarios, which benefit both DT simulations and RL training. In this paper, we explore the integration of DMs with RL and DT. Simulation results confirm the effectiveness and benefits of DMs in generating neighbor velocity estimates in a four-UAV swarm coordination task using Deep Reinforcement Learning (DRL).

无人驾驶飞行器（UAVs）在现代通信网络中的应用日益广泛。然而，决策和数字建模方面的挑战 continue to阻碍了其快速发展。强化学习（RL）算法面临样本效率低和数据多样性有限等局限，这些问题在无人机通信场景中进一步放大。此外，数字孪生（DT）建模在决策和数据管理方面也面临重大挑战。为解决这些问题，RL模型通常被集成到DT框架中，但需要大量训练数据才能做出准确预测。与传统关注类别边界的方法不同，扩散模型（DMs）作为新型生成式人工智能，能够从训练数据中学习底层概率分布，并基于学习到的分布生成可靠的新模式。DT和RL在实现智能化、数据驱动的无人机操作方面具有互补作用，DMs通过解决数据稀缺问题、提高建模准确性和生成逼真场景，进一步增强了这种协同效应。本文探讨了DMs与RL和DT的集成应用。仿真结果验证了DMs在四无人机蜂群协调任务中使用深度强化学习（DRL）生成邻机速度估计的有效性和优势。

Vision-Language-Action (VLA) models have emerged as a prominent paradigm for end-to-end autonomous driving; however, their efficient deployment is severely constrained by high computational latency and exposure bias arising from sequential autoregressive decoding. Conversely, while specialized diffusion policies enable low-latency, parallel execution, training them from scratch typically yields narrow, single-task architectures that lack holistic visual-linguistic reasoning. Successfully transforming pre-trained autoregressive generalists into parallel diffusion models could combine multi-task cognitive intelligence with execution efficiency, yet this transition presents a formidable architectural challenge due to mismatched attention patterns (causal versus bidirectional) and divergent optimization objectives. To bridge this divide, we introduce WAM-Diff2, a multi-task discrete diffusion VLA framework powered by a three-stage hierarchical distillation strategy. By structuring the architectural shift through progressive block-wise adaptation, block-wise distillation, and model-wise cross-scale distillation, WAM-Diff2 preserves the underlying semantic foundations of the base model while accelerating inference. Extensive evaluations across driving understanding, perception, and planning benchmarks demonstrate that WAM-Diff2 effectively mitigates exposure bias and achieves performance parity with autoregressive baselines. Crucially, the autoregressive-to-diffusion transition yields a 2.8x decoding speedup, which scales to an ultimate 15.1x acceleration when combined with system-level optimizations including FlashInfer and CUDA Graphs.

视觉语言动作（VLA）模型已成为端到端自动驾驶的主流范式；然而，其高效部署受到高计算延迟和顺序自回归解码所导致的暴露偏差的严重制约。相比之下，尽管专用扩散策略能够实现低延迟并行执行，但从零开始训练通常会产生狭隘的单任务架构，缺乏全面的视觉语言推理能力。将预训练的自回归通用模型成功转化为并行扩散模型，可以结合多任务认知智能与执行效率，但由于注意力模式（因果与双向）不匹配以及优化目标存在差异，这种转变面临严峻的架构挑战。为弥补这一差距，我们提出了WAM-Diff2，一个由三阶段层次化蒸馏策略驱动的多任务离散扩散VLA框架。通过渐进式分块适配、分块蒸馏和模型级跨尺度蒸馏来组织架构转变，WAM-Diff2在加速推理的同时保留了基础模型的底层语义基础。在驾驶理解、感知和规划基准上的广泛评估表明，WAM-Diff2有效缓解了暴露偏差，并实现了与自回归基线相当的性能。关键在于，自回归到扩散的转变带来了2.8倍的解码加速，结合FlashInfer和CUDA Graphs等系统级优化后，最终可扩展至15.1倍的加速效果。

Vision-language-action (VLA) driving models couple a reasoning stage with a diffusion-based trajectory decoder, but do not give a direct way to redirect attention toward safety-critical actors at inference time without retraining. We studied a bounded additive pre-softmax attention bias on the visual tokens of detector localized traffic actors on Alpamayo-R1's Qwen3-VL backbone. It is applied as a fail open forward pre-hook with no weight changes. On 50 lane-change scenarios from the Physical AI World Model Synthetic dataset. The trajectory decoder shows a monotonic dose response in the bias magnitude, separate from a paired zero bias control at every tested magnitude. It reaches $\approx 17$\,cm mean displacement with lateral shifts up to $\sim 140$\ cm at the clamp. A layer ablation places the action-relevant signal in late layers, where the effect increases with the number of hooked layers (2.0cm for the first 8 layers; 67.6cm for all 36). A per call injection audit explains why the Chain-of-Causation text never changes. The mask based bias never reaches the reasoning pathway in this serving stack, so the invariance is verified exposure, not robustness. Steered trajectories tend to shift toward the attended actor, suggesting the bias governs where the model looks rather than encoding a target behavior.

视觉-语言-动作（VLA）驾驶模型将推理阶段与基于扩散的轨迹解码器相结合，但在不进行重训练的情况下，无法提供在推理时将注意力重定向到安全关键行为体的直接方法。我们在Alpamayo-R1的Qwen3-VL骨干网络上，针对检测器定位的交通行为体的视觉tokens，研究了一种有界加性注意力偏差（pre-softmax）。该方法作为失效开放的前向预钩子应用，无需改变权重。在来自Physical AI世界模型合成数据集的50个变道场景中，轨迹解码器表现出与偏差幅度相关的单调剂量响应，这与每个测试幅度下的配对零偏差对照不同。在夹紧条件下，偏差达到约17厘米的平均横向位移，最大横向偏移可达约140厘米。层消融实验将动作相关信号定位于后层，且效果随钩住的层数增加而增强（前8层为2.0厘米；全部36层为67.6厘米）。每次调用注入审计解释了因果链文本从不改变的原因。在此服务栈中，基于掩码的偏差从未到达推理路径，因此不变性是验证性暴露，而非鲁棒性。被引导的轨迹倾向于向被关注的行為體偏移，表明该偏差控制模型看向何处，而非编码目标行为。

Driving scene reconstruction and rendering, especially with 3D Gaussian Splatting, has become an important component of autonomous driving simulation. However, rendered views often degrade under extrapolated ego trajectories and scene edits, producing blurry structures, temporal flicker, and foreground-background misalignment. Existing refinement methods are commonly designed for a specific setting, such as image-level novel-view repair or object-editing correction. In this paper, we introduce SPVC, a structured and panoptic video fixing framework for cross-dataset driving scene rendering. The name summarizes four design principles. (1) Structured fixing denotes the use of explicit spatial conditions, including camera pose, 3D bounding boxes, and HD maps, to guide the repair process and reduce uncontrolled hallucination. (2) Panoptic fixing refers to correcting both background rendering artifacts, such as distorted roads, buildings, and lanes, and foreground vehicle artifacts introduced by scene editing, such as inconsistent object appearance. (3) Video fixing means that the model operates on driving sequences rather than isolated frames, allowing temporal cues to be used during artifact correction. (4) Cross-dataset fixing means that a single shared network is trained and applied across multiple driving datasets, reducing the need for dataset-specific or scene-specific fixers. Concretely, we construct paired degraded-clean training data by simulating under-constrained 3DGS rendering and foreground vehicle insertion artifacts, and train a two-stage controllable video diffusion model that first addresses video-level appearance and then refines scene layout with structured controls.

驾驶场景重建与渲染，尤其是基于3D Gaussian Splatting的方法，已成为自动驾驶仿真的重要组成部分。然而，在外推自我轨迹和场景编辑下，渲染视图往往出现质量退化，产生模糊结构、时间闪烁以及前景-背景错位等问题。现有的优化方法通常针对特定场景设计，如图像级新视图修复或目标编辑校正。本文提出SPVC，一个面向跨数据集驾驶场景渲染的结构化全景视频修复框架。该名称概括了四个设计原则。（1）结构化修复指使用显式空间条件（包括相机位姿、3D边界框和HD地图）来引导修复过程，减少不受控的幻觉。（2）全景修复指同时纠正背景渲染伪影（如扭曲的道路、建筑和车道）以及场景编辑引入的前景车辆伪影（如不一致的目标外观）。（3）视频修复指模型在驾驶序列而非孤立帧上运行，从而在伪影校正中利用时间线索。（4）跨数据集修复指在多个驾驶数据集上训练并应用单一共享网络，减少对数据集特定或场景特定修复器的需求。具体而言，我们通过模拟欠约束3DGS渲染和前景车辆插入伪影来构建成对的退化-干净训练数据，并训练一个两阶段可控视频扩散模型，先解决视频级外观问题，再利用结构化控制优化场景布局。

In this paper, we tackle the problem of performing consistent, unified modifications to a multi-shot video sequence. This task is particularly challenging because multi-shot videos consist of discontinuous temporal segments that vary significantly in viewpoint, camera scale, and subject pose, leading to severe identity drift and cumulative error propagation. Achieving coherent edits requires establishing reliable cross-shot semantic awareness to maintain stable subject appearance and visual continuity across these disjointed boundaries. To address this, we propose MSEditor, the first framework designed specifically for consistent multi-shot video editing. To overcome the scarcity of high-quality multi-shot training data, we repurpose existing multi-view video datasets to provide robust cross-shot supervision. Architecturally, we introduce a Supervisory Adapter that injects this cross-shot information into the diffusion backbone, enabling the model to learn identity-consistent representations. Furthermore, to effectively mitigate cumulative errors and ensure long-range temporal coherence, we design a Cross-Shot Packing strategy that dynamically aggregates information from semantically related shots within the self-attention window. Extensive experiments demonstrate that MSEditor significantly outperforms existing methods on our curated multi-shot video editing benchmark in terms of identity preservation, temporal stability, and overall visual quality.

本文针对多镜头视频序列进行一致、统一修改的问题展开研究。该任务极具挑战性，因为多镜头视频由不连续的时间段组成，在视角、相机尺度和主体姿态方面存在显著差异，从而导致严重的身份漂移和累积误差传播。要实现连贯的编辑效果，需要建立可靠的跨镜头语义感知，以在这些分离的边界间保持稳定的主体外观和视觉连续性。为此，我们提出了MSEditor，这是首个专门为一致多镜头视频编辑设计的框架。为克服高质量多镜头训练数据稀缺的难题，我们重新利用现有的多视角视频数据集来提供稳健的跨镜头监督。在架构上，我们引入了监督适配器（Supervisory Adapter），将该跨镜头信息注入扩散主干，使模型能够学习身份一致的表示。此外，为有效减轻累积误差并确保长程时间一致性，我们设计了跨镜头打包策略（Cross-Shot Packing），可在自注意力窗口内动态聚合语义相关镜头的相关信息。大量实验表明，在我们的精选多镜头视频编辑基准测试中，MSEditor在身份保持、时间稳定性和整体视觉质量方面均显著优于现有方法。

Although text-to-image diffusion models exhibit remarkable generative power, concept erasure techniques are essential for preventing harmful content. Existing adversarial probes evaluate these methods by testing whether erased concepts can still be recovered. However, existing erasure and probe methods remain largely text-centric, focusing on whether the text-to-image mapping is severed while overlooking whether the corresponding visual knowledge remains. To investigate this question from a visual perspective, we leverage diffusion inversion to probe whether a generative trajectory can reconstruct visual instances of an erased concept. Under a null-text condition, standard inversion avoids the textual pathway but amplifies approximation errors, hindering faithful trajectory recovery. To address this challenge, we introduce TINA+, a diffusion-consistent Text-free INversion Attack equipped with optimization-based inversion. We also find that unconstrained diffusion inversion may discover spurious trajectories, even allowing a randomly initialized diffusion model to reconstruct the target concept. Such trajectories may falsely indicate residual visual knowledge. TINA+ therefore introduces Diffusion-Consistent Trajectory Regularization to suppress this failure mode. By penalizing trajectories that fall far below the expected marginal energy evolution of diffusion, TINA+ suppresses spurious inversion paths while preserving its ability to recover erased concepts. Experiments across twelve erasure methods, four concept-erasure tasks, and different model architectures demonstrate that TINA+ reliably probes residual visual knowledge through diffusion-consistent visual trajectories. These results provide stronger evidence that current methods often obscure concepts by severing text-image links rather than eliminating the underlying visual knowledge.

尽管文本到图像扩散模型展现出卓越的生成能力，但概念擦除技术对于防止有害内容生成至关重要。现有的对抗性探测方法通过测试被擦除概念是否仍可被恢复来评估这些方法。然而，现有的擦除和探测方法仍然主要围绕文本展开，聚焦于文本到图像的映射是否被切断，而忽略了相应的视觉知识是否仍然存在。为从视觉角度探究这一问题，我们利用扩散反转来探测生成轨迹是否能重建被擦除概念的视觉实例。在空文本条件下，标准反转虽能避免文本路径，但会放大近似误差，阻碍真实轨迹的恢复。为解决这一挑战，我们引入了TINA+，一种配备基于优化反转的扩散一致文本无关反转攻击。我们还发现无约束的扩散反转可能发现虚假轨迹，甚至允许随机初始化的扩散模型重建目标概念。这类轨迹可能错误地指示残留视觉知识。因此，TINA+引入了扩散一致轨迹正则化来抑制这种失败模式。通过惩罚远低于预期边际能量演化的轨迹，TINA+在保留恢复被擦除概念能力的同时抑制了虚假反转路径。跨越十二种擦除方法、四种概念擦除任务以及不同模型架构的实验表明，TINA+能够通过扩散一致的视觉轨迹可靠地探测残留视觉知识。这些结果提供了更强的证据，表明当前方法往往通过切断文本-图像链接而非消除底层视觉知识来掩盖概念。

Diffusion models have achieved remarkable success in image and video generation, yet the high computational cost of iterative sampling remains a critical bottleneck for practical deployment. Feature caching has emerged as a promising acceleration paradigm by reusing or predicting intermediate features across timesteps. However, existing training-free methods apply uniform prediction strategies that cannot adapt to the heterogeneous feature dynamics, causing significant quality degradation under high acceleration ratios. We propose LinCa, a feature caching framework based on learnable invertible networks. LinCa decomposes cached features into sub-components with distinct continuity properties via a lightweight invertible network and applies differentiated prediction orders matched to each component. The strict invertibility guarantees lossless reconstruction back to the original feature space, forming a unified Decompose-Predict-Reconstruct pipeline. By training separate predictors for different models and timestep segments, LinCa adapts to heterogeneous feature dynamics. Experiments on FLUX, Qwen-Image, and HunyuanVideo demonstrate that LinCa, with less than 0.2% additional parameters, significantly outperforms existing methods and maintains near-lossless quality at 5-7x speedup. Code: https://github.com/QHR69/LinCa

扩散模型在图像和视频生成方面取得了显著成功，但迭代采样的高计算成本仍是实际部署中的关键瓶颈。特征缓存作为一种有前景的加速范式，通过跨时间步重用或预测中间特征而受到关注。然而，现有无训练方法采用统一的预测策略，无法适应异构的特征动态，导致在高加速比下出现严重的质量下降。我们提出LinCa，一个基于可学习可逆网络的特征缓存框架。LinCa通过轻量级可逆网络将缓存特征分解为具有不同连续性特性的子组件，并应用与每个组件相匹配的不同预测顺序。严格的数学可逆性保证了到原始特征空间的无损重建，形成了统一的分解-预测-重建流程。通过为不同模型和时间步段训练专门的预测器，LinCa能够适应异构的特征动态。在FLUX、Qwen-Image和HunyuanVideo上的实验表明，LinCa仅需不到0.2%的额外参数，就能显著超越现有方法，并在5-7倍加速下保持近无损质量。代码：https://github.com/QHR69/LinCa

Diffusion Transformers (DiTs) achieve high-quality generation but are costly due to iterative sampling. Dynamic-resolution sampling reduces early-stage cost by denoising at low resolution; however, uniformly upsampling all latent tokens at resolution transitions incurs redundant computation and may degrade fine-detail consistency. Existing partial upsampling strategies typically rely on local latent structure cues or single-step statistics, making it difficult to jointly capture token-text semantic relevance and token-wise representation dynamics across diffusion steps. We propose AViTS, an adaptive spatiotemporal token selection framework for dynamic-resolution DiTs. AViTS models spatial importance via latent-text attention and temporal importance via token-level feature variation across diffusion timesteps, and fuses them to enable spatiotemporal importance-aware selective upsampling: it prioritizes resolution refinement for critical tokens while deferring less important ones, thereby reducing redundant high-resolution computation and improving the quality-efficiency trade-off. AViTS achieves up to 6.34x on FLUX and nearly 9x FLOPs reduction on Qwen-Image-Edit and FLUX.1-Kontext-dev, orthogonal to distillation, quantization, and feature caching, and reaching 14.76x with distilled models. Code: https://github.com/QHR69/AViTS

Diffusion Transformer（DiT）模型虽然能够实现高质量生成，但因迭代采样过程而计算成本高昂。动态分辨率采样通过在低分辨率下去噪来降低前期成本，但在分辨率转换时统一上采样所有潜空间tokens会导致计算冗余，并可能损害细节一致性。现有的部分上采样策略通常依赖于局部潜空间结构线索或单步统计信息，难以在扩散步骤中同时捕捉token与文本的语义相关性以及token级的表示动态。我们提出了AViTS，这是一个面向动态分辨率DiT的自适应时空token选择框架。AViTS通过潜空间-文本注意力建模空间重要性，通过跨扩散时间步的token级特征变化建模时间重要性，并融合两者以实现时空重要性感知的选择性上采样：优先对关键tokens进行分辨率优化，推迟处理次要tokens，从而减少冗余的高分辨率计算，提高质量-效率权衡。AViTS在FLUX上实现最高6.34倍加速，在Qwen-Image-Edit和FLUX.1-Kontext-dev上实现近9倍FLOPs减少，该方法与蒸馏、量化和特征缓存正交，结合蒸馏模型可达到14.76倍加速。代码：https://github.com/QHR69/AViTS

Traffic elements such as traffic lights and road signs play a fundamental role in human driving decisions and should naturally influence end-to-end driving performance. However, existing end-to-end driving research predominantly focuses on dynamic road participants (e.g., vehicles and pedestrians), while the role of traffic elements remains largely unexplored. The community still lacks a systematic study quantifying their impact, largely because public datasets rarely provide structured traffic-element annotations and modern driving systems vary widely in architecture and training paradigm. In this work, we present the first systematic investigation of traffic element awareness for end-to-end autonomous driving. We construct a unified research infrastructure by augmenting multiple public driving datasets with comprehensive traffic-element annotations. To support diverse model families, we adopt a minimal and universal integration design that incorporates traffic-element signals into existing pipelines in a plug-and-play manner with negligible architectural modification. We evaluate this design across modern paradigms, including perception-prediction-planning pipelines, vision-language-action models (VLA), regression-based planners, diffusion-based policies, and trajectory-scoring frameworks, on nuScenes, NAVSIM-v1, NAVSIM-v2, and Bench2Drive. Across all paradigms and datasets, this simple integration consistently improves driving performance, demonstrating that traffic element awareness provides a robust and generalizable signal for end-to-end driving systems. Notably, on the challenging NAVSIM-v2 benchmark, our approach significantly improves state-of-the-art architectures and data pipelines, establishing a new state of the art.

交通灯、道路标志等交通元素在人类驾驶决策中起着基础性作用，理应影响端到端驾驶性能。然而，现有的端到端驾驶研究主要聚焦于动态道路参与者（如车辆和行人），而交通元素的作用仍未被充分探索。该领域仍缺乏系统性的研究来量化其影响，主要原因在于公开数据集很少提供结构化的交通元素标注，且现代驾驶系统的架构和训练范式差异较大。本工作首次对端到端自动驾驶中的交通元素感知进行了系统性研究。我们通过为多个公开驾驶数据集补充全面的交通元素标注，构建了统一的研究基础设施。为支持多样化的模型家族，我们采用了一种最小化且通用的集成设计，以即插即用且几乎无需修改架构的方式将交通元素信号融入现有管线。我们针对现代范式评估了该设计，包括感知-预测-规划管线、视觉-语言-动作模型（VLA）、基于回归的规划器、基于扩散的策略以及轨迹评分框架，评测数据集涵盖nuScenes、NAVSIM-v1、NAVSIM-v2和Bench2Drive。在所有范式和数据集上，这种简单的集成方式持续提升了驾驶性能，表明交通元素感知为端到端驾驶系统提供了稳健且可泛化的信号。值得注意的是，在极具挑战性的NAVSIM-v2基准上，我们的方法显著提升了最先进的架构和数据管线，达到了新的最优水平。

High-resolution image editing is increasingly demanded in professional workflows, yet existing diffusion-based models remain constrained to resolutions below 1K due to quadratic attention complexity and prohibitive memory requirements. A prevalent workaround employs a two-stage pipeline: editing at low resolution followed by independent super-resolution. However, this approach suffers from two critical issues: information divergence, where hallucinated details contradict the original high-resolution (HR) source, and texture degradation, manifesting as over-smoothed or over-sharpened artifacts. We propose EditBridge, a diffusion bridge framework for efficient ultra high-resolution editing. Unlike conventional diffusion that regenerates from noise, we formulate refinement as structured data-to-data translation from the low-resolution (LR) edited result to its HR counterpart, explicitly conditioned on the original HR source to preserve authentic details. To efficiently incorporate HR source guidance, we introduce a prior-guided block-wise sparse attention mechanism that exploits semantic correspondence from first-stage editing to constrain cross-image interactions to spatially aligned regions, significantly reducing computational overhead. Extensive experiments demonstrate that EditBridge achieves high-fidelity editing with superior perceptual quality at resolutions up to 4K, delivering 3.6--8.4$\times$ speedup at 2K and enabling practical 4K editing in 61 seconds.

高分辨率图像编辑在专业工作流程中的需求日益增长，然而现有的基于扩散的模型由于二次方注意力复杂度和 prohibitive 的内存需求，仍局限于1K以下的分辨率。一种常见的解决方案采用两阶段流程：首先在低分辨率进行编辑，然后独立进行超分辨率处理。然而这种方法存在两个关键问题：信息分歧，即生成的幻觉细节与原始高分辨率（HR）源图相矛盾；以及纹理退化，表现为过度平滑或过度锐化的伪影。我们提出 EditBridge，一个用于高效超高分辨率编辑的扩散桥接框架。与传统从噪声重新生成的扩散不同，我们将细化表述为从低分辨率（LR）编辑结果到其高分辨率对应版本的结构化数据到数据转换，并显式以原始 HR 源图为条件以保留真实细节。为有效整合 HR 源图引导，我们引入了一种先验引导的块状稀疏注意力机制，利用第一阶段编辑的语义对应将跨图像交互约束到空间对齐的区域，从而显著降低计算开销。大量实验表明，EditBridge 在高达 4K 的分辨率下实现了高保真编辑和卓越的感知质量，在 2K 分辨率下实现 3.6--8.4 倍加速，并能在 61 秒内完成实际的 4K 编辑。

Sampling from a diffusion model typically requires many forward passes through a large neural network, making generation computationally expensive. While much work has focused on efficient solvers and samplers, comparatively little attention has been paid to selecting the sampling timesteps themselves. A recent line of work optimizes theoretically derived surrogates for sample quality rather than the quality metric itself. We propose Optimizing Your Sampling (OYS), which instead treats timestep selection as a black-box optimization problem, optimizing the target metric directly with Bayesian optimization. OYS outperforms both the default schedules and those of Align Your Steps on text-to-image generation, and improves over the default schedules on inpainting and other image tasks, in both quantitative and human evaluations. OYS requires no additional training, is applicable even to distilled models, and improves both simple and sophisticated samplers such as Euler and DPM-Solver++. A 5-step OYS schedule retains 89%-94% of the quality of a 50-step schedule while reducing inference cost by 10x.

从扩散模型采样通常需要多次通过大型神经网络的前向传播，这使得生成过程计算成本高昂。尽管大量研究聚焦于高效求解器和采样器，但对采样时间步选择本身的关注相对较少。最近的研究工作优化了样本质量的理论推导代理，而非质量指标本身。我们提出了优化采样（OYS）方法，将时间步选择视为黑盒优化问题，并使用贝叶斯优化直接优化目标指标。OYS在文本到图像生成任务中优于默认调度和Align Your Steps方法，在图像修复及其他图像任务中同样优于默认调度，体现在定量评估和人类评估中。OYS无需额外训练，甚至适用于蒸馏模型，并能提升欧拉和DPM-Solver++等简单和复杂采样器的性能。5步OYS调度可保留89%-94%的50步调度质量，同时将推理成本降低10倍。

Generating safety-critical driving scenarios is crucial for evaluating and improving autonomous driving systems, but long-tail risky situations are rarely observed in real-world data and difficult to specify through manual scenario design. Existing generative approaches typically treat risk as an after-the-fact label and struggle to maintain geometric consistency in multi-view driving scenes. We present RiskMV-DPO, a general and systematic pipeline for physically-informed, risk-controllable multi-view scenario generation. By integrating target risk levels with physically-grounded risk modeling, we synthesize diverse and high-stakes dynamic trajectories that serve as explicit geometric anchors for a diffusion-based video generator. To ensure spatial-temporal coherence and geometric fidelity, we introduce a geometry-appearance alignment module and a region-aware direct preference optimization (RA-DPO) strategy with motion-aware masking to focus learning on localized dynamic regions. Experiments on the nuScenes dataset show that RiskMV-DPO can freely generate a wide spectrum of diverse scenarios while maintaining visual quality, improving 3D detection mAP from 18.17 to 30.50 and reducing FID to 15.70. Our work shifts the role of world models from passive environment prediction to proactive, risk-controllable synthesis, providing a scalable toolchain for the development of embodied intelligence.

生成安全关键的驾驶场景对于评估和改进自动驾驶系统至关重要，但长尾风险情况在现实世界数据中很少观察到，且难以通过手动场景设计来指定。现有的生成方法通常将风险视为事后标签，难以在多视角驾驶场景中保持几何一致性。我们提出了RiskMV-DPO，这是一个通用的、基于物理信息的风险可控多视角场景生成系统。通过将目标风险等级与基于物理的风险建模相结合，我们合成了多样化的动态高风险轨迹，作为扩散视频生成器的显式几何锚点。为确保时空一致性和几何保真度，我们引入了几何-外观对齐模块和区域感知直接偏好优化（RA-DPO）策略，通过运动感知掩码聚焦学习局部动态区域。在nuScenes数据集上的实验表明，RiskMV-DPO可以自由生成多样化的场景谱系，同时保持视觉质量，将3D检测mAP从18.17提高到30.50，并将FID降至15.70。我们的工作将世界模型的角色从被动环境预测转变为主动、风险可控的合成，为具身智能的发展提供了可扩展的工具链。

We introduce LaviGen, a framework that repurposes 3D generative models for 3D layout generation. Unlike previous methods that infer object layouts from textual descriptions, LaviGen operates directly in the native 3D space, formulating layout generation as an autoregressive process that explicitly models geometric relations and physical constraints among objects, producing coherent and physically plausible 3D scenes. To further enhance this process, we propose an adapted 3D diffusion model that integrates scene, object, and instruction information and employs a dual-guidance self-rollout distillation mechanism to improve efficiency and spatial accuracy. Extensive experiments on the LayoutVLM benchmark show LaviGen achieves superior 3D layout generation performance, with 19% higher physical plausibility than the state of the art and 65% faster computation. Our code is publicly available at https://github.com/fenghora/LaviGen.

本文提出LaviGen框架，该框架将3D生成模型重新用于3D布局生成。不同于以往从文本描述推断物体布局的方法，LaviGen直接在原生3D空间中运行，将布局生成形式化为自回归过程，明确建模物体间的几何关系和物理约束，从而生成连贯且物理上合理的3D场景。为进一步增强该过程，本文提出一种改进的3D扩散模型，该模型整合场景、物体和指令信息，并采用双引导自展开蒸馏机制以提升效率和空间准确性。在LayoutVLM基准数据集上的大量实验表明，LaviGen实现了卓越的3D布局生成性能，物理合理性较现有最优方法提升19%，计算速度提升65%。代码已公开访问：https://github.com/fenghora/LaviGen。

Reconstructing dynamic 3D scenes from sparse multi-view videos is highly ill-posed, often leading to geometric collapse, trajectory drift, and floating artifacts. Recent attempts introduce generative priors to hallucinate missing content, yet naive integration frequently causes structural drift and temporal inconsistency due to the mismatch between stochastic 2D generation and deterministic 3D geometry. In this paper, we propose GeoRect4D, a novel unified framework for sparse-view dynamic reconstruction that couples explicit 3D consistency with generative refinement via a closed-loop optimization process. Specifically, GeoRect4D introduces a degradation-aware feedback mechanism that incorporates a robust anchor-based dynamic 3DGS substrate with a single-step diffusion rectifier to hallucinate high-fidelity details. This rectifier utilizes a structural locking mechanism and spatiotemporal coordinated attention, effectively preserving physical plausibility while restoring missing content. Furthermore, we present a progressive optimization strategy that employs stochastic geometric purification to eliminate floaters and generative distillation to infuse texture details into the explicit representation. Extensive experiments demonstrate that GeoRect4D achieves state-of-the-art performance in reconstruction fidelity, perceptual quality, and spatiotemporal consistency across multiple datasets. Project Page: https://mediax-sjtu.github.io/GeoRect4D

从稀疏多视角视频重建动态3D场景是一个高度不适定问题，常导致几何坍塌、轨迹漂移和漂浮伪影。最近的研究尝试引入生成先验来补全缺失内容，但朴素集成常因随机2D生成与确定性3D几何之间的不匹配而导致结构漂移和时间不一致性问题。本论文提出GeoRect4D，一种用于稀疏视角动态重建的新型统一框架，通过闭环优化过程将显式3D一致性耦合到生成式细化中。具体而言，GeoRect4D引入了一种退化感知反馈机制，该机制融合了基于锚点的动态3DGS基底与单步扩散矫正器，以生成高保真细节。该矫正器利用结构锁定机制和时空协调注意力，有效保持物理合理性的同时恢复缺失内容。此外，我们提出了一种渐进式优化策略，采用随机几何净化来消除漂浮伪影，并使用生成蒸馏将纹理细节注入显式表示。大量实验表明，GeoRect4D在多个数据集上实现了重建保真度、感知质量和时空一致性的最新最优性能。项目页面：https://mediax-sjtu.github.io/GeoRect4D

Deep stochastic processes have recently become a central paradigm for image enhancement, with many methods explicitly conditioning the stochastic trajectory on the degraded input. However, the relationship between these conditional processes and standard diffusion models remains unclear. In this work, we introduce a unified perspective on stochastic image enhancement by classifying recent methods into three families of continuous-time processes: unconditional diffusion models, Ornstein-Uhlenbeck (OU) processes, and diffusion bridges. We show that all of these approaches arise from a common stochastic differential equation (SDE) formulation. This framework makes explicit that seemingly disparate methods differ primarily in their drift and diffusion terms, terminal distributions, and boundary conditions, while schedulers and samplers constitute orthogonal design choices. Leveraging this unification, we conduct a controlled empirical study across multiple image enhancement tasks using identical architectures and training protocols. Our results reveal no consistently dominant method; instead, we identify and disentangle the specific design choices that most strongly influence performance. Finally, we release ItoVision, a modular PyTorch library that implements the unified framework and enables rapid prototyping and fair comparison of stochastic image enhancement methods.

深度随机过程已成为图像增强的核心范式，许多方法明确地将随机轨迹条件化于降质输入。然而，这些条件过程与标准扩散模型之间的关系仍不清楚。在本工作中，我们通过将近期方法分类为三类连续时间过程：无条件扩散模型、Ornstein-Uhlenbeck（OU）过程和扩散桥，提出了随机图像增强的统一视角。我们表明，所有这些方法都源于一个共同的随机微分方程（SDE）形式。该框架明确指出，看似不同的方法主要在漂移项和扩散项、终端分布以及边界条件上存在差异，而调度器和采样器则构成正交设计选择。利用这一统一框架，我们使用相同的架构和训练协议在多个图像增强任务上进行了受控实证研究。我们的结果揭示没有始终占优的方法；相反，我们识别并分离出对性能影响最大的具体设计选择。最后，我们发布了ItoVision，这是一个模块化的PyTorch库，实现了统一框架，能够实现随机图像增强方法的快速原型设计和公平比较。

Point cloud completion commonly follows a coarse-to-fine paradigm, where a low-density coarse shape is first predicted and then upsampled to the target resolution. Although recent methods have improved global structure recovery, the fine stage often remains limited by simple upsampling and insufficient interaction with coarse structural features, making local detail reconstruction challenging. We propose SUMI, a diffusion-enhanced refinement module for coarse-to-fine point cloud completion. Unlike prior diffusion-based completion methods that use diffusion as a standalone point generator, SUMI injects noisy geometric features into cross-attention with coarse structural features, enabling reverse denoising to refine local geometry while preserving global consistency. SUMI can also be integrated into existing coarse-to-fine models as a flexible refinement module. Experiments on PCN, ShapeNet-55/34, and MVP demonstrate consistent improvements over strong baselines. SUMI achieves the best overall CD and F1-score on PCN, reduces CD by up to 16.1% on ShapeNet-55, and obtains the best CD across all output densities on MVP.

点云补全通常遵循粗到细的范式，即首先预测低密度的粗形状，然后上采样至目标分辨率。尽管近期方法改善了全局结构恢复，但精细阶段往往受限于简单的上采样以及与粗结构特征的交互不足，使得局部细节重建具有挑战性。我们提出了SUMI，一个用于粗到细点云补全的扩散增强细化模块。与先前使用扩散作为独立点生成器的基于扩散的补全方法不同，SUMI将带噪声的几何特征注入到与粗结构特征的交叉注意力中，使反向去噪能够在保持全局一致性的同时细化局部几何。SUMI还可以作为灵活的细化模块集成到现有的粗到细模型中。在PCN、ShapeNet-55/34和MVP上的实验表明，其相比强基线方法取得了一致的改进。SUMI在PCN上实现了最佳的总体CD和F1分数，在ShapeNet-55上CD降低了最多16.1%，并在MVP的所有输出密度上获得了最佳的CD。

Instruction-based video editing is commonly built on video-pretrained generative backbones: a video diffusion transformer is adapted, at considerable cost, to condition on a source video and an editing instruction. In this report we explore a different route and show that a strong instruction-based image editing model can edit videos by operating directly on video-VAE latents. Starting from Qwen-Image-Edit, we arrange the latent frames of a Wan~2.1 video VAE as tiles of one large virtual image, reuse the editor's image positional encoding for every tile, and bridge the two latent spaces with a pair of lightweight input/output projections warm-started from the editor&x27;s own patchify and unpatchify layers, so that at initialization a (static) video is embedded exactly as an image the model already understands. The whole system is then fine-tuned on the public Ditto-1M editing triplets, and a few denoising steps of Wan~2.2 serve as an optional temporal enhancer. We motivate the design with a chain of zero-training observations: the stock image editor already edits a video presented as a contact sheet; it is indifferent to whether the sheet's tokens come from one joint encode or from per-frame encodes stitched in latent space; and it even edits genuine video latents zero-shot to a clearly recognizable degree, leaving fine-tuning only a fidelity gap to close. Our results suggest that, despite the large investment in training video latent spaces, per-frame video latents remain close enough to the image domain that mature image editing priors transfer with minimal adaptation. Project Page: https://yunpeng1998.github.io/Qwen-Video-Edit-Page Code: https://github.com/yunpeng1998/Qwen-Video-Edit Model: https://huggingface.co/yunpeng1998/Qwen-Video-Edit

基于指令的视频编辑通常建立在视频预训练的生成主干网络之上：视频扩散Transformer需要付出相当大的代价进行适配，以实现对源视频和编辑指令的条件控制。在本报告中，我们探索了一条不同的路径，证明了强大的基于指令的图像编辑模型可以直接在视频VAE潜在空间中操作来编辑视频。以Qwen-Image-Edit为起点，我们将Wan 2.1视频VAE的潜在帧排列为一个大虚拟图像的切片，复用编辑器的图像位置编码应用于每个切片，并使用一对轻量级的输入/输出投影来桥接两个潜在空间，这些投影由编辑器自身的补丁化和反补丁化层热启动初始化，使得在初始化时，一个（静态）视频被精确嵌入为模型已经理解的图像。随后，整个系统在公开的Ditto-1M编辑三元组上进行微调，并使用Wan 2.2的若干去噪步骤作为可选的时间增强器。我们通过一系列零训练观察来阐明设计动机：现有的图像编辑器已经能够编辑以联系表形式呈现的视频；它对于该联系表的令牌是来自联合编码还是来自潜在空间中拼接的逐帧编码漠不关心；它甚至能够零样本编辑真实视频潜在空间，达到明显可识别的程度，微调只需弥合保真度差距即可。我们的研究结果表明，尽管在训练视频潜在空间方面投入巨大，但逐帧视频潜在空间仍与图像域足够接近，使得成熟的图像编辑先验只需进行最小程度的适配即可迁移。

Despite strong results on recognition and segmentation, current 3D visual pre-training methods often underperform on robotic manipulation. We attribute this gap to two factors: the lack of state-action-state dynamics modeling and the unnecessary redundancy of explicit geometric reconstruction. We introduce AFRO, a self-supervised framework that learns dynamics-aware 3D representations without action or reconstruction supervision. AFRO casts state prediction as a generative diffusion process and jointly models forward and inverse dynamics in a shared latent space to capture causal transition structure. To prevent feature leakage in action learning, we employ feature differencing and inverse-consistency supervision, improving the quality and stability of visual features. When combined with Diffusion Policy, AFRO substantially increases manipulation success rates across 16 simulated and 4 real-world tasks, outperforming existing pre-training approaches. The framework also scales favorably with data volume and task complexity. Qualitative visualizations indicate that AFRO learns semantically rich, discriminative features, offering an effective pre-training solution for 3D representation learning in robotics. Project page: https://kolakivy.github.io/AFRO/

尽管当前3D视觉预训练方法在识别和分割任务上取得了优异成绩，但在机器人操作任务中的表现往往不尽如人意。我们将这一差距归因于两个因素：缺乏状态-动作-状态动力学建模，以及不必要的显式几何重建冗余。我们提出了AFRO，一个无需动作或重建监督的自监督框架，用于学习动态感知的3D表征。AFRO将状态预测建模为生成扩散过程，并在共享潜在空间中联合建模前向动力学和逆动力学，以捕捉因果转换结构。为防止动作学习中的特征泄露，我们采用特征差分和逆一致性监督来提升视觉特征的质量和稳定性。当与Diffusion Policy结合使用时，AFRO在16个模拟任务和4个真实世界任务中显著提升了操作成功率，优于现有的预训练方法。该框架在数据量和任务复杂度方面也具有良好的可扩展性。定性可视化表明，AFRO学习到了语义丰富、具有判别性的特征，为机器人领域的3D表征学习提供了一种有效的预训练解决方案。项目主页：https://kolakivy.github.io/AFRO/

Diffusion-based visuomotor policies excel at modeling action distributions but are inference-inefficient, since recursively denoising from noise to policy requires many steps and heavy UNet backbones, which hinders deployment on resource-constrained robots. Flow matching alleviates the sampling burden by learning a one-step vector field, yet prior implementations still inherit large UNet-style architectures. In this work, we present KAN-We-Flow, a flow-matching policy that draws on recent advances in Receptance Weighted Key Value (RWKV) and Kolmogorov-Arnold Networks (KAN) from vision to build a lightweight and highly expressive backbone for 3D manipulation. Concretely, we introduce an RWKV-KAN block: an RWKV first performs efficient time/channel mixing to propagate task context, and a subsequent GroupKAN layer applies learnable spline-based, groupwise functional mappings to perform feature-wise nonlinear calibration of the action mapping on RWKV outputs. Moreover, we introduce an Action Consistency Regularization (ACR), a lightweight auxiliary loss that enforces alignment between predicted action trajectories and expert demonstrations via Euler extrapolation, providing additional supervision to stabilize training and improve policy precision. Without resorting to large UNets, our design reduces parameters by 86.8\%, maintains fast runtime, and achieves state-of-the-art success rates on Adroit, Meta-World, and DexArt benchmarks. Our project page can be viewed in \href{https://zhihaochen-2003.github.io/KAN-We-Flow.github.io/}{\textcolor{red}{link}}

基于扩散的视觉运动策略在建模动作分布方面表现出色，但推理效率较低，因为从噪声到策略的递归去噪需要多个步骤和繁重的UNet骨干网络，这阻碍了其在资源受限机器人上的部署。流匹配通过学习一步向量场来减轻采样负担，但现有实现仍然继承大型UNet架构。本研究提出KAN-We-Flow，一种流匹配策略，利用Receptance Weighted Key Value（RWKV）和Kolmogorov-Arnold Networks（KAN）在视觉领域的最新进展，构建用于3D操作的轻量级且高表达力的骨干网络。具体而言，我们引入RWKV-KAN块：RWKV首先执行高效的时间/通道混合来传播任务上下文，随后的GroupKAN层应用可学习的基于样条的分组建函映射，对RWKV输出进行特征级非线性校准以完成动作映射。此外，我们引入动作一致性正则化（ACR），这是一种轻量级辅助损失，通过欧拉外推法强制预测动作轨迹与专家演示对齐，为训练提供额外监督以稳定训练并提高策略精度。我们的设计无需使用大型UNet，参数减少86.8%，保持快速运行时间，并在Adroit、Meta-World和DexArt基准上实现最先进的成功率。

Underwater image enhancement (UIE) aims to recover clear images from observations affected by wavelength-dependent absorption, scattering, and spatially nonuniform degradation. Although existing generative methods can handle complex degradations, severe information loss may lead to semantic drift in the restored results. To address this issue, we propose RPL-UIE, a two-stage teacher--student framework for reliable prior learning. In the teacher stage, the network learns reliable and complementary spatial priors characterizing appearance and photometric properties from paired degraded and reference images. In the student stage, the network takes only degraded images as input and learns to emulate the teacher's prior extraction capability, thereby providing more reliable restoration guidance for the enhancement process without requiring reference images at inference. To reduce the prior-learning discrepancy between the teacher and student models, we further develop Residual Prior Refinement Diffusion (RPRD) and Frequency-Aware Prior Residual Calibration (FPRC). RPRD uses the coarse priors as anchors and progressively predicts the necessary corrections in the residual space. FPRC retains stable low-frequency residual components and selectively modulates high-frequency detail residuals, producing calibrated priors to support high-quality reconstruction. Experiments on multiple UIE benchmarks demonstrate competitive restoration performance. Downstream underwater object detection and instance segmentation experiments further demonstrate the improved utility of enhanced images for visual perception, while tests on real-world data captured by a remotely operated vehicle (ROV) support the robustness and practical applicability of RPL-UIE.

水下图像增强（UIE）旨在从受波长依赖性吸收、散射和空间非均匀退化影响的观测图像中恢复清晰图像。尽管现有生成方法能够处理复杂退化，但严重的信息丢失可能导致恢复结果出现语义漂移。为解决这一问题，我们提出了RPL-UIE，一个用于可靠先验学习的两阶段师生框架。在教师阶段，网络从成对的退化图像和参考图像中学习可靠且互补的空间先验，以表征外观和光度特性。在学生阶段，网络仅以退化图像作为输入，学习模拟教师的先验提取能力，从而在推理时无需参考图像即可为增强过程提供更可靠的恢复指导。为缩小师生模型之间的先验学习差异，我们进一步开发了残差先验精炼扩散（RPRD）和频率感知先验残差校准（FPRC）。RPRD将粗先验作为锚点，并在残差空间中逐步预测必要的修正。FPRC保留稳定的低频残差分量，选择性调制高频细节残差，产生校准后的先验以支持高质量重建。在多个UIE基准数据集上的实验表明其具有竞争力的恢复性能。水下目标检测和实例分割的下游实验进一步证明了增强图像对视觉感知实用性的提升，而对遥控潜水器（ROV）采集的真实世界数据的测试则验证了RPL-UIE的鲁棒性和实际适用性。