每日 arXiv 论文简报

Human Activity Recognition (HAR) with self-administered wearables, such as at-home rehabilitation and exercise monitoring, often requires reattaching inertial measurement units (IMUs) across sessions. In multi-IMU settings, this can induce independent orientation offsets across body locations, a deployment shift that conventional scalar HAR models do not structurally handle. Existing remedies rely on rotation augmentation, whose robustness depends on sampled transformations, or calibration and orientationnormalization pipelines requiring additional reference-frame assumptions or explicit procedures. We present Truly Rotation-Invariant HAR (TRI-HAR), a rotation-invariant framework that makes robustness to independent per-location IMU orientation offsets a structural model property. TRI-HAR reshapes accelerometer and gyroscope streams into triaxial vectors, applies a shared SO(3)-equivariant backbone and invariant projection to each IMU location, and fuses the resulting invariant features for activity classification. Across four multi-IMU benchmarks, TRI-HAR preserves macro-F1 under fixed independent per-location SO(3) rotations and outperforms rotation-augmented baselines under this target shift without requiring rotational augmentation.

使用自行管理的可穿戴设备进行人类活动识别（HAR），如家庭康复和运动监测，通常需要跨会话重新佩戴惯性测量单元（IMU）。在多IMU设置中，这可能导致身体各部位产生独立的方向偏移，而传统的标量HAR模型在结构上无法处理这种部署偏移。现有的解决方法依赖于旋转增强，其鲁棒性取决于采样变换，或者需要额外参考框架假设或明确程序的校准和方向归一化流程。本文提出了真正旋转不变的HAR（TRI-HAR），这是一个旋转不变框架，将对独立每位置IMU方向偏移的鲁棒性作为结构模型属性。TRI-HAR将加速度计和陀螺仪数据流重塑为三轴向量，对每个IMU位置应用共享的SO(3)等变主干网络和不变投影，并融合所得的不变特征进行活动分类。在四个多IMU基准数据集上，TRI-HAR在固定独立每位置SO(3)旋转下保持了宏F1分数，并在无需旋转增强的情况下在此目标偏移下优于旋转增强基线方法。

Deciding whether a Sokoban puzzle is solvable is PSPACE-complete (Culberson, 1997): solutions can be exponentially long and there is no short certificate to check. Solvability is also a fragile property, since even a single misplaced wall can silently render an entire puzzle unsolvable. In this work, we show that a transformer-based discrete diffusion model trained purely on tile completion, with no access to solvers, rewards, or solvability labels, achieves a solvability rate of 77.4%, with 94.5% of the remaining failures rendered solvable by removing a single wall. In other words, a global, search-heavy property follows from a local training objective: trained only to fill in masked cells, the model inherits solvability it was never trained on. An autoregressive model factorizes as $p(c_k \mid c_1 \dots c_{k-1})$, meaning a fixed order, always conditioned on a prefix. Masked diffusion does not: it hides a random subset of cells and learns $p(c_k \mid \text{any subset})$, so at generation time it can reveal cells in any order, each one conditioned on everything already placed, wherever it sits on the board. A puzzle's difficulty comes from exactly this kind of non-local interaction, a decision in one part of the grid constraining what will work somewhere else entirely. A generator that is not locked into a single fixed order is therefore a better structural match for the problem than one that is. The training pipeline is adapted from MD4 (Shi et al., 2024) and the dataset is DeepMind&x27;s Boxoban (Guez et al., 2019). The trained model and instructions for generating puzzles are publicly available.

判断推箱子谜题是否可解是PSPACE完全问题（Culberson, 1997）：解的长度可能呈指数级增长，且不存在简短的验证证书。可解性同时也是一个脆弱的性质，因为即使仅放置错一块墙也可能悄然使整个谜题变得不可解。在本工作中，我们证明了一个基于Transformer的离散扩散模型，仅在瓦片填充任务上进行训练，无法访问求解器、奖励或可解性标签，即可达到77.4%的可解率，剩余失败案例中有94.5%可通过移除单堵墙变得可解。换言之，一个全局性的、需大量搜索的属性竟能从局部训练目标中涌现：模型仅被训练填充掩码单元格，却意外获得了从未被训练过的可解性。自回归模型可分解为$p(c_k \mid c_1 \dots c_{k-1})$，意味着固定的顺序，总是以前缀为条件。掩码扩散则不同：它隐藏随机单元格的子集并学习$p(c_k \mid \text{任意子集})$，因此在生成时能以任意顺序揭示单元格，每个单元格都已放置的内容为条件，而不论其在棋盘上的位置。谜题的难度恰恰来源于这种非局部交互——棋盘某一处的决策约束着完全无关另一处的可行方案。因此，一种不受单一固定顺序约束的生成器在结构上比受约束的生成器更适合这个问题。训练流程改编自MD4（Shi et al., 2024），数据集使用DeepMind的Boxoban（Guez et al., 2019）。训练好的模型及生成谜题的说明已公开发布。

Standard autoregressive video generation algorithms based on Diffusion and Flow Matching rely on rigid training objectives and static sampling schedules, limiting inference procedures from adapting to the data. We introduce Equilibrium Forcing (EqF), a simplified framework for video denoising generative models without noise level conditioning. EqF pioneers modular training- and inference-time designs for noise-unconditional generation that decouple learning the denoising field from sampling. This flexibility allows for inference-time algorithms that operate in a closed loop by adapting to feedback from the sample, improving video quality and consistency on challenging autoregressive video generation benchmarks. Extensive analysis elucidates exactly how removing the noise level conditioning enables EqF's data-dependent inference properties to surpass the performance of standard noise level-conditional denoising video methods.

基于扩散和流匹配的标准自回归视频生成算法依赖固定的训练目标和静态采样策略，导致推理过程难以适应数据特性。本文提出平衡强制（Equilibrium Forcing，EqF），一种无需噪声水平条件的视频去噪生成模型简化框架。EqF开创性地实现了噪声无关生成在训练阶段和推理阶段的模块化设计，将去噪场的学习与采样过程解耦。这种灵活性使得推理算法能够以闭环方式运行，通过自适应地响应样本反馈，在具有挑战性的自回归视频生成基准测试中提升视频质量和一致性。大量分析阐明了移除噪声水平条件如何使EqF的数据依赖推理特性超越标准噪声水平条件去噪视频方法的性能。

Predicting spatial gene expression from hematoxylin and eosin (H\&E)-stained images offers a cost-effective alternative to spatial transcriptomics (ST). However, existing methods treat H\&E images as generic visual inputs and ignore their intrinsic biological hierarchy, where spatially organized cell types collectively form functional tissue microenvironments that govern local gene expression programs. To bridge this gap, we formulate H\&E-to-ST prediction as a cross-modal semantic translation task and propose Path2ST, a hierarchically grounded autoregressive framework featuring three key components: (i) a Hierarchical Cell-Tissue Conditioning mechanism that fuses explicit and implicit cellular features with tissue-level semantic representations to construct hierarchical conditioning signals; (ii) a Scale-Adaptive Autoregressive Generation process over a hierarchical semantic vocabulary, enabling coarse-to-fine, biologically consistent expression synthesis; and (iii) SpectraLoss, a full-spectrum objective that jointly enforces ordinal fidelity, models transcriptional bursts, and aligns semantic structures with cell types. Extensive experiments on three datasets demonstrate state-of-the-art performance, validating that Path2ST generates highly accurate and spatially coherent transcriptomic profiles. The related code is released at https://github.com/RuochenLiu23/Path2ST.

从苏木精-伊红（H&E）染色图像预测空间基因表达为空间转录组学（ST）提供了一种经济有效的替代方案。然而，现有方法将H&E图像视为通用视觉输入，忽视了内在的生物学层级结构，即空间组织的细胞类型共同形成功能组织微环境，控制局部基因表达程序。为弥补这一差距，我们将H&E到ST预测形式化为跨模态语义翻译任务，并提出Path2ST，一个层级锚定的自回归框架，包含三个关键组件：（i）层级细胞-组织条件机制，将显性和隐性细胞特征与组织级语义表示融合，构建层级条件信号；（ii）跨层级语义词汇表的尺度自适应自回归生成，实现从粗到细、生物一致性的表达合成；以及（iii）SpectraLoss，一个全谱目标函数，共同强制顺序保真度、模拟转录爆发，并使语义结构与细胞类型对齐。在三个数据集上的广泛实验表明，Path2ST达到了最先进的性能，验证了其能够生成高度准确且空间连贯的转录组学图谱。相关代码已发布于 https://github.com/RuochenLiu23/Path2ST。

Positional encoding is a fundamental component of Transformer-based generative recommendation models, where user histories are modeled as autoregressive item sequences. Most positional encoding methods are inherited from natural language processing and mainly represent discrete item order. However, recommendation sequences go beyond ordered lists, as timestamps and temporal effects also shape item relations. Our work is motivated by a real-world food delivery and instant retail recommendation system, where user behavior exhibits multi-level temporal regularities, including recency effects, meal-time peaks, weekday-weekend shifts, and promotion-driven traffic bursts. Existing methods partially address this issue through timestamp features, interval embeddings, decay functions, or attention biases, but they usually inject heterogeneous temporal signals through a unified representation or a single modeling pathway, making it difficult to distinguish broad temporal dynamics from local order cues. To address this limitation, we propose Decoupled Temporal Encoding, a lightweight framework for generative recommendation. DTE separates temporal dynamics from order information through two complementary modules: a personalized macro-temporal module that injects compact temporal primitives into item embeddings, and a time-gated micro-sequential module that introduces relative-order bias only when interactions are temporally dense. DTE is also parameter-efficient and deployment-friendly, allowing easy integration into existing systems.

位置编码是基于Transformer的生成式推荐模型中的基础组件，其中用户历史被建模为自回归项目序列。大多数位置编码方法继承自自然语言处理，主要表示离散的项目顺序。然而，推荐序列超越有序列表，因为时间戳和时间效应也塑造了项目关系。我们的工作源于一个真实的外卖和即时零售推荐系统，其中用户行为呈现多层次的时间规律性，包括近因效应、餐时高峰、工作日-周末转换以及促销驱动的流量激增。现有方法通过时间戳特征、间隔嵌入、衰减函数或注意力偏置部分解决了这一问题，但它们通常通过统一表示或单一建模路径注入异质时间信号，难以区分广泛的时间动态与局部顺序线索。为解决这一局限性，我们提出了解耦时间编码（DTE），一个用于生成式推荐的轻量级框架。DTE通过两个互补模块将时间动态与顺序信息分离：一个个性化宏观时间模块，将紧凑的时间原语注入项目嵌入；以及一个时间门控微观序列模块，仅在交互时间密集时引入相对顺序偏置。DTE还具有参数高效和易于部署的特点，可轻松集成到现有系统中。

Generative recommendation treats next-item prediction as autoregressive item-identifier generation. Specifically, items are encoded as semantic identifiers (SIDs), which are short coarse-to-fine token sequences whose early tokens capture broad semantics and later tokens refine them. Recent work augments this paradigm with reasoning traces and optimizes them via reinforcement learning with verifiable rewards, typically outcome-reward algorithm with exact-match feedback on the generated SID. However, in large-catalog recommendation, exact-match feedback on the generated SID only reports whether the final item is correct; when a generated SID mismatches, outcome-reward cannot identify which SID-token prediction caused the mismatch and may penalize matched SID-token positions together with the mismatched position. We identify that the natural unit of credit assignment in this setting is a single reasoning step (one thinking block paired with one SID token). We instantiate this idea in SAPO (Step-Aligned Policy Optimization): rather than broadcasting one advantage to the whole response, SAPO computes a separate group-relative advantage for each reasoning step and applies it only to the corresponding thinking block and SID token. Across three real-world recommendation datasets, SAPO stabilizes reinforcement-learning training and consistently improves over existing generative recommendation baselines, with the largest gains where sparse exact-match feedback makes reasoning-step credit assignment important. Our results suggest that reinforcement-learning objectives for structured generation should mirror the decoder's own decomposition of the output.

生成式推荐将下一个项目预测视为自回归项目标识符生成。具体而言，项目被编码为语义标识符（SID），这些是粗到细的短token序列，其早期token捕捉粗粒度语义，后续token则进行细粒度细化。近期研究通过推理轨迹增强了这一范式，并利用可验证奖励的强化学习进行优化，通常采用结果奖励算法并对生成的SID进行精确匹配反馈。然而，在大规模目录推荐中，对生成的SID的精确匹配反馈仅报告最终项目是否正确；当生成的SID不匹配时，结果奖励无法识别是哪个SID-token预测导致了错误，可能会将匹配的SID-token位置与不匹配位置一起受到惩罚。我们发现该设置下信用分配的自然单元是单个推理步骤（一个思考块配对一个SID token）。我们在SAPO（分步对齐策略优化）中实现了这一思想：SAPO不是将一个优势广播到整个响应，而是为每个推理步骤计算单独的组相对优势，并仅将其应用于相应的思考块和SID token。在三个真实推荐数据集上，SAPO稳定了强化学习训练并持续改进了现有生成式推荐基线模型，在稀疏精确匹配反馈使得推理步骤信用分配变得重要的场景中提升幅度最大。我们的结果表明，针对结构化生成的强化学习目标应与解码器自身的输出分解相一致。

Generating physically buildable brick structures from 3D shapes requires more than geometric reconstruction: the output must also satisfy discrete part constraints and structural stability. Existing brick generation methods either rely on heuristic optimization, which can break down when the target 3D shape does not admit a feasible structure under predefined constraints, or generate brick sequences without explicitly modeling the underlying 3D geometry and assembly relations. In this work, we present BrickAnything, a geometry-conditioned autoregressive framework for generating buildable brick structures from diverse 3D representations. BrickAnything uses point clouds as a unified geometric interface and predicts brick sequences that reconstruct the target shape under assembly constraints. To model structural dependencies among bricks, we introduce a structure-aware tree tokenization, which represents brick structures through local attachment relations. This formulation makes sequence generation more consistent with the physical construction process, and reduces invalid intermediate states. We further introduce preference-based alignment post-training, validity-constrained decoding and adaptive rollback to improve buildability objectives such as stability and geometric fidelity. Extensive experiments demonstrate that BrickAnything produces geometrically faithful and physically realizable brick structures, and that the proposed tokenization effectively reduces rollback and regeneration compared with conventional ordering strategies.

从3D形状生成物理可构建的砖块结构不仅需要几何重建：输出还必须满足离散部件约束和结构稳定性。现有的砖块生成方法要么依赖启发式优化，当目标3D形状在预定义约束下不存在可行结构时会失效，要么生成砖块序列而未显式建模底层3D几何和装配关系。本工作提出BrickAnything，一个几何条件的自回归框架，用于从多种3D表示生成可构建的砖块结构。BrickAnything使用点云作为统一几何接口，预测在装配约束下重建目标形状的砖块序列。为了建模砖块之间的结构依赖关系，我们引入结构感知树形标记化，通过局部附着关系表示砖块结构。这种 formulation 使序列生成更加符合物理构建过程，并减少无效中间状态。我们进一步引入基于偏好的对齐后训练、有效性约束解码和自适应回滚来改善稳定性、几何保真度等可构建性目标。大量实验表明，BrickAnything生成几何保真且物理可实现的砖块结构，且与常规排序策略相比，所提出的标记化方法能有效减少回滚和重新生成。

jina-code-embeddings is a novel code embedding model suite designed to retrieve code from natural language queries, perform technical question-answering, and identify semantically similar code snippets across programming languages. It makes innovative use of an autoregressive backbone pre-trained on both text and code, generating embeddings via last-token pooling. We outline the training recipe and demonstrate state-of-the-art performance despite the relatively small size of the models, validating this approach to code embedding model construction.

jina-code-embeddings是一个新型代码嵌入模型套件，旨在从自然语言查询中检索代码、执行技术问答任务，并识别跨编程语言的语义相似代码片段。该模型创新性地采用在文本和代码上预训练的自回归骨干网络，通过最后一个token池化方式生成嵌入向量。本文概述了其训练方法，并尽管模型规模相对较小仍展示了最先进的性能，验证了这一代码嵌入模型构建方法的有效性。

Semantic-ID generative recommenders represent each item as a short sequence of discrete semantic tokens and predict the next item by autoregressively generating this token sequence. This paradigm enables a unified generation interface for item IDs, histories, and item text, but it also creates a structured optimization bottleneck during reward-based post-training: when an early semantic token enters the wrong branch of the item-token space, finite rollout groups rarely reach the ground-truth item, so group-relative optimization receives identical zero rewards and produces no useful advantage. We propose Hint-Conditioned Generative Recommendation (HCGRec), a semantic-ID generative recommendation framework that recovers learning signal for such hard training instances. HCGRec diagnoses each instance with checkpoint rollouts and supplies a minimal target-prefix hint only when the current generator cannot reach the correct item. The model then generates the unhinted suffix under the hinted semantic branch, turning zero-reward groups into informative comparisons over item-token completions. Hinting also changes token identity: hinted prefix tokens are oracle-provided item context, while unhinted suffix tokens are sampled generation actions. We therefore introduce hint-aware credit decomposition, using supervised learning to preserve item-semantic and prefix-structure alignment for hinted tokens and GRPO to optimize the sampled suffix. Experiments on sequential recommendation benchmarks show that HCGRec substantially improves over supervised fine-tuning and vanilla reward-based post-training, while reducing zero-advantage training samples from over 70% to below 20%. The code is accessible at https://github.com/WncFht/GRec.

语义ID生成式推荐器将每个物品表示为一个简短的离散语义标记序列，并通过自回归生成该标记序列来预测下一个物品。这一范式为物品ID、历史记录和物品文本提供了统一的生成接口，但在基于奖励的后训练过程中也造成了结构化优化瓶颈：当早期语义标记进入物品-标记空间的错误分支时，有限的展开组很少能到达真实物品，因此组相对优化收到相同的零奖励，无法产生有用的优势。本文提出提示条件生成式推荐（HCGRec），这是一个语义ID生成式推荐框架，能够为这类困难训练样本恢复学习信号。HCGRec通过检查点展开来诊断每个样本，并在当前生成器无法到达正确物品时仅提供最小化的目标前缀提示。然后模型在提示的语义分支下生成未提示的后缀，将零奖励组转换为物品-标记补全上的信息性比较。提示还会改变标记身份：提示的前缀标记是由先验提供的物品上下文，而未提示的后缀标记是采样的生成动作。因此，本文引入提示感知的信用分解，使用监督学习来保持物品语义和前缀结构的对齐以处理提示标记，并使用GRPO来优化采样的后缀。在序列推荐基准上的实验表明，HCGRec显著优于监督微调和普通基于奖励的后训练，同时将零优势训练样本从超过70%降低到20%以下。代码可访问 https://github.com/WncFht/GRec。

Generating full-body human gestures based on speech signals remains challenges on quality and speed. Existing approaches model different body regions such as body, legs and hands separately, which fail to capture the spatial interactions between them and result in unnatural and disjointed movements. Additionally, their autoregressive/diffusion-based pipelines show slow generation speed due to dozens of inference steps. To address these two challenges, we propose GestureLSM, a flow-matching-based approach for Co-Speech Gesture Generation with spatial-temporal modeling. Our method i) explicitly model the interaction of tokenized body regions through spatial and temporal attention, for generating coherent full-body gestures. ii) introduce the flow matching to enable more efficient sampling by explicitly modeling the latent velocity space. To overcome the suboptimal performance of flow matching baseline, we propose latent shortcut learning and beta distribution time stamp sampling during training to enhance gesture synthesis quality and accelerate inference. Combining the spatial-temporal modeling and improved flow matching-based framework, GestureLSM achieves state-of-the-art performance on BEAT2 while significantly reducing inference time compared to existing methods, highlighting its potential for enhancing digital humans and embodied agents in real-world applications. Project Page: https://andypinxinliu.github.io/GestureLSM

基于语音信号生成全身人体姿态在质量和速度方面仍面临挑战。现有方法将身体不同区域（如躯干、腿部、手部）分别建模，无法捕捉各区域之间的空间交互，导致动作不自然且相互割裂。此外，其自回归/基于扩散的生成流程因推理步数众多而显示缓慢的生成速度。为解决这两个挑战，我们提出了GestureLSM，这是一种基于流匹配的语音同步手势生成方法，采用时空建模。我们的方法i) 通过时空注意力显式建模token化身体区域的交互，以生成连贯的全身手势；ii) 引入流匹配技术，通过显式建模潜在速度空间实现更高效的采样。为克服流匹配基线的次优性能，我们提出了潜在快捷学习法和训练期间的β分布时间戳采样，以增强手势合成质量并加速推理。结合时空建模和改进的基于流匹配的框架，GestureLSM在BEAT2数据集上实现了最先进的性能，同时与现有方法相比显著缩短了推理时间，突出了其在现实应用中增强数字人和具身智能体的潜力。项目主页：https://andypinxinliu.github.io/GestureLSM

Text-to-motion generation has advanced with larger corpora and stronger generators, yet many models still rely on holistic frame- or clip-level latents that entangle trajectory, orientation, and articulation. This entanglement obscures body topology and forces the generator to recover kinematic structure implicitly. We present \name, a SMPL motion generation framework that factorizes motion into continuous kinematic-unit latents. A causal Motion VAE maps motion to a time-by-kinematic-unit latent manifold, and a Kinematic-Unit Flow Transformer performs text-conditioned flow matching in this structured space. Because each latent coordinate remains tied to a physical body unit, \name can use kinematic-tree rotary position encoding and kinematic-adaptive flow scheduling. We further train the generator with per-token timesteps over clean-context/noisy-target masks, enabling frame-conditioned continuation and autoregressive segment chaining within one model. Experiments first validate the representation: the kinematic-unit VAE achieves lower geometry, rotation, and feature errors than existing motion tokenizers, showing that the latent space preserves articulated structure rather than merely compressing frames. With a 1.4B-parameter generator trained only on publicly available academic motion--text data, \name outperforms all evaluated academic-data text-to-motion baselines and remains competitive with systems trained on much larger non-public motion corpora. Without task-specific retraining, the same formulation also improves prefix-conditioned generation, BABEL sequential rollout, and narrative motion composition. These results indicate that kinematic-unit latent factorization provides an effective generation substrate for controllable SMPL motion synthesis. Code will be released at https://github.com/ZeyuLing/PRISM.

文本到动作生成随着更大规模的语料库和更强的生成器而取得了进展，然而许多模型仍然依赖于整体帧级或片段级潜在变量，这些变量将轨迹、方向和关节动作纠缠在一起。这种纠缠模糊了身体拓扑结构，并迫使生成器隐式地恢复运动学结构。我们提出了PRISM，一个SMPL动作生成框架，它将动作分解为连续的运动学单元潜在变量。一个因果运动变分自编码器将动作映射到时间×运动学单元潜在流形，而一个运动学单元流匹配Transformer在该结构化空间中执行文本条件流匹配。由于每个潜在坐标始终与一个物理身体单元绑定，PRISM可以使用运动树旋转位置编码和运动学自适应流调度。我们进一步在干净上下文/噪声目标掩码上使用每token时间步来训练生成器，使得帧条件延续和自回归片段链接可以在同一个模型内实现。实验首先验证了该表示方法：运动学单元变分自编码器在几何、旋转和特征误差方面均低于现有动作分词器，表明潜在空间保留了关节结构而非仅仅压缩帧。在仅使用公开学术动作-文本数据训练的14亿参数生成器上，PRISM优于所有评估的学术数据文本到动作基线方法，并与在更大非公开动作语料库上训练的系统保持竞争力。无需针对特定任务重新训练，相同的 formulation 还能改进前缀条件生成、BABEL顺序展开和叙事动作合成。这些结果表明，运动学单元潜在分解为可控SMPL动作合成提供了一个有效的生成基础。代码将发布于 https://github.com/ZeyuLing/PRISM。

Diffusion models have been shown to implicitly generate visual content autoregressively in the frequency domain, where low-frequency components are generated earlier in the denoising process while high-frequency details emerge only in later timesteps. This structure offers a natural opportunity for efficient generation, as high-resolution computation on noise-dominated frequencies is largely redundant. We propose Spectral Progressive Diffusion, a general framework that progressively grows resolution along the denoising trajectory of pretrained diffusion models. To this end, we develop a spectral noise expansion mechanism and derive an optimal resolution schedule from the model's power spectrum. Our framework supports training-free acceleration and a novel fine-tuning recipe that further improves efficiency and quality. We demonstrate significant speedups on state-of-the-art pretrained image and video generation models while preserving visual quality.

扩散模型已被证明在频域中隐式地自回归生成视觉内容，其中低频成分在去噪过程早期生成，而高频细节仅在后期时间步出现。这种结构为高效生成提供了自然的机会，因为对噪声主导的频率进行高分辨率计算在很大程度上是冗余的。我们提出了频谱渐进扩散（Spectral Progressive Diffusion），这是一个通用框架，沿预训练扩散模型的去噪轨迹逐步增大分辨率。为此，我们开发了频谱噪声扩展机制，并从模型的功率谱推导出最优分辨率调度。我们的框架支持无训练加速和一种新颖的微调方案，进一步提升效率和质量。我们在先进的预训练图像和视频生成模型上展示了显著的加速效果，同时保持了视觉质量。

Methods for text-based generation of hand-object interaction (HOI) sequences primarily focus on producing smooth, physically plausible trajectories. A truly utilitarian method should additionally support variable-length generation, composite motion sequences, motion completion and infilling, and reliable termination without compromising physical plausibility. Standard diffusion models for HOI generation are typically trained only for text-to-motion generation on atomic motions and require the motion length to be specified a-priori. Autoregressive (AR) methods provide greater sequence-level flexibility, but commonly depend on discrete motion codes, which can lose contact-sensitive motion detail. To address these key limitations, we present a model performing Masked Autoregression with Diffusion for HOI generation (MAD-HOI). Our method starts by encoding hand and object motions in a continuous latent space while keeping them disentangled to maintain stream-wise control. This is followed by a masked autoregressive transformer to predict context features that condition a flow-matching head. MAD-HOI is capable of motion generation for atomic and composite articulated sequences, conditioned motion completion and infilling, as well as EOM (End of Motion) prediction from a single training objective. We provide comprehensive evaluations for these capabilities and benchmark our method on the ARCTIC and GRAB datasets. Our experiments demonstrate that our method generates more diverse and physically plausible interactions compared to other open-sourced baseline methods.

基于文本的手-物体交互（HOI）序列生成方法主要关注生成平滑、物理上合理的轨迹。一个真正实用的方法还应支持变长生成、复合运动序列、运动补全和填充，以及可靠的终止判断，同时不损害物理合理性。用于HOI生成的标准扩散模型通常仅针对原子动作的文本到运动生成进行训练，且需要预先指定运动长度。自回归（AR）方法提供了更大的序列级灵活性，但通常依赖于离散运动码，可能会丢失接触敏感的运动细节。为了解决这些关键限制，我们提出了一种用于HOI生成的掩码自回归扩散模型（MAD-HOI）。我们的方法首先将手部和物体运动编码到连续潜在空间中，同时保持它们解耦以维持流式控制。随后使用掩码自回归变换器预测上下文特征，这些特征用于条件化流匹配头。MAD-HOI能够为原子动作和复合关节序列生成运动，支持条件运动补全和填充，以及从单一训练目标进行EOM（动作结束）预测。我们对这些能力进行了全面评估，并在ARCTIC和GRAB数据集上对我们的方法进行了基准测试。我们的实验表明，与其他开源基线方法相比，我们的方法能够生成更加多样化和物理上合理的交互。

Joint audio-video generative models serve as foundation for immersive and interactive digital-human generation. Nevertheless, most existing models rely on bidirectional attention and multi-step denoising and can generate only short clips, making them unsuitable for real-time interaction over extended durations. We present Omni-LiveAvatar, the first framework for minute-level, real-time streaming joint audio-video avatar generation. Specifically, we propose (1) a progressive autoregressive distillation pipeline that transfers a large bidirectional joint audio-video diffusion model into a few-step autoregressive generator without auxiliary stabilization mechanisms; (2) a synchronized audio-video long-short-term memory that preserves global consistency under a bounded memory budget; and (3) a hierarchical rolling prompt planning strategy that enables coherent semantic evolution and seamless prompt transitions. Extensive experiments show that Omni-LiveAvatar generates high-quality, synchronized minute-level avatars in real time. In terms of speed, it achieves a 33$\times$ generation speedup over its teacher, LTX-2, on a single NVIDIA H200 GPU; in terms of generation quality, it outperforms accelerated baselines across visual quality, audio quality, cross-modal synchronization, and human fidelity. Our code is available at https://github.com/Aoko955/Omni-LiveAvatar.

联合音视频生成模型是实现沉浸式和交互式数字人生成的基础。然而，现有大多数模型依赖双向注意力和多步去噪机制，且仅能生成短视频片段，不适合长时间实时交互应用。本文提出Omni-LiveAvatar，这是首个支持分钟级实时流式联合音视频数字人生成的框架。具体而言，我们提出以下三项技术：（1）渐进式自回归蒸馏管道，将大型双向联合音视频扩散模型迁移为少步自回归生成器，无需辅助稳定机制；（2）同步音视频长短期记忆机制，在有限内存预算下保持全局一致性；（3）分层滚动提示规划策略，实现连贯的语义演进和无缝的提示转换。大量实验表明，Omni-LiveAvatar能够实时生成高质量、同步的分钟级数字人。在生成速度方面，其在单块NVIDIA H200 GPU上相较于教师模型LTX-2实现了33倍的加速；在生成质量方面，其在视觉质量、音频质量、跨模态同步和人类保真度等指标上均优于加速后的基线模型。代码已开源至 https://github.com/Aoko955/Omni-LiveAvatar。

Predicting single-cell transcriptomic responses to genetic perturbations is central to functional genomics and virtual-cell modeling. Existing approaches, however, typically predict an entire expression profile as a whole, leaving the order in which individual gene responses are generated unmodeled. To address this problem, we introduce \textbf{$D^{2}R^{2}$} (\textbf{D}iscrete \textbf{D}iffusion with \textbf{R}egulation \textbf{R}einforcement), which reformulates perturbation prediction as regulation-guided gene-wise progressive generation. A Masked Discrete Diffusion Model represents expression as ordinal tokens and reconstructs a fully masked profile step by step, allowing generated gene responses to condition those that remain masked. A Regulatory Policy Module initializes the generation policy from a gene regulatory network inferred from control cells and adapts it to the perturbation and current partially generated state. Then, group-relative policy optimization refines only the ordering policy using final perturbation-effect agreement as reward. Across Norman19 and VCC-H1, $D^{2}R^{2}$ achieves the best performance on all five metrics on Norman19 and remains competitive on H1. Controlled ablations holding the generator and generation budget fixed show that biological-prior ordering improves over random ordering and is more reliable than uncertainty-based heuristics, whereas reversing the biological-prior ordering degrades every metric. Biological analyses further show that the refined policy prioritizes regulatory genes early while promoting perturbation-specific transcription factors and responsive genes. These results establish gene generation order as an effective, controllable, and biologically interpretable dimension of single-cell perturbation prediction.

预测单细胞转录组对基因扰动的响应是功能基因组学和虚拟细胞建模的核心问题。然而，现有方法通常将整个表达谱作为整体进行预测，未对单个基因响应生成的顺序进行建模。为解决这一问题，我们提出了$D^{2}R^{2}$（离散调控强化扩散），该方法将扰动预测重新表述为基于调控引导的基因级渐进生成。掩码离散扩散模型将表达量表示为序数标记，并逐步重建完全掩码的图谱，使已生成的基因响应能够为仍处于掩码状态的基因提供条件约束。调控策略模块从对照细胞推断的基因调控网络初始化生成策略，并使其适应扰动信息和当前部分生成的状态。随后，组相对策略优化仅利用扰动效应一致性作为奖励来优化排序策略。在Norman19和VCC-H1数据集上，$D^{2}R^{2}$在Norman19的所有五个指标上均取得最佳性能，并在H1上保持竞争力。固定生成器和生成预算的受控消融实验表明，基于生物学先验的排序优于随机排序，且比基于不确定性的启发式方法更可靠，而逆转生物学先验排序会导致所有指标下降。生物学分析进一步表明，优化后的策略在早期优先考虑调控基因，同时促进扰动特异性转录因子和响应基因的表达。这些结果证明了基因生成顺序是单细胞扰动预测的一个有效、可控且具有生物学可解释性的维度。

Deciding whether a Sokoban puzzle is solvable is PSPACE-complete (Culberson, 1997): solutions can be exponentially long and there is no short certificate to check. Solvability is also a fragile property, since even a single misplaced wall can silently render an entire puzzle unsolvable. In this work, we show that a transformer-based discrete diffusion model trained purely on tile completion, with no access to solvers, rewards, or solvability labels, achieves a solvability rate of 77.4%, with 94.5% of the remaining failures rendered solvable by removing a single wall. In other words, a global, search-heavy property follows from a local training objective: trained only to fill in masked cells, the model inherits solvability it was never trained on. An autoregressive model factorizes as $p(c_k \mid c_1 \dots c_{k-1})$, meaning a fixed order, always conditioned on a prefix. Masked diffusion does not: it hides a random subset of cells and learns $p(c_k \mid \text{any subset})$, so at generation time it can reveal cells in any order, each one conditioned on everything already placed, wherever it sits on the board. A puzzle's difficulty comes from exactly this kind of non-local interaction, a decision in one part of the grid constraining what will work somewhere else entirely. A generator that is not locked into a single fixed order is therefore a better structural match for the problem than one that is. The training pipeline is adapted from MD4 (Shi et al., 2024) and the dataset is DeepMind&x27;s Boxoban (Guez et al., 2019). The trained model and instructions for generating puzzles are publicly available.

判断推箱子谜题是否可解是PSPACE完全问题（Culberson, 1997）：解的长度可能呈指数级增长，且不存在简短的验证证书。可解性同时也是一个脆弱的性质，因为即使仅放置错一块墙也可能悄然使整个谜题变得不可解。在本工作中，我们证明了一个基于Transformer的离散扩散模型，仅在瓦片填充任务上进行训练，无法访问求解器、奖励或可解性标签，即可达到77.4%的可解率，剩余失败案例中有94.5%可通过移除单堵墙变得可解。换言之，一个全局性的、需大量搜索的属性竟能从局部训练目标中涌现：模型仅被训练填充掩码单元格，却意外获得了从未被训练过的可解性。自回归模型可分解为$p(c_k \mid c_1 \dots c_{k-1})$，意味着固定的顺序，总是以前缀为条件。掩码扩散则不同：它隐藏随机单元格的子集并学习$p(c_k \mid \text{任意子集})$，因此在生成时能以任意顺序揭示单元格，每个单元格都已放置的内容为条件，而不论其在棋盘上的位置。谜题的难度恰恰来源于这种非局部交互——棋盘某一处的决策约束着完全无关另一处的可行方案。因此，一种不受单一固定顺序约束的生成器在结构上比受约束的生成器更适合这个问题。训练流程改编自MD4（Shi et al., 2024），数据集使用DeepMind的Boxoban（Guez et al., 2019）。训练好的模型及生成谜题的说明已公开发布。

Accurate protein structure prediction is fundamental to structural biology because protein structure underlies molecular function and provides a basis for mechanistic interpretation. Recent advances in deep learning have transformed the field from multiple sequence alignment (MSA)-driven monomer folding into broader frameworks capable of modeling protein complexes and increasingly heterogeneous molecular systems. Existing reviews have summarized this progress from the perspectives of representative models, application domains, and protein design. Building on these efforts, this review focuses on the methodological evolution of the field itself. It examines recent developments through three closely related dimensions: representations and data, architectures and learning strategies, and confidence and evaluation. Within this perspective, the field is organized into four methodological phases and three cross-cutting transitions: from explicit evolutionary coupling features and early contact prediction to learned sequence representations in AlphaFold2, RoseTTAFold, and ESMFold; from protein-only monomer folding to increasingly integrated modeling of heterogeneous molecular systems in AlphaFold-Multimer, RoseTTAFoldNA, and AlphaFold3; and, more recently, from prediction-oriented structure inference to design-oriented generative modeling in RFdiffusion and related frameworks. This framework provides a clearer understanding of how methodological shifts have shaped the capabilities, limitations, and practical roles of recent models.

准确的蛋白质结构预测是结构生物学的根本所在，因为蛋白质结构是分子功能的基础，并为机制解释提供了依据。深度学习的最新进展已将该领域从多序列比对（MSA）驱动的单体折叠转变为能够建模蛋白质复合物及日益异质化的分子系统的更广泛框架。现有综述已从代表性模型、应用领域和蛋白质设计的角度总结了这一进展。在此基础上，本综述聚焦于该领域自身的方法论演变，从三个密切相关维度审视近期发展：表示与数据、架构与学习策略、以及置信度与评估。基于这一视角，该领域被划分为四个方法论阶段和三次跨领域转变：从显式进化耦合特征及早期接触预测到AlphaFold2、RoseTTAFold和ESMFold中的学习到的序列表示；从仅蛋白质的单体折叠到AlphaFold-Multimer、RoseTTAFoldNA和AlphaFold3中日益整合的异质分子系统建模；以及近期从预测导向的结构推断到RFdiffusion及相关框架中面向设计的生成式建模。该框架有助于更清晰地理解方法论转变如何塑造了近期模型的能力、局限性和实际作用。

Driving video generation models support autonomous-driving development by predicting controllable future scenes for simulation, planning evaluation, and offline data generation. Diffusion-based driving generators repeatedly evaluate large backbones across denoising steps, which limits generation throughput. Existing diffusion acceleration methods reduce this cost, but general-purpose designs omit driving signals available before generation, such as ego speed and planned trajectories. Experiments across driving motions show that cache tolerance varies with ego translation and rotation, denoising progress, and consecutive reuse length. We propose DriveCache, a training-free, action-aware controller that uses planned motion to allocate reuse across scenes and dynamic programming to place it across denoising steps under a calibrated response budget. A causal drift check refreshes features and replans the remaining schedule when generation departs from calibration. Across three generator configurations, DriveCache improves the overall fidelity-efficiency trade-off over evaluated cache methods. Our code will be publicly available.

驾驶视频生成模型通过预测可控的未来场景来支持自动驾驶开发，用于仿真、规划评估和离线数据生成。基于扩散的驾驶生成器在去噪步骤中重复评估大型骨干网络，这限制了生成吞吐量。现有的扩散加速方法降低了这一成本，但通用设计忽略了生成前可用的驾驶信号，如自车速度和规划轨迹。针对驾驶运动的实验表明，缓存容忍度随自车平移和旋转、去噪进度以及连续重用长度而变化。我们提出了DriveCache，这是一种无训练、动作感知的控制器，利用规划的运动在场景间分配重用，并使用动态规划在去噪步骤间放置缓存，同时保持校准的响应预算。当生成偏离校准时，因果漂移检查会刷新特征并重新规划剩余调度。在三种生成器配置下，DriveCache在整体保真度-效率权衡方面优于所评估的缓存方法。我们的代码将公开可用。

The placement of base station (BS) is a fundamental determinant of coverage and capacity of urban wireless networks. Yet large-scale BS deployment optimization remains challenging due to its dependency on site-specific radio propagation and user spatial distributions, both of which are unfortunately difficult to obtain prior to deployment. To overcome this barrier, we propose an intelligent BS deployment framework that integrates a geographic data-informed wireless network digital twin (DT) with deep reinforcement learning (DRL), enabling sample-free macro BS deployment optimization from solely open geographic data, without on-site measurements, real user trajectories, or exhaustive ray tracing. The proposed DT incorporates a sample-free radio map prediction model with hybrid input representation to achieve kilometer-scale signal strength estimation in milliseconds, complemented by a diffusion-based generative model for trajectory synthesis to collectively characterize channel and user distributions. Leveraging the DT as a virtual training environment, we formulate BS deployment as a multi-step Markov decision process (MDP) and solve it via a spatially structured DRL algorithm. A local search process and a Wasserstein distance-based deployment buffer are further incorporated to efficiently explore the large combinatorial solution space. Experimental results in real-world urban scenarios demonstrate that the geographic data-informed DT attains accuracy comparable to 100-sample-based prediction, and the intelligent BS deployment framework achieves up to 98.9% of the idealized benchmark performance while reducing optimization overhead by over 99%.

基站（BS）选址是城市无线网络覆盖和容量的根本决定因素。然而，大规模基站部署优化仍然面临挑战，因为它依赖于特定场地的无线电传播和用户空间分布，而这两种因素在部署前都难以获取。为克服这一障碍，我们提出了一种智能基站部署框架，将地理数据驱动的无线网络数字孪生（DT）与深度强化学习（DRL）相结合，实现了仅从开放地理数据进行无样本宏基站部署优化，无需现场测量、真实用户轨迹或详尽的射线追踪。所提出的DT融合了基于混合输入表示的无样本无线电地图预测模型，可在毫秒级实现公里尺度的信号强度估计，并辅以基于扩散的生成模型进行轨迹合成，以共同表征信道和用户分布。以DT作为虚拟训练环境，我们将基站部署表述为多步马尔可夫决策过程（MDP），并采用空间结构化DRL算法进行求解。此外，我们还引入了局部搜索过程和基于Wasserstein距离的部署缓冲区，以高效探索大规模组合解空间。在真实城市场景中的实验结果表明，地理数据驱动的DT达到了与基于100个样本的预测相当的精度，而智能基站部署框架达到了理想基准性能的98.9%，同时将优化开销降低了超过99%。

Most mobile image-generation applications are thin clients over cloud services, leaving outputs hard to audit. We present an Android latent-diffusion application that runs entirely on-device and is driven by the ambient-light sensor rather than a text prompt, keeping generation, telemetry, and storage local. The contribution is not a new diffusion method but the surrounding measurement workflow: each output is bound to the sensor reading, runtime path, and seed that produced it, giving a per-artifact audit trail for offline analysis. On a single Samsung foldable, one fixed capture of 373 artifacts shows the controller's log-lux input positively associated with output luminance (Pearson $r=0.532$, 95\% CI $[0.455, 0.601]$), confirming the ambient dependency survives denoising and VAE decoding, while the latent UNet/VAE pipeline runs at 552--1334\,ms mean latency across three quality tiers under the Android Neural Networks API (NNAPI).

大多数移动端图像生成应用采用云服务瘦客户端模式，使得输出难以审计。本文提出一款Android端潜在扩散应用，完全运行于本地设备，并采用环境光传感器而非文本提示驱动生成过程，确保生成、遥测和存储均在本地完成。本文的贡献并非提出新的扩散方法，而是构建了一套完整的测量工作流程：每个生成产物均绑定传感器读数、运行时路径及生成种子，从而为每个离线分析对象提供审计追踪。在一台三星折叠屏设备上，对373个生成产物的单次固定采集测试表明，控制器的对数勒克斯输入与输出亮度呈正相关（皮尔逊相关系数r=0.532，95%置信区间[0.455, 0.601]），证实了环境光依赖性在去噪和VAE解码后仍然保留。同时，在Android神经网络API（NNAPI）下，潜在UNet/VAE流水线在三个质量等级上的平均延迟为552至1334毫秒。

Standard autoregressive video generation algorithms based on Diffusion and Flow Matching rely on rigid training objectives and static sampling schedules, limiting inference procedures from adapting to the data. We introduce Equilibrium Forcing (EqF), a simplified framework for video denoising generative models without noise level conditioning. EqF pioneers modular training- and inference-time designs for noise-unconditional generation that decouple learning the denoising field from sampling. This flexibility allows for inference-time algorithms that operate in a closed loop by adapting to feedback from the sample, improving video quality and consistency on challenging autoregressive video generation benchmarks. Extensive analysis elucidates exactly how removing the noise level conditioning enables EqF's data-dependent inference properties to surpass the performance of standard noise level-conditional denoising video methods.

基于扩散和流匹配的标准自回归视频生成算法依赖固定的训练目标和静态采样策略，导致推理过程难以适应数据特性。本文提出平衡强制（Equilibrium Forcing，EqF），一种无需噪声水平条件的视频去噪生成模型简化框架。EqF开创性地实现了噪声无关生成在训练阶段和推理阶段的模块化设计，将去噪场的学习与采样过程解耦。这种灵活性使得推理算法能够以闭环方式运行，通过自适应地响应样本反馈，在具有挑战性的自回归视频生成基准测试中提升视频质量和一致性。大量分析阐明了移除噪声水平条件如何使EqF的数据依赖推理特性超越标准噪声水平条件去噪视频方法的性能。

Posterior sampling with a pretrained diffusion prior is governed by a conditional score whose intermediate likelihood component is generally intractable. We begin from an ideal one-parameter posterior SDE family in which a stochasticity parameter controls probability-flow transport and stochastic exploration without changing the posterior marginals. To obtain a tractable model, we express the likelihood in a rescaled clean-image coordinate and use log-SNR to organize the resulting posterior proxies. Projecting the diffusion uncertainty through the forward operator then yields a noise-conditioned covariance path whose targets approach the clean posterior. Because endpoint consistency of these targets does not ensure that a surrogate transport follows them, we interleave the transport with a frozen-target Langevin corrector, producing a continuous surrogate SDE. We discretize this model with an outer Lie--Trotter splitting and a variance-matched split-step IMEX predictor that treats the learned prior explicitly, the linear likelihood implicitly, and the stochastic innovation after the implicit solve. We prove marginal invariance of the ideal family, posterior convergence of the continuous surrogate under mixing and transport-defect conditions, and a first-order weak error bound for the discrete algorithm. Experiments on FFHQ and ImageNet with 100 score evaluations demonstrate competitive reconstruction fidelity for super-resolution and deblurring. A controlled 100-image ablation separates scale consistency from the finite-step effects of stochastic-increment placement, continuation, and corrector allocation. A separate noiseless box-inpainting study shows that large exploration reaches a performance plateau only when the matched innovation is injected after the stiff likelihood solve.

基于预训练扩散先验的后验采样由条件分数控制，其中间似然分量通常不可处理。我们从一个理想的一参数后验随机微分方程族出发，其中随机性参数控制概率流传输和随机探索，同时保持后验边缘分布不变。为了获得可处理的模型，我们在重新缩放的清晰图像坐标中表达似然，并利用对数信噪比（log-SNR）来组织所得到的后验代理。通过前向算子传播扩散不确定性，生成噪声条件协方差路径，其目标值趋近于清晰后验。由于这些目标值的终点一致性无法保证代理传输会遵循它们，我们将传输与冻结目标Langevin校正器交错进行，形成连续代理随机微分方程。我们采用外层Lie-Trotter分裂和方差匹配的分裂步隐显（IMEX）预测器对该模型进行离散化，其中学习得到的先验被显式处理，线性似然被隐式处理，而随机创新在隐式求解之后注入。我们证明了理想族的边缘不变性，在混合和传输缺陷条件下后验的连续代理收敛性，以及离散算法的一阶弱误差界。在FFHQ和ImageNet数据集上使用100次评分函数评估的实验表明，超级分辨率和去模糊任务具有竞争力的重建保真度。受控的100张图像消融实验将尺度一致性与随机增量放置、延续和校正器分配的有限步效应分离开来。独立的无噪声盒子修复研究表明，大规模探索仅在刚性似然求解后注入匹配创新时才能达到性能 plateau。

Unmanned Aerial Vehicles (UAVs) play a crucial role in various scenarios ranging from disaster response to traffic surveillance. However, aerial video footage often suffers from severe motion blur due to rapid flight maneuvers, vibrations, and camera panning, which can significantly degrade downstream tasks such as target detection. Our goal is to explore a computationally-efficient and effective video deblurring approach to enhance UAV target detection performance. To reduce computational cost, we first propose an Adaptive Latent Scale Selector that dynamically adjusts the latent space resolution according to the intensity of UAV motion, thus balancing detail preservation with inference efficiency. To ensure temporal consistency, we introduce a Multi-Frame Alignment and Learnable Gating module to warp and gate the preceding frames, allowing the model to fuse only relevant temporal information and suppress misaligned or uninformative features. Our method can effectively recover sharp details from the UAV video stream. Extensive experiments on real UAV benchmarks demonstrate that our method not only yields superior deblurring performance but also significantly boosts target detection accuracy, making it highly applicable to robust aerial vision tasks.

无人驾驶航空器（UAV）在灾难响应、交通监控等多种场景中发挥着关键作用。然而，航空视频 footage 常因快速飞行机动、振动和摄像机平移而产生严重的运动模糊，这会显著降低目标检测等下游任务的性能。我们的目标是探索一种计算高效且有效的视频去模糊方法，以提升无人机目标检测性能。为降低计算成本，我们首先提出了一种自适应潜在尺度选择器（Adaptive Latent Scale Selector），根据无人机运动强度动态调整潜在空间分辨率，从而在细节保留与推理效率之间取得平衡。为确保时间一致性，我们引入了多帧对齐与可学习门控模块（Multi-Frame Alignment and Learnable Gating module），对前面帧进行扭曲和门控，使模型仅融合相关的时序信息，并抑制错位或无信息量的特征。我们的方法能够从无人机视频流中有效恢复清晰细节。在真实无人机基准数据集上的大量实验表明，我们的方法不仅产生了卓越的去模糊性能，还显著提升了目标检测精度，使其非常适用于鲁棒的空中视觉任务。

Text-to-audio-video (T2AV) generation models produce a video and its soundtrack from a textual description, but offer no control over whose voice speaks in the output. We show that a base T2AV model can be turned into a voice-cloning model by adding a single zero-initialized linear layer on top of its audio backbone, fine-tuning for a comparatively short training schedule, and conditioning on a short reference recording at inference time. The reference is injected through two complementary signals: its diffusion latents are prepended to the audio stream, and a global speaker embedding modulates token of the target audio. On a benchmark of 674 speaker-text pairs spanning 30 speakers we compare against five strong voice-cloning text-to-speech baselines: our enhanced 5B model attains the highest speaker-encoder cosine similarity (SECS) across three independent verification networks (ECAPA-TDNN, WavLM-SV, Resemblyzer), statistically significantly outperforming every baseline. A side product of the architecture is that the audio path can be evaluated without the video path at inference time, yielding a ~30x speed-up over the full audio-video diffusion loop while preserving the voice-cloning behaviour.

文生音视频（T2AV）生成模型能够根据文本描述生成视频及其配乐，但无法控制输出中说话者的声音。本研究证明，通过在音频backbone上添加单个零初始化的线性层，进行相对较短的微调，并在推理时基于短参考录音进行条件化，即可将基础T2AV模型转化为声音克隆模型。参考信号通过两个互补信号注入：其扩散潜在表示被前置到音频流中，全局说话人嵌入对目标音频的token进行调制。在包含30个说话人的674个说话人-文本对基准上，我们与五个强大的声音克隆文本转语音基线模型进行了比较：我们的增强型5B模型在三个独立验证网络（ECAPA-TDNN、WavLM-SV、Resemblyzer）上获得了最高的说话人编码器余弦相似度（SECS），并在统计上显著优于所有基线模型。该架构的附带优势在于，推理时音频路径可独立于视频路径进行评估，相比完整的音视频扩散循环可实现约30倍加速，同时保持声音克隆效果。

Conditional image-to-image generators are single-shot: they map input features to an output in one forward pass and treat it as final, with no opportunity to improve on it. Although trained to produce the best possible result in one step, such a model leaves room for improvement if it can adaptively revise its own output over iterations. We propose Recursive Refinement via Feedback Conditioning (RRFC), a novel feedback-conditioning framework for iterative output refinement that teaches a model to adaptively revise its output by conditioning on a new signal, namely its most recent previous prediction, which is fed back as an auxiliary set of channels alongside the original input. This preserves the generator's core architecture while modifying its conditioning interface and, depending on the model family, its training or inference procedure, so RRFC can be attached to existing generators without redesign. We evaluate RRFC across six baselines spanning adversarial, equilibrium, and diffusion-based models and three paired image-to-image translation tasks. Across 18 architecture-task settings, RRFC yields seven Holm-corrected improvements, seven degradations, and four non-significant changes. The gains concentrate on reconstruction-fidelity and identity settings, while five of the seven degradations fall on the single semantic-layout task, where every model declines. These results indicate that feedback-based refinement helps when its objective overlaps with the evaluated property, and that its gains concentrate on the tasks where that overlap holds.

条件图像到图像生成器是单次生成的：它们将输入特征在一次前向传播中映射到输出，并将其作为最终结果，没有改进的机会。虽然训练目标是尽可能在一步中产生最佳结果，但如果模型能够通过迭代自适应地修订其输出，则仍有改进空间。我们提出了递归细化反馈条件化（RRFC），这是一种用于迭代输出细化的新型反馈条件化框架，它通过在一个新信号上进行条件化来训练模型自适应地修订其输出，这个新信号即其最近的先前预测，作为辅助通道集与原始输入一起反馈。这保留了生成器的核心架构，同时修改了其条件接口，并根据模型家族修改其训练或推理过程，使得RRFC可以附加到现有生成器上而无需重新设计。我们在跨越对抗模型、平衡态模型和扩散模型三种模型族的六个基线模型上评估RRFC，并针对三个配对图像到图像翻译任务。在18个架构-任务设置中，RRFC产生了7个Holm校正的改进、7个退化和4个不显著变化。改进集中在重建保真度和身份设置任务上，而7个退化中有5个发生在单一语义布局任务上，所有模型在该任务上都有所下降。这些结果表明，当反馈细化的目标与评估属性重叠时，基于反馈的细化会有所帮助，且其收益集中在该重叠成立的任务上。

Diffusion models have recently shown strong potential for multivariate time-series anomaly detection by learning the distribution of normal data through iterative denoising. Existing diffusion-based approaches, however, typically perform anomaly detection after completing the reverse diffusion process, relying primarily on the final reconstructed signal and overlooking informative representations produced during denoising. This design incurs substantial computational cost and limits the use of intermediate diffusion information for anomaly detection. In this paper, we propose FirstDiff, a diffusion-based anomaly detection framework based on the observation that the predicted diffusion noise at the initial reverse-diffusion evaluation already contains sufficient information for accurate anomaly detection. FirstDiff models the statistical distribution of predicted diffusion noise under normal behavior using validation data, enabling anomaly inference from a single denoising-network evaluation rather than completing the reverse diffusion trajectory. To model complex temporal and inter-sensor dependencies, FirstDiff employs a Diffusion Transformer as the denoising backbone. Extensive experiments on five public benchmark datasets demonstrate that FirstDiff achieves state-of-the-art performance while reducing diffusion inference from the full reverse trajectory to a single denoising-network evaluation.

扩散模型通过迭代去噪学习正常数据的分布，近年来在多元时间序列异常检测领域展现出强大的潜力。然而，现有的基于扩散的方法通常在完成逆向扩散过程后才进行异常检测，主要依赖最终重建的信号，而忽略了去噪过程中产生的有用信息表示。这种设计带来了相当高的计算成本，并且限制了中间扩散信息用于异常检测。 本文提出FirstDiff，这是一个基于扩散的异常检测框架，其核心观察是：在逆向扩散过程的初始步骤中预测的扩散噪声已经包含了足够的信息来进行准确的异常检测。FirstDiff利用验证数据对正常行为下预测扩散噪声的统计分布进行建模，从而能够从单次去噪网络评估中进行异常推断，而非完成整个逆向扩散轨迹。 为了建模复杂的时间依赖和传感器间依赖关系，FirstDiff采用Diffusion Transformer作为去噪骨干网络。在五个公开基准数据集上的大量实验表明，FirstDiff实现了最先进的性能，同时将扩散推理从完整的逆向轨迹简化为单次去噪网络评估。

Conformal prediction (CP) provides distribution-free coverage guarantees and has emerged as a principled tool for uncertainty quantification. In edge-level fraud detection on temporal interaction graphs, where false positives and false negatives both carry substantial cost, such coverage guarantees are particularly appealing for risk-aware decision making. However, directly applying existing graph conformal predictors yields inefficient prediction sets due to two recurring properties of fraud data. Fraudulent interactions are often embedded in benign-dominated neighborhoods that dilute calibration signals, while extreme class imbalance leaves scarce labeled-fraud support in the calibration split and leads to overly conservative class-conditional thresholds. To address these issues, we propose ProtoCP, a conformal prediction framework for edge-level fraud detection on temporal graphs. ProtoCP improves calibration efficiency by focusing calibration on fraud-relevant subgraph context and producing more stable nonconformity scores under class imbalance and temporal drift. Specifically, it leverages learned prototypes to suppress benign-dominated noise in the calibration context and introduces a neighborhood-relative scoring mechanism with temporal score diffusion for stable class-conditional calibration. Experiments on four fraud benchmarks (YelpChi, S-FFSD, FTFD, and BankSim) show that ProtoCP achieves the target coverage with consistently smaller prediction sets than state-of-the-art baselines. Our codes are available at https://github.com/Picard1701ent/ProtoCP.git

共形预测（Conformal Prediction, CP）提供无分布覆盖保证，已成为不确定性量化的重要工具。在时间交互图的边级欺诈检测中，假阳性和假阴性都带来相当大的成本，这种覆盖保证对于风险感知决策尤其有吸引力。然而，由于欺诈数据具有两个常见特性，直接应用现有的图共形预测器会导致预测集效率低下。欺诈性交互通常嵌入在良性主导的邻域中，这会稀释校准信号；而极端的类不平衡使得校准分割中标记欺诈的样本稀缺，导致类别条件阈值过于保守。为解决这些问题，我们提出了ProtoCP，这是一个用于时间图上边级欺诈检测的共形预测框架。ProtoCP通过将校准聚焦于欺诈相关的子图上下文，并在类不平衡和时间漂移下产生更稳定的不一致性分数来提高校准效率。具体而言，它利用学习到的原型来抑制校准背景中良性主导的噪声，并引入邻域相对评分机制结合时间分数扩散，以实现稳定的类别条件校准。在四个欺诈基准数据集（YelpChi、S-FFSD、FTFD和BankSim）上的实验表明，ProtoCP在实现目标覆盖的同时，预测集始终比最先进的基线方法更小。我们的代码可访问https://github.com/Picard1701ent/ProtoCP.git。

Monitoring war-induced damage to agricultural land in Ukraine is important for understanding threats to food security, environmental stability, and post-war recovery. However, the development of computer-vision systems for satellite-based damage analysis is limited by the scarcity of labeled imagery, especially for damaged agricultural fields. This work investigates synthetic data augmentation as a method for improving classification under limited and imbalanced training data. We train class-conditional Generative Adversarial Network (GAN) and Denoising Diffusion Probabilistic Model (DDPM) architectures on real satellite images and use them to generate additional bombed and not-bombed agricultural-field samples. The generated images are used only for training augmentation, while all downstream evaluation is performed on an exclusively real test set. A Vision Transformer classifier is trained under multiple real and synthetic data configurations to measure the practical utility of each generative approach. The best configuration, based on balanced DDPM augmentation, improves accuracy from 84\% to 88\%, balanced accuracy from 67\% to 81\%, macro F1 from 65\% to 78\%, and recall for the underrepresented not-bombed class from 41\% to 69\%. These results demonstrate the potential of synthetic satellite imagery for data-scarce geospatial applications in war-affected regions.

监测乌克兰战争导致的农业土地损坏对于理解粮食安全威胁、环境稳定性和战后恢复至关重要。然而，用于卫星图像损伤分析的计算机视觉系统开发受到标注图像稀缺的限制，特别是对于受损农田的标注图像。本研究探讨合成数据增强作为在有限且不平衡的训练数据下改进分类的方法。我们在真实卫星图像上训练了类别条件生成对抗网络（GAN）和去噪扩散概率模型（DDPM）架构，并利用它们生成额外的轰炸与非轰炸农田样本。生成的图像仅用于训练增强，而所有下游评估均在纯真实测试集上进行。视觉Transformer分类器在多种真实和合成数据配置下进行训练，以衡量每种生成方法的实际效用。基于平衡DDPM增强的最佳配置将准确率从84%提升至88%，平衡准确率从67%提升至81%，宏F1分数从65%提升至78%，并将代表性不足的非轰炸类别的召回率从41%提升至69%。这些结果证明了合成卫星图像在战区数据稀缺地理空间应用中的潜力。

Procedure planning seeks to estimate a sequence of actions to transition from an observed initial state to a given goal state. Current procedure planning approaches directly predict action sequences from latent representations using feed-forward neural networks or diffusion-based inference. These paradigms treat every action as plausible, lacking the ability to enforce task-specific logical constraints that render certain actions irrelevant or not plausible. We propose CEFITO, a procedure planning approach that learns a predictor to express an action-conditioned representation space. Based on this representation space, we formulate procedure planning as a task-constrained optimization problem. Unlike prior methods, CEFITO explicitly reasons over the action space by omitting irrelevant actions during inference-time planning. This reformulation enables effective procedure planning and achieves state-of-the-art accuracy on two established procedure planning benchmarks.

程序规划旨在估计一个动作序列，将观察到的初始状态转换到给定的目标状态。当前的程序规划方法直接使用前馈神经网络或基于扩散的推理从潜在表示预测动作序列。这些范式将每个动作都视为可行的，缺乏强制执行任务特定逻辑约束的能力，而这些约束会使某些动作不相关或不可行。我们提出了CEFITO，这是一种学习预测器来表达动作条件表示空间的程序规划方法。基于该表示空间，我们将程序规划表述为任务约束优化问题。与先前方法不同，CEFITO通过在推理时间规划中忽略不相关的动作来显式推理动作空间。这种重新表述实现了有效的程序规划，并在两个已建立的程序规划基准上达到了最先进的精度。

The Porous Medium Equation (PME), given by $u_t = \Delta(u^m)$ for $m > 1$, is a degenerate nonlinear parabolic partial differential equation that arises in various physical applications such as fluid flow in porous media, heat transfer in plasmas, and population dynamics. It is known for its nonlinear diffusion and finite propagation speed. In this paper, we study numerical solutions of the one-dimensional direct and inverse PME using Physics-Informed Neural Networks (PINNs), and compare them with classical numerical methods and available analytical and manufactured solutions. While PINNs provide a flexible framework for solving both forward and inverse problems, we show that the standard inverse formulation suffers from a strong sensitivity to the initial guess, leading to only local convergence. To address this issue, we propose a novel two-stage PINN training framework for the inverse problem, which significantly improves convergence stability and allows reliable recovery of the unknown parameter even for poor initial guesses. Overall, the proposed approach demonstrates that PINNs are a flexible and accurate alternative to classical methods for the 1D PME, and the introduced two-stage training strategy substantially improves their robustness in inverse problems, providing a solid basis for extensions to more complex geometries and higher-dimensional cases.

多孔介质方程（PME）由$u_t = \Delta(u^m)$（$m > 1$）给出，是一种退化非线性抛物型偏微分方程，存在于多孔介质流体、等离子体热传递以及人口动力学等多种物理应用中。该方程以其非线性扩散和有限传播速度特性而闻名。本文研究了一维正逆PME问题的物理信息神经网络（PINNs）数值解，并与经典数值方法以及现有解析解和构造解进行了比较。尽管PINNs为求解正问题和逆问题提供了灵活的框架，但我们表明标准逆 formulation 对初始猜测具有很强的敏感性，只能收敛到局部解。为解决这一问题，我们提出了一种用于逆问题的新型两阶段PINN训练框架，显著提高了收敛稳定性，即使对于较差的初始猜测也能可靠地恢复未知参数。总体而言，所提出的方法表明PINNs是经典方法求解一维PME问题的一种灵活且准确的替代方案，并且引入的两阶段训练策略显著提高了其在逆问题中的鲁棒性，为扩展到更复杂几何形状和高维情形奠定了坚实基础。

Multimodal named entity recognition (MNER) determines whether each candidate span and entity-type hypothesis is supported by joint textual and visual evidence. Existing imagine-and-compare verifiers map each (span, type) pair to one predicted visual feature, compressing diverse visual realisations into a single prototype and providing a compatibility score without explicit probabilistic semantics. We introduce DiffImaginE, which formulates MNER type verification as conditional latent diffusion inference. Given span-localised visual evidence, a type-conditioned denoiser predicts noise injected into its standardised latent. The resulting denoising error provides an ELBO-consistent surrogate for type-conditional negative log-likelihood, allowing competing type hypotheses to be ranked by how well they explain the observation. DiffImaginE retains a standard multimodal encoder stack and replaces the deterministic verifier with a classifier-free-guided diffusion scorer trained using Min-SNR weighting. We directly supervise per-type diffusion scores as classification logits, learn aggregation across noise levels, and use antithetic sampling to reduce Monte Carlo comparison variance. Our analysis shows that classifier-free guidance sharpens the induced type posterior and characterises when antithetic pairing reduces variance at equal denoiser cost. Experiments on Twitter-2015 and Twitter-2017 show consistent gains over a matched deterministic ImaginE control under the same encoder, auxiliary objectives, and evaluation protocol, supported by ablations and paired significance tests.

多模态命名实体识别（MNER）旨在判断每个候选片段和实体类型假设是否被联合的文本和视觉证据所支持。现有的想象-比较验证器将每个（片段，类型）对映射到一个预测的视觉特征，将多样化的视觉实现压缩为单一原型，并提供兼容性分数而无需显式的概率语义。本文提出DiffImaginE，将MNER类型验证建模为条件潜在扩散推理给定片段定位的视觉证据，类型条件去噪器预测注入到其标准化潜在表示中的噪声。得到的去噪误差提供了ELBO一致的负对数似然代理，使竞争的类型假设能够根据其对观测结果的解释程度进行排序。DiffImaginE保留标准的多模态编码器堆栈，并用基于无分类器引导的扩散评分器替换确定性验证器，该评分器使用Min-SNR加权进行训练。我们直接监督每类型扩散分数作为分类logits，学习跨噪声水平的聚合，并使用对偶采样来降低蒙特卡洛比较方差。我们的分析表明，无分类器引导使诱导的类型后验更加尖锐，并揭示了对偶配对在相同去噪器成本下何时能够降低方差。在Twitter-2015和Twitter-2017数据集上的实验表明，在相同的编码器、辅助目标和评估协议下，相比匹配的确定性ImaginE控制方法，我们的方法获得了一致的性能提升，并通过消融实验和配对显著性检验提供了支持。

Diffusion Transformers (DiT) have become the dominant methods in image and video generation yet still suffer substantial computational costs. As an effective approach for DiT acceleration, feature caching methods are designed to cache the features of DiT in previous timesteps and reuse them in the next timesteps, allowing us to skip the computation in the next timesteps. Among them, token-wise feature caching has been introduced to perform different caching ratios for different tokens in DiTs, aiming to skip the computation for unimportant tokens while still computing the important ones. In this paper, we propose to carefully check the effectiveness in token-wise feature caching with the following two questions: (1) Is it really necessary to compute the so-called "important" tokens in each step? (2) Are so-called important tokens really important? Surprisingly, this paper gives some counter-intuition answers, demonstrating that consistently computing the selected ``important tokens'&x27; in all steps is not necessary. The selection of the so-called ``important tokens'&x27; is often ineffective, and even sometimes shows inferior performance than random selection. Based on these observations, this paper introduces dual feature caching referred to as DuCa, which performs aggressive caching strategy and conservative caching strategy iteratively and selects the tokens for computing randomly. Extensive experimental results demonstrate the effectiveness of our method in DiT, PixArt, FLUX, and OpenSora, demonstrating significant improvements than the previous token-wise feature caching.

扩散变换器（Diffusion Transformers，DiT）已成为图像和视频生成的主流方法，但仍存在较高的计算成本。作为DiT加速的一种有效方法，特征缓存方法旨在将DiT在前一个时间步的特征缓存起来，并在下一个时间步中复用，从而跳过下一个时间步的计算。其中，token级特征缓存被引入到DiT中，以对不同的token执行不同的缓存比例，旨在跳过不重要token的计算，同时仍计算重要的token。本文提出仔细验证token级特征缓存的有效性，并针对以下两个问题展开研究：(1) 所谓的“重要”token在每个步骤中是否真的需要计算？(2) 所谓的“重要”token真的重要吗？令人惊讶的是，本文给出了一些反直觉的答案，证明在所有步骤中持续计算选定的“重要”token并非必要。所谓的“重要token”选择往往无效，有时甚至表现出比随机选择更差的性能。基于这些观察，本文引入了双特征缓存（称为DuCa），该方法迭代执行激进的缓存策略和保守的缓存策略，并随机选择需要计算的token。大量实验结果证明了我们的方法在DiT、PixArt、FLUX和OpenSora上的有效性，显著优于先前提出的token级特征缓存方法。

We propose CLONE, a Continuous Latent Optimization framework for Normal Estimation via 3D Gaussian splatting. The core idea is to construct an image-geometry-image consistency strategy that unifies explicit geometric representation with differentiable rendering, thereby enabling weakly supervised learning without normal ground truth. Specifically, CLONE comprises four components. First, by introducing a differentiable light interaction model with a learnable modulation kernel, we perform a unified reparameterization of the 3DGS parameter space. Second, the conditional single-step deterministic refinement network integrates denoising architectures with differentiable reprojection constraints to refine the initial normals, thereby adaptively recovering the high-frequency details erased by the inherently smooth Gaussian primitives. Third, the cross-domain gating fusion mechanism adaptively combines the two complementary normal estimates, reconciling the geometrically consistent yet over-smooth 3DGS estimate with the detailed yet potentially geometry-inconsistent refinement. Finally, all components are jointly optimized under a unified photometric reprojection objective with geometric consistency regularizations in a fully differentiable pathway, achieving an end-to-end optimization closed loop without relying on external normal labels.

我们提出CLONE，一个通过3D高斯溅射进行法线估计的连续潜变量优化框架。其核心思想是构建一种图像-几何-图像一致性策略，将显式几何表示与可微渲染相结合，从而实现无法线真值的弱监督学习。具体而言，CLONE包含四个组件。首先，通过引入具有可学习调制核的可微光交互模型，我们对3DGS参数空间进行统一重参数化。其次，条件单步确定性细化网络将去噪架构与可微重投影约束相结合，以细化初始法线，从而自适应恢复被固有平滑的高斯原语擦除的高频细节。第三，跨域门控融合机制自适应地整合两种互补的法线估计，协调几何一致但过度平滑的3DGS估计与细节丰富但可能几何不一致的细化结果。最后，所有组件在统一的光度重投影目标与几何一致性正则化的约束下通过完全可微的路径进行联合优化，实现了端到端的优化闭环，而不依赖于外部法线标签。

Bimanual dexterous manipulation relies on integrating multimodal inputs to perform complex real-world tasks. To address the challenges of effectively combining these modalities, we propose DECO, a decoupled multimodal diffusion transformer that disentangles vision, proprioception, and tactile signals through specialized conditioning pathways, enabling structured and controllable integration of multimodal inputs, with a lightweight adapter for parameter-efficient injection of additional signals. Alongside DECO, we release DECO-50 dataset for bimanual dexterous manipulation with tactile sensing, consisting of 50 hours of data and over 5M frames, collected via teleoperation on real dual-arm robots. We train DECO on DECO-50 and conduct extensive real-world evaluation with over 2,000 robot rollouts. Experimental results show that DECO achieves the best performance across all tasks, with a 72.25% average success rate and a 21% improvement over the baseline. Moreover, the tactile adapter brings an additional 10.25% average success rate across all tasks and a 20% gain on complex contact-rich tasks while tuning less than 10% of the model parameters.

双手灵巧操作依赖于整合多模态输入以执行复杂的现实世界任务。为有效解决这些模态组合的挑战，我们提出了DECO，一种解耦多模态扩散变换器，通过专用条件化路径将视觉、本体感觉和触觉信号解耦，实现多模态输入的结构化和可控整合，并配备一个轻量级适配器用于参数高效地注入额外信号。随DECO一起，我们发布了DECO-50双手灵巧操作触觉感知数据集，包含50小时的数据和超过500万帧，通过真实双臂机器人的遥操作采集。我们在DECO-50上训练DECO，并进行了广泛的真实世界评估，涵盖超过2000次机器人部署。实验结果表明，DECO在所有任务中实现了最佳性能，平均成功率为72.25%，较基线提升21%。此外，触觉适配器在所有任务中带来了额外的10.25%平均成功率提升，在复杂的接触密集型任务中实现了20%的增益，同时仅需调整不到10%的模型参数。

Diffusion-based image-to-video (I2V) models are increasingly effective, yet they struggle to scale to ultra-high-resolution inputs (e.g., 4K). Generating videos at the model's native resolution often loses fine-grained structure, whereas high-resolution tiled denoising preserves local detail but breaks global layout consistency. This failure mode is particularly severe in the fresco animation setting: monumental artworks containing many distinct characters, objects, and semantically different sub-scenes that must remain spatially coherent over time. We introduce FrescoDiffusion, a training-free method for coherent large-format I2V generation from a single complex image. The key idea is to augment tiled denoising with a precomputed latent prior: we first generate a low-resolution video at the underlying model resolution and upsample its latent trajectory to obtain a global reference that captures long-range temporal and spatial structure. For 4K generation, we compute per-tile noise predictions and fuse them with this reference at every diffusion timestep by minimizing a single weighted least-squares objective in model-output space. The objective combines a standard tile-merging criterion with our regularization term, yielding a closed-form fusion update that strengthens global coherence while retaining fine detail. We additionally provide a spatial regularization variable that enables region-level control over where motion is allowed. Experiments on the VBench-I2V dataset and our proposed fresco I2V dataset show improved global consistency and fidelity over tiled baselines, while being computationally efficient. Our regularization enables explicit controllability of the trade-off between creativity and consistency.

基于扩散的图像到视频（I2V）模型日益强大，但在扩展到超高分辨率输入（如4K）方面仍面临挑战。在模型原生分辨率生成视频往往导致精细结构损失，而高分辨率平铺去噪虽能保留局部细节，却破坏了全局布局一致性。这种失败模式在壁画动画场景中尤为严重：包含众多不同角色、物体和语义各异子场景的宏大艺术作品必须保持时间上的空间连贯性。我们提出FrescoDiffusion，一种无需训练的从单张复杂图像生成连贯大格式I2V的方法。其核心思想是利用预计算的潜在先验增强平铺去噪：首先在底层模型分辨率生成低分辨率视频，并上采样其潜在轨迹以获得捕捉长程时空结构的全局参考。对于4K生成，我们在每个扩散时间步计算每块平铺的噪声预测，并通过在模型输出空间最小化单个加权最小二乘目标将其与该参考融合。该目标融合了标准平铺合并准则与我们的正则化项，产生闭式融合更新，在保留精细细节的同时增强全局连贯性。我们还提供空间正则化变量，实现对运动允许区域的细粒度控制。在VBench-I2V数据集和我们新提出的壁画I2V数据集上的实验表明，该方法在保持计算效率的同时，全局一致性和保真度均优于平铺基线方法。我们的正则化还能明确控制创造力与一致性之间的权衡。

Fake/synthetic images are increasingly prevalent, but it remains unclear whether Convolutional Neural Networks (CNNs) process real and fake images in the same internal manner. This work examines the hypothesis that CNNs represent real and fake images differently, such that fake images induce different hidden-layer activation patterns even when semantic content is preserved. The hypothesis is evaluated in scene recognition settings using trained CNN models. Dense-layer activations are extracted, and neurosymbolic methods assign semantic labels to selected neurons. For each real test image, corresponding fake images are generated with similar semantic content using object-label-guided text-to-image and image-to-image generation based on Stable Diffusion variants. Paired real-fake activation patterns are then compared statistically. Additional experiments with another dataset, CNN architecture, generative model, and JPEG/blur degradation analysis assess robustness. Results suggest that fake images evoke different hidden-neuron activations, and these differences are not explained only by simple image degradation. Overall, the findings indicate that real and fake images differ in CNN hidden-layer activation behavior at least in some settings, which opens the door for follow-up work on making use of this different behavior to improve fake image detection.

伪造/合成图像日益普及，但目前尚不清楚卷积神经网络（CNN）是否以相同的内部方式处理真实图像和伪造图像。本研究假设CNN对真实图像和伪造图像的表示存在差异，即伪造图像即使在语义内容保留的情况下也会引发不同的隐藏层激活模式。该假设在场景识别设置下使用训练好的CNN模型进行评估。全连接层激活被提取出来，神经符号方法被用于为选定的神经元分配语义标签。对于每个真实测试图像，使用基于Stable Diffusion变体的对象标签引导文本到图像和图像到图像生成方法，生成具有相似语义内容的对应伪造图像。随后对成对的真实-伪造激活模式进行统计分析。另一数据集、CNN架构、生成模型以及JPEG/模糊退化分析的额外实验用于评估鲁棒性。结果表明，伪造图像会引发不同的隐藏层神经元激活，而这些差异不能用简单的图像退化来解释。总体而言，研究结果表明，在某些设置下，真实图像和伪造图像在CNN隐藏层激活行为上存在差异，这为后续利用这种差异性来改进伪造图像检测的工作开辟了道路。

Unified image and video creation requires a model to follow diverse instructions while preserving identity, geometry, and temporal structure from visual context. However, semantic-only conditioning and creation-only training do not explicitly supervise the local structure needed for precise, temporally consistent editing. We therefore formulate depth and surface-normal prediction as image-form denoising targets, using these dense tasks as structured visual supervision within the same creation interface. Our framework decouples semantic interpretation from spatially aligned visual injection while sharing one multimodal diffusion transformer (MMDiT) backbone across all tasks. Mutual Context Attention (MCA), a paired-video data-construction procedure, and a progressive training curriculum then connect the learned structural cues to temporally localized editing and reference-conditioned creation. A single checkpoint obtains the highest overall score in the reported comparison of unified systems (4.15); adding dense supervision improves OpenVE Overall from 3.98 to 4.06 and Local Add from 3.92 to 4.18. These results support a deliberately bounded conclusion: perception-oriented dense supervision transfers useful structural knowledge to downstream creation, especially editing locality and preservation; we do not claim superiority as a standalone dense predictor.

统一图像和视频创建要求模型遵循多样化指令，同时保留来自视觉上下文中的身份、几何形状和时间结构。然而，纯语义条件化和纯创建训练并未明确监督精确且时间一致编辑所需的局部结构。因此，我们将深度和表面法线预测制定为图像形式的去噪目标，在同一创建接口内使用这些密集任务作为结构化视觉监督。我们的框架将语义解释与空间对齐的视觉注入解耦，同时在所有任务中共享一个多模态扩散Transformer（MMDiT）主干。互上下文注意力（MCA）、配对视频数据构建程序以及渐进训练课程随后将学习到的结构线索与时间局部化编辑和参考条件创建相关联。一个检查点在统一系统报告比较中获得最高总分（4.15）；添加密集监督将OpenVE总体得分从3.98提升至4.06，Local Add从3.92提升至4.18。这些结果支持一个经过审慎界定得出的结论：感知导向的密集监督能够将有用的结构知识迁移到下游创建任务中，特别是编辑局部性和保真度方面；我们不声称其作为独立密集预测器的优越性。

Instruction-based video editing is commonly built on video-pretrained generative backbones: a video diffusion transformer is adapted, at considerable cost, to condition on a source video and an editing instruction. In this report we explore a different route and show that a strong instruction-based image editing model can edit videos by operating directly on video-VAE latents. Starting from Qwen-Image-Edit, we arrange the latent frames of a Wan~2.1 video VAE as tiles of one large virtual image, reuse the editor's image positional encoding for every tile, and bridge the two latent spaces with a pair of lightweight input/output projections warm-started from the editor&x27;s own patchify and unpatchify layers, so that at initialization a (static) video is embedded exactly as an image the model already understands. The whole system is then fine-tuned on the public Ditto-1M editing triplets, and a few denoising steps of Wan~2.2 serve as an optional temporal enhancer. We motivate the design with a chain of zero-training observations: the stock image editor already edits a video presented as a contact sheet; it is indifferent to whether the sheet's tokens come from one joint encode or from per-frame encodes stitched in latent space; and it even edits genuine video latents zero-shot to a clearly recognizable degree, leaving fine-tuning only a fidelity gap to close. Our results suggest that, despite the large investment in training video latent spaces, per-frame video latents remain close enough to the image domain that mature image editing priors transfer with minimal adaptation. Project Page: https://yunpeng1998.github.io/Qwen-Video-Edit-Page; Code: https://github.com/yunpeng1998/Qwen-Video-Edit; Model: https://huggingface.co/yunpeng1998/Qwen-Video-Edit.

基于指令的视频编辑通常建立在视频预训练的生成骨干网络之上：视频扩散变换器需要以相当高的成本进行适配，以 conditioning 源视频和编辑指令。本报告探索了一条不同的路径，展示了强大的基于指令的图像编辑模型可以直接在视频 VAE 潜在空间上操作来编辑视频。从 Qwen-Image-Edit 出发，我们将 Wan~2.1 视频 VAE 的潜在帧排列为一个大虚拟图像的瓦片，为每个瓦片复用编辑器的图像位置编码，并用一对轻量级的输入/输出投影桥接两个潜在空间，这些投影从编辑器的 patchify 和 unpatchify 层热启动，使得在初始化时，一个（静态）视频被嵌入为模型已经能够理解的图像。然后，整个系统在公开的 Ditto-1M 编辑三元组上进行微调，Wan~2.2 的几个去噪步骤作为可选的时间增强器。我们通过一系列零训练观察来论证该设计的合理性：现成的图像编辑器已经能够编辑以拼接图形式呈现的视频；它对于该拼接图的 token 是来自联合编码还是来自潜在空间中拼接的逐帧编码并不敏感；甚至它能够零样本编辑真实的视频潜在空间，达到明显可识别的程度，微调只需弥补保真度差距即可。我们的结果表明，尽管在训练视频潜在空间方面投入巨大，但逐帧视频潜在空间仍与图像域足够接近，使得成熟的图像编辑先验知识只需极少的适配就能迁移过来。项目主页：https://yunpeng1998.github.io/Qwen-Video-Edit-Page；代码：https://github.com/yunpeng1998/Qwen-Video-Edit；模型：https://huggingface.co/yunpeng1998/Qwen-Video-Edit

Diffusion-based methods have dominated the HOI generation, as they enable critical contact fusions or signals to guide the diffusion process. However, they often result in high artifacts and unstable interaction quality due to error accumulation during iterative denoising. In this work, we propose HOIMask, the first generative masked framework for modeling HOI motion in discrete space. HOIMask first encodes both motion sequences and contact-aware signals into discrete 2D human and object token maps via HOI Vector Quantization (VQ), preserving fine-grained spatial-temporal structure beyond conventional 1D representations. On this basis, a generative masked modeling framework is employed to jointly capture human-object interaction dynamics, leveraging a transformer architecture designed to model complex spatial-temporal and interaction dependencies. To generate more coherent and physically plausible motions, we further introduce a novel contact-aware reconstruction guidance in discrete space during inference, which fuses contact signals to optimize HOI tokens that forces the generated motion with higher spatio-temporal consistency. With craftily designed motion interaction tokens, dedicated architecture and guidance strategy, HOIMask outperforms state-of-the-art diffusion-based methods, generating more realistic and semantically aligned HOI motions. Please refer to https://jyhflash.github.io/HOIMask/ for more results.

基于扩散的方法在HOI生成中占据主导地位，因为它们能够引导扩散过程的关键接触融合或信号。然而，由于迭代去噪过程中的误差累积，这些方法往往产生高伪影和不稳定的交互质量。在本工作中，我们提出了HOIMask，这是首个用于在离散空间中建模HOI运动的生成式掩码框架。HOIMask首先通过HOI矢量量化（VQ）将运动序列和接触感知信号编码到离散的二维人类和对象标记图中，超越了传统一维表示，保留了细粒度的时空结构。在此基础上，采用生成式掩码建模框架来共同捕捉人体物体交互动态，并利用专为建模复杂时空和交互依赖关系而设计的Transformer架构。为了生成更加连贯且物理上合理的运动，我们进一步引入了一种新的离散空间接触感知重构引导方法，该方法融合接触信号以优化HOI标记，迫使生成的运动具有更高的时空一致性。通过精心设计的运动交互标记、专用架构和引导策略，HOIMask优于最先进的基于扩散的方法，生成了更加逼真且语义对齐的HOI运动。更多结果请访问https://jyhflash.github.io/HOIMask/。

Audio-driven 3D facial animation is essential for advancing immersion and interactivity in virtual experiences. Although recent advances have shown promising capabilities, the training and evaluation of existing methods typically rely on ground-truth-based errors, which fall short of aligning with human preferences. To address this, we present a comprehensive framework that learns an automatic perceptual model from human preference data and leverages it to improve and evaluate the perceptual quality of audio-driven 3D facial animation. To begin with, we construct FMPair (Facial Motion Pairwise preference), the first human preference dataset for audio-driven 3D facial animation, which is built through a systematic annotation pipeline and comprises 65,574 annotated 3D facial motion pairs from 8,834 distinct in-the-wild audio clips. Based on the pairwise comparison dataset, we propose a Facial Motion Reward model, termed FMReward, which takes audio and 3D facial motion as inputs and predicts a perceptual quality score aligned with human preferences. Building upon FMReward, we further introduce Facial Motion reward Feedback Learning (FMFL), a direct fine-tuning algorithm that leverages a pretrained reward model to optimize diffusion-based audio-driven 3D facial animation models for better alignment with human preferences. Extensive experiments demonstrate the superiority of FMReward over other metrics in aligning with human preferences and the effectiveness of FMFL in improving the perceptual quality of audio-driven 3D facial animation.

音频驱动的3D面部动画对于提升虚拟体验的沉浸感和交互性至关重要。尽管近年来的研究已展现出良好的性能，但现有方法的训练和评估通常依赖于基于真值的误差，这与人类偏好存在偏差。为此，我们提出了一个综合框架，从人类偏好数据中学习自动感知模型，并利用其改善和评估音频驱动3D面部动画的感知质量。首先，我们构建了FMPair（Facial Motion Pairwise preference）数据集，这是首个针对音频驱动3D面部动画的人类偏好数据集。该数据集通过系统化的标注流程构建，包含来自8,834个不同真实音频片段的65,574个标注3D面部动作对。基于该成对比较数据集，我们提出了一个名为FMReward的面部动作奖励模型，该模型以音频和3D面部动作作为输入，预测与人类偏好一致的感知质量分数。在此基础上，我们进一步引入了面部动作奖励反馈学习（FMFL），这是一种直接微调算法，利用预训练的奖励模型优化基于扩散的音频驱动3D面部动画模型，以更好地对齐人类偏好。大量实验表明，FMReward在人类偏好对齐方面优于其他指标，且FMFL在提升音频驱动3D面部动画感知质量方面具有显著效果。

A spatial-local image-denoising filter is proposed, and its performance metrics are evaluated in comparison with baseline filtering algorithms, including the median, adaptive median, Gaussian, bilateral, Wiener, anisotropic diffusion, and non-local means. The developed filter is based on aligning the intensity value of the central pixel in a 3x3 window with the statistical majority intensity of one of the two clusters formed by optimal Otsu's partitioning of a pixel set sorted by intensity and trimmed to seven elements. This is followed by a fuzzy fusion of the calculated value with the median intensity of the pixels within the window. The proposed filter demonstrates the highest robustness to variations in image noise levels, particularly when processing mixed noise consisting of salt-and-pepper impulse noise and additive Gaussian noise in various proportions

提出了一种空间局部图像去噪滤波器，并将其性能指标与基线滤波算法进行了对比评估，包括中值滤波、自适应中值滤波、高斯滤波、双边滤波、维纳滤波、各向异性扩散滤波和非局部均值滤波。所提出的滤波器基于以下方法：将3×3窗口中中心像素的强度值与按强度排序并裁剪至七个元素的像素集经最优Otsu分割所形成的两个聚类之一的统计众数强度进行对齐，随后将计算所得值与窗口内像素的中值强度进行模糊融合。所提出的滤波器对图像噪声水平的变化表现出最高的鲁棒性，尤其是在处理由不同比例的椒盐脉冲噪声和加性高斯噪声组成的混合噪声时。

Text-to-image diffusion models can be misused to generate harmful content through adversarial or paraphrased prompts that bypass built-in safety mechanisms. Existing concept erasure methods often suffer from limited robustness against adversarial prompts, degradation of benign generation quality, or reliance on inference-time interventions that introduce persistent computational overhead. To address these limitations, we formulate concept erasure as a domain alignment problem in the text representation space. We propose a lightweight Text Encoder Alignment framework (TEA) that fine-tunes only the text encoder while keeping the generative backbone fully frozen. Given concept--anchor prompt pairs, our method trains a discriminator to distinguish token-level representations of concept-containing prompts from those of safe anchor prompts, while updating the text encoder to make these representations indistinguishable. TEA introduces zero inference-time overhead and requires only a small number of fine-tuning steps, making it highly efficient to deploy at scale. Despite this efficiency, TEA achieves state-of-the-art erasure robustness against black-box and white-box adversarial attacks on Stable Diffusion v1.4, while preserving generation quality on benign prompts. Furthermore, TEA is model-agnostic and achieves the lowest attack success rate on Stable Diffusion v3.5, extending concept erasure to a Rectified Flow Transformer architecture with T5 conditioning where prior methods remain largely unexplored. Code is available at \href{https://github.com/alirezafarashah/TEA.git}{https://github.com/alirezafarashah/TEA.git}

文本到图像扩散模型可被滥用于通过绕过内置安全机制的对抗性或改写提示来生成有害内容。现有概念擦除方法通常在对抗性提示的鲁棒性方面表现有限，存在良性生成质量下降问题，或依赖于引入持续计算开销的推理时干预方法。为解决这些局限性，我们将概念擦除表述为文本表示空间中的域对齐问题。我们提出了一种轻量级的文本编码器对齐框架（TEA），该框架仅微调文本编码器，同时保持生成主干网络完全冻结。给定概念-锚点提示对，我们的方法训练一个判别器来区分包含概念提示与安全锚点提示的词元级表示，同时更新文本编码器使这些表示难以区分。TEA引入了零推理时开销，且仅需少量微调步骤，使其非常适合大规模部署。尽管如此高效，TEA在Stable Diffusion v1.4上实现了针对黑盒和白盒对抗攻击的最先进擦除鲁棒性，同时在良性提示上保持了生成质量。此外，TEA与模型无关，在Stable Diffusion v3.5上实现了最低的攻击成功率，将概念擦除扩展到修正流Transformer架构与T5条件机制，而此前方法在该领域几乎未被探索。代码可访问 https://github.com/alirezafarashah/TEA.git

Reconstructing three-dimensional computed tomography (CT) from severely constrained projections is highly ill-posed. Sparse angular sampling, restricted angular coverage, and low photon counts can occur individually or jointly, obscuring global anatomy and local tissue detail. Many learned CT reconstruction methods are tailored to a single dominant degradation. Existing diffusion and Gaussian approaches commonly recover global structure and local detail within a shared representation. We propose HiGDiff, a feed-forward hierarchical Gaussian diffusion framework that decomposes reconstruction both spatially and from structure to detail. Physics-conditioned anatomical anchors and a foreground capacity field allocate learnable Gaussian primitives to informative regions. A structure diffusion stage first recovers global attenuation geometry, and its learned representation conditions a detail diffusion stage for residual boundaries and tissue transitions. The resulting Gaussian banks are rendered as attenuation fields and further refined by a gradient-isolated residual module. Experiments on three distinct CT benchmark datasets demonstrate state-of-the-art reconstruction performance across isolated, paired, and joint degradation settings, including improvements of 5.81 dB in macro-average peak signal-to-noise ratio (PSNR) and 0.113 in structural similarity index measure (SSIM) on the Low Dose CT Image and Projection Data (LDCT-PD) collection. Code and experimental configurations are openly available at https://github.com/Bean-Young/HiGDiff.

从严重受限的投影中重建三维计算机断层扫描（CT）是一个高度不适定问题。稀疏角度采样、受限角度覆盖和低光子计数可能单独出现或同时出现，掩盖全局解剖结构和局部组织细节。许多学习型CT重建方法是针对单一主要降质任务定制的。现有的扩散和高斯方法通常在共享表示中恢复全局结构和局部细节。我们提出了HiGDiff，一个前馈层次化高斯扩散框架，从空间和从结构到细节两个维度分解重建任务。物理条件化解剖锚点和前景容量场将可学习的高斯基元分配到信息丰富的区域。结构扩散阶段首先恢复全局衰减几何结构，其学习到的表示为细节扩散阶段提供条件，用于处理残余边界和组织过渡。生成的高斯库被渲染为衰减场，并进一步通过梯度隔离残差模块进行细化。在三个不同的CT基准数据集上的实验表明，所提方法在单独、成对和联合降质设置下均实现了最先进的重建性能，包括在低剂量CT图像和投影数据（LDCT-PD）集上的宏平均峰值信噪比（PSNR）提高5.81 dB，结构相似性指数（SSIM）提高0.113。代码和实验配置已开源，访问地址：https://github.com/Bean-Young/HiGDiff。

Current flow matching models learn to transport the source i.i.d. Gaussian noise into the target distribution of natural images, yet this source distribution carries no notion of spatial structure. Images however are fundamentally local since nearby pixels are strongly correlated. By sampling the noise independently, we hypothesize that models are implicitly encouraged to exploit less noisy neighbors as context during training, partially bypassing the need to properly learn the true local structure of images. The source distribution, in other words, works against the inductive bias of the image domain. To ameliorate this design discrepancy, we propose StructFlow which encodes spatial locality directly into the source by having the pixels within a small region share a common noise component. This structured source produces transport paths that are geometrically aligned with image regions - enabling properties that generic flow matching struggles to provide: fine-grained local editing that naturally respects boundaries, robust structure preservation, and smooth semantic interpolation between images. We show that these benefits also extend to large pre-trained models, demonstrating that StructFlow can even be incorporated through a lightweight post-training phase. Comprehensive experiments on multiple datasets, in unconditional, class and text-conditioned regimes, using different diffusion transformer architectures confirm that StructFlow not only offers competitive image generation quality, but also significantly improves localized controllable re-synthesis.

当前的流匹配模型学习将源分布中的独立同分布高斯噪声传输到自然图像的目标分布，然而该源分布并不携带空间结构概念。但图像本质上是局部的，因为相邻像素之间高度相关。我们假设，通过独立采样噪声，模型在训练中被隐式地鼓励利用噪声较少的邻域作为上下文，从而部分绕过了学习图像真实局部结构的需要。换句话说，源分布与图像领域的归纳偏置相矛盾。为改善这一设计偏差，我们提出了StructFlow方法，该方法通过让小区域内的像素共享共同的噪声分量，将空间局部性直接编码到源分布中。这种结构化源分布产生了与图像区域几何对齐的传输路径——从而实现了普通流匹配难以提供的特性：自然遵循边界的细粒度局部编辑、鲁棒的结构保留以及图像间的平滑语义插值。我们表明这些优势同样适用于大型预训练模型，证明StructFlow甚至可以通过轻量级的后训练阶段进行整合。在多个数据集上进行的全面实验，涵盖无条件、类别条件和文本条件生成场景，并采用不同的扩散Transformer架构，证实了StructFlow不仅提供具有竞争力的图像生成质量，还显著提升了局部可控重合成能力。

Recent audio-visual generation models can synthesize synchronized video and sound in a unified diffusion process, but their inference cost remains high because long video token sequences require repeated attention computation across denoising steps.A variety of acceleration techniques have been developed for video generation models, including low-bit quantization, attention sparsification, and feature caching.However, since these methods are originally designed for video generation, directly applying them to audio-visual models overlooks the interactions between the audio and video branches and may therefore disrupt audio-video synchronization.We present a synchronization-aware acceleration framework for efficient audio-visual generation.Our key observation is that bidirectional audio-video cross-attention reveals structured interactions between the two branches, with high responses often concentrated on a few sound-related visual and temporal regions.Guided by this interaction pattern, we introduce a protected sparse attention strategy that preserves high-fidelity computation for synchronization-critical tokens while sparsifying redundant attention interactions.By explicitly accounting for cross-modal dependence during acceleration, our method improves inference efficiency while keeping video quality, audio quality, and audio-video synchronization.

近期的音视频生成模型能够在统一的扩散过程中合成同步的视频和声音，但其推理成本较高，因为长视频token序列需要在多个去噪步骤中重复执行注意力计算。视频生成领域已开发了多种加速技术，包括低比特量化、注意力稀疏化和特征缓存。然而，由于这些方法原本是针对视频生成设计的，直接应用于音视频模型会忽略音视频分支之间的交互，因而可能破坏音视频同步。本文提出了一种面向高效音视频生成的同步感知加速框架。我们的关键发现是双向音视频交叉注意力揭示了两个分支之间的结构化交互，高响应通常集中于少数与声音相关的视觉和时间区域。基于这一交互模式，我们引入了一种受保护的稀疏注意力策略，对同步关键token保留高保真计算，同时对冗余的注意力交互进行稀疏化。通过在加速过程中显式考虑跨模态依赖，本方法在保持视频质量、音频质量和音视频同步的同时提升了推理效率。

Video models are increasingly used to predict what happens next in a scene, yet the metrics commonly used to compare their outputs say little about whether the predicted objects move correctly. Motion, geometry, identity, background stability, and visual similarity can fail independently, but whole-frame scores often mix these errors together. We introduce RigidBench, a simulator-grounded benchmark that compares a generated continuation with a reference rollout from the same initial frame and motion description. Its five rigid-body tasks vary objects, materials, viewpoints, and indoor and outdoor scenes, with per-frame masks, depth, 6-DoF trajectories, and contacts available for scoring. We evaluate eight models on the same 100 examples with ten measurements that keep these aspects separate. The resulting rankings depend strongly on what is measured: no model leads on all ten, and across model means, higher SSIM accompanies larger 3D trajectory error (r = 0.89). RigidBench also includes 5,000 training videos with exact simulator state, which we use to fine-tune and analyze Wan 2.2 TI2V-5B. Full fine-tuning reduces 3D trajectory error by about 20% with almost no change in SSIM, while teacher-forced probes and targeted interventions show that object position is represented throughout Wan's diffusion transformer and used by its denoising computation.

视频模型越来越多地被用于预测场景中接下来会发生什么，然而用于比较其输出的常用指标很少说明预测的物体是否正确移动。运动、几何、身份、背景稳定性和视觉相似性可能独立失效，但整体帧分数经常将这些错误混合在一起。我们推出了RigidBench，这是一个基于模拟器的基准测试，将生成的延续与来自相同初始帧和运动描述的参考推演进行比较。其五个刚体任务涵盖不同的物体、材料、视角以及室内和室外场景，并提供逐帧掩膜、深度、6自由度轨迹和接触信息用于评分。我们在相同的100个示例上评估八个模型，使用十个独立指标进行测量。结果显示排名高度依赖于所测量的指标：没有模型在所有十个指标上都领先，而且跨模型平均来看，更高的SSIM伴随更大的3D轨迹误差（r = 0.89）。RigidBench还包含5000个具有精确模拟器状态的训练视频，我们用这些视频来微调和分析Wan 2.2 TI2V-5B。完整微调将3D轨迹误差降低约20%，而SSIM几乎不变；教师强制探测和定向干预表明，物体位置在Wan的扩散Transformer中得到了体现，并被其去噪计算所利用。

While Text-to-Image (T2I) diffusion models have achieved remarkable success, precise spatial and orientational control in multi-object scenes remains a persistent challenge. Existing methods either rely on computationally expensive dense 3D maps or suffer from severe attribute leakage and "cut-and-paste" artifacts. To address these limitations, we propose PoseAdapter, a lightweight framework for high-fidelity 2.5D controllable image generation. Instead of dense spatial maps, it establishes precise spatial-angular anchors using an efficient condition layout: individual object captions, 2D bounding boxes, and 3D angles. To resolve the generative trade-off between strict instance isolation and global coherence, we introduce a Context-Aware Dual-Stream Representation. By injecting local object tokens and relation-enriched scene tokens into the visual stream of modern MM-DiT architectures via parallel masked and unmasked pathways, PoseAdapter eliminates attribute leakage while preserving natural inter-object relationships and scene-level coherence. To support this paradigm, we construct OrientLayout, a high-quality dataset featuring standardized 2.5D annotations and instance-level decoupled semantics. Extensive experiments demonstrate that PoseAdapter outperforms state-of-the-art baselines in spatial accuracy, orientational precision, and multi-object visual fidelity. Code and dataset will be available at https://github.com/cyf23/PoseAdapter.

尽管文生图（T2I）扩散模型已取得显著成就，但在多对象场景中实现精确的空间和方向控制仍是一项持续性挑战。现有方法要么依赖计算成本高昂的密集3D地图，要么遭受严重的属性泄露和“剪切粘贴”伪影问题。为解决这些局限性，我们提出了PoseAdapter，一个用于高保真2.5D可控图像生成的轻量级框架。该方法不使用密集空间地图，而是通过高效的条件布局建立精确的空间-角度锚点：独立的对象标题、2D边界框和3D角度。为解决严格实例隔离与全局一致性之间的生成权衡问题，我们引入了上下文感知双流表示方法。通过将局部对象标记和关系增强的场景标记通过并行掩码和非掩码路径注入到现代MM-DiT架构的视觉流中，PoseAdapter在保持自然对象间关系和场景级一致性的同时消除了属性泄露。为支撑这一范式，我们构建了OrientLayout数据集，这是一个具有标准化2.5D注释和实例级解耦语义的高质量数据集。大量实验表明，PoseAdapter在空间精度、方向精度和多对象视觉保真度方面均优于最先进的基线方法。代码和数据集将可在https://github.com/cyf23/PoseAdapter获取。

Controllable text-to-image diffusion models can often follow the global layout of spatial conditions, yet still violate fine-grained structures such as object boundaries, thin contours, and medium/small conditioned regions. This limitation is especially problematic for VAE-based latent diffusion, where spatial compression can weaken high-frequency and low-area condition signals. We propose PixelControl, a pixel-space controllable diffusion framework for fine-grained condition fidelity. Built on a PixelDiT-style backbone, PixelControl avoids the latent bottleneck and introduces two complementary designs. First, Structure-Aware Control Injection derives a condition structure map and uses it to strengthen injected control residuals around spatially sensitive regions. Second, Multi-Scale Pyramid Cycle Loss verifies generated images against condition-derived structures across multiple resolutions, balancing global layout consistency with local boundary and detail accuracy. PixelControl supports depth, segmentation, edge, and their combinations through modality-specific control branches with lightweight gated fusion. Experiments across depth, segmentation, and edge control show that PixelControl improves structural fidelity and visual quality over existing controllable generation methods, with especially strong gains on boundaries and medium/small conditioned regions. The project page can be found at: https://linxin0.github.io/pixelcontrol_homepage/pixelcontrol-site/

可控文生图扩散模型通常能够遵循空间条件的全局布局，但仍会违反细粒度结构，如物体边界、细轮廓以及中等/小尺寸条件区域。这一问题在基于VAE的潜在扩散模型中尤为严重，因为空间压缩会削弱高频和低面积条件信号。我们提出PixelControl，一个用于细粒度条件保真度的像素空间可控扩散框架。PixelControl基于PixelDiT风格的主干网络构建，避免了潜在空间瓶颈，并引入了两项互补设计。首先，结构感知控制注入（Structure-Aware Control Injection）推导条件结构图，并利用它来增强空间敏感区域周围注入的控制残差。其次，多尺度金字塔循环损失（Multi-Scale Pyramid Cycle Loss）在多个分辨率下验证生成图像与条件派生结构的一致性，平衡全局布局一致性与局部边界和细节准确性。PixelControl通过具有轻量级门控融合的模态特定控制分支，支持深度、分割、边缘及其组合控制。在深度、分割和边缘控制任务上的实验表明，PixelControl在结构保真度和视觉质量方面优于现有可控生成方法，尤其在边界和中等/小尺寸条件区域上提升显著。项目页面见：https://linxin0.github.io/pixelcontrol_homepage/pixelcontrol-site/

Text-driven human motion editing aims to modify existing motion sequences according to natural language instructions while maintaining the structural consistency of the original motion. Existing diffusion-based approaches struggle to balance text-responsive "change" and inertial "invariance". They often rely on coarse spatial constraints and rigid uniform time assumptions, leading to spatial motion distortions and the destruction of intrinsic physical rhythms during variable-length editing. To handle these challenges, we propose Change and Invariance Motion Editing (CIME), a unified framework that comprehensively decouples change and invariance into spatial pose and temporal rhythm dimensions. For spatial poses, our method integrates an omni-supervised positive-negative learning mechanism comprising hierarchical retrospective feature supervision, subtle motion preservation, and triplet-based semantic alignment. For temporal rhythms, we introduce the Riemannian Non-uniform Integral Manifold Mapping (RNIMM) module, which achieves high-fidelity reproduction of physical beats in the edited text via kinematics-aware non-uniform timestamps. Extensive experiments on the MotionFix and STANCE Adjustment datasets demonstrate that CIME achieves state-of-the-art performance in editing alignment and structural fidelity, validating the effectiveness of our unified architecture. Our source codes and models have been released at: github.com/ZhenwuShi/CIME.git

文本驱动的人体动作编辑旨在根据自然语言指令修改现有的动作序列，同时保持原始动作的结构一致性。现有的基于扩散的方法在平衡文本响应的“变化”与惯性的“不变性”方面存在困难。它们通常依赖粗略的空间约束和刚性的均匀时间假设，导致空间动作扭曲以及可变长度编辑过程中内在物理节奏的破坏。为应对这些挑战，我们提出了变化与不变性动作编辑（Change and Invariance Motion Editing，CIME），这是一个统一的框架，将变化与不变性全面解耦到空间姿态和时间节奏两个维度。对于空间姿态，我们的方法整合了一个全监督正负学习机制，包括分层回顾性特征监督、细微动作保留和基于三元组的语义对齐。对于时间节奏，我们引入了黎曼非均匀积分流形映射（Riemannian Non-uniform Integral Manifold Mapping，RNIMM）模块，通过运动学感知的非均匀时间戳实现编辑文本中物理节拍的高保真再现。在MotionFix和STANCE Adjustment数据集上的大量实验表明，CIME在编辑对齐和结构保真度方面达到了最先进的性能，验证了我们统一架构的有效性。我们的源代码和模型已发布于：github.com/ZhenwuShi/CIME.git

Generative image semantic communication converts an image into a text description and then performs text-to-image reconstruction at the receiver via diffusion-based generative models. This paradigm has attracted broad attention due to its extremely low bandwidth cost. However, existing methods still face two critical bottlenecks across image-to-text (I2T) semantic extraction at the transmitter and text-to-image (T2I) semantic reconstruction at the receiver: (i) semantic loss and distortion in I2T, where holistic image descriptions may omit fine-grained object attributes and spatial-position information, causing the generated text to deviate from the original image semantics; and (ii) insufficient semantic faithfulness in T2I, where even with the same semantically faithful text description, different initial noise settings may lead diffusion-based reconstruction to produce images with different levels of semantic consistency with the original image. These issues jointly limit the semantic faithfulness of image reconstruction. To address them, we propose TISC, a text-driven image semantic communication framework tailored for faithful reconstruction. TISC incorporates two key designs: (1) Tree-Structured Attribute Semantic Extraction (TSASE), which decomposes semantic extraction into global scene, background, and object-level attribute descriptions, covering spatial position, shape/pose, color, material, and other physical attributes for each detected object; and (2) an Initial Noise Optimization (INO) mechanism, which selects an initial noise seed at the transmitter according to a comprehensive similarity score that jointly considers visual and semantic consistency. Experiments on multiple datasets show that TSASE improves object-position recovery and semantic description faithfulness, while the INO parameter study supports the adopted configuration for noise selection.

生成式图像语义通信将图像转换为文本描述，然后通过基于扩散的生成模型在接收端执行文本到图像重建。由于其极低的带宽成本，这种范式引起了广泛关注。然而，现有方法在发射端的图像到文本（I2T）语义提取和接收端的文本到图像（T2I）语义重建方面仍面临两个关键瓶颈：（i）I2T中的语义损失和失真，其中整体图像描述可能遗漏细粒度对象属性和空间位置信息，导致生成文本偏离原始图像语义；（ii）T2I中语义保真度不足，其中即使使用相同的语义保真文本描述，不同的初始噪声设置也可能导致基于扩散的重建生成与原始图像语义一致性程度不同的图像。这些问题共同限制了图像重建的语义保真度。针对这些问题，我们提出了TISC，一种专为保真重建设计的文本驱动图像语义通信框架。TISC包含两个关键设计：（1）树结构属性语义提取（TSASE），将语义提取分解为全局场景、背景和对象级属性描述，涵盖每个检测到的对象的空间位置、形状/姿态、颜色、材质和其他物理属性；以及（2）初始噪声优化（INO）机制，该机制在发射端根据综合相似度评分选择初始噪声种子，该评分综合考虑视觉和语义一致性。多个数据集上的实验表明，TSASE提高了对象位置恢复和语义描述保真度，而INO参数研究支持了所采用的噪声选择配置。

Diffusion and flow matching models have made significant progress in text-to-image generation, yet high computation, quadratic complexity, and large memory footprint hinder high-resolution synthesis and edge deployment. We propose Nexus, which integrates sparse architecture, linear complexity, and low-bit quantization. It combines MoE feed-forward layers, gated DeltaNet attention, and per-expert low-bit training to reduce computation and memory. Their joint optimization allows Nexus to achieve generation quality comparable to mainstream models such as SDXL and SD3 while delivering markedly higher inference efficiency. Experiments on COCO and LAION validate its effectiveness.

扩散模型和流匹配模型在文本到图像生成领域取得了显著进展，然而高计算量、二次复杂度和大内存占用阻碍了高分辨率合成与边缘部署的应用。本研究提出Nexus模型，该模型整合了稀疏架构、线性复杂度和低比特量化技术。Nexus采用MoE前馈层、门控DeltaNet注意力机制和每专家低比特训练相结合的方式以降低计算和内存开销。通过联合优化，Nexus能够达到与SDXL、SD3等主流模型相当的生成质量，同时显著提升推理效率。在COCO和LAION数据集上的实验验证了其有效性。

Video Diffusion Transformers (DiTs) spend most of their compute inside the Self-Attention operation, whose cost grows quadratically, $\mathcal{O}(n^2)$, with the number of latent tokens $n$. For the task of video generation, the token count is large, so this term dominates runtime and memory, and thereby caps the resolution and duration we can generate. Linear $\mathcal{O}(n)$ and low-rank $\mathcal{O}(nk)$ surrogates of Self-Attention trade the full softmax $QK^T$ for cheaper kernels, but rarely recover the original's expressivity, leaving a stubborn quality gap. Motivated by this, we propose SQuad, a Sub-Quadratic Attention Distillation framework that achieves a complexity of $\mathcal{O}(n\sqrt{n})$ in the resulting distilled Attention, naturally balancing the efficiency v/s expressivity trade-off. Instead of training our own Video DiT from scratch, which is prohibitively expensive, we fit a pretrained full softmax Self-Attention DiT into our proposed SQuad-Attention one by distilling the former in two stages: Flow-Matching Supervised Fine-Tuning (SFT), followed by improved Distribution Matching Distillation (DMD2) which additionally makes the sampling more efficient. On the Wan~2.2 5B text-to-video model, SQuAD matches the quadratic teacher on VBench ($83.20$ v/s $83.08$) while cutting the per-step per-block attention FLOPs by $\sim__MATHBLOCK_0__11\times$, and end-to-end DiT latency by 2$\times$, all while also generating a video in only $6$ Neural Functional Evaluations (NFEs) instead of the default $100$.

视频扩散变换器（Video Diffusion Transformers, DiTs）的大部分计算成本消耗在自注意力操作上，其复杂度随潜空间token数量n呈二次增长，即O(n²)。对于视频生成任务，由于token数量庞大，这一项占据了运行时间和内存的主导地位，从而限制了可生成的分辨率和时长。线性的O(n)和低秩的O(nk)自注意力近似方法将完整的softmax QK^T替换为更廉价的核函数，但往往难以恢复原始注意力的表达能力，留下难以逾越的质量差距。基于此，我们提出了SQuad，一个次二次注意力蒸馏框架，在蒸馏后的注意力中实现O(n√n)的复杂度，自然地平衡了效率与表达力之间的权衡。我们并非从零开始训练自己的视频DiT（成本过高），而是提出通过两阶段蒸馏将预训练的全softmax自注意力DiT适配到SQuad-Attention：第一阶段为流匹配监督微调（Flow-Matching SFT），随后采用改进的分布匹配蒸馏（DMD2）进一步提升采样效率。在Wan 2.2 5B文生视频模型上，SQuad在VBench上与二次复杂度教师模型表现相当（83.20 vs 83.08），同时将每步每块注意力的浮点运算数降低约67倍，注意力延迟降低约11倍，端到端DiT延迟降低2倍，且仅需6次神经功能评估（NFEs）即可生成视频，而非默认的100次。

Inference-time quality-enhancement methods are an effective and widely adopted means of improving diffusion models without expensive retraining. We study a family of training-free techniques conceptually rooted in Classifier-Free Guidance (CFG), most of which were originally proposed on older U-Net diffusion models and validated using metrics that assess image quality in isolation, without accounting for compositional alignment or semantic correspondence between the generated image and its associated text prompt. We re-evaluate eight such methods on two open-weight rectified-flow transformers under a fixed per-model protocol and three compositional-alignment benchmarks. No method consistently improves on CFG across the measured criteria. APG obtains several nominal best scores, but the corresponding gains often remain within the estimated evaluation uncertainty. Attention-perturbation methods provide isolated gains on SD3.5 Medium and more frequent degradations on FLUX.2 [klein] 4B Base, while CFG remains a competitive lower-cost baseline.

推理时的质量提升方法是一种有效且广泛采用的提升扩散模型的方式，无需进行昂贵的重训练。我们研究了一类在概念上源于无分类器引导（CFG）的免训练技术，其中大多数方法最初是在旧的U-Net扩散模型上提出的，并使用单独评估图像质量的指标进行验证，未能考虑生成图像与其相关文本提示之间的组合对齐或语义对应。我们在两个开源权重的修正流Transformer上，采用固定的单模型协议和三个组合对齐基准，对八种此类方法进行了重新评估。结果表明，没有一种方法在测量指标上能够持续超越CFG。APG获得了若干名义上的最佳分数，但相应的提升幅度通常仍处于估计的评估不确定性范围内。注意力扰动方法在SD3.5 Medium上提供了有限的提升，而在FLUX.2 [klein] 4B Base上则出现了更频繁的性能下降，而CFG仍是一个具有竞争力的低成本基线方法。

Unified image restoration (UIR) aims to recover high-quality (HQ) content from low-quality (LQ) images with different degradations using a single model. Most recent methods adapt large pretrained text-to-image (T2I) latent diffusion models for their strong capacity and generative priors. However, the variational autoencoder (VAE) in latent T2I models may discard restoration-sensitive details, while the open-ended synthesis prior can introduce content-inconsistent artifacts. We present PixRestore, a VAE-free pixel-space Diffusion Transformer (DiT) for UIR, where the diffusion backbone is trained entirely from scratch, without relying on T2I pretraining. PixRestore performs flow matching directly on patchified pixels, preserving fine-grained details while keeping the token sequence tractable. To adapt to different degradations, PixRestore learns to predict the reliability of layer features using LQ--HQ DINO feature similarity. Features from more reliable layers are fused as dense conditioning, while less reliable layers receive stronger HQ-feature supervision to encourage degradation removal. We train PixRestore on a large-scale corpus of diverse scenes and degradations, and further finetune it into a one-step generator using DINO-based adversarial objectives for efficient inference. Experiments on public benchmarks and real-world test sets show that, with only about 50M parameters and single-step inference, PixRestore achieves the best overall fidelity, perceptual quality, and robustness to degradations among competing UIR models while being far more efficient. Larger PixRestore variants can further boost performance, demonstrating the scalability of our pixel-space design. Code and the curated benchmark can be found at https://github.com/csslc/PixRestore.

统一图像复原（UIR）旨在使用单一模型从具有不同退化的低质量（LQ）图像中恢复高质量（HQ）内容。最近的方法采用大型预训练文本到图像（T2I）潜在扩散模型，因其强大的生成能力而受到青睐。然而，潜在T2I模型中的变分自编码器（VAE）可能会丢失对修复敏感的细节，而开放式的合成先验可能引入与原始内容不一致的伪影。我们提出PixRestore，这是一个无VAE的像素空间扩散变换器（DiT），其扩散主干完全从零开始训练，不依赖T2I预训练。PixRestore直接在分块像素上进行流匹配，在保持细粒度细节的同时使token序列保持可控。为适应不同的退化方式，PixRestore学习使用LQ-HQ DINO特征相似度来预测各层特征的可靠性。更可靠层的特征被融合为密集条件信号，而可靠性较低的层则接收更强的HQ特征监督以促进退化去除。我们在包含多样场景和退化的大规模语料库上训练PixRestore，并进一步使用基于DINO的对抗目标将其微调为单步生成器以实现高效推理。在公开基准测试和真实世界测试集上的实验表明，仅需约50M参数和单步推理，PixRestore在竞争激烈的UIR模型中实现了最佳的保真度、感知质量和退化鲁棒性，同时效率更高。更大的PixRestore变体可以进一步提升性能，证明了我们的像素空间设计的可扩展性。

Existing image editing frameworks predominantly follow the training paradigm of text-to-image diffusion models. However, extending this paradigm to image editing highlights two inherent discrepancies, specifically, the insufficient attention to edit concept granularity and the training inefficiency caused by sparse supervision signals. To address these issues, we establish a comprehensive hierarchical taxonomy featuring over 1,000 fine-grained edit concepts and build ConceptEdit-12M, a massive dataset of 12 million high-quality editing pairs via an improved synthesis framework. This library-driven approach effectively rectifies the distribution collapse of generated data while ensuring high data fidelity. Furthermore, we propose a dense supervision training strategy that synthesizes multiple non-interfering concepts into single image pairs. By providing richer learning signals, this strategy significantly enhances both training efficiency and overall model performance. Training results validate our strategy, significantly outperforming prior works. Finally, we present ConceptEdit-Bench, a granular evaluation suite designed to diagnose model capabilities across a vast array of real-world scenarios.

现有图像编辑框架主要遵循文本到图像扩散模型的训练范式。然而，将此范式扩展到图像编辑时存在两个内在缺陷：一是对编辑概念粒度的关注不足，二是由稀疏监督信号导致的训练效率低下。为解决这些问题，我们构建了一个包含超过1000个细粒度编辑概念的全面层次分类体系，并通过改进的合成框架创建了ConceptEdit-12M数据集，该数据集包含1200万对高质量编辑样本。这种库驱动的方法有效纠正了生成数据的分布崩溃问题，同时确保了高数据保真度。此外，我们提出了一种密集监督训练策略，将多个互不干扰的概念合成到单一图像对中。该策略通过提供更丰富的学习信号，显著提升了训练效率和整体模型性能。训练结果验证了我们的策略，性能显著优于现有方法。最后，我们提出了ConceptEdit-Bench，这是一个细粒度评估套件，旨在评估模型在大量真实场景下的能力。

Generating photorealistic novel views from unposed images requires both 3D geometric understanding and the ability to synthesize unseen content. A natural strategy combines feed-forward 3DGS reconstruction with multi-view diffusion. Yet prior pipelines extract at most one signal from the reconstruction, either pixel rendering or learned features, while none exploits per-Gaussian visibility for occlusion-aware reference selection. This information disconnect leaves renderable geometry, visibility cues, and learned features unused. SplatGuide closes this disconnect by reusing a single 3DGS scene across three complementary roles. Rendered images provide pixel-aligned geometric conditioning. Per-Gaussian source-view indices are rendered into a target-view voting map for occlusion-aware reference selection. Reconstruction tokens supply feature-level guidance via cross-attention. All three signals derive from the same reconstruction forward pass. Across RealEstate10K, DL3DV, Tanks-and-Temples, and Mip-NeRF 360, SplatGuide achieves state-of-the-art pose-free novel view synthesis. On RealEstate10K, with a moderate number of input views, it surpasses the ground-truth-pose baseline.

从未经姿态标注的图像生成逼真的新视角需要同时具备3D几何理解能力和合成不可见内容的能力。一种自然的策略是将前馈3DGS重建与多视角扩散相结合。然而，先前的方法仅从重建中提取一种信号——要么是像素渲染，要么是学习到的特征——而没有利用每个高斯体的可见性进行遮挡感知的参考选择。这种“信息割裂”导致可渲染几何体、可见性线索和学习特征未被充分利用。SplatGuide通过让单个3DGS场景承担三种互补角色来弥合这一割裂。渲染图像提供像素对齐的几何条件。每个高斯体的源视角索引被渲染成目标视角投票图，用于遮挡感知的参考选择。重建tokens通过交叉注意力提供特征级指导。这三种信号均源自同一次重建前向传播。在RealEstate10K、DL3DV、Tanks-and-Temples和Mip-NeRF 360数据集上，SplatGuide实现了最先进的无姿态新视角合成。在RealEstate10K数据集上，使用中等数量的输入视角时，其性能甚至超越了基于真实姿态的基线方法。

This paper investigates an increasingly important topic in generative modeling: pixel-space diffusion models. Although numerous studies have explored this topic, most focus on small-scale or class-conditional settings. Consequently, a practical recipe for training pixel-space models that rival or exceed well-established latent-space counterparts remains elusive. Through a comprehensive empirical study, we first observe that direct large-scale pre-training in pixel space converges substantially more slowly than in latent space. This observation motivates a latent-to-pixel strategy that acquires generative priors efficiently in latent space and transitions to pixel space during post-training. We then systematically investigate the key design choices governing this transition, including weight initialization, data composition, prediction target, decoder architecture, and noise schedule, and identify a practical recipe that makes the resulting pixel-space models match or outperform their latent-space counterparts while delivering 3.18 to 4.75 times end-to-end inference speedups. We hope that our findings provide useful empirical insights and practical guidelines for future research on pixel-space generation.

本文研究生成式建模中日益重要的主题：像素空间扩散模型。尽管已有大量研究探索这一主题，但大多数研究集中于小规模或类别条件设置。因此，训练能够与成熟的潜在空间模型相媲美甚至超越它们的像素空间模型的实用方案仍然难以捉摸。通过全面的实证研究，我们首先观察到在像素空间进行直接大规模预训练的收敛速度明显慢于潜在空间。这一观察促使我们提出一种潜在空间到像素空间的策略，即在潜在空间高效获取生成先验，并在后训练阶段过渡到像素空间。随后，我们系统地研究了这一过渡过程中的关键设计选择，包括权重初始化、数据组成、预测目标、解码器架构和噪声调度，并确定了一种实用方案，使生成的像素空间模型能够与潜在空间模型相匹配甚至超越后者，同时实现3.18至4.75倍的端到端推理加速。我们希望我们的发现能够为像素空间生成的未来研究提供有用的实证洞察和实践指导。

We present AnyTalk, a novel method for generating 3D speech animations for arbitrary characters without requiring any animation data. While existing audio-driven 3D speech animation methods rely on character-specific training data or laborious rigging/re-meshing, AnyTalk circumvents these limitations by leveraging recent video diffusion models trained on extensive video datasets. We first adapt a pre-trained video diffusion model to a target character through our Character-specific Fine-tuning (\textit{CsF}) technique. By fine-tuning on rendered images of the 3D character paired with zeroed-out audio embeddings (representing "no motion"), we eliminate the need for animation data while preserving the motion prior of large-scale video diffusion model. We then uplift the resulting talking-head video into a 3D speech animation by estimating blendshape parameters through a proposed optimization process. AnyTalk enables lip-synced animations across diverse face meshes and blendshape configurations, significantly reducing manual effort and data requirements. We further enhance usability by distilling AnyTalk into a streamlined network, $\text{AnyTalk}_{RT}$, thereby enabling real-time performance. By leveraging talking-head video generation, our method broadens access to audio-driven speech animation technology for arbitrary characters. The code is publicly available at https://serin-yoon.github.io/projects/anytalk/.

我们提出AnyTalk，这是一种无需任何动画数据即可为任意角色生成3D语音动画的新方法。现有的音频驱动3D语音动画方法依赖于角色特定的训练数据或繁琐的绑定/重网格化操作，而AnyTalk通过利用在海量视频数据集上训练的最新视频扩散模型来克服这些限制。我们首先通过角色特定微调（CsF）技术将预训练的视频扩散模型适配到目标角色。通过对3D角色渲染图像与归零的音频嵌入（代表“无运动”）进行配对微调，我们在保留大规模视频扩散模型运动先验的同时消除了对动画数据的需求。随后，我们通过提出的优化过程估计混合形状参数，将生成的说话头像视频提升为3D语音动画。AnyTalk能够在不同的面部网格和混合形状配置下实现唇形同步动画，显著减少了人工劳动力和数据需求。我们进一步将AnyTalk精炼为精简的网络AnyTalk_RT，从而实现实时性能。通过利用说话头像视频生成，我们的方法扩大了任意角色音频驱动语音动画技术的可及性。代码已在https://serin-yoon.github.io/projects/anytalk/公开提供。

Generating personalized dance videos from a reference image, text prompt, and audio track requires music-conditioned body motion. Singing-and-dancing adds a second requirement: the visible subject must also articulate the vocals. Existing music-conditioned methods focus primarily on choreography, while speech-driven models generally assume that the visible subject produces the input voice, leaving this combined setting largely underexplored. We introduce SingDance, a unified video diffusion framework that formulates controllable vocal articulation as a semantic role: the visible subject is either the source, who produces the vocal signal, or the listener, who receives it from an off-screen performer. Hard-compact routing selects task-relevant speech, music, and role conditions, which are composed through frame-wise joint audio injection; source and listener retain the same speech pathway. Training uses asymmetric supervision: on-screen speaking and curated off-screen conversational-response videos establish role control, while instrumental and song-based dancing-only videos establish music-conditioned body motion. The target Song/Source configuration is never observed during training. At inference, assigning the source role to a song composes separately learned articulation and song-conditioned dance capabilities, enabling compositional zero-shot singing-and-dancing. Experiments demonstrate strong motion--beat alignment and visual fidelity, reliable paired switching of vocal articulation while preserving music-aligned body motion, and highly competitive lip synchronization with substantially fewer generation-time parameters than the strongest speech-driven baseline evaluated.

基于参考图像、文本提示和音频轨道生成个性化舞蹈视频需要音乐条件下的身体动作。唱跳任务增加了第二个要求：可见主体还必须表达歌声。现有的音乐条件方法主要关注编舞，而语音驱动模型通常假设可见主体产生输入语音，这一组合设置在很大程度上尚未得到充分探索。我们提出了SingDance，一个统一的视频扩散框架，将可控的语音表达形式化为语义角色：可见主体可以是声源（产生语音信号的人），或者是听众（从屏幕外表演者接收声音的人）。硬紧凑路由选择任务相关的语音、音乐和角色条件，通过逐帧联合音频注入进行组合；声源和听众保留相同的语音路径。训练采用非对称监督：屏幕上说话和精选的屏幕外对话响应视频建立角色控制，而纯器乐和基于歌曲的舞蹈视频建立音乐条件下的身体动作。目标歌曲/声源配置在训练中从未被观察过。在推理时，将声源角色分配给歌曲会将单独学习的表达能力和歌曲条件舞蹈能力进行组合，实现组合式零样本唱跳。实验表明，本方法具有较强的动作-节拍对齐和视觉保真度，能够可靠地成对切换语音表达同时保持音乐对齐的身体动作，并且与评估的最强语音驱动基线相比，生成时参数更少，唇同步性能极具竞争力。

Generating full-body human gestures based on speech signals remains challenges on quality and speed. Existing approaches model different body regions such as body, legs and hands separately, which fail to capture the spatial interactions between them and result in unnatural and disjointed movements. Additionally, their autoregressive/diffusion-based pipelines show slow generation speed due to dozens of inference steps. To address these two challenges, we propose GestureLSM, a flow-matching-based approach for Co-Speech Gesture Generation with spatial-temporal modeling. Our method i) explicitly model the interaction of tokenized body regions through spatial and temporal attention, for generating coherent full-body gestures. ii) introduce the flow matching to enable more efficient sampling by explicitly modeling the latent velocity space. To overcome the suboptimal performance of flow matching baseline, we propose latent shortcut learning and beta distribution time stamp sampling during training to enhance gesture synthesis quality and accelerate inference. Combining the spatial-temporal modeling and improved flow matching-based framework, GestureLSM achieves state-of-the-art performance on BEAT2 while significantly reducing inference time compared to existing methods, highlighting its potential for enhancing digital humans and embodied agents in real-world applications. Project Page: https://andypinxinliu.github.io/GestureLSM

基于语音信号生成全身人体姿态在质量和速度方面仍面临挑战。现有方法将身体不同区域（如躯干、腿部、手部）分别建模，无法捕捉各区域之间的空间交互，导致动作不自然且相互割裂。此外，其自回归/基于扩散的生成流程因推理步数众多而显示缓慢的生成速度。为解决这两个挑战，我们提出了GestureLSM，这是一种基于流匹配的语音同步手势生成方法，采用时空建模。我们的方法i) 通过时空注意力显式建模token化身体区域的交互，以生成连贯的全身手势；ii) 引入流匹配技术，通过显式建模潜在速度空间实现更高效的采样。为克服流匹配基线的次优性能，我们提出了潜在快捷学习法和训练期间的β分布时间戳采样，以增强手势合成质量并加速推理。结合时空建模和改进的基于流匹配的框架，GestureLSM在BEAT2数据集上实现了最先进的性能，同时与现有方法相比显著缩短了推理时间，突出了其在现实应用中增强数字人和具身智能体的潜力。项目主页：https://andypinxinliu.github.io/GestureLSM

We address the task of video style transfer with diffusion models, where the goal is to preserve the context of an input video while rendering it in a target style specified by a text prompt. A major challenge is the lack of paired video data for supervision. We propose PickStyle, a video-to-video style transfer framework that augments pretrained video diffusion backbones with style adapters and benefits from paired still image data with source-style correspondences for training. PickStyle inserts low-rank adapters into the self-attention layers of conditioning modules, enabling efficient specialization for motion-style transfer while maintaining strong alignment between video content and style. To bridge the gap between static image supervision and dynamic video, we construct synthetic training clips from paired images by applying shared augmentations that simulate camera motion, ensuring temporal priors are preserved. In addition, we introduce Context-Style Classifier-Free Guidance (CS-CFG), a novel factorization of classifier-free guidance into independent text (style) and video (context) directions. CS-CFG ensures that context is preserved in generated video while the style is effectively transferred. Experiments across benchmarks show that our approach achieves temporally coherent, style-faithful, and content-preserving video translations, outperforming existing baselines both qualitatively and quantitatively.

我们针对基于扩散模型的视频风格迁移任务展开研究，旨在保留输入视频的上下文内容，同时根据文本提示指定的目标风格对其进行渲染。主要挑战在于缺乏用于监督的配对视频数据。我们提出了PickStyle，一个视频到视频风格迁移框架，该框架通过风格适配器增强预训练的 video diffusion 主干网络，并利用带有源-风格对应关系的配对静态图像数据进行训练。PickStyle将低秩适配器插入条件模块的自注意力层中，使得运动-风格迁移的高效专业化成为，同时保持视频内容与风格之间的强对齐。为了弥合静态图像监督与动态视频之间的差距，我们通过应用模拟相机运动的共享增强方法从配对图像构建合成训练剪辑，确保时间先验得以保留。此外，我们提出了上下文-风格无分类器引导（CS-CFG），这是一种将无分类器引导分解为独立文本（风格）方向和视频（上下文）方向的新方法。CS-CFG确保生成的视频中保留上下文，同时有效转移风格。在基准测试上的实验表明，我们的方法实现了时间一致、风格忠实且内容保留的视频转换，在定性和定量方面均优于现有基线方法。

Reliable long-horizon co-speech gesture generation requires precise motion representation and consistent structural priors across all joints. Existing generative methods typically operate on local joint rotations, which are defined hierarchically based on the skeleton structure. This leads to cumulative errors during generation, manifesting as unstable and implausible motions at end-effectors. In this work, we propose GlobalDiff, a diffusion-based framework that operates directly in the space of global joint rotations for the first time, fundamentally decoupling each joint's prediction from upstream dependencies and alleviating hierarchical error accumulation. To compensate for the absence of structural priors in global rotation space, we introduce a multi-level constraint scheme. Specifically, a joint structure constraint introduces virtual anchor points around each joint to better capture fine-grained orientation. A skeleton structure constraint enforces angular consistency across bones to maintain structural integrity. A temporal structure constraint utilizes a multi-scale variational encoder to align the generated motion with ground-truth temporal patterns. These constraints jointly regularize the global diffusion process and reinforce structural awareness. Extensive evaluations on standard co-speech benchmarks show that GlobalDiff generates smooth and accurate motions, improving the performance by 46.0% compared to the current SOTA under multiple speaker identities.

可靠的长期共手势生成需要精确的运动表示以及所有关节的一致结构先验。现有的生成方法通常在局部关节旋转上操作，这些旋转基于骨架结构进行层级定义。这导致生成过程中出现累积误差，表现为末端执行器的运动不稳定且不合理。本工作提出GlobalDiff，这是一个首次直接在全局关节旋转空间中操作的扩散框架，从根本上解耦了每个关节的预测与上游依赖关系，从而减轻了层级错误累积。为了弥补全局旋转空间中结构先验的缺失，我们引入了一种多层次约束方案。具体而言，关节结构约束在每个关节周围引入虚拟锚点，以更好地捕捉细粒度的方向。骨架结构约束强制骨骼间的角度一致性以维持结构完整性。时间结构约束利用多尺度变分编码器将生成的动作与真实时间模式对齐。这些约束共同正则化全局扩散过程并增强结构感知。在标准共语音基准测试上的广泛评估表明，GlobalDiff生成平滑且准确的动作，在多位说话人身份下相较于当前最优方法提升了46.0%的性能。

Recent generative models produce near-photorealistic images, challenging the trustworthiness of photographs. Synthetic image detection (SID) methods, however, often struggle to generalize across datasets and generative models. CLIP, which embeds images and text in a shared semantic space, performs well at SID, but the cues underlying its decisions remain poorly understood. We therefore study CLIP-based SID as an empirical interpretability problem rather than proposing a new detector. We introduce SynthCLIC, which pairs real photographs with caption-matched, high-quality diffusion-generated counterparts. We evaluate CLIP-based detectors on SynthCLIC, a GAN-heavy benchmark, and a broad external benchmark, and compare them with a low-level forensic CNN, a broad-generator detector, and a text-grounded concept model. CLIP-based linear detectors reach 0.96 mAP on the GAN-heavy benchmark but 0.92 on SynthCLIC, while cross-family transfer to CNNSpot falls to 0.42 mAP. Within-class associations between detector scores and text-derived cue scores show that higher synthetic scores correspond to cleaner, more compositionally controlled, and technically polished images, whereas lower scores correspond to messier capture conditions and provenance cues characteristic of real photographs. These associations are distributed across many overlapping cues, and their profiles differ strongly across training datasets. CLIP-based and forensic detectors therefore fail in different ways and provide complementary evidence, while broad generator coverage appears important for robust SID.

最近的生成模型能够生成接近照片级真实感的图像，挑战了照片的可信度。然而，合成图像检测（SID）方法往往难以在数据集和生成模型之间泛化。CLIP将图像和文本嵌入共享的语义空间，在SID上表现良好，但其决策背后的线索仍不为人所理解。因此，我们将基于CLIP的SID作为经验可解释性问题来研究，而不是提出新的检测器。我们引入了SynthCLIC，它将真实照片与caption匹配的高质量扩散生成对应物配对。我们在SynthCLIC、一个GAN密集型基准以及一个广泛的外部基准上评估基于CLIP的检测器，并与低级取证CNN、广泛生成器检测器和基于文本的概念模型进行比较。基于CLIP的线性检测器在GAN密集型基准上达到0.96 mAP，但在SynthCLIC上为0.92 mAP，而跨家族转移到CNNSpot时降至0.42 mAP。检测器分数与文本派生线索分数之间的类内关联表明，更高的合成分数对应于更干净、更具构图控制和技术精炼的图像，而更低的分数则对应于更混乱的捕获条件和真实照片的来源线索。这些关联分布在许多重叠的线索中，且其特征画像在训练数据集之间存在显著差异。因此，基于CLIP的检测器和取证检测器以不同方式失败并提供互补证据，而广泛的生成器覆盖对于稳健的SID似乎很重要。

Training-free image editing with diffusion models is highly desirable yet is complex and remains a significant challenge. While recent optimisation-based methods achieve strong zero-shot edits from text, they still struggle to preserve identity and capture intricate details, such as facial structure, surface texture, or object-specific geometry, that exist below the level of linguistic abstraction. To address this fundamental gap, we propose Concept Distillation Sampling (CDS). To the best of our knowledge, we are the first to introduce a unified, training-free framework for target-less, multi-concept image editing. CDS overcomes this linguistic bottleneck of previous methods by anchoring the editing process in the certainty of pretrained LoRA adapters. We integrate a highly stable distillation backbone (featuring ordered timesteps, regularisation, and negative-prompt guidance) with a novel dynamic weighting mechanism. This approach enables the composition and control of multiple visual concepts directly within the diffusion process, utilising spatially-aware priors from pretrained LoRA adapters without causing concept clashing. Our method preserves instance concept identity without requiring reference samples of the desired edit. Extensive quantitative and qualitative evaluations demonstrate that CDS establishes a new state-of-the-art over existing training-free editing and multi-LoRA composition methods on the InstructPix2Pix and ComposLoRA benchmarks. Project Page: https://nickyfot.github.io/cds/.

无需训练的扩散模型图像编辑非常理想，但复杂且仍是一项重大挑战。虽然近年来基于优化的方法实现了强大的零样本文本编辑，但它们仍然难以保持身份特征并捕捉细节，如面部结构、表面纹理或物体特定几何形状，这些信息存在于语言抽象层面之下。为解决这一根本性差距，我们提出了概念蒸馏采样（CDS）。据我们所知，我们是第一个引入统一的、无需训练的目标无关多概念图像编辑框架的方法。CDS通过将编辑过程锚定在预训练LoRA适配器的确定性中来克服先前方法的语言瓶颈。我们整合了一个高度稳定的蒸馏主干（采用有序时间步、正则化和负提示引导）与一种新颖的动态加权机制。这种方法能够在扩散过程中直接组合和控制多个视觉概念，利用预训练LoRA适配器的空间感知先验信息，同时避免概念冲突。我们的方法无需编辑目标的参考样本即可保留实例概念身份。广泛的定量和定性评估表明，CDS在InstructPix2Pix和ComposLoRA基准测试上建立了无需训练编辑和多LoRA组合方法的新技术前沿。项目主页：https://nickyfot.github.io/cds/

Tone style transfer for photo retouching aims to adapt the stylistic tone of the reference image to a given content image. However, the lack of high-quality large-scale triplet datasets with stylized ground truth forces existing methods to rely on self-supervised or proxy objectives, which limits model capability. To mitigate this gap, we design a data construction pipeline to build TST100K, a large-scale dataset of 100,000 content-reference-stylized triplets. At the core of this pipeline, we train a tone style scorer to ensure strict stylistic consistency for each triplet. In addition, existing methods typically extract content and reference features independently and then fuse them in a decoder, which may cause semantic loss and lead to inappropriate color transfer and degraded visual aesthetics. Instead, we propose ICTone, a diffusion-based framework that performs tone transfer in an in-context manner by jointly conditioning on both images, leveraging the semantic priors of generative models for semantic-aware transfer. Reward feedback learning using the tone style scorer is further incorporated to improve stylistic fidelity and visual quality. Experiments demonstrate the effectiveness of TST100K, and ICTone achieves state-of-the-art performance on both quantitative metrics and human evaluations. The project page is available online: https://dengyuhai.github.io/ICTone_Project/.

照片修图的色调风格迁移旨在将参考图像的风格色调适配到给定内容图像。然而，高质量大规模风格化三元组数据集的匮乏迫使现有方法依赖自监督或代理目标，这限制了模型的性能。为弥补这一差距，我们设计了一套数据构建流程，构建了TST100K，一个包含100,000个内容-参考-风格化三元组的大规模数据集。该流程的核心是训练一个色调风格评分器，以确保每个三元组的严格风格一致性。此外，现有方法通常独立提取内容和参考特征，然后在解码器中进行融合，这可能导致语义损失并引发不恰当的颜色迁移和视觉美学退化。为此，我们提出了ICTone，这是一个基于扩散的框架，通过对两幅图像进行联合条件化，以上下文方式执行色调迁移，利用生成模型的语义先验实现语义感知迁移。进一步引入基于色调风格评分器的奖励反馈学习来提升风格保真度和视觉质量。实验证明了TST100K的有效性，ICTone在定量指标和人工评估上均取得了最先进的性能。项目页面可在线访问：https://dengyuhai.github.io/ICTone_Project/

Reconstructing dynamic 3D scenes from sparse multi-view videos is highly ill-posed, often leading to geometric collapse, trajectory drift, and floating artifacts. Recent attempts introduce generative priors to hallucinate missing content, yet naive integration frequently causes structural drift and temporal inconsistency due to the mismatch between stochastic 2D generation and deterministic 3D geometry. In this paper, we propose GeoRect4D, a novel unified framework for sparse-view dynamic reconstruction that couples explicit 3D consistency with generative refinement via a closed-loop optimization process. Specifically, GeoRect4D introduces a degradation-aware feedback mechanism that incorporates a robust anchor-based dynamic 3DGS substrate with a single-step diffusion rectifier to hallucinate high-fidelity details. This rectifier utilizes a structural locking mechanism and spatiotemporal coordinated attention, effectively preserving physical plausibility while restoring missing content. Furthermore, we present a progressive optimization strategy that employs stochastic geometric purification to eliminate floaters and generative distillation to infuse texture details into the explicit representation. Extensive experiments demonstrate that GeoRect4D achieves state-of-the-art performance in reconstruction fidelity, perceptual quality, and spatiotemporal consistency across multiple datasets.

从稀疏多视角视频重建动态3D场景是一个高度病态的问题，常常导致几何坍塌、轨迹漂移和漂浮伪影。最近的研究尝试引入生成先验来填补缺失内容，但朴素地集成生成模型经常因随机2D生成与确定性3D几何之间的不匹配而导致结构漂移和时间不一致性。本文提出GeoRect4D，这是一种用于稀疏视角动态重建的统一框架，通过闭环优化过程将显式3D一致性耦合到生成式细化中。具体而言，GeoRect4D引入了一种降质感知反馈机制，该机制结合了基于锚点的动态3DGS基座与单步扩散矫正器，以生成高保真细节。该矫正器利用结构锁定机制和时空协调注意力，在有效保持物理合理性的同时恢复缺失内容。此外，我们提出了一种渐进式优化策略，采用随机几何净化来消除漂浮伪影，并利用生成式蒸馏将纹理细节注入显式表示中。大量实验表明，GeoRect4D在多个数据集上实现了重建保真度、感知质量和时空一致性的最先进性能。

Diffusion models have been shown to implicitly generate visual content autoregressively in the frequency domain, where low-frequency components are generated earlier in the denoising process while high-frequency details emerge only in later timesteps. This structure offers a natural opportunity for efficient generation, as high-resolution computation on noise-dominated frequencies is largely redundant. We propose Spectral Progressive Diffusion, a general framework that progressively grows resolution along the denoising trajectory of pretrained diffusion models. To this end, we develop a spectral noise expansion mechanism and derive an optimal resolution schedule from the model's power spectrum. Our framework supports training-free acceleration and a novel fine-tuning recipe that further improves efficiency and quality. We demonstrate significant speedups on state-of-the-art pretrained image and video generation models while preserving visual quality.

扩散模型已被证明在频域中隐式地自回归生成视觉内容，其中低频成分在去噪过程早期生成，而高频细节仅在后期时间步出现。这种结构为高效生成提供了自然的机会，因为对噪声主导的频率进行高分辨率计算在很大程度上是冗余的。我们提出了频谱渐进扩散（Spectral Progressive Diffusion），这是一个通用框架，沿预训练扩散模型的去噪轨迹逐步增大分辨率。为此，我们开发了频谱噪声扩展机制，并从模型的功率谱推导出最优分辨率调度。我们的框架支持无训练加速和一种新颖的微调方案，进一步提升效率和质量。我们在先进的预训练图像和视频生成模型上展示了显著的加速效果，同时保持了视觉质量。

Large and demographically balanced datasets are essential for reliable neuroimaging biomarkers. Full-resolution 3D brain MRI synthesis can support data augmentation in this setting, but existing approaches either incur prohibitive computational cost at volumetric scale or rely on lossy latent compression that may compromise anatomical detail. As a result, practical 3D generative augmentation often requires specialized compute infrastructure. We propose WaveDiT, a conditional flow matching framework operating in the coefficient space of a 3D Haar Discrete Wavelet Transform. The model combines factorized spatio-depth attention with band-wise heteroscedastic uncertainty modeling derived from higher-order wavelet statistics. Predicted log-variance is integrated directly into both the flow objective and conditioning pathway, enabling adaptive precision consistent with the heavy-tailed and input-dependent variance structure of anatomical detail. This formulation supports full-resolution 3D synthesis under practical memory and time constraints on a single modern GPU. Evaluation on a multi-site cohort demonstrates improved alignment between generated and real MRI distributions, together with enhanced downstream brain age prediction and region-level anatomical agreement relative to diffusion, latent, and wavelet-based baselines. Code is available at https://github.com/sisinflab/WaveDiT

大规模且人口统计学平衡的数据集对于可靠的神经影像生物标志物至关重要。全分辨率3D脑MRI合成可以在此背景下支持数据增强，但现有方法在体素尺度上要么产生 prohibitive 的计算成本，要么依赖可能有损的潜在压缩，从而可能损害解剖细节。因此，实际的3D生成增强通常需要专门的计算基础设施。我们提出了WaveDiT，一个在3D Haar离散小波变换系数空间中运行的条件流匹配框架。该模型结合了分解的空域-深度注意力与从高阶小波统计导出的带-wise异方差不确定性建模。预测的对数方差直接集成到流目标和条件通路中，使得自适应精度与解剖细节的重尾且输入依赖的方差结构相一致。该公式在单个现代GPU的实际内存和时间约束下支持全分辨率3D合成。在多中心队列上的评估表明，生成MRI与真实MRI分布之间的对齐得到改善，同时与扩散、潜在和小波基线相比，下游脑年龄预测和区域级解剖一致性得到增强。代码可访问 https://github.com/sisinflab/WaveDiT。

Audio-driven video generation (A2V) has achieved promising progress in synthesizing temporally coherent and audio-visually aligned videos, yet its inference remains expensive due to the iterative denoising process of diffusion models. Existing caching methods mainly exploit temporal redundancy in visual features while overlooking the cross-modal alignment of A2V, where audio drives visual generation with highly non-uniform temporal importance. In this paper, we identify two levels of misalignment in existing A2V caching methods: temporal-semantic and computation-storage misalignment. To address them, we propose EchoCache, an energy-guided cross-modal caching framework for efficient A2V generation. EchoCache leverages audio time-frequency energy as a saliency anchor to guide latent-level cache updates and further introduces a dynamic timestep-latent caching mechanism with quantized cache management for joint efficiency and memory optimization. Extensive experiments on mainstream A2V models show that EchoCache consistently improves the latency-quality trade-off while preserving generation quality and audio-visual consistency. In particular, on Wan2.2-S2V over the EMTD benchmark, EchoCache achieves a 2.46x speedup with the best overall performance. Code is available at https://github.com/IF-LAB-PKU/EchoCache.

音频驱动视频生成（A2V）在合成时间一致性和音视频对齐的视频方面已取得显著进展，然而由于扩散模型的迭代去噪过程，其推理过程仍需较高的计算成本。现有缓存方法主要利用视觉特征中的时间冗余，而忽视了A2V中音频驱动视觉生成所具有的高度非均匀时间重要性的跨模态对齐特性。本文识别出现有A2V缓存方法中的两个层次的错配问题：时序语义错配和计算-存储错配。为解决这些问题，我们提出了EchoCache，一个面向高效A2V生成的能量引导跨模态缓存框架。EchoCache利用音频时频能量作为显著性锚点来引导潜空间级缓存更新，并进一步引入动态时间步-潜变量缓存机制，结合量化缓存管理以实现效率与内存的联合优化。在主流A2V模型上进行的广泛实验表明，EchoCache在保持生成质量和音视频一致性的同时，能够持续改善延迟-质量权衡。具体而言，在EMTD基准上针对Wan2.2-S2V模型，EchoCache实现了2.46倍的加速效果，并获得了最佳的整体性能。代码已开源于https://github.com/IF-LAB-PKU/EchoCache。

Methods for text-based generation of hand-object interaction (HOI) sequences primarily focus on producing smooth, physically plausible trajectories. A truly utilitarian method should additionally support variable-length generation, composite motion sequences, motion completion and infilling, and reliable termination without compromising physical plausibility. Standard diffusion models for HOI generation are typically trained only for text-to-motion generation on atomic motions and require the motion length to be specified a-priori. Autoregressive (AR) methods provide greater sequence-level flexibility, but commonly depend on discrete motion codes, which can lose contact-sensitive motion detail. To address these key limitations, we present a model performing Masked Autoregression with Diffusion for HOI generation (MAD-HOI). Our method starts by encoding hand and object motions in a continuous latent space while keeping them disentangled to maintain stream-wise control. This is followed by a masked autoregressive transformer to predict context features that condition a flow-matching head. MAD-HOI is capable of motion generation for atomic and composite articulated sequences, conditioned motion completion and infilling, as well as EOM (End of Motion) prediction from a single training objective. We provide comprehensive evaluations for these capabilities and benchmark our method on the ARCTIC and GRAB datasets. Our experiments demonstrate that our method generates more diverse and physically plausible interactions compared to other open-sourced baseline methods.

基于文本的手-物体交互（HOI）序列生成方法主要关注生成平滑、物理上合理的轨迹。一个真正实用的方法还应支持变长生成、复合运动序列、运动补全和填充，以及可靠的终止判断，同时不损害物理合理性。用于HOI生成的标准扩散模型通常仅针对原子动作的文本到运动生成进行训练，且需要预先指定运动长度。自回归（AR）方法提供了更大的序列级灵活性，但通常依赖于离散运动码，可能会丢失接触敏感的运动细节。为了解决这些关键限制，我们提出了一种用于HOI生成的掩码自回归扩散模型（MAD-HOI）。我们的方法首先将手部和物体运动编码到连续潜在空间中，同时保持它们解耦以维持流式控制。随后使用掩码自回归变换器预测上下文特征，这些特征用于条件化流匹配头。MAD-HOI能够为原子动作和复合关节序列生成运动，支持条件运动补全和填充，以及从单一训练目标进行EOM（动作结束）预测。我们对这些能力进行了全面评估，并在ARCTIC和GRAB数据集上对我们的方法进行了基准测试。我们的实验表明，与其他开源基线方法相比，我们的方法能够生成更加多样化和物理上合理的交互。

Humans learn locomotion through visual observation, interpreting visual content first before imitating actions. However, state-of-the-art humanoid locomotion systems rely on either curated motion capture trajectories or sparse text commands, leaving a critical gap between visual understanding and control. Text-to-motion methods suffer from semantic sparsity and staged pipeline errors, while video-based approaches only perform mechanical pose mimicry without genuine visual understanding. We propose RoboMirror, the first retargeting-free video-to-locomotion framework embodying "understand before you imitate". Leveraging VLMs, it distills raw egocentric/third-person videos into visual motion intents, which directly condition a diffusion-based policy to generate physically plausible, semantically aligned locomotion without explicit pose reconstruction or retargeting. Extensive experiments validate the effectiveness of RoboMirror, it enables telepresence via egocentric videos, drastically reduces third-person control latency by 80%, and achieves a 3.7% higher task success rate than baselines. By reframing humanoid control around video understanding, we bridge the visual understanding and action gap.

人类通过视觉观察学习运动，先理解视觉内容再模仿动作。然而，当前最先进的人形机器人运动系统依赖于精心设计的动作捕捉轨迹或稀疏的文本命令，在视觉理解和控制之间存在关键差距。文本到运动方法存在语义稀疏和阶段性流水线错误的问题，而基于视频的方法仅执行机械姿态模仿，缺乏真正的视觉理解。我们提出 RoboMirror，这是首个无重定向的视频到运动框架，体现了「先理解后模仿」的理念。该方法利用视觉语言模型将原始第一人称/第三人称视频提炼为视觉运动意图，并直接以此条件化扩散策略，从而生成物理上合理且语义对齐的运动，无需进行显式的姿态重建或重定向。大量实验验证了 RoboMirror 的有效性：它通过第一人称视频实现远程临场感，将第三人称控制延迟降低 80%，并在任务成功率上比基线方法提高 3.7%。通过围绕视觉理解重新构建人形机器人控制，我们成功弥合了视觉理解与动作之间的鸿沟。

Joint audio-video generative models serve as foundation for immersive and interactive digital-human generation. Nevertheless, most existing models rely on bidirectional attention and multi-step denoising and can generate only short clips, making them unsuitable for real-time interaction over extended durations. We present Omni-LiveAvatar, the first framework for minute-level, real-time streaming joint audio-video avatar generation. Specifically, we propose (1) a progressive autoregressive distillation pipeline that transfers a large bidirectional joint audio-video diffusion model into a few-step autoregressive generator without auxiliary stabilization mechanisms; (2) a synchronized audio-video long-short-term memory that preserves global consistency under a bounded memory budget; and (3) a hierarchical rolling prompt planning strategy that enables coherent semantic evolution and seamless prompt transitions. Extensive experiments show that Omni-LiveAvatar generates high-quality, synchronized minute-level avatars in real time. In terms of speed, it achieves a 33$\times$ generation speedup over its teacher, LTX-2, on a single NVIDIA H200 GPU; in terms of generation quality, it outperforms accelerated baselines across visual quality, audio quality, cross-modal synchronization, and human fidelity. Our code is available at https://github.com/Aoko955/Omni-LiveAvatar.

联合音视频生成模型是实现沉浸式和交互式数字人生成的基础。然而，现有大多数模型依赖双向注意力和多步去噪机制，且仅能生成短视频片段，不适合长时间实时交互应用。本文提出Omni-LiveAvatar，这是首个支持分钟级实时流式联合音视频数字人生成的框架。具体而言，我们提出以下三项技术：（1）渐进式自回归蒸馏管道，将大型双向联合音视频扩散模型迁移为少步自回归生成器，无需辅助稳定机制；（2）同步音视频长短期记忆机制，在有限内存预算下保持全局一致性；（3）分层滚动提示规划策略，实现连贯的语义演进和无缝的提示转换。大量实验表明，Omni-LiveAvatar能够实时生成高质量、同步的分钟级数字人。在生成速度方面，其在单块NVIDIA H200 GPU上相较于教师模型LTX-2实现了33倍的加速；在生成质量方面，其在视觉质量、音频质量、跨模态同步和人类保真度等指标上均优于加速后的基线模型。代码已开源至 https://github.com/Aoko955/Omni-LiveAvatar。

Running large AI models on resource-constrained edge devices requires model compression to reduce model size and computation. What compresses well, however, need not deploy well. We survey dozens of recent works that report compression results on real hardware and extract practical deployment guidelines from them. Following these guidelines, we deploy compact language and image models on GPU, CPU, and Raspberry Pi platforms across question answering and image segmentation. No single technique wins across tasks. For question answering, Qwen3.5 0.8B reaches 93.85 SQuAD F1 and 92 EM under Q5_K_M GGUF quantization, while structured pruning at the same precision costs 16 F1 at a 1% ratio. For segmentation, the ranking reverses: default quantization leaves parameters and MACs unchanged, whereas pruning cuts model size by nearly 80% at near-constant mIoU. Pruning can even inflate the deployed artifact by 21-49% by breaking k-quant super-block alignment; combined with longer, less format-compliant outputs, this raises Raspberry Pi latency up to 3.4x. Compression can also manufacture the appearance of competence rather than destroy it visibly: one LoRA-recovered variant stays fully parseable and holds 71% strict BoolQ accuracy while sending 97 of 100 predictions to a single class, at 52.6% balanced accuracy. We explain these effects through neural-flow graph analysis and prefill-decode-level latency decomposition, and condense them into task-specific deployment research directions. The right technique depends on the task, the model, and the hardware. Our experiment code and artifacts are open-sourced at https://github.com/Arnavvvkumar/deployment

在资源受限的边缘设备上运行大型AI模型需要进行模型压缩以减少模型大小和计算量。然而，压缩效果好的模型并不一定能实现良好的部署效果。我们调研了数十项在真实硬件上报告压缩结果的最新工作，并从中提炼出实际部署指南。遵循这些指南，我们在GPU、CPU和Raspberry Pi平台上部署了紧凑型语言和图像模型，应用于问答和图像分割任务。没有单一技术能在所有任务上取得最优表现。对于问答任务，Q5_K_M GGUF量化下的Qwen3.5 0.8B达到了93.85 SQuAD F1和92 EM，而同精度下的结构化剪枝在1%压缩率下损失了16个F1分数。对于分割任务，排名发生反转：默认量化保持参数量和MACs不变，而剪枝在mIoU几乎不变的情况下将模型大小减少近80%。剪枝甚至可能通过破坏k-quant超块对齐来使部署产物膨胀21%至49%；再加上更长、格式兼容性更差的输出，这使得Raspberry Pi延迟增加高达3.4倍。压缩也可能制造能力假象而非明显破坏能力：一个LoRA恢复的变体保持完全可解析，并在100个预测中发送97个到单一类别的情况下维持71%的严格BoolQ准确率，同时达到52.6%的平衡准确率。我们通过神经流图分析和预填充-解码级延迟分解来解释这些现象，并将其归纳为特定任务的部署研究方向。正确的技术选择取决于任务、模型和硬件。我们的实验代码和工件已在GitHub上开源：https://github.com/Arnavvvkumar/deployment

Learned image compression (LIC) has demonstrated remarkable rate-distortion (RD) performance in benign settings. However, the high representational capacity endowed by deep neural networks (DNNs) comes at the expense of increased adversarial vulnerability. This hinders their adoption as trusted standardized codecs. Recent work has sketched test-time refinement (TTR) as a defense in gray-box scenarios, despite its original purpose of improving benign RD performance. Unfortunately, extensive iterations of TTR incur prohibitive overhead, while the robustness mechanism lacks theoretical understanding. Moreover, TTR has not been evaluated in white-box settings or against attacks beyond $\ell_2$-bounded rate and untargeted distortion objectives. To bridge these gaps, we present a systematic study. Our study reveals an Asymmetric Adversarial Trajectory (AAT) property in LIC systems: transitioning from adversarial to benign regions is significantly easier than the reverse process, where adversarial examples can often be roughly recovered within only 1-2 steps. We provide a two-dimensional Tube Model to explain this phenomenon. Based on AAT, we propose a Fast Test-Time Refinement (FTTR) framework for practical and robust LIC systems. We establish that the robustness arises from the contraction of adversarial regions induced by the Input-as-Label property of LIC systems, rather than from obfuscated gradients. Extensive evaluations with diverse strong adaptive attacks across multiple LIC systems demonstrate the promise of the proposed FTTR framework. The code is available at https://github.com/chinaliangjiaming/FTTR.git.

学习图像压缩（LIC）在良性环境下展现出优异的率失真（RD）性能。然而，深度神经网络（DNN）所赋予的高表征能力是以增加对抗脆弱性为代价的。这阻碍了它们作为可信标准化编解码器的应用。最近的研究提出了测试时细化（TTR）作为灰盒场景下的防御方法，尽管其原本目的是提升良性RD性能。不幸的是，TTR的多次迭代会产生难以承受的计算开销，同时其鲁棒性机制缺乏理论解释。此外，TTR尚未在白盒环境下进行评估，也未针对超越ℓ₂有界率和无目标失真目标的攻击进行测试。为弥补这些空白，我们开展了一项系统性研究。我们的研究揭示了LIC系统中存在一种非对称对抗轨迹（AAT）特性：从对抗区域过渡到良性区域明显比反向过程更为容易，对抗样本通常仅需1-2步即可大致恢复。我们提出了二维管模型来解释这一现象。基于AAT特性，我们提出了一种面向实际且鲁棒LIC系统的快速测试时细化（FTTR）框架。我们证实，鲁棒性源于LIC系统输入即标签特性所诱导的对抗区域收缩，而非来自梯度混淆。通过在多种LIC系统上针对多种强自适应攻击进行的广泛评估，验证了所提FTTR框架的有效性。代码可访问 https://github.com/chinaliangjiaming/FTTR.git。

Physical AI systems such as autonomous vehicles and robots rely on timely exchange of high-dimensional sensory signals under tight bandwidth, latency, and energy budgets. Because the task driving downstream decisions evolves over time, a task-specific codec is brittle and retraining one per task is infeasible in the field. We propose UniTAC, a single learned image codec spanning universal (task-agnostic) to task-specialized operation, re-targeted at runtime without retraining. The task is abstracted as a per-component importance vector, derived, e.g., from gradient attribution of any downstream model, and transmitted as low-overhead side information that conditions both encoder and decoder. Trained once over a broad, randomized family of such vectors against weighted-reconstruction distortion, UniTAC keeps a fixed backbone and a single human-viewable reconstruction whose fidelity is steered to the active task by swapping the injected vector. We analyze the underlying weighted rate-distortion problem, characterizing when a diagonal weighted distortion is task-consistent and how weights relate to task sensitivity. Guided by this, we design a Vision Transformer (ViT) codec whose token-level conditioning natively realizes this weight-driven code. On a localized task at 0.034 bpp, a single UniTAC model reaches 91.4% accuracy, only 1.9% below a task-based codec (93.3%) and above universal codecs (76.9%).

物理AI系统（如自动驾驶车辆和机器人）在严格的带宽、延迟和能耗约束下依赖于高维感知信号的及时交换。由于驱动下游决策的任务会随时间演变，任务特定的编解码器缺乏灵活性，而为每个任务单独重训练又不切实际。为此，我们提出UniTAC，一个单一的通用（任务无关）到任务专用的学习图像编解码器，可在运行时重定向而无需重训练。任务被抽象为每分量重要性向量，可从任何下游模型的梯度归因中导出，并作为低开销的侧信息传输，用于条件化编码器和解码器。UniTAC针对这类向量的广泛随机化家族进行一次训练，使用加权重构失真度量，保持固定的主干网络和单个人眼可查看的重构结果，通过切换注入的向量将保真度导向活跃任务。我们分析了底层加权率失真问题，表征了对角加权失真何时满足任务一致性，以及权重如何与任务敏感性相关。在此指导下，我们设计了一个Vision Transformer（ViT）编解码器，其token级条件化原生实现了这种权重驱动的码。在0.034 bpp的局部化任务上，单个UniTAC模型达到91.4%的准确率，仅比任务专用编解码器（93.3%）低1.9%，且高于通用编解码器（76.9%）。

The rapid proliferation of generative models raises the model attribution problem: given only an image, can we determine which model produced it? Existing methods have grown as elaborate as the generators they target, on the as- sumption that a more sophisticated model demands a more sophisticated attributor. We show it does not. RPA (Raw- Patch Attribution) attributes images in the strictest black- box setting with a lightweight CNN. Despite its simplicity, it attributes more models at higher accuracy than prior work, reaching 98.0% on 25-class DRAGON and 92.9% on 27- class OpenFake; it is data-efficient and runs at a cost inde- pendent of the number of candidate models; and it stays ro- bust to the compression, blur, and resizing images undergo in the wild. Training for closed-set attribution yields a ver- satile feature extractor: the same representation recovers model lineage without supervision, flags and groups unseen generators, and admits new models through few-shot adap- tation rather than retraining.

生成模型的快速普及引发了模型归因问题：给定一张图像，能否确定它是由哪个模型生成的？现有方法与其目标生成器一样日趋复杂，假设更复杂的模型需要更复杂的归因器。我们证明这一假设并不成立。RPA（原始图像块归因）以最严格的黑盒设置对图像进行归因，仅使用轻量级卷积神经网络。尽管方法简单，它以更高的准确率归因更多模型，在25类DRAGON数据集上达到98.0%，在27类OpenFake数据集上达到92.9%；它具有数据效率，且运行成本与候选模型数量无关；并且对图像在真实环境中经历的压缩、模糊和调整大小操作保持鲁棒。闭集归因的训练产生了一个通用的特征提取器：同一表示可以在无监督情况下恢复模型谱系、标记和分组未见过的生成器，并通过少样本适应而非重新训练来接入新模型。

Controllable text-to-image diffusion models can often follow the global layout of spatial conditions, yet still violate fine-grained structures such as object boundaries, thin contours, and medium/small conditioned regions. This limitation is especially problematic for VAE-based latent diffusion, where spatial compression can weaken high-frequency and low-area condition signals. We propose PixelControl, a pixel-space controllable diffusion framework for fine-grained condition fidelity. Built on a PixelDiT-style backbone, PixelControl avoids the latent bottleneck and introduces two complementary designs. First, Structure-Aware Control Injection derives a condition structure map and uses it to strengthen injected control residuals around spatially sensitive regions. Second, Multi-Scale Pyramid Cycle Loss verifies generated images against condition-derived structures across multiple resolutions, balancing global layout consistency with local boundary and detail accuracy. PixelControl supports depth, segmentation, edge, and their combinations through modality-specific control branches with lightweight gated fusion. Experiments across depth, segmentation, and edge control show that PixelControl improves structural fidelity and visual quality over existing controllable generation methods, with especially strong gains on boundaries and medium/small conditioned regions. The project page can be found at: https://linxin0.github.io/pixelcontrol_homepage/pixelcontrol-site/

可控文生图扩散模型通常能够遵循空间条件的全局布局，但仍会违反细粒度结构，如物体边界、细轮廓以及中等/小尺寸条件区域。这一问题在基于VAE的潜在扩散模型中尤为严重，因为空间压缩会削弱高频和低面积条件信号。我们提出PixelControl，一个用于细粒度条件保真度的像素空间可控扩散框架。PixelControl基于PixelDiT风格的主干网络构建，避免了潜在空间瓶颈，并引入了两项互补设计。首先，结构感知控制注入（Structure-Aware Control Injection）推导条件结构图，并利用它来增强空间敏感区域周围注入的控制残差。其次，多尺度金字塔循环损失（Multi-Scale Pyramid Cycle Loss）在多个分辨率下验证生成图像与条件派生结构的一致性，平衡全局布局一致性与局部边界和细节准确性。PixelControl通过具有轻量级门控融合的模态特定控制分支，支持深度、分割、边缘及其组合控制。在深度、分割和边缘控制任务上的实验表明，PixelControl在结构保真度和视觉质量方面优于现有可控生成方法，尤其在边界和中等/小尺寸条件区域上提升显著。项目页面见：https://linxin0.github.io/pixelcontrol_homepage/pixelcontrol-site/

Text-to-image models often struggle to synthesize correct occlusion relationships among multiple objects, especially in densely overlapping regions. Many training-free layout-guided methods enforce 2D spatial constraints but do not explicitly resolve depth-dependent attention competition, which can cause concept mixing and implausible occlusion. To address this problem, we propose DepthArb, a training-free framework that formulates occlusion generation as attention arbitration within a unified denoising trajectory. DepthArb employs two core occlusion-control mechanisms: Attention Arbitration Modulation suppresses background-object attention within foreground support according to relative depth, while Spatial Compactness Control limits attention dispersion to preserve object coherence. Because interference varies during generation, Occlusion Conflict Estimation constructs a shared spatial conflict field to adaptively weight both objectives. Through a unified spatial-text attention interface, DepthArb operates on U-Net cross-attention and the image-to-text component of MMDiT joint attention without model retraining. We further introduce OcclBench, a benchmark with continuous relative-depth specifications and occlusion-specific evaluation metrics. Experiments on OcclBench and public benchmarks show that DepthArb improves several layout and occlusion metrics over the evaluated baselines while maintaining competitive text-image alignment.

文本到图像模型在合成多个物体之间的正确遮挡关系时往往存在困难，尤其是在密集重叠区域。许多无需训练的布局引导方法虽然强制执行2D空间约束，但并未明确解决深度依赖的注意力竞争问题，这可能导致概念混合和不合理的遮挡。为了解决这一问题，我们提出了DepthArb，这是一个无需训练的框架，将遮挡生成表述为统一去噪轨迹中的注意力仲裁。DepthArb采用两种核心遮挡控制机制：注意力仲裁调制根据相对深度抑制前景支撑内的背景-物体注意力，而空间紧凑性控制则限制注意力分散以保持物体连贯性。由于干扰在生成过程中会发生变化，遮挡冲突估计构建了共享空间冲突场以自适应地加权这两个目标。通过统一的空间-文本注意力接口，DepthArb可应用于U-Net交叉注意力和MMDiT联合注意力的图像到文本组件，无需模型重训练。我们还引入了OcclBench，这是一个具有连续相对深度规格和遮挡特定评估指标的基准。OcclBench和公共基准上的实验表明，DepthArb在保持竞争力的文本-图像对齐性能的同时，在多个布局和遮挡指标上优于评估的基线方法。

Pixel-space generative models bypass lossy latent compression, yet necessitate joint learning of global structure and fine-grained details in a high-dimensional space. Standard flow matching interpolates noise toward a fixed clean-image endpoint, leaving the spectral evolution to be learned implicitly. In this paper, we introduce Energy-Guided Flow Matching(EG-FM) that explicitly models a coarse-to-fine generative trajectory by moving endpoint. Specifically, EG-FM replaces the fixed endpoint with a heat-kernel-filtered endpoint that evolves smoothly from low-frequency image to clean image. The fraction of high-frequency signal in moving endpoint is released by an image-specific energy-guided scheduling, leading to the re-targeting of velocity in flow matching. Our framework requires no adaptation of the backbone and training data, bringing negligible cost on the training and inference stages. In our experiment, EG-FM consistently achieves lower FID on the ImageNet class-conditional image generation task at $256 \times 256$ with fewer epochs, reaching an FID of 1.55 at 200 epochs and 1.45 at 600 epochs. We continue training the generation task on the setting of $512 \times 512$ resolution, yielding a FID of 1.58 after only 40 high-resolution adaptation epochs. Furthermore, we transfer EG-FM on text-to-image generation and achieve 0.85 on GenEval score and 83.9 on DPG-Bench. Code is available at https://github.com/ysng123/EG-FM.

像素空间生成模型绕过了有损的潜在空间压缩，但需要在高维空间中联合学习全局结构和细粒度细节。标准流匹配将噪声插值到固定的干净图像终点，频谱演变需要被隐式学习。本文提出能量引导的流匹配（EG-FM），通过移动终点来显式建模粗到细的生成轨迹。具体而言，EG-FM将固定终点替换为热核过滤终点，该终点从低频图像平滑演变为干净图像。移动终点中的高频信号比例通过图像特定的能量引导调度释放，从而重新定向流匹配中的速度。我们的框架无需对骨干网络和训练数据进行适配，在训练和推理阶段带来可忽略的计算成本。在我们的实验中，EG-FM在256×256分辨率的ImageNet类别条件图像生成任务上以更少的训练轮次持续获得更低的FID分数，在200轮时达到1.55，600轮时达到1.45。我们在512×512分辨率设置下继续训练生成任务，仅用40轮高分辨率适应就达到了1.58的FID。此外，我们将EG-FM迁移到文本到图像生成任务，在GenEval上达到0.85分，在DPG-Bench上达到83.9分。代码可从https://github.com/ysng123/EG-FM获取。

The Discrete Fourier Transform, the Discrete Cosine Transform, and their block-wise variants underpin most deployed image and video codecs. Their effectiveness rests on three properties: they run in near-linear time (linear up to a polylogarithmic factor), they are exactly invertible, and they carry few to no parameters. In this work, we generalize these bases to isometric multilinear bases, allowing a small number of extra parameters, polylogarithmic in the image size, while preserving all three properties. Given an image dataset, we develop a systematic framework that searches this family for the basis compressing the dataset most effectively: the basis is parameterized as an isometric tensor network, inspired by quantum many-body theory, and trained with Riemannian optimization on the manifold of unitary matrices. Across natural photographs and line drawings, the trained bases consistently improve on their fixed, non-parametric counterparts. On Quick Draw line-drawing compression, they store images in roughly $20\%$ fewer bytes than JPEG's $8 \times 8$ block cosine transform at the same reconstruction quality.

离散傅里叶变换、离散余弦变换及其分块变体构成了大多数已部署图像和视频编解码器的基础。它们的有效性基于三个特性：近线性时间复杂度（线性至多带一个多对数因子）、完全可逆性、以及极少或不含参数。在本工作中，我们将这些基推广到等距多线性基，允许引入少量参数（数量级为图像大小的多对数），同时保留上述三个特性。给定一个图像数据集，我们开发了一个系统性框架在该族基中搜索压缩效果最佳的基：受量子多体理论启发的等距张量网络参数化该基，并在酉矩阵流形上使用黎曼优化进行训练。在自然照片和线条画的实验中，经过训练的基函数始终优于其固定的无参数对应物。在Quick Draw线条画压缩任务中，在相同重建质量下，它们比JPEG的8×8分块余弦变换节省约20%的字节数。