
Deploying Vision Transformers on edge devices demands extreme compression without sacrificing accuracy. Encoder–decoder compression methods can cut model size dramatically, but they consistently leave LayerNorm parameters in full floating-point precision and ignore redundancy in the encoded representations themselves. We revisit both oversights. Our framework combines channel-wise LayerNorm quantization, designed to match LayerNorm’s per-channel affine structure, with magnitude-based pruning of encoded weights stabilized by gradient freezing during fine-tuning. On DeiT-S (Data-efficient Image Transformer-Small), channel-wise LayerNorm quantization alone drops top-1 accuracy by just 1.14% at 15.26× compression (5.51 MB, 8.88 GFLOPs). Adding pruning and knowledge distillation pushes compression to 16.2× (5.20 MB) with a 1.34% accuracy loss and 8.18 GFLOPs. Treating LayerNorm carefully and exploiting latent-space sparsity together push ViT compression noticeably past what current encoder–decoder methods achieve. Git link: Layernorm aware compression of vision transformers
Cross-component prediction (CCP) is a promising coding tool that provides bitrate reductions by exploiting inter-channel correlations between luma (Y) and chroma (UV) components for next-generation video coding (NGVC). In fact, CCP is utilized in the exploration test model for NGVC, namely Enhanced Compression Model (ECM), developed by the Joint Video Experts Team (JVET). However, existing CCP methods assume fixed chroma sample positions, and this assumption does not hold for diverse YUV 4:2:0 video sequences in which the chroma components are subsampled with a different phase relative to luma. We propose an adaptive CCP framework that estimates suitable chroma sample positions from the first frame of each sequences and signals them using existing indices to avoid additional signaling overhead. We introduce the proposed method into seven CCP variants in ECM by modifying downsampling filters, coordinates, and gradients. Experiments on ECM-18 show significant bitrate reductions with negligible complexity impact for diverse test sequences of JVET’s common test conditions and call for evidence, especially for gaming content with -2.84% (U) and -2.09% (V) reductions. The proposed method has been adopted in ECM-19 due to its favorable coding gains.
Preserving subtle spectral variations and temporal consistency is critical for reliable endoscopic video denoising. However, most existing methods process RGB channels independently and emphasize spatial noise suppression, often causing color distortion and temporal incoherence. In this paper, we propose STQFormer, a spatio-temporal denoising framework that models color channels as a unified vector entity and captures long-range temporal dependencies via quaternion-based representations. STQFormer integrates Spatio-Temporal Quaternion Transformer blocks with a frame-wise Swin encoder and is trained in an unsupervised manner without paired clean–noisy data. Experimental results on endoscopic video datasets demonstrate that STQ-Former achieves state-of-the-art denoising performance while preserving diagnostic color fidelity and temporal coherence.
Video anomaly detection (VAD) in nighttime traffic scenarios remains challenging due to low illumination, overexposure, motion blur, and reflection noise. To address these issues, we propose a Hybrid CNN–Swin Temporal Attention Network (HSTA) for unsupervised nighttime video anomaly detection based on future-frame prediction. HSTA integrates convolutional and transformer-based branches to jointly capture local texture details and global contextual dependencies. A Random Temporal Shift (RTS) module enhances temporal robustness, while a Temporal-Aware Channel Attention Block (TACAB) emphasizes motion-sensitive channels for refined spatial-temporal modeling. Experimental results on real nighttime traffic data demonstrate the effectiveness of HSTA, achieving AUC scores of 76.4%, which is 1.5% higher than the state-of-the-art method. Furthermore, additional evaluations on three daytime benchmarks indicate that HSTA exhibits promising generalization and robustness across different lighting conditions.
Recent advances in 3D Gaussian Splatting (3DGS) have demonstrated impressive performance in 3D reconstruction. However, artifacts such as spurious geometry and floaters remain annoying in practical 3DGS. While recent approaches increasingly leverage diffusion priors to improve visual fidelity, they often suffer from geometric hallucination due to their exclusive reliance on 2D image supervision. In this paper, we propose DepthFix3D, a geometry-aware diffusion framework designed for high-quality artifact removal in 3DGS renderings. The core of our approach introduces depth constraints in diffusion-based artifact removal, which consist of multi-source geometric cues extracted from both 3DGS and point cloud. The depth images from 3DGS and point cloud exhibit distinct artifacts-related patterns, providing complementary geometric cues that help the model locate artifact-prone regions. Moreover, we find that introducing point cloud representations provides complementary scene information, enabling more 3D-consistent and higher-quality content generation. Multi-source geometric cues are conditioned into the diffusion process via a ControlNet, and a progressive view synthesis mechanism is further utilized to enhance 3DGS quality. Experiments on diverse datasets demonstrate that DepthFix3D significantly outperforms existing baselines in both reconstruction fidelity (1.87 dB in RGB-averaged PSNR) and geometric consistency.