The Robinson Research Institute, based at Victoria University of Wellington in New Zealand, conducts applied research in electromagnetics, superconductivity, and energy systems. It develops technologies for medical devices, renewable energy, and advanced materials. The institute collaborates with NEC Laboratories America on scientific initiatives related to high-efficiency energy systems and advanced materials research. These collaborations promote global exchange in applied physics and engineering. The institute bridges academic research with industrial application.

Posts

THAT: Token-wise High-frequency Augmentation Transformer for Hyperspectral Pansharpening

/in /by

Transformer-based methods have demonstrated strong potential in hyperspectral pansharpening by modeling long-range dependencies. However, their effectiveness is often limited by redundant token representations and a lack of multiscale feature modeling. Hyperspectral images exhibit intrinsic spectral priors (e.g., abundance sparsity) and spatial priors(e.g., non-local similarity), which are critical for accurate reconstruction. From a spectral–spatial perspective, Vision Transformers (ViTs) face two major limitations: they struggle to preserve high-frequency components—such as material edges and texture transitions, and suffer from attention dispersion across redundant tokens. These issues stem from the global self-attention mechanism, which tends to dilute high-frequency signals and overlook localized details. To address these challenges, we propose the Token-wise High-frequency AugmentationTransformer (THAT), a novel framework designed to enhance hyperspectral pansharpening through improved high-frequency feature representation and token selection. Specifically, THAT introduces: (1) Pivotal Token Selective Attention (PTSA) to prioritize informative tokens and suppress redundancy; (2) a Multi-level Variance-aware Feed-forward Network (MVFN) to enhance high-frequency detail learning. Experiments on standard benchmarks show that THAT achieves state-of-the-art performance with improved reconstruction quality and efficiency.

Read more