Spatial Temporal describes data or processes that evolve across both space and time. NEC Labs America studies spatial-temporal modeling in distributed sensing, smart cities, and biomedical AI. Techniques such as graph neural networks and temporal fusion models enable researchers to analyze evolving signals, whether in urban traffic, energy grids, or disease progression. This work enhances predictive accuracy, making AI systems more effective in dynamic real-world contexts.

Posts

Group Relative Augmentation for Data Efficient Action Detection

/in /by

Adapting large Video-Language Models (VLMs) for action detection using only a few examples poses challenges like overfitting and the granularity mismatch between scene-level pre-training and required person-centric understanding. We propose an efficient adaptation strategy combining parameter-efficient tuning (LoRA) with a novel learnable internal feature augmentation. Applied within the frozen VLM backbone using FiLM, these augmentations generate diverse feature variations directly relevant to the task. Additionally, we introduce a group-weighted loss function that dynamically modulates the training contribution of each augmented sample based on its prediction divergence relative to the group average. This promotes robust learning by prioritizing informative yet reasonable augmentations. We demonstrate our method’s effectiveness on complex multi-label, multi-person action detection datasets (AVA, MOMA), achieving strong mAP performance and showcasing significant data efficiency for adapting VLMs from limited examples.

Read more