Uncertainty-Aware Knowledge Distillation for Multimodal Large Language Models

/in /by

Knowledge distillation establishes a learning paradigm that leverages both data supervision and teacher guidance. However, determining the optimal balance between learning from data and learning from the teacher is challenging, as some samples may be noisy while others are subject to teacher uncertainty. This motivates the need for adaptively balancing data and teacher supervision. We propose Beta-weighted Knowledge Distillation (Beta-KD), an uncertainty-aware distillation framework that adaptively modulates how much the student relies on teacher guidance. Specifically, we formulate teacher–student learning from a unified Bayesian perspective and interpret teacher supervision as a Gibbs prior over student activations. This yields a closed-form, uncertainty-aware weighting mechanism and supports arbitrary distillation objectives and their combinations. Extensive experiments on multimodal VQA benchmarks demonstrate that distilling student Vision-Language Models from a large teacher VLM consistently improves performance. The results show that Beta-KD outperforms existing knowledge distillation methods.

Read more

HorizonWeaver: Generalizable Multi-Level Semantic Editing for Driving Scenes

/in /by

Ensuring safety in autonomous driving requires scalable generation of realistic, controllable driving scenes beyond what real-world testing provides. Yet existing instruction guided image editors, trained on object-centric or artistic data, struggle with dense, safety-critical driving layouts. We propose HorizonWeaver, which tackles three fundamental challenges in driving scene editing: (1) multi-level granularity, requiring coherent object- and scene-level edits in dense environments; (2) rich high-level semantics, preserving diverse objects while following detailed instructions; and (3) ubiquitous domain shifts, handling changes in climate, layout, and traffic across unseen environments. The core of HorizonWeaver is a set of complementary contributions across data, model, and training: (1) Data: Large-scale dataset generation, where we build a paired real/synthetic dataset from Boreas, nuScenes, and Argoverse2 to improve generalization; (2) Model: Language-Guided Masks for fine-grained editing, where semantics-enriched masks and prompts enable precise, language-guided edits; and (3) Training: Content preservation and instruction alignment, where joint losses enforce scene consistency and instruction fidelity. Together, HorizonWeaver provides a scalable framework for photorealistic, instruction-driven editing of complex driving scenes, collecting 255K images across 13 editing categories and outperforming prior methods in L1, CLIP, and DINO metrics, achieving +46.4% user preference and improving BEV segmentation IoU by +33%. Project page: https://msoroco.github.io/horizonweaver/

Read more

Leveraging Deployed Telecom Cables for Distributed Fiber Sensing Topologies and Applications

/in /by

Distributed fiber optic sensing (DFOS) has emerged as a promising technology for wide-area monitoring by utilizing existing telecom cables as large-scale sensing media. This paper explores three sensing modalities, backscattering-based sensing, forward-transmission-based sensing, and hybrid sensing, and discusses their respective benefits, challenges, and application domains. Backscattering sensing demonstrates strong potential for applications such as road traffic monitoring, pavement condition assessment, intrusion detection, and cabledamage prevention but is constrained in amplified dense wavelength division multiplexing (DWDM) networks. Forward-transmission sensing enables sensing over operational telecom links with in-line amplification, extending sensing reach, although it involves trade-offs in spatial resolution and localization accuracy. To address these challenges, a hybrid sensing architecture that integrates backscattering and forward-transmission techniques is introduced, achieving enhanced sensing distance while maintaining high sensitivity and localization performance.In addition, this work incorporates artificial intelligence (AI) through a locally adaptive anomaly detection (LAAD) framework based on self-supervised representation learning. By leveraging location-based pretext tasks and unlabeled data, the proposed AI approach enables efficient adaptation across heterogeneous fiber routes and operational environments, significantly reducing reliance on labeled data while improving cross-domain generalization. Field trials over deployed telecom networks validate the feasibility and effectiveness of the proposedsensing and AI framework, demonstrating scalable, telecom-compatible DFOS for real-world infrastructure monitoring and intelligent network operations.

Read more

Multi-Agent Procedural Graph Extraction with Structural and Logical Refinement

/in /by

Automatically extracting workflows as procedural graphs from natural language is promising yet underexplored, demanding both structural validity and logical alignment. While recent large language models (LLMs) show potential for procedural graph extraction, they often produce ill-formed structures or misinterpret logical flows. We present text2flow, a multi-agent framework that formulates procedural graph extraction as a multi-round reasoning process with dedicated structural and logical refinement. The framework iterates through three stages: (1) a graph extraction phase with the graph builder agent, (2) a structural feedback phase in which a simulation agent diagnoses and explains structural defects, and (3) a logical feedback phase in which a semantic agent aligns semantics between flow logic and linguistic cues in the source text. Important feedback is prioritized and expressed in naturallanguage, which is injected into subsequent prompts, enabling interpretable and controllable refinement. This modular design allows agents to target distinct error types without supervision or parameter updates. Experiments demonstrate that text2flow achieves substantial improvements in both structural correctness and logical consistency over strong baselines.

Read more

DeepSieve: Information Sieving via LLM-as-a-Knowledge-Router

/in /by

Large Language Models (LLMs) excel at many reasoning tasks but struggle with knowledge-intensive queries due to their inability to dynamically access up-to-date or domain-specific information. Retrieval-Augmented Generation (RAG) has emerged as a promising solution, enabling LLMs to ground their responses in external sources. However, existing RAG methods lack fine-grained control over both the query and source sides, resulting in noisy retrieval, shallow reasoning, and limited adaptability to heterogeneous knowledge sources. In this work, we introduce DeepSieve, a novel RAG method that incorporates information sieving via LLM-as-a-knowledge-router. DeepSieve breaks down complex queries into structured sub-queries and recursively routes each to the most appropriate knowledge source, filtering out irrelevant information through a multi-stage information sieving process. This modular and transparent approach ensures that DeepSieve remains adaptable across diverse information needs. Experiments on three multi-hop QA benchmarks involving heterogeneous sources show that DeepSieve achieves greater reasoning depth, retrieval precision, and interpretability compared to conventional RAG approaches. Our codes are available at https://github.com/MinghoKwok/DeepSieve.

Read more

Decoding Time Series with LLMs: A Multi-Agent Framework for Cross-Domain Annotation

/in /by

Time series data is ubiquitous across various domains, including manufacturing, finance, and healthcare. High-quality annotations are essential for effectively understanding time series and facilitating downstream tasks. However, obtaining such annotations is challenging, particularly in mission-critical domains. In this paper, we propose TESSA, a multi-agent system designed to automatically generate both general and domain-specific annotations for time series data. TESSA introduces two agents: a general annotation agent and a domain-specific annotation agent. The general agent captures common patterns and knowledge across multiple source domains, leveraging both time-series-wise and text-wise features to generate general annotations. Meanwhile, the domain-specific agent utilizes limited annotations from the target domain to learn domain-specific terminology and generate targeted annotations. Extensive experiments on multiple synthetic and real-world datasets demonstrate that TESSA effectively generates high-quality annotations, outperforming existing methods.

Read more

Interpretability and Implicit Model Semantics in Biomedicine and Deep Learning

/in /by

We introduce a framework to analyse interpretability in deep learning, by drawing on a formal notion of model semantics from the philosophy of science. We argue that interpretability is only one aspect of a model’s semantics and illustrate our framework with examples from biomedicine.

Read more

Mobile Orbital Domain-based Hierarchical Routing in Satellite Networks

/in /by

We propose a mobile orbital domain-based hierarchical routing scheme which addresses the challenges posed by constant satellite movement and the resulting dynamicnetwork topology, thus significantly improving the routing scalability and efficiency in satellite networks.

Read more

Frequency-Division Multiplexed Time-Interleaved Phase-OTDR with Nested Phase References

/in /by

We propose a method to compensate the phase offset between samples from different tributaries in time-interleaved phase OTDR using nested phase reference channels. We demonstrate our method for a four-span bidirectional link with high-loss loopback.

Read more

Field study on phase and polarization dynamics of deployed anti-resonant hollow core fiber cable for vibration sensing

/in /by

We report the first field study of the phase and polarization dynamics of deployed antiresonant hollow core fiber cable in a data center interconnect for real-world vibration sensing,revealing enhanced phase sensitivity and significantly faster polarization angular rate compared with standard single mode fibers.

Read more