Entries by NEC Labs America

Agentic LLMs for AI Orchestration Project: Revolutionizing Complex Workflows

/in /by

The development of Agentic LLMs for AI Orchestration represents a significant advancement in artificial intelligence. By seamlessly integrating computer vision, logic, and compute modules, our LLM is poised to revolutionize the way complex workflows are managed and executed. Supported by robust research and driven by innovative training methodologies, our agentic LLM sets a new standard in AI orchestration, offering unparalleled performance and adaptability.

First Field Trial of Hybrid Fiber Sensing with Data Transmission Resulting in Enhanced Sensing Sensitivity and Spatial Resolution

/in /by

Optical fiber cables, initially designed for telecommunications, are increasingly repurposed for environmental monitoring using distributed fiber sensing technologies [1,2]. Distributed acoustic sensing (DAS) based on phase optical time domain reflectometry (?-OTDR) of Rayleigh backscatter enables various applications including traffic monitoring [3], railway [4] and perimeter intrusion detection [5] and cable damage detection [6], etc. The sensing range of DAS is typically limited to several tens of kilometers due to low optical signal-to-noise (OSNR) of the received backscatter. Additionally, compatibility of DAS with existing fiber infrastructure is hindered by the unidirectional operation of inline amplifiers with isolators. An alternative approach based on forward transmission was recently proposed [7, 8], which involves probing an optical fiber with a continuous wave (CW) signal and measuring either changes in received phase or the state of polarization (SOP) to detect cumulative vibration-induced strain. Unlike backscatter measurement, forward transmissions methods have longer sensing range due to higher OSNR, and is compatible with existing telecom infrastructure. However, potential challenges include limited localization accuracy, and low number of simultaneous events that can be discriminated and localized [7]. In this paper, we propose a new concept of “hybrid fiber sensing” for long-haul DWDM networks where the repeater node architecture combines DAS with forward-phase sensing (FPS), enhancing sensitivity by 32%. This approach achieves a multi-span, fine-resolution fiber sensing system. The FPS method detects vibration anomalies and coarsely localizes its position to within a fiber span. A segmented DAS then refines the position estimate and provides a precise waveform measurement. Consequently, the special resolution improves from one fiber span of 80 km to 4 m. Our scheme is validated on a test bed comprising lab spools and field fibers, demonstrating the capability to detect and monitor field construction while simultaneously supporting full C-band 400-Gb/s real-time (RT) data transmission.

zeta-QVAE: A Quantum Variational Autoencoder utilizing Regularized Mixed-state Latent Representations

/in /by

A major challenge in near-term quantum computing is its application to large real-world datasets due to scarce quantum hardware resources. One approach to enabling tractable quantum models for such datasets involves compressing the original data to manageable dimensions while still representing essential information for downstream analysis. In classical machine learning, variational autoencoders (VAEs) facilitate efficient data compression, representation learning for subsequent tasks, and novel data generation. However, no model has been proposed that exactly captures all of these features for direct application to quantum data on quantum computers. Some existing quantum models for data compression lack regularization of latent representations, thus preventing direct use for generation and control of generalization. Others are hybrid models with only some internal quantum components, impeding direct training on quantum data. To bridge this gap, we present a fully quantum framework, ?-QVAE, which encompasses all the capabilities of classical VAEs and can be directly applied for both classical and quantum data compression. Our model utilizes regularized mixed states to attain optimal latent representations. It accommodates various divergences for reconstruction and regularization. Furthermore, by accommodating mixed states at every stage, it can utilize the full-data density matrix and allow for a “global” training objective. Doing so, in turn, makes efficient optimization possible and has potential implications for private and federated learning. In addition to exploring the theoretical properties of ?-QVAE, we demonstrate its performance on representative genomics and synthetic data. Our results consistently indicate that ?-QVAE exhibits similar or better performance compared to matched classical models.

DFA-RAG: Conversational Semantic Router for Large Language Model with Definite Finite Automaton

/in /by

This paper introduces the retrieval-augmented large language model with Definite Finite Automaton (DFA-RAG), a novel framework designed to enhance the capabilities of conversational agents using large language models (LLMs). Traditional LLMs face challenges in generating regulated and compliant responses in special scenarios with predetermined response guidelines, like emotional support and customer service. Our framework addresses these challenges by embedding a Definite Finite Automaton (DFA), learned from training dialogues, within the LLM. This structured approach acts as a semantic router which enables the LLM to adhere to a deterministic response pathway. The routing is achieved by the retrieval-augmentation generation (RAG) strategy, which carefully selects dialogue examples aligned with the current conversational context. The advantages of DFA-RAG include an interpretable structure through human-readable DFA, context-aware retrieval for responses in conversations, and plug-and-play compatibility with existing LLMs. Extensive benchmarks validate DFA-RAG’s effectiveness, indicating its potential as a valuable contribution to the conversational agent.

Low-Latency Passive Thermal Stabilization of a Silicon Micro-Ring Resonator with Self-Heating

/in /by

Analog photonic information processing can be implemented with low chip area using wavelength-division multiplexed systems, which typically manipulate light using micro-ring resonators. Micro-rings are uniquely susceptible to thermal crosstalk, with negative system performance consequences if not addressed. Existing thermal sensitivity mitigation methods face drawbacks including high complexity, high latency, high digital and analog hardware requirements, and CMOS incompatibility. Here, we demonstrate a passive thermal desensitization mechanism for silicon micro-ring resonators exploiting self-heating resulting from optical absorption. We achieve a 49% reduction in thermal crosstalk sensitivity and 1 ?s adaptation latency using a system with no specialized micro-ring engineering, no additional control hardware, and no additional calibration. Our theoretical model indicates the potential for significant further desensitization gains with optimized microring designs. Self-heating desensitization can be combined with active thermal stabilization to achieve both responsiveness and accuracy or applied independently to thermally desensitize large photonic systems for signal processing or neural network inference.

RIO-CPD: A Riemannian Geometric Method for Correlation-aware Online Change Point Detection

/in /by

The objective of change point detection is to identify abrupt changes at potentially multiple points within a data sequence. This task is particularly challenging in the online setting where various types of changes can occur, including shifts in both the marginal and joint distributions of the data. This paper tackles these challenges by sequentially tracking correlation matrices on their Riemannian geometry, where the geodesic distances accurately capture the development of correlations. We propose Rio-CPD, a non-parametric correlation-aware online change point detection framework that combines the Riemannian geometry of the manifold of symmetric positive definite matrices and the cumulative sum statistic (CUSUM) for detecting change points. Rio-CPD enhances CUSUM by computing the geodesic distance from present observations to the Frechet mean of previous observations. With careful choice of metrics equipped to the Riemannian geometry, Rio-CPD is simple and computationally efficient. Experimental results on both synthetic and real-world datasets demonstrate that Rio-CPD outperforms existing methods in detection accuracy and efficiency.

Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviews

/in /by

We present an approach for estimating the fraction of text in a large corpus which is likely to be substantially modified or produced by a large language model (LLM). Our maximum likelihood model leverages expert-written and AI-generated reference texts to accurately and efficiently examine real-world LLM-use at the corpus level. We apply this approach to a case study of scientific peer review in AI conferences that took place after the release of ChatGPT: ICLR 2024, NeurIPS 2023, CoRL 2023 and EMNLP 2023. Our results suggest that between 6.5% and 16.9% of text submitted as peer reviews to these conferences could have been substantially modified by LLMs, i.e. beyond spell-checking or minor writing updates. The circumstances in which generated text occurs offer insight into user behavior: the estimated fraction of LLM-generated text is higher in reviews which report lower confidence, were submitted close to the deadline, and from reviewers who are less likely to respond to author rebuttals. We also observe corpus-level trends in generated text which may be too subtle to detect at the individual level, and discuss the implications of such trends on peer review. We call for future interdisciplinary work to examine how LLM use is changing our information and knowledge practices.

Multi-terminal Germanium Photodetector in a Commercial Silicon Photonics Platform

/in /by

We report responsivity measurements of a multiterminal photodetection device in a commercial silicon photonics platform. The ratio of measured responsivities is found to track the relative terminal lengths. This can serve as a highly compact optoelectronic tap/diplexer. More importantly, complex biasing conditions of similar devices are promising for onchip reprogrammable opto-electronic responses in conventional silicon photonic platforms, with applications in reprogrammable photonics and neuromorphic photonics.

GNPy Experimental Validation in a C+L Multiband Optical Multiplex Section

/in /by

The GNPy quality-of-transmission estimator has undergone improvements and rigorous experimental validation in a C+L multiband transmission scenario. This includes the incorporation of a disaggregated generalized Gaussian noise model, along with advanced modeling of amplifiers and transceivers. The recently proposed implementation demonstrates notable enhancements, offering highly accurate GSNR predictions on commercial C+L-band equipment while significantly reducing computation time.