Georgia State University is a leading urban research university focused on student success and real-world impact. It excels in public health, data analytics, and education research, especially in underserved communities. NEC Labs America collaborates with Georgia State University on NLP applications for education, automated assessment, and student-centered learning technologies. Please read about our latest news and collaborative publications with Georgia State University.

Posts

Uni-LoRA: One Vector is All You Need

/in /by

Low-Rank Adaptation (LoRA) has become the de facto parameter-efficient fine-tuning (PEFT) method for large language models (LLMs) by constraining weight updates to low-rank matrices. Recent works such as Tied-LoRA, VeRA, and VB-LoRA push efficiency further by introducing additional constraints to reduce the trainable parameter space. In this paper, we show that the parameter space reduction strategies employed by these LoRA variants can be formulated within a unified framework, Uni-LoRA, where the LoRA parameter space, flattened as a high-dimensional vector space R^D, can be reconstructed through a projection from a subspace R^d, with d ll D. We demonstrate that the fundamental difference among various LoRA methods lies in the choice of the projection matrix, P in R^(Unknown sysvar: (D times d)).Most existing LoRA variants rely on layer-wise or structure-specific projections that limit cross-layer parameter sharing, thereby compromising parameter efficiency. In light of this, we introduce an efficient and theoretically grounded projection matrix that is isometric, enabling global parameter sharing and reducing computation overhead. Furthermore, under the unified view of Uni-LoRA, this design requires only a single trainable vector to reconstruct LoRA parameters for the entire LLM – making Uni-LoRA both a unified framework and a “one-vector-only” solution. Extensive experiments on GLUE, mathematical reasoning, and instruction tuning benchmarks demonstrate that Uni-LoRA achieves state-of-the-art parameter efficiency while outperforming or matching prior approaches in predictive performance.

Read more

NeurIPS 2025 in San Diego from November 30th to December 5th, 2025

/in /by

NEC Laboratories America is heading to San Diego for NeurIPS 2025, where our researchers will present cutting-edge work spanning optimization, AI systems, language modeling, and trustworthy machine learning. multi-agent coordination, scalable training, efficient inference, and techniques for detecting LLM-generated text.

Read more

VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks

/in /by

As the adoption of large language models increases and the need for per-user or per-task model customization grows, the parameter-efficient fine-tuning (PEFT) methods, such as low-rank adaptation (LoRA) and its variants, incur substantial storage and transmission costs. To further reduce stored parameters, we introduce a “divide-and-share” paradigm that breaks the barriers of low-rank decomposition across matrix dimensions, modules, and layers by sharing parameters globally via a vector bank. As an instantiation of the paradigm to LoRA, our proposed VB-LoRA composites all the low-rank matrices of LoRA from a shared vector bank with a differentiable top-k admixture module. VB-LoRA achieves extreme parameter efficiency while maintaining comparable or better performance compared to state-of-the-art PEFT methods. Extensive experiments demonstrate the effectiveness of VB-LoRA on natural language understanding, natural language generation, instruction tuning, and mathematical reasoning tasks. When fine-tuning the Llama2-13B model, VB-LoRA only uses 0.4% of LoRA’s stored parameters, yet achieves superior results. Our source code is available at https://github.com/leo-yangli/VB-LoRA. This method has been merged into the Hugging Face PEFT package.

Read more

Improvement of Resilience of Submarine Networks Based on Fiber Sensing

/in /by

Simultaneous phase and polarization sensing with span length resolution using the supervisory path is demonstrated. It is shown that by measuring polarization rotation matrix of the return paths, instead of monitoring only the state of polarization, location of the polarization disturbance can be determined even for large polarization rotations. By using the polarization rotation matrices, the phase and polarization disturbances are successfully decoupled. How the existing supervisory system and sensing can coexist in new SDM cables that utilizes pump sharing is discussed.

Read more

Polarization Sensing Using Polarization Rotation Matrix Eigenvalue Method

/in /by

Polarization-based, multi-span sensing over a link with reflection-back circuits is demonstrated experimentally. By measuring rotation matrices instead of just monitoring polarization, a 35 dB extinction in localization is achieved regardless of the disturbance magnitude.

Read more