NEC Laboratories America

Tag Archive for: new york university

You are here: / / new york university

New York University (NYU) is a major private research university with global campuses and strengths in computer science, medicine, and public policy. It fosters boundary-pushing research in a vibrant urban setting. We have worked with New York University on deep learning and multimodal AI research. Our joint efforts include developing generative adversarial networks and robust pretraining techniques to improve performance on complex visual and language tasks. Please read about our latest news and collaborative publications with New York University.

Posts

Bayesian Data Reweighting Improves Multimodal Retrieval for Knowledge-Based Visual Question Answering

/in /by

Multimodal retrievers are essential for knowledge-based visual question answering, where they retrieve external evidence for image-question pairs. However, existing contrastive training methods typically treat all unmatched query-document pairs as equally informative negatives, which is problematic because many unmatched documents may still be semantically relevant or partially useful. We propose Bayesian Data Reweighting, a probabilistic framework that models query-document importance as latent variables and adaptively infers posterior weights to downweight likely false negatives. With closed-form posterior updates under conjugate priors and stochastic EM optimization, our method consistently improves retrieval accuracy across three retrievers and seven knowledge-based VQA benchmarks.

Read more

Integration of Fiber Optic Sensing and Sparse Grid Sensors for Accurate Fault Localization in Distribution Systems

/in /by

Fault localization in power distribution networks is essential for rapid recovery and enhancing system resilience. While Phasor Measurement Units (PMUs or ?PMUs) providehigh-resolution measurements for precise fault localization, their widespread deployment is cost-prohibitive. Distributed Fiber Optic Sensing (DFOS) offers a promising alternative for event detection along power lines using collocated optical fiber; however, it cannot independently differentiate between events and pinpoint exact fault locations. This paper introduces an innovative framework that combines DFOS with sparsely deployed PMUs for accurate fault localization. The proposed approach first utilizes a Graph Attention Network (GAT) model to capture spatial and temporal correlations from synchronized PMU and DFOS measurements, effectively identifying fault zones. High-spatial- resolution DFOS measurements further refine the fault locationwithin the identified zone. Singular Value Decomposition (SVD) is applied to extract feature vectors from DFOS measurements, enhancing the convergence speed of the GAT model. Thisintegrated solution significantly improves localization accuracy while minimizing reliance on extensive deployment of PMUs.

Read more

National Intern Day at NEC Laboratories America: Celebrating the Next Generation of Innovators

/in /by

On National Intern Day, NEC Laboratories America celebrates the bright minds shaping tomorrow’s technology. Each summer, interns from top universities work side-by-side with our researchers on real-world challenges in AI, cybersecurity, data science, and more. From groundbreaking research to team-building events, our interns contribute fresh ideas and bold thinking that power NEC’s innovation engine.

Read more

Resilient DFOS Placement Strategy for Power Grid Monitoring: Integrating Fiber and Power Network Dependencies

/in /by

We propose a novel Distributed Fiber Optic Sensing (DFOS) placement strategy tailored to the evolving needs of modern power grids, where fiber cables serve dual purposes: communication and real-time sensing. Our approach integrates a heuristic algorithm, PURE (Power Source-aware Route Exploration), with Integer Linear Programming (ILP) to optimize DFOS placement while addressing power supply constraints. The strategy ensures resilient monitoring across diverse grid scenarios by prioritizing observability during outages and leveraging advancements in fiber infrastructure deployment. Case studies demonstrate the effectiveness of our methodology in maintaining power grid resilience while minimizing deployment costs.

Read more

Summer Interns 2024

/in /by

Learn about the amazing group of interns who joined us at Princeton and San Jose campuses this summer. Their hard work, fresh perspectives, and dedication have truly made an impact across the board, from cutting-edge research projects to innovative software development initiatives.

Read more

StreetAware: A High-Resolution Synchronized Multimodal Urban Scene Dataset

/in /by

Access to high-quality data is an important barrier in the digital analysis of urban settings, including applications within computer vision and urban design. Diverse forms of data collected from sensors in areas of high activity in the urban environment, particularly at street intersections, are valuable resources for researchers interpreting the dynamics between vehicles, pedestrians, and the built environment. In this paper, we present a high-resolution audio, video, and LiDAR dataset of three urban intersections in Brooklyn, New York, totaling almost 8 unique hours. The data were collected with custom Reconfigurable Environmental Intelligence Platform (REIP) sensors that were designed with the ability to accurately synchronize multiple video and audio inputs. The resulting data are novel in that they are inclusively multimodal, multi-angular, high-resolution, and synchronized. We demonstrate four ways the data could be utilized — (1) to discover and locate occluded objects using multiple sensors and modalities, (2) to associate audio events with their respective visual representations using both video and audio modes, (3) to track the amount of each type of object in a scene over time, and (4) to measure pedestrian speed using multiple synchronized camera views. In addition to these use cases, our data are available for other researchers to carry out analyses related to applying machine learning to understanding the urban environment (in which existing datasets may be inadequate), such as pedestrian-vehicle interaction modeling and pedestrian attribute recognition. Such analyses can help inform decisions made in the context of urban sensing and smart cities, including accessibility-aware urban design and Vision Zero initiatives.

Read more

Opportunistic Temporal Fair Mode Selection and User Scheduling in Full-Duplex Systems

/in /by

In-band full-duplex (FD) communication has emerged as one of the promising techniques to improve data rates in next generation wireless systems. Typical FD scenarios considered in the literature assume FD base stations (BSs) and half-duplex (HD) users activated either in uplink (UL) or downlink (DL), where inter-user interference (IUI) is treated as noise at the DL user. This paper considers more general FD scenarios where an arbitrary fraction of the users are capable of FD and/or they can perform successive interference cancellation (SIC) to mitigate IUI. Consequently, one user can be activated in either UL or DL (HD-UL and HD-DL modes), or simultaneously in both directions requiring self-interference mitigation (SIM) at that user (FD-SIM mode). Furthermore, two users can be scheduled, one in UL and the other in DL (both operating in HD), where the DL user can treat IUI as noise (FD-IN mode) or perform SIC to mitigate IUI (FD-SIC mode). This paper studies opportunistic mode selection and user scheduling under long-term and short-term temporal fairness in single-carrier and multi-carrier (OFDM) FD systems, with the goal of maximizing system utility (e.g. sum-rate). First, the feasible region of temporal demands is characterized for both long-term and short-term fairness. Subsequently, optimal temporal fair schedulers as well as practical low-complexity online algorithms are devised. Simulation results demonstrate that using SIC to mitigate IUI as well as having FD capability at users can improve FD throughput gains significantly especially, when user distribution is concentrated around a few hotspots.

Read more

Beam Training Optimization in Millimeter-wave Systems under Beamwidth, Modulation and Coding Constraints

/in /by

Millimeter-wave (mmWave) bands have the potential to enable significantly high data rates in wireless systems. In order to overcome intense path loss and severe shadowing in these bands, it is essential to employ directional beams for data transmission. Furthermore, it is known that the mmWave channel incorporates a few number of spatial clusters necessitating additional time to align the corresponding beams with the channel prior to data transmission. This procedure is known as beam training (BT). While a longer BT leads to more directional beams (equivalently higher beamforming gains), there is less time for data communication. In this paper, this trade-off is investigated for a time slotted system under practical constraints such as finite beamwidth resolution and discrete modulation and coding schemes. At each BT time slot, the access point (AP) scans a region of uncertainty by transmitting a probing packet and refines angle of arrival (AoA) estimate based on user equipment (UE) feedback. Given a total number time slots, the objective is to find the optimum allocation between BT and data transmission and a feasible beamwidth for the estimation of AoA at each BT time slot such that the expected throughput is maximized. It is shown that the problem satisfies the optimal substructure property enabling the use of a backward dynamic programming approach to find the optimal solution with polynomial computational complexity. Simulation results reveal that in practical scenarios, the proposed approach outperforms existing techniques such as exhaustive and bisection search.

Read more